-- Logs begin at Sat 2022-08-27 02:24:04 UTC, end at Sat 2022-08-27 04:50:58 UTC. -- Aug 27 02:56:45.240753 n-d-852086-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 02:56:45.248286 n-d-852086-5 devstack@n-api.service[106545]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:56:45 2022] *** Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: nodename: n-d-852086-5 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: machine: x86_64 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: clock source: unix Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: pcre jit disabled Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: detected number of CPU cores: 4 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: current working directory: / Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: your processes number limit is 47680 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: your memory page size is 4096 bytes Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: detected max file descriptor number: 2048 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: lock engine: pthread robust mutexes Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: thunder lock: enabled Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 02:56:45.252488 n-d-852086-5 devstack@n-api.service[106545]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:56:45.291907 n-d-852086-5 devstack@n-api.service[106545]: Python main interpreter initialized at 0x56457ea3a9c0 Aug 27 02:56:45.291907 n-d-852086-5 devstack@n-api.service[106545]: python threads support enabled Aug 27 02:56:45.291907 n-d-852086-5 devstack@n-api.service[106545]: your server socket listen backlog is limited to 100 connections Aug 27 02:56:45.291907 n-d-852086-5 devstack@n-api.service[106545]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:56:45.292270 n-d-852086-5 devstack@n-api.service[106545]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:56:45.292347 n-d-852086-5 devstack@n-api.service[106545]: *** Operational MODE: preforking *** Aug 27 02:56:45.292577 n-d-852086-5 devstack@n-api.service[106545]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:56:45.292577 n-d-852086-5 devstack@n-api.service[106545]: spawned uWSGI master process (pid: 106545) Aug 27 02:56:45.292779 n-d-852086-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 02:56:45.293903 n-d-852086-5 devstack@n-api.service[106545]: spawned uWSGI worker 1 (pid: 106546, cores: 1) Aug 27 02:56:45.293903 n-d-852086-5 devstack@n-api.service[106545]: spawned uWSGI worker 2 (pid: 106547, cores: 1) Aug 27 02:56:45.293903 n-d-852086-5 devstack@n-api.service[106545]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:56:45.957824 n-d-852086-5 devstack@n-api.service[106547]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:56:45.967279 n-d-852086-5 devstack@n-api.service[106546]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:56:47.063985 n-d-852086-5 devstack@n-api.service[106546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:56:47.063985 n-d-852086-5 devstack@n-api.service[106546]: from cryptography.utils import int_from_bytes Aug 27 02:56:47.064668 n-d-852086-5 devstack@n-api.service[106547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:56:47.064668 n-d-852086-5 devstack@n-api.service[106547]: from cryptography.utils import int_from_bytes Aug 27 02:56:47.065047 n-d-852086-5 devstack@n-api.service[106546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:56:47.065047 n-d-852086-5 devstack@n-api.service[106546]: from cryptography.utils import int_from_bytes Aug 27 02:56:47.065160 n-d-852086-5 devstack@n-api.service[106547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:56:47.065160 n-d-852086-5 devstack@n-api.service[106547]: from cryptography.utils import int_from_bytes Aug 27 02:56:49.589836 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:56:49.590526 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:56:49.590627 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:56:49.590979 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:56:49.591239 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:56:49.591588 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:56:49.591935 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.592015 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:56:49.592090 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.592255 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.592375 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:56:49.592582 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.592755 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:56:49.592914 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.593014 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:56:49.593227 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.593382 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.593549 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.593713 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.593871 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.594038 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.594222 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.594387 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.594474 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.594724 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.594822 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.595038 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.595125 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852086-5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.595362 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.595449 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.595686 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.595786 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.596004 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.596095 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.596266 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.596362 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.596583 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.596686 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.596909 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852086-5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.597008 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.597213 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.597298 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.597538 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.597712 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.597867 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.598180 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.598282 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.598498 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.598607 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.598812 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.598909 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.599118 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.599214 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.599450 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.599626 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.599758 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.599941 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.600078 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.600289 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.600413 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.600606 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.600819 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.601055 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.601157 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.601375 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.601516 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852086-5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.601690 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.601830 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.602014 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.602142 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.602366 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.602512 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.602697 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.602882 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.603055 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.603206 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.603396 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852086-5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.603522 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.603738 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.603875 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.604034 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.604152 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.604352 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.604449 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.604719 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.604819 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.605042 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.605132 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.605362 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.605479 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.605683 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.605768 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.605986 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.606070 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.606319 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.606410 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.606630 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.606715 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.606952 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.607051 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.607262 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.607435 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.607565 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.607652 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.607815 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.607922 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.608121 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.608207 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.608442 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.608533 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.608762 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.608859 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609081 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609170 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609339 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609441 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609592 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609697 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609911 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.609999 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.610255 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.610344 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.610567 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.610665 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.610880 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.610965 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.611135 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.611227 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.611390 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.611482 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.611713 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.611798 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.612039 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.612133 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.612357 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.612441 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.612663 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.612748 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.612973 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.613081 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.613284 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.613376 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.613595 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.613706 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.613901 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.613996 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.614228 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.614318 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.614539 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.614624 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.614862 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.614950 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.615170 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.615255 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.615495 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.615579 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.616335 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.616426 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.616657 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.616858 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.616994 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.617268 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.617459 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.617596 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.617773 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.617933 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.618083 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.618288 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.618436 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.618589 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.618718 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.618805 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.619111 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.619438 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.619530 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.619751 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.619836 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.620064 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.620148 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.620369 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.620454 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.620679 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.620771 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621002 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621088 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621315 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621408 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621568 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621653 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621874 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.621968 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.622203 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.622306 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.622532 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.622619 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.622850 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.622943 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.623156 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.623243 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.623463 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.623546 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.623766 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.623859 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.624068 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.624151 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.624374 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.624459 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.624679 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.624778 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.624984 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.625069 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.625291 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.625375 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.625597 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.625691 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.625903 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.625986 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.626230 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.626331 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.626538 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.626624 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.626842 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.626928 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.627161 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.627246 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.627468 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.627561 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.627776 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.627861 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.628095 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.628178 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.628399 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.628493 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.628704 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.628796 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.629014 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.629097 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.629318 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.629409 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.629624 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.629710 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.629931 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.630015 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.630254 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.630360 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.630563 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.630657 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.630871 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.630955 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.631181 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.631266 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.632089 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.632192 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.632412 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.632625 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.632742 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.632946 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.633098 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.633271 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.633410 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.633585 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.633715 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.633896 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.634020 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.634232 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.634348 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.634545 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.634671 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.634853 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.634993 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.635162 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.635304 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.635468 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.635613 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.635775 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.635933 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.636079 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.636237 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.636399 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.636574 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.636721 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.636907 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.637031 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.637251 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.637345 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.637569 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.637654 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.637903 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.637989 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:56:49.638268 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.638359 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.638591 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.638675 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.638906 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.638990 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.639220 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.639313 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.639549 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.639635 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.639862 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.639953 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.640174 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.640260 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.640485 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.640569 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.640803 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.640896 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.641127 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.641212 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.641441 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.641531 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.641758 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.641850 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.642072 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.642191 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.642420 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.642536 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.642731 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.642842 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.643054 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.643152 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.643372 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.643460 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.643690 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.643783 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.644002 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.644100 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.644316 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.644401 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.644640 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.644734 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.644971 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.645063 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.645295 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.645384 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.645610 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.645704 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.645921 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.646006 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.646262 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.646353 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.646575 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.646662 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.646898 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.646985 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.647293 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.647423 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.647606 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.647832 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.647925 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.648166 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.648263 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.648533 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.648625 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.648872 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.648957 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.649188 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.649272 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.649505 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.649608 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.649820 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.649904 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.650131 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.650291 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.650469 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.650563 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.650781 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.650872 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.651098 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.651184 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.651411 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.651503 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.651726 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.651812 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.652040 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.652132 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.652361 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.652448 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.652675 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.652762 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.652989 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.653076 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.653303 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.653388 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.653609 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.653693 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.653916 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.654001 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.654250 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.654340 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.654563 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.654649 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.654869 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.654967 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.655178 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.655307 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.655485 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.655571 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.655798 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.655892 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.656107 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.656194 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.656426 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.656510 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.656741 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.656839 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.657051 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.657135 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.657362 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.657452 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.657670 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.657835 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.657983 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.658068 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.658321 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.658419 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.658634 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.658727 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.658944 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.659028 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.659261 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.659355 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.659570 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.659655 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.660124 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.660213 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.660449 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.660533 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.660760 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.660853 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.661068 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.661153 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.661381 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.661466 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.661690 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.661783 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.662001 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.662086 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.662336 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.662436 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.662652 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.662750 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.663002 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.663087 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.663316 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.663459 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.663654 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.663779 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.663983 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.664111 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.664365 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.664462 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.664695 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.664788 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.665021 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.665106 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.665341 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.665438 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.665648 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.665735 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.665959 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.666043 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.666290 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.666380 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.666599 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.666696 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.666904 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.667002 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.667214 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.667300 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.667519 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.667617 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.667826 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.667911 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.668130 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.668217 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.668433 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.668518 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.668737 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.668829 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.669046 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.669138 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.669352 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.669437 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.669688 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.669789 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.669962 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.670055 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.670288 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.670376 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.670614 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.670710 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.670923 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.671016 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.671232 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.671318 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.671539 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.671631 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.671884 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.671977 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.672198 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.672291 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.672510 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.672603 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.672828 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.672913 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.673141 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.673233 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.673454 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.673580 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.673766 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.673852 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.674077 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.674208 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.674422 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.674510 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.674735 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.674821 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.675049 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.675135 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.675359 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.675482 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.675682 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.675773 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.675991 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.676076 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.676313 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.676399 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.676619 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.676704 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.676936 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.677022 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.677248 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.677333 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.677573 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.677665 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.677884 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.677977 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.678226 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.678809 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.679062 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.679179 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.679448 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.679545 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.679827 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.679911 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.680155 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.680248 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.680470 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.680567 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.680799 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.680885 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.681095 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.681187 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.681405 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.681498 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.681714 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.681798 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.682023 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.682108 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.682371 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.682474 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.682682 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.682766 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.683000 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.683088 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.683308 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.683394 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.683625 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.683710 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.683936 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.684020 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.684257 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.684343 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.684568 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.684654 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.684878 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.684962 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.685202 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.685299 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.685516 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.685601 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.685828 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.685913 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.686141 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.686285 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.686490 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.686576 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.686795 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.686892 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.687107 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.687200 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.687419 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.687504 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.687728 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.687888 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.688036 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.688120 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.688341 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.688425 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.688656 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.688749 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.688965 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.689049 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.689270 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.689362 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.689575 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.689669 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.689887 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.689973 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.690219 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.690308 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.690532 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.690619 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.690841 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.690934 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.691158 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.691243 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.691463 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.691549 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.691772 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.691858 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.692099 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.692185 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.692411 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.692498 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.692722 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.692808 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.693030 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.693121 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.693338 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.693423 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.693662 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.693794 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.694599 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.694707 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.694966 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.695051 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.695292 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.695455 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.695708 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.695802 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.696032 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.696118 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.696346 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.696439 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.696670 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.696767 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.696999 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.697091 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.697317 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.697401 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.697632 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.697724 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.697945 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.698039 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.698284 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.698381 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.698598 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.698691 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.698913 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.698999 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.699227 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.699311 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.699544 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.699630 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.699855 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.699939 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.700171 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.700264 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.700481 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.700566 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.700787 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.700872 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.701100 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.701192 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.701414 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.701499 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.701728 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.701983 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.702068 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.702342 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.702431 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.702660 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.702746 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.702981 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.703234 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.703330 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.703574 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.703669 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.703893 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.703990 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.704215 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.704301 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.704538 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.704625 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.704861 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.704944 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.705171 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.705266 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.705483 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.705582 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.705790 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.705883 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.706102 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.706242 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.706448 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.706551 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.706756 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.706841 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.707061 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.707146 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.707372 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.707473 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.707679 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.707771 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.707982 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.708074 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.708288 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.708382 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.708595 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.708682 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.708902 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.708987 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.709205 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.709297 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.709509 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.709625 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.709865 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.710028 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.710215 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.710393 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.710631 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.710764 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.710993 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.711087 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.711305 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.711395 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.711611 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.711704 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.711958 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.712049 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.712266 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.712357 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.712577 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.712666 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.712885 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.713070 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.713235 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.713338 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.713546 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.713647 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.713850 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.713989 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.714196 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.714297 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.714508 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.714593 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.714815 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.714915 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.715121 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.715214 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.715432 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.715518 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.715743 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.715841 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.716049 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.716143 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.716361 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.716450 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.716672 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.716759 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.716985 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.717077 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.717293 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.717379 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.717597 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.717681 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.717906 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.717992 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.718235 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.718325 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.718554 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.718648 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.718860 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.718944 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.719164 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.719255 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.719469 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.719556 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.719780 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.719866 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.720090 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.720182 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.720390 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.720496 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.720696 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.720856 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.720996 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.721095 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.721307 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.721399 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.721610 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.721694 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.721914 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.722007 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.722247 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.722350 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.722559 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.722651 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.722869 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.722978 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.723175 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.723264 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.723483 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.723575 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.723797 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.723908 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.724105 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.724195 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.724409 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.724494 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.724717 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.724804 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.725022 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.725107 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.725410 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.725518 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.725722 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.725843 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.726048 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.726141 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.726389 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.726479 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.726749 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.726848 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.727007 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.727093 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.727313 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.727407 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.727620 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.727706 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.727924 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.728009 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.728232 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.728335 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.728535 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.728621 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.728839 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.728925 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.729142 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.729236 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.729448 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.729534 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.729756 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.729842 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.730080 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.730204 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.730413 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.730510 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.730722 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.730850 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.731031 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.731130 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.731332 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.731417 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.731659 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.731744 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.731967 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.732053 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.732276 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.732368 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.732590 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.732677 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.732920 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.733005 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.733232 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.733317 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.733543 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.733628 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.733856 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.733958 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.734184 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.734285 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.734494 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.734593 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.734808 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.734900 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.735120 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.735206 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.735432 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.735525 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.735736 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.735823 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.736039 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.736167 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.736355 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.736453 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.736665 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.736750 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.736973 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.737058 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.737280 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.737374 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.737605 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.737690 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.737920 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.738004 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.738247 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.738347 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.738560 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.738647 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.738874 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.738967 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.739184 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.739270 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.739496 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.739581 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.739808 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.739899 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.740117 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.740202 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.740427 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.740519 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.740737 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.741430 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.741599 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.741688 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.741914 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.742241 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.742330 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.742554 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.742817 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.742905 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.743164 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.743618 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.743717 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.743805 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.743950 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.744084 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.744398 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.744495 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.744704 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.744800 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.745017 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.745103 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.745326 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.745555 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.745760 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.746041 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.746128 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.746395 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.746494 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.746703 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.746790 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.747015 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.747124 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.747326 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.747551 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.747638 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.747947 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.748114 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.748254 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.748685 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.748784 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.749000 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.749171 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.749312 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.749632 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.749726 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.749939 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.750025 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.750268 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.750359 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.750583 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.750672 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.750909 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.750995 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.751217 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.751311 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.751523 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.751617 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.751829 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.751929 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.752151 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.752245 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.752455 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.752592 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.752775 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.752918 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.753193 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.753279 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.753504 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.753589 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.753810 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.753904 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.754203 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.754309 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.754498 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.754601 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.754833 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.754932 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.755150 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.755236 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.755465 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.755558 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.755780 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.755867 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.756085 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.756176 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.756399 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.757132 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.757335 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.757452 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.757723 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.757926 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.758018 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.758098 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.758313 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.758404 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.758632 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.758817 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.758943 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.759137 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.759269 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.759456 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.759598 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.759791 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.759913 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.760119 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.760239 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.760451 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.760655 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.760749 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.760983 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.761070 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.761296 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.761397 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.761619 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.761714 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.761946 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.762034 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.762275 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.762383 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.762583 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.762670 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.762893 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.762979 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.763203 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.763297 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.763510 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.763619 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.763834 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.763940 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.764142 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.764272 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.764454 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.764696 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.764786 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.765028 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.765128 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.765346 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.765433 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.765650 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.765734 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.765972 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.766067 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.766305 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.766394 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.766616 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.766703 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.766930 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.767028 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.767241 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.767326 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.767554 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.767639 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.767859 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.767959 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.768180 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.768265 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.768488 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.768573 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.768794 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.768946 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.769102 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.769191 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.769407 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.769495 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.769714 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.769862 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.770043 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.770137 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.770378 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.770468 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.770708 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.770795 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.771027 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.771156 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.771337 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.771422 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.771670 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.771762 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.771983 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.772118 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.772517 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.772632 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.772703 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.772768 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.772978 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.773166 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.773296 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.773477 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.773605 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.773783 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.773951 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.774095 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.774285 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.774428 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.774611 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.774737 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.774946 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.775032 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.775281 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.775375 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.775599 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.775686 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.775921 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.776006 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.776224 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.776312 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.776548 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.776634 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.776854 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.776948 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.777176 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.777270 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.777483 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.777567 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.777786 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.777871 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.778092 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.778197 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.778420 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.778506 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.778727 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.778823 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.779037 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.779132 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.779350 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.779436 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.779658 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.779751 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.779965 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.780052 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.780271 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.780361 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.780584 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.780685 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.780892 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.780978 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.781251 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.781343 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.781518 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.781612 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.781827 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.781916 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.782137 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.782295 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.782466 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.782564 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.782783 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.782869 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.783097 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.783192 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.783414 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.783501 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.783725 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.783950 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.784039 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.784282 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.784417 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.784597 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.784684 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.785231 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.785334 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.785571 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.785669 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.785888 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.785981 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.786226 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.786316 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.786547 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.786643 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.786862 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.786949 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.787182 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.787269 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.787499 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.787587 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.788353 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.788449 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.788766 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.788930 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.789101 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.789273 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.789434 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.789600 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.789754 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.789924 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.790078 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.790270 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.790420 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.790593 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.790737 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.790915 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.791095 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.791234 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.791412 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.791554 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.791722 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.791859 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.792039 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.792174 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.792355 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.792507 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.792667 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.792835 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.792971 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.793163 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.793283 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.793503 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.793603 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.793832 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.793919 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.794153 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.794292 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.794498 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.794595 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.794818 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.794906 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.795133 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.795226 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.795460 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.795558 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.795788 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.795875 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.796107 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.796194 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.796423 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.796514 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.796741 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.796881 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.797056 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.797160 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.797373 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.797575 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.797692 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.797893 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.798011 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.798258 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.798359 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.798589 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.798676 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.798917 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.799011 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.799236 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.799323 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.799555 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.799642 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.799891 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.799978 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.800203 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.800291 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.800509 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.800596 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.800821 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.800915 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.801135 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.801229 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.801442 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.801660 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.801753 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.801981 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.802068 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.802349 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.802450 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.802684 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.802777 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.803014 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.803101 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.803934 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.804105 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.804267 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.804447 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.804600 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.804770 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.804916 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.805102 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.805230 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.805432 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.805547 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.805754 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.805864 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.806067 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.806192 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.806424 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.806513 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.806735 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.806822 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.807044 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.807131 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.807361 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.807455 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.807673 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.807760 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.807981 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.808265 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.808353 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.808588 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.808672 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.808900 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.808986 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.809210 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.809298 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.809523 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.809617 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.809836 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.809923 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.810181 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.810271 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.810495 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.810582 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.810805 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.810893 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.811115 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.811202 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.811426 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.811511 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.811733 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.811828 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.812040 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.812128 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.812350 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.812436 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.812655 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.812748 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.812968 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.813059 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.813273 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.813364 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.813583 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.813677 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.813890 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.813976 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.814224 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.814324 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.814537 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.814637 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.814850 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.814942 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.815161 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.815254 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.815476 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.815567 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.815789 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.815875 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.816100 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.816193 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.816412 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.816499 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.816722 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.816809 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.817041 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.817126 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.817352 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.817440 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.817664 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.817756 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.817974 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.818059 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.818315 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.818405 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.818630 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.818872 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.818997 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.819336 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.819520 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.819655 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.819742 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.820002 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.820089 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.820322 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.820474 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.820642 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.820730 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.820954 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.821040 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.821268 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.821356 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.821586 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.821678 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.821901 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.821987 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.822244 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.822335 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.822564 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.822650 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.822881 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.823109 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.823197 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.823451 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.823537 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.823780 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.823873 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.824095 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.824190 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.824408 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.824507 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.824721 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.824808 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.825036 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.825125 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.825346 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.825431 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.825658 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.825751 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.825972 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.826060 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.826311 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.826400 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.826630 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.826728 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.826949 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.827036 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.827265 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.827358 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.827580 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.827675 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.827896 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.827982 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.828208 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.828292 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.828520 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.828616 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.828832 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.828917 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.829145 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.829232 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.829457 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.829585 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.829774 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.829861 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.830088 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.830195 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.830417 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.830505 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.830777 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.830869 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.831101 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.831186 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.831426 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.831513 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.831745 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.831888 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.832057 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.832146 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.832371 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.832456 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.832685 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.832779 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.832992 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.833085 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.833303 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.833387 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.833615 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.833706 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.833945 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.834039 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.834291 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.834381 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.834675 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.834821 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.835105 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.835194 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.835416 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.835501 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.835726 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.835814 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.836037 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.836135 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.836346 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.836435 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.836666 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.836753 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.836977 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.837065 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.837282 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.837369 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.837589 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.837688 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.837900 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.837987 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.838235 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.838324 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.838544 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.838646 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.838851 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.838938 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.839159 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.839246 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.839469 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.839564 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.839772 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.839861 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.840082 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.840168 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.840387 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.840481 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.840692 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.840779 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.840997 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.841083 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.841303 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.841396 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.841612 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.841698 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.841915 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.842001 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.842245 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.842335 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.842552 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.842638 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.842856 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.842942 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.843162 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.843247 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.843469 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.843554 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.843777 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.843863 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.844088 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.844175 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.844628 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.844725 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.844812 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.844904 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.844984 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.845070 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.845289 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.845414 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.845602 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.845701 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.845909 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.845996 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.846240 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.846341 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.846550 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.846645 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.846858 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.846950 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.847165 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.847251 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.847498 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.847591 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.847811 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.847898 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.848126 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.848213 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.848440 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.848530 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.848753 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.848846 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.849078 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.849164 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.849393 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.849479 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.849699 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.849829 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.850031 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.850117 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.850887 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.850987 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.851197 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.851273 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.851531 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.851711 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.851829 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.851907 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.852145 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.852232 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.852462 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.852557 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.852772 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.852857 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.853083 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.853169 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.853397 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.853499 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.853706 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.853792 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.854023 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.854110 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.854363 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.854453 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.854677 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.854764 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.854996 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.855083 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.855317 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.855405 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.855638 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.855723 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.855954 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.856030 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.856264 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.856340 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.856590 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.856675 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.856905 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.856998 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.857217 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.857304 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.857533 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.857626 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.857848 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.857942 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.858200 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.858295 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.858506 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.858593 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.858821 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.858924 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.859142 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.859229 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.859392 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:56:49.859478 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.859781 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.860113 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.860428 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.860761 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.861092 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.861440 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.861757 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.862104 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.862467 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.862790 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.863106 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.863414 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:56:49.863661 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:56:50.014536 n-d-852086-5 devstack@n-api.service[106547]: INFO dbcounter [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Registered counter for database nova_api Aug 27 02:56:50.018268 n-d-852086-5 devstack@n-api.service[106546]: INFO dbcounter [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Registered counter for database nova_api Aug 27 02:56:50.035428 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_db.sqlalchemy.engines [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.041826 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_db.sqlalchemy.engines [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.042028 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writer thread running {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.048297 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writer thread running {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.099220 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.context [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=106547) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:56:50.103435 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_concurrency.lockutils [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:50.103921 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_concurrency.lockutils [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:50.105525 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_concurrency.lockutils [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:50.105856 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.context [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=106546) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:56:50.106287 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_concurrency.lockutils [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:50.106743 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_concurrency.lockutils [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:50.108755 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_concurrency.lockutils [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:50.109696 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:50.110253 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:50.110761 n-d-852086-5 devstack@n-api.service[106547]: INFO dbcounter [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Registered counter for database nova_cell0 Aug 27 02:56:50.111815 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:50.112553 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:50.113317 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:50.114810 n-d-852086-5 devstack@n-api.service[106547]: INFO dbcounter [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Registered counter for database nova_cell1 Aug 27 02:56:50.115138 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:50.117232 n-d-852086-5 devstack@n-api.service[106546]: INFO dbcounter [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Registered counter for database nova_cell0 Aug 27 02:56:50.121409 n-d-852086-5 devstack@n-api.service[106546]: INFO dbcounter [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Registered counter for database nova_cell1 Aug 27 02:56:50.121803 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_db.sqlalchemy.engines [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.124021 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_db.sqlalchemy.engines [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.128637 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writer thread running {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.128773 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_db.sqlalchemy.engines [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.132382 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writer thread running {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.132526 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_db.sqlalchemy.engines [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.135401 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writer thread running {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.281138 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writer thread running {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.283006 n-d-852086-5 devstack@n-api.service[106547]: INFO dbcounter [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Registered counter for database nova_cell0 Aug 27 02:56:50.290287 n-d-852086-5 devstack@n-api.service[106547]: DEBUG oslo_db.sqlalchemy.engines [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.291281 n-d-852086-5 devstack@n-api.service[106546]: INFO dbcounter [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Registered counter for database nova_cell0 Aug 27 02:56:50.294574 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writer thread running {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.299810 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_db.sqlalchemy.engines [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:56:50.304933 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writer thread running {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:56:50.637428 n-d-852086-5 devstack@n-api.service[106546]: WARNING keystonemiddleware.auth_token [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:56:50.640871 n-d-852086-5 devstack@n-api.service[106547]: WARNING keystonemiddleware.auth_token [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:56:50.644784 n-d-852086-5 devstack@n-api.service[106546]: WARNING keystonemiddleware.auth_token [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:56:50.648724 n-d-852086-5 devstack@n-api.service[106547]: WARNING keystonemiddleware.auth_token [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:56:50.990036 n-d-852086-5 devstack@n-api.service[106546]: WARNING keystonemiddleware.auth_token [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:56:50.995454 n-d-852086-5 devstack@n-api.service[106547]: WARNING keystonemiddleware.auth_token [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:56:50.996167 n-d-852086-5 devstack@n-api.service[106546]: WARNING keystonemiddleware.auth_token [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:56:51.001265 n-d-852086-5 devstack@n-api.service[106546]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56457ea3a9c0 pid: 106546 (default app) Aug 27 02:56:51.001649 n-d-852086-5 devstack@n-api.service[106547]: WARNING keystonemiddleware.auth_token [None req-11d718c5-e893-4443-b49d-fdb6c3aed5d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:56:51.003357 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:51.004566 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 27 02:56:51.004973 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Sat Aug 27 02:56:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:51.006810 n-d-852086-5 devstack@n-api.service[106547]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56457ea3a9c0 pid: 106547 (default app) Aug 27 02:58:09.208382 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:09.209408 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002303 Aug 27 02:58:09.209812 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:09.221797 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writing DB stats nova_api:SELECT=3 {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:09.223560 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writing DB stats nova_cell1:SELECT=3 {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:09.224594 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writing DB stats nova_cell0:SELECT=3 {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:09.225765 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:10.113991 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-3f84aee5-1ae3-4f0b-ac38-ea3f4152d93a admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:10.147540 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-3f84aee5-1ae3-4f0b-ac38-ea3f4152d93a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930963 Aug 27 02:58:10.148421 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 02:58:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:12.523646 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:12.524463 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-fba4256e-6ed2-47ed-925e-72ea5f3b9b60 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 27 02:58:12.525033 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:12.958677 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-1f24cb0b-82c3-4b96-b8ae-f5c42c39eafd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:13.006842 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-1f24cb0b-82c3-4b96-b8ae-f5c42c39eafd admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.475827 Aug 27 02:58:13.007579 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:13.022474 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writing DB stats nova_api:SELECT=3 {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:13.023210 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writing DB stats nova_cell0:SELECT=3 {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:13.024090 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writing DB stats nova_cell1:SELECT=3 {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:13.025546 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:13.235487 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-e796e6be-bfc7-42d4-b050-e84c92c2db0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:13.302571 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-e796e6be-bfc7-42d4-b050-e84c92c2db0e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286739 Aug 27 02:58:13.303351 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1336 bytes} [Sat Aug 27 02:58:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:15.729330 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-1f24cb0b-82c3-4b96-b8ae-f5c42c39eafd admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.730631 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-1f24cb0b-82c3-4b96-b8ae-f5c42c39eafd admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 27 02:58:15.731407 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:16.463400 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-44db3c5a-de04-4208-87fd-19d12d87dbf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "id": "d1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:16.520476 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-44db3c5a-de04-4208-87fd-19d12d87dbf9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.782790 Aug 27 02:58:16.521328 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:16.533146 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-d8d5e3c6-9a97-4a95-bcc5-e288fd97aefc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:16.571080 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-d8d5e3c6-9a97-4a95-bcc5-e288fd97aefc admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041575 Aug 27 02:58:16.572421 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1336 bytes} [Sat Aug 27 02:58:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:19.221619 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-44db3c5a-de04-4208-87fd-19d12d87dbf9 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:19.224091 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-44db3c5a-de04-4208-87fd-19d12d87dbf9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002843 Aug 27 02:58:19.224727 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:19.742584 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-0e4a339d-5434-4a14-80e3-646786af7ce6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "ram": 1024}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:19.769434 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-0e4a339d-5434-4a14-80e3-646786af7ce6 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.537675 Aug 27 02:58:19.783680 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-81ee27c3-cfed-411b-8167-6b1b616822d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:19.789965 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:19.822777 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-81ee27c3-cfed-411b-8167-6b1b616822d6 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042820 Aug 27 02:58:19.833524 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1336 bytes} [Sat Aug 27 02:58:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:22.295027 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-0e4a339d-5434-4a14-80e3-646786af7ce6 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:22.296042 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-0e4a339d-5434-4a14-80e3-646786af7ce6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 27 02:58:22.296707 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:22.773377 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-d30beb5b-eeb2-4806-970f-7067594ace93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:22.794979 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-d30beb5b-eeb2-4806-970f-7067594ace93 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491663 Aug 27 02:58:22.798318 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:22.808313 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-016e9ea3-be2b-4e5b-bde9-cbf375da40ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:22.841680 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-016e9ea3-be2b-4e5b-bde9-cbf375da40ec admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037183 Aug 27 02:58:22.842805 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1336 bytes} [Sat Aug 27 02:58:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:25.416347 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-d30beb5b-eeb2-4806-970f-7067594ace93 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:25.417322 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-d30beb5b-eeb2-4806-970f-7067594ace93 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 27 02:58:25.417748 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:25.891169 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-58b5e340-0b6e-4852-be58-f022a8eb2f71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "id": "d4", "name": "ds4G"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:25.937973 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-58b5e340-0b6e-4852-be58-f022a8eb2f71 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513904 Aug 27 02:58:25.939308 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:25.952970 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-4890a853-8cd0-4637-b89a-113cb21895f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:25.989935 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-4890a853-8cd0-4637-b89a-113cb21895f3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041534 Aug 27 02:58:25.991272 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1336 bytes} [Sat Aug 27 02:58:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:28.430125 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-58b5e340-0b6e-4852-be58-f022a8eb2f71 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:28.431260 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-58b5e340-0b6e-4852-be58-f022a8eb2f71 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 27 02:58:28.442268 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:28 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:28.860666 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-74b7fd45-6d90-426e-b64f-a3a543bfc07f admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:28.887170 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-74b7fd45-6d90-426e-b64f-a3a543bfc07f admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449008 Aug 27 02:58:28.888464 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 02:58:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:31.333146 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-58b5e340-0b6e-4852-be58-f022a8eb2f71 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:31.334441 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-58b5e340-0b6e-4852-be58-f022a8eb2f71 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001835 Aug 27 02:58:31.335000 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:31.751549 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-f41d2f9e-f2b2-4316-889b-be69ed23571d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "id": "1"}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:31.775981 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-f41d2f9e-f2b2-4316-889b-be69ed23571d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.432993 Aug 27 02:58:31.778267 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:31.799896 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-5c66bb27-61bb-4027-bc8c-d8f18e2b24f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:31.834874 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-5c66bb27-61bb-4027-bc8c-d8f18e2b24f0 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042764 Aug 27 02:58:31.835459 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1333 bytes} [Sat Aug 27 02:58:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:34.474233 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-f41d2f9e-f2b2-4316-889b-be69ed23571d admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:34.475272 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-f41d2f9e-f2b2-4316-889b-be69ed23571d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 27 02:58:34.475675 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:34.906177 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-ac14a1ab-e03f-43b7-b68f-eff17fbc39fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:34.927087 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-ac14a1ab-e03f-43b7-b68f-eff17fbc39fb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444157 Aug 27 02:58:34.927920 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:58:34.942307 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-54597965-ad71-4494-b780-4e7e8d77f2c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:34.971173 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-54597965-ad71-4494-b780-4e7e8d77f2c4 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033194 Aug 27 02:58:34.974361 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1333 bytes} [Sat Aug 27 02:58:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:37.367491 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-ac14a1ab-e03f-43b7-b68f-eff17fbc39fb admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:37.368518 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-ac14a1ab-e03f-43b7-b68f-eff17fbc39fb admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 27 02:58:37.368924 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:37.777290 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-48e0a601-0476-4aa9-8d23-083531421d53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:37.798233 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-48e0a601-0476-4aa9-8d23-083531421d53 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.423255 Aug 27 02:58:37.798887 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:58:37.811696 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8e409189-ccdf-4fc5-af90-b0cf30872c0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:37.835792 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8e409189-ccdf-4fc5-af90-b0cf30872c0e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027744 Aug 27 02:58:37.842904 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1333 bytes} [Sat Aug 27 02:58:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:40.229837 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-48e0a601-0476-4aa9-8d23-083531421d53 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:40.231165 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-48e0a601-0476-4aa9-8d23-083531421d53 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 Aug 27 02:58:40.231641 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:40.658565 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-50f6458b-fe5e-416e-bdc7-304882253d04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:40.668668 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:40.684059 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-50f6458b-fe5e-416e-bdc7-304882253d04 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445602 Aug 27 02:58:40.686286 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:40.700186 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-241fedfe-9e19-4707-8ea1-6961855cd154 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:40.728627 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-241fedfe-9e19-4707-8ea1-6961855cd154 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032295 Aug 27 02:58:40.729201 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1333 bytes} [Sat Aug 27 02:58:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:43.384401 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-50f6458b-fe5e-416e-bdc7-304882253d04 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:43.385413 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-50f6458b-fe5e-416e-bdc7-304882253d04 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 27 02:58:43.385999 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:43.837823 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-19a1d119-44b3-42b8-b0cd-511e5f435093 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:43.843509 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:43.858801 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-19a1d119-44b3-42b8-b0cd-511e5f435093 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467014 Aug 27 02:58:43.859671 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1283 bytes} [Sat Aug 27 02:58:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:58:43.872279 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-190288f3-6dac-43b9-a2f1-56199c777ce3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:43.903027 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-190288f3-6dac-43b9-a2f1-56199c777ce3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034536 Aug 27 02:58:43.903905 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1333 bytes} [Sat Aug 27 02:58:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:06.537140 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-19a1d119-44b3-42b8-b0cd-511e5f435093 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:06.538134 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-19a1d119-44b3-42b8-b0cd-511e5f435093 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 27 02:59:06.538563 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 02:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:06.549310 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:06.926961 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-919523a5-eaa1-411a-b7ff-84360865b6cf admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:06.945696 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-919523a5-eaa1-411a-b7ff-84360865b6cf admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401012 Aug 27 02:59:06.946248 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 02:59:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:08.020361 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-19a1d119-44b3-42b8-b0cd-511e5f435093 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:08.021375 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-19a1d119-44b3-42b8-b0cd-511e5f435093 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 27 02:59:08.021757 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:08.570530 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-f38ba504-6968-4759-8c95-688fe6b18a5d admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:08.576107 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.wsgi [None req-f38ba504-6968-4759-8c95-688fe6b18a5d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-f38ba504-6968-4759-8c95-688fe6b18a5d admin admin] Request method failure captured: Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: Accept: application/json Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: Accept-Encoding: gzip, deflate Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: Connection: keep-alive Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: Content-Length: 0 Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: Host: 10.222.0.69 Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: Openstack-Api-Version: compute 2.90 Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: Openstack-System-Scope: None Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: User-Agent: python-novaclient Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Auth-Token: gAAAAABjCYh70q2qwY4adaTZA62DEJUIPRKbD2khxUllH1mNWFqj2KEfM16-WAhpbARsizYq2vaXSKauu8hvE_QhKepVsv3Eg7MGeUFlio0jnGdwiilMZS-xxKUUv-U9MKGYsYLZnjtDG30rIE8lm71sKA_Ow4o_WcymAMdrFxanEJIv6tT9o7Y Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Domain-Id: None Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Domain-Name: None Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Identity-Status: Confirmed Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Is-Admin-Project: True Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Domain-Id: default Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Domain-Name: Default Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Name: admin Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Role: admin,member,reader Aug 27 02:59:08.579772 n-d-852086-5 devstack@n-api.service[106547]: X-Roles: admin,member,reader Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dff225d3c6bd4b80afea944ba104b06f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}] Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant: admin Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant-Name: admin Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-User: admin Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-User-Domain-Id: default Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-User-Domain-Name: Default Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-User-Id: 9f04bb0258a949ffa7a195d6d3c204be Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: X-User-Name: admin Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: method: > Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: exception: Flavor 42 could not be found. Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: action_args: {'id': '42'} Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:08.581411 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:08.582582 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.584100 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-f38ba504-6968-4759-8c95-688fe6b18a5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:08.585397 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-f38ba504-6968-4759-8c95-688fe6b18a5d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397051 Aug 27 02:59:08.585397 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Sat Aug 27 02:59:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:59:08.591051 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-b46c9f36-7c8d-49c4-afdf-8c59e0ab5b5a admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:08.615060 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-b46c9f36-7c8d-49c4-afdf-8c59e0ab5b5a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027554 Aug 27 02:59:08.615608 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Sat Aug 27 02:59:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:08.630180 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-0e3a784f-94cd-468c-9fae-9404d4a80840 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:08.652416 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-0e3a784f-94cd-468c-9fae-9404d4a80840 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026161 Aug 27 02:59:08.652947 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Sat Aug 27 02:59:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:08.663118 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-9a0cd320-d033-45f5-b849-bfc6c82b554a admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:08.668730 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.wsgi [None req-9a0cd320-d033-45f5-b849-bfc6c82b554a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-9a0cd320-d033-45f5-b849-bfc6c82b554a admin admin] Request method failure captured: Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: Accept: application/json Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: Accept-Encoding: gzip, deflate Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: Connection: keep-alive Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: Content-Length: 0 Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: Host: 10.222.0.69 Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: Openstack-Api-Version: compute 2.90 Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: Openstack-System-Scope: None Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: User-Agent: python-novaclient Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Auth-Token: gAAAAABjCYh70q2qwY4adaTZA62DEJUIPRKbD2khxUllH1mNWFqj2KEfM16-WAhpbARsizYq2vaXSKauu8hvE_QhKepVsv3Eg7MGeUFlio0jnGdwiilMZS-xxKUUv-U9MKGYsYLZnjtDG30rIE8lm71sKA_Ow4o_WcymAMdrFxanEJIv6tT9o7Y Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Domain-Id: None Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Domain-Name: None Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Identity-Status: Confirmed Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Is-Admin-Project: True Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Domain-Id: default Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Domain-Name: Default Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Name: admin Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Role: admin,member,reader Aug 27 02:59:08.671970 n-d-852086-5 devstack@n-api.service[106546]: X-Roles: admin,member,reader Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dff225d3c6bd4b80afea944ba104b06f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}] Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant: admin Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant-Name: admin Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-User: admin Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-User-Domain-Id: default Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-User-Domain-Name: Default Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-User-Id: 9f04bb0258a949ffa7a195d6d3c204be Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: X-User-Name: admin Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: method: > Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: exception: Flavor 42 could not be found. Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: action_args: {'id': '42'} Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:08.673288 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:08.674702 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:08.675809 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-9a0cd320-d033-45f5-b849-bfc6c82b554a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:08.676963 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-9a0cd320-d033-45f5-b849-bfc6c82b554a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014094 Aug 27 02:59:08.676963 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Sat Aug 27 02:59:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:59:09.662062 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-0e3a784f-94cd-468c-9fae-9404d4a80840 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:09.663138 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-0e3a784f-94cd-468c-9fae-9404d4a80840 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 27 02:59:09.663537 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:10.186334 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-2f25490e-bd43-4ec1-bcd0-356bb0b0edf4 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:10.191873 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.wsgi [None req-2f25490e-bd43-4ec1-bcd0-356bb0b0edf4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-2f25490e-bd43-4ec1-bcd0-356bb0b0edf4 admin admin] Request method failure captured: Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: Accept: application/json Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: Accept-Encoding: gzip, deflate Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: Connection: keep-alive Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: Content-Length: 0 Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: Host: 10.222.0.69 Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: Openstack-Api-Version: compute 2.90 Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: Openstack-System-Scope: None Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: User-Agent: python-novaclient Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Auth-Token: gAAAAABjCYh9KEpV407Lnfpmi_ca7uaZJBP7aOMslpSHpxxA036nR9ZvzF5Ze4zhe5zKm2sNWULjj2wckPD4OzyOsgBm7iHM0d3OwSfBwP--qF7wHMTAggLhR0U0sBkRtFlpkFGjWF6aMOKx39M7TzfxKFemri7vCll4BBH1CXdduymUgac_uHQ Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Domain-Id: None Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Domain-Name: None Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Identity-Status: Confirmed Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Is-Admin-Project: True Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Domain-Id: default Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Domain-Name: Default Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Name: admin Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Role: admin,member,reader Aug 27 02:59:10.193430 n-d-852086-5 devstack@n-api.service[106546]: X-Roles: admin,member,reader Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dff225d3c6bd4b80afea944ba104b06f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}] Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant: admin Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant-Name: admin Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-User: admin Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-User-Domain-Id: default Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-User-Domain-Name: Default Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-User-Id: 9f04bb0258a949ffa7a195d6d3c204be Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: X-User-Name: admin Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: method: > Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: exception: Flavor 84 could not be found. Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: action_args: {'id': '84'} Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:10.195063 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:10.195946 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.197247 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-2f25490e-bd43-4ec1-bcd0-356bb0b0edf4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:10.198647 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-2f25490e-bd43-4ec1-bcd0-356bb0b0edf4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391685 Aug 27 02:59:10.198647 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Sat Aug 27 02:59:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:59:10.204441 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-4e55e811-e9e7-4582-aa2c-593567c70977 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:10.219765 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-4e55e811-e9e7-4582-aa2c-593567c70977 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018995 Aug 27 02:59:10.220835 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Sat Aug 27 02:59:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:10.230502 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-eb016d54-b264-4d21-b27f-8565751ff7b6 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:10.245906 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-eb016d54-b264-4d21-b27f-8565751ff7b6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018849 Aug 27 02:59:10.246498 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Sat Aug 27 02:59:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:10.255612 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-16689ff2-1e9c-4cbe-947f-cfaf7388cafa admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:10.260921 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.wsgi [None req-16689ff2-1e9c-4cbe-947f-cfaf7388cafa admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-16689ff2-1e9c-4cbe-947f-cfaf7388cafa admin admin] Request method failure captured: Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: Accept: application/json Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: Accept-Encoding: gzip, deflate Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: Connection: keep-alive Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: Content-Length: 0 Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: Host: 10.222.0.69 Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: Openstack-Api-Version: compute 2.90 Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: Openstack-System-Scope: None Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: User-Agent: python-novaclient Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Auth-Token: gAAAAABjCYh9KEpV407Lnfpmi_ca7uaZJBP7aOMslpSHpxxA036nR9ZvzF5Ze4zhe5zKm2sNWULjj2wckPD4OzyOsgBm7iHM0d3OwSfBwP--qF7wHMTAggLhR0U0sBkRtFlpkFGjWF6aMOKx39M7TzfxKFemri7vCll4BBH1CXdduymUgac_uHQ Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Domain-Id: None Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Domain-Name: None Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Identity-Status: Confirmed Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Is-Admin-Project: True Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Domain-Id: default Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Domain-Name: Default Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Name: admin Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Role: admin,member,reader Aug 27 02:59:10.262469 n-d-852086-5 devstack@n-api.service[106547]: X-Roles: admin,member,reader Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dff225d3c6bd4b80afea944ba104b06f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}] Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant: admin Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant-Name: admin Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-User: admin Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-User-Domain-Id: default Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-User-Domain-Name: Default Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-User-Id: 9f04bb0258a949ffa7a195d6d3c204be Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: X-User-Name: admin Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: method: > Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: exception: Flavor 84 could not be found. Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: action_args: {'id': '84'} Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:10.263972 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:10.264922 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:10.266103 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-16689ff2-1e9c-4cbe-947f-cfaf7388cafa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:10.267229 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-16689ff2-1e9c-4cbe-947f-cfaf7388cafa admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011701 Aug 27 02:59:10.267229 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Sat Aug 27 02:59:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:59:11.257602 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-eb016d54-b264-4d21-b27f-8565751ff7b6 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:11.258649 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-eb016d54-b264-4d21-b27f-8565751ff7b6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 27 02:59:11.259053 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:11.824367 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-0d73e2ea-4863-40ce-91f8-572c53a4fe11 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:11.830797 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.wsgi [None req-0d73e2ea-4863-40ce-91f8-572c53a4fe11 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-0d73e2ea-4863-40ce-91f8-572c53a4fe11 admin admin] Request method failure captured: Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: Accept: application/json Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: Accept-Encoding: gzip, deflate Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: Connection: keep-alive Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: Content-Length: 0 Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: Host: 10.222.0.69 Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: Openstack-Api-Version: compute 2.90 Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: Openstack-System-Scope: None Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: User-Agent: python-novaclient Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Auth-Token: gAAAAABjCYh_j1rqHTHy-5ysx2wAqLiFHt-IQJIxH-6tW99B02UxOopmmaa1k_xRMYS-xxRtr5ohEebDa-bLgtRMAzxnGa2e4isjF4tbDWJk8ztwq1h0N1QoBVvkJHdkRY7uPo5MsgrqYcZNWajXZ96aDdextLWE6MLLiZ08kxnw9HacN9uSWvs Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Domain-Id: None Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Domain-Name: None Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Identity-Status: Confirmed Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Is-Admin-Project: True Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Domain-Id: default Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Domain-Name: Default Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Project-Name: admin Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Role: admin,member,reader Aug 27 02:59:11.832290 n-d-852086-5 devstack@n-api.service[106547]: X-Roles: admin,member,reader Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dff225d3c6bd4b80afea944ba104b06f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}] Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant: admin Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-Tenant-Name: admin Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-User: admin Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-User-Domain-Id: default Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-User-Domain-Name: Default Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-User-Id: 9f04bb0258a949ffa7a195d6d3c204be Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: X-User-Name: admin Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: method: > Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: exception: Flavor 451 could not be found. Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: action_args: {'id': '451'} Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:11.833801 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:11.834898 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.836308 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-0d73e2ea-4863-40ce-91f8-572c53a4fe11 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:11.837608 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-0d73e2ea-4863-40ce-91f8-572c53a4fe11 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.437017 Aug 27 02:59:11.837608 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 02:59:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:59:11.843346 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-b5927e0b-beba-45e6-92a4-0d3b3505ce4f admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:11.858643 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-b5927e0b-beba-45e6-92a4-0d3b3505ce4f admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018870 Aug 27 02:59:11.859207 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Sat Aug 27 02:59:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:11.870592 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:11.885573 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018562 Aug 27 02:59:11.886106 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Sat Aug 27 02:59:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:11.895381 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-f7a4b447-8729-4d25-af08-d6dc67c388da admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:11.900913 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.wsgi [None req-f7a4b447-8729-4d25-af08-d6dc67c388da admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-f7a4b447-8729-4d25-af08-d6dc67c388da admin admin] Request method failure captured: Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: Accept: application/json Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: Accept-Encoding: gzip, deflate Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: Connection: keep-alive Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: Content-Length: 0 Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: Host: 10.222.0.69 Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: Openstack-Api-Version: compute 2.90 Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: Openstack-System-Scope: None Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: User-Agent: python-novaclient Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Auth-Token: gAAAAABjCYh_j1rqHTHy-5ysx2wAqLiFHt-IQJIxH-6tW99B02UxOopmmaa1k_xRMYS-xxRtr5ohEebDa-bLgtRMAzxnGa2e4isjF4tbDWJk8ztwq1h0N1QoBVvkJHdkRY7uPo5MsgrqYcZNWajXZ96aDdextLWE6MLLiZ08kxnw9HacN9uSWvs Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Domain-Id: None Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Domain-Name: None Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Identity-Status: Confirmed Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Is-Admin-Project: True Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Domain-Id: default Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Domain-Name: Default Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Project-Name: admin Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Role: admin,member,reader Aug 27 02:59:11.902440 n-d-852086-5 devstack@n-api.service[106546]: X-Roles: admin,member,reader Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dff225d3c6bd4b80afea944ba104b06f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dff225d3c6bd4b80afea944ba104b06f"}]}] Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant: admin Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant-Id: dff225d3c6bd4b80afea944ba104b06f Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-Tenant-Name: admin Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-User: admin Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-User-Domain-Id: default Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-User-Domain-Name: Default Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-User-Id: 9f04bb0258a949ffa7a195d6d3c204be Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: X-User-Name: admin Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: method: > Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: exception: Flavor 451 could not be found. Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: action_args: {'id': '451'} Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:11.903875 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:11.904721 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: ERROR nova.api.openstack.wsgi Aug 27 02:59:11.905776 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-f7a4b447-8729-4d25-af08-d6dc67c388da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:11.906875 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-f7a4b447-8729-4d25-af08-d6dc67c388da admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011962 Aug 27 02:59:11.906875 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 02:59:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:59:12.888968 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:12.890021 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 27 02:59:12.890444 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:13.414967 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-0774f556-6ef0-4782-a058-c4f1f17c6c99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:13.435403 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-0774f556-6ef0-4782-a058-c4f1f17c6c99 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404459 Aug 27 02:59:13.435945 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Sat Aug 27 02:59:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:59:14.418624 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.419638 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 27 02:59:14.420045 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:14.953452 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-91b6bca5-5c29-4e27-9ead-d7a8f69f0901 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:14.973295 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-91b6bca5-5c29-4e27-9ead-d7a8f69f0901 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412190 Aug 27 02:59:14.973840 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Sat Aug 27 02:59:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:59:15.942002 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:15.943076 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 27 02:59:15.943472 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:16.470586 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-69bf8954-52d1-4a41-8cdb-45ae503f919d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:16.491200 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-69bf8954-52d1-4a41-8cdb-45ae503f919d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.408719 Aug 27 02:59:16.491745 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Sat Aug 27 02:59:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:59:17.457522 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:17.458598 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 27 02:59:17.459002 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:17.991852 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-76ac1b19-847c-46a0-a5bd-0acbb08c5954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:18.010847 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-76ac1b19-847c-46a0-a5bd-0acbb08c5954 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414084 Aug 27 02:59:18.011374 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Sat Aug 27 02:59:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:59:18.976589 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:18.977662 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 27 02:59:18.978067 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 02:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:19.511338 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-0912f0ef-5c63-42e5-8736-02dffc1b1447 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:19.531490 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-0912f0ef-5c63-42e5-8736-02dffc1b1447 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403927 Aug 27 02:59:19.532618 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Sat Aug 27 02:59:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:13.440478 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.441491 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-8ecc0727-4908-4f56-90cd-1a527784291b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 27 03:00:13.441904 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 931 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:13.452950 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:13.832927 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-9dcdcc56-d272-4443-8aaa-312e175326ee admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.852818 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-9dcdcc56-d272-4443-8aaa-312e175326ee admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404842 Aug 27 03:00:13.853360 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:13.874759 n-d-852086-5 devstack@n-api.service[106547]: DEBUG dbcounter [-] [106547] Writing DB stats nova_api:SELECT=14 {{(pid=106547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:13.878824 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-25f7c3fe-7107-471a-a235-ac25ff65dac3 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.886443 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-25f7c3fe-7107-471a-a235-ac25ff65dac3 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013757 Aug 27 03:00:13.886962 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1283 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:13.899368 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-772876a0-2fc4-4269-a26b-44873ad4b944 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.907213 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-772876a0-2fc4-4269-a26b-44873ad4b944 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011399 Aug 27 03:00:13.907727 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1286 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:13.919385 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-a2b62a3d-7719-4d2f-9ebb-1ca708996ff5 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.927667 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-a2b62a3d-7719-4d2f-9ebb-1ca708996ff5 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011811 Aug 27 03:00:13.928177 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1286 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:13.939960 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-966ca974-62a5-4d35-a27b-542e1d9438f5 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:13.947417 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-966ca974-62a5-4d35-a27b-542e1d9438f5 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011600 Aug 27 03:00:13.947929 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1283 bytes} [Sat Aug 27 03:00:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:38.437663 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-a2b62a3d-7719-4d2f-9ebb-1ca708996ff5 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:38.438743 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-a2b62a3d-7719-4d2f-9ebb-1ca708996ff5 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 27 03:05:38.439150 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 03:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:38.587646 n-d-852086-5 devstack@n-api.service[106546]: DEBUG dbcounter [-] [106546] Writing DB stats nova_api:SELECT=6 {{(pid=106546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:38.729983 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:38.733467 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.733967 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.734424 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.735131 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.735573 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.735987 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.777171 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-ee00ff4d-0b69-48e0-856c-7ef14d92df9d admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.190948 Aug 27 03:05:38.777732 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 03:05:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:05:39.637540 n-d-852086-5 devstack@n-api.service[106547]: DEBUG nova.api.openstack.wsgi [None req-a2b62a3d-7719-4d2f-9ebb-1ca708996ff5 admin admin] Calling method '>' {{(pid=106547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:39.638567 n-d-852086-5 devstack@n-api.service[106547]: INFO nova.api.openstack.requestlog [None req-a2b62a3d-7719-4d2f-9ebb-1ca708996ff5 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 27 03:05:39.638964 n-d-852086-5 devstack@n-api.service[106547]: [pid: 106547|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Sat Aug 27 03:05:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:39.836004 n-d-852086-5 devstack@n-api.service[106546]: DEBUG nova.api.openstack.wsgi [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] Calling method '>' {{(pid=106546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:39.839628 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.840109 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.840538 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.842035 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.842810 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.843274 n-d-852086-5 devstack@n-api.service[106546]: DEBUG oslo_concurrency.lockutils [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.866420 n-d-852086-5 devstack@n-api.service[106546]: INFO nova.api.openstack.requestlog [None req-63fc9edd-29a1-42d8-8b90-ac3ea17e8d09 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.082090 Aug 27 03:05:39.866998 n-d-852086-5 devstack@n-api.service[106546]: [pid: 106546|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 03:05:39 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:06:25.004513 n-d-852086-5 devstack@n-api.service[106545]: Sat Aug 27 03:06:25 2022 - graceful shutdown triggered... Aug 27 03:06:25.005051 n-d-852086-5 devstack@n-api.service[106546]: Gracefully killing worker 1 (pid: 106546)... Aug 27 03:06:25.004761 n-d-852086-5 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 03:06:25.006006 n-d-852086-5 devstack@n-api.service[106547]: Gracefully killing worker 2 (pid: 106547)... Aug 27 03:06:26.005742 n-d-852086-5 devstack@n-api.service[106545]: worker 1 buried after 1 seconds Aug 27 03:06:26.005742 n-d-852086-5 devstack@n-api.service[106545]: worker 2 buried after 1 seconds Aug 27 03:06:26.005742 n-d-852086-5 devstack@n-api.service[106545]: goodbye to uWSGI. Aug 27 03:06:26.007205 n-d-852086-5 systemd[1]: devstack@n-api.service: Succeeded. Aug 27 03:06:26.007783 n-d-852086-5 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 03:06:26.010613 n-d-852086-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 03:06:26.026013 n-d-852086-5 devstack@n-api.service[122392]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 03:06:26 2022] *** Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: nodename: n-d-852086-5 Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: machine: x86_64 Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: clock source: unix Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: pcre jit disabled Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: detected number of CPU cores: 4 Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: current working directory: / Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: your processes number limit is 47680 Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: your memory page size is 4096 bytes Aug 27 03:06:26.042741 n-d-852086-5 devstack@n-api.service[122392]: detected max file descriptor number: 2048 Aug 27 03:06:26.043790 n-d-852086-5 devstack@n-api.service[122392]: lock engine: pthread robust mutexes Aug 27 03:06:26.043790 n-d-852086-5 devstack@n-api.service[122392]: thunder lock: enabled Aug 27 03:06:26.043790 n-d-852086-5 devstack@n-api.service[122392]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 03:06:26.043790 n-d-852086-5 devstack@n-api.service[122392]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 03:06:26.084778 n-d-852086-5 devstack@n-api.service[122392]: Python main interpreter initialized at 0x560c91a969c0 Aug 27 03:06:26.084778 n-d-852086-5 devstack@n-api.service[122392]: python threads support enabled Aug 27 03:06:26.084778 n-d-852086-5 devstack@n-api.service[122392]: your server socket listen backlog is limited to 100 connections Aug 27 03:06:26.084778 n-d-852086-5 devstack@n-api.service[122392]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:06:26.085238 n-d-852086-5 devstack@n-api.service[122392]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:06:26.085238 n-d-852086-5 devstack@n-api.service[122392]: *** Operational MODE: preforking *** Aug 27 03:06:26.085487 n-d-852086-5 devstack@n-api.service[122392]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:06:26.085487 n-d-852086-5 devstack@n-api.service[122392]: spawned uWSGI master process (pid: 122392) Aug 27 03:06:26.085701 n-d-852086-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 03:06:26.088298 n-d-852086-5 devstack@n-api.service[122392]: spawned uWSGI worker 1 (pid: 122407, cores: 1) Aug 27 03:06:26.088298 n-d-852086-5 devstack@n-api.service[122392]: spawned uWSGI worker 2 (pid: 122408, cores: 1) Aug 27 03:06:26.088298 n-d-852086-5 devstack@n-api.service[122392]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:06:26.756019 n-d-852086-5 devstack@n-api.service[122407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 03:06:26.758415 n-d-852086-5 devstack@n-api.service[122408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 03:06:27.945811 n-d-852086-5 devstack@n-api.service[122407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:06:27.945811 n-d-852086-5 devstack@n-api.service[122407]: from cryptography.utils import int_from_bytes Aug 27 03:06:27.946475 n-d-852086-5 devstack@n-api.service[122407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:06:27.946475 n-d-852086-5 devstack@n-api.service[122407]: from cryptography.utils import int_from_bytes Aug 27 03:06:27.952336 n-d-852086-5 devstack@n-api.service[122408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:06:27.952336 n-d-852086-5 devstack@n-api.service[122408]: from cryptography.utils import int_from_bytes Aug 27 03:06:27.952820 n-d-852086-5 devstack@n-api.service[122408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:06:27.952820 n-d-852086-5 devstack@n-api.service[122408]: from cryptography.utils import int_from_bytes Aug 27 03:06:30.375336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:06:30.375922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:06:30.376126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:06:30.376494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:06:30.376750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:06:30.377709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.378092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.378441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.378835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.379166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.379476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.379799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.380117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.380445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.380706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.381021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.381344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852086-5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.381665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.381972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.382301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.382621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.382919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.383238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.383540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.384038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.384490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.384797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.385103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.385438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.385750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.386054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.386404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.386710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.387034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.387339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.387740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852086-5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.388058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.388368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.388679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.389088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.389398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.389706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.390027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.390372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.390678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.391002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.391322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.391643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.391962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.392262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.392568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.392989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.393334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.393639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.393937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.394267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.394582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.394903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.395225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.395551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.395800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.396048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.396367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.396688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.396995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.397298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.397601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.397905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.398230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.398534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.398838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.399234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.399555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.399869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.400189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.400512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.400812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.401205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.401455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.401761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.402099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.402440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.402748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.403062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.403382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.403690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.403994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.404346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.404457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:06:30.404864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.404962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:06:30.405058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.405223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:06:30.405379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.405479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.405602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:06:30.405759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.405886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:06:30.406065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.406259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.406410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.406593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.406976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.407179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.407291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.407505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.407610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.407840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.407939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.408144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.408972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.409292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.409402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.409502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.409651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.409800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.409902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.409989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.410081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.410339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.410436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.410644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.410740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852086-5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.410948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.411049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.411252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.411345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.411570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.411665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.411889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.412003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.412193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.412295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.412497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.412598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.412821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.412941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.413116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.413316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.413451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.413631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.413735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.413941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.414047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.414276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.414376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.414620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.414733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.414921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.415014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.415237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.415331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.415542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.415648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.415903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.416012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.416161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.416256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.416459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.416561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.416761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.416859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852086-5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.417076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.417180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.417379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.417475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.417679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.417782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.417978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.418194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.418293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.418517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.418623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.418840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.418934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.419155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.419256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.419454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.419555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.419749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.419856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.420063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.420156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.420383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.420484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.420689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.420791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.420991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.421091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.421290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.421384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.421606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.421709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.421916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.422017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.422264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.422375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.422577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.422686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.422942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.423061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.423149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.423242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.423434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.423543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.423760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.423854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.424656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.424873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.424990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.425240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.425377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.425506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.425706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.425817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.426021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.426202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.426440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.426542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.426753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.426860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.427064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.427166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.427374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.427468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.427684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.427793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.427995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.428094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.428304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.428397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.428612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.428716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.428919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.429018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.429236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.429329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.429559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.429652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.429869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.429971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.430191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.430300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.430538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.430633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.430848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.430948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.431159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.431253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.431500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.431592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.431820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.431920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.432127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.432219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.432436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.432539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.432748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.432882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.433056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.433158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.433367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.433468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.433679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.433781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.433994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.434096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.434331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.434427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.434653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.434746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.434912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.435053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.435214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.435315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.435524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.435625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.435844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.435948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.436152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.436258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.436459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.436558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.436771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.436867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.437078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.437172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.437387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.437480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.437696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.437790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.438004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.438102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.438336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.438430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.438644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.438737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.438949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.439049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.439254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.439354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.439559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.439702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.439954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.440103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.440282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.440396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.440599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.440700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.440909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.441015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.441222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.441329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.441577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.441697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.441830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.441923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.442146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.442271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.442479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.442580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.442786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.442888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.443094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.443195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.443399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.443499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.443703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.443809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.444008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.444099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.444311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.444405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.444618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.444719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.444927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.445019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.445229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.445322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.445536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.445637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.445841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.445940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.446146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.446279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.446476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.446582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.446783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.446878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.447089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.447190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.447394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.447488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.447700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.447800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.448002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.448093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.448309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.448411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.448612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.448711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.448939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.449033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.449264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.449356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.449566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.449659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.449873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.449973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.450196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.450306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.450522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.450610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:06:30.450825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.450929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.451133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.451234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.451435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.451523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.451737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.451850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.452036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.452151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.452345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.452492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.452649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.452817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.452952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.453135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.453253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.453457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.453575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.453791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.453894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.454107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.454215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.454459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.454563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.454761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.454852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.455065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.455160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.455394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.455561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.455928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.456023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.456234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.456335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.456583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.456695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.456907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.456999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.457224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.457322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.457547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.457647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.457860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.457955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.458211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.458323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.458533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.458630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.458869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.458962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.459180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.459281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.459492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.459586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.459811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.459912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.460121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.460223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.460440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.460534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.460747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.460850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.461070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.461171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.461379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.461473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.461697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.461798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.461999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.462102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.462337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.462433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.462673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.462765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.463004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.463116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.463317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.463450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.463631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.463732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.463938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.464039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.464250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.464350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.464559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.464652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.464867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.464969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.465175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.465279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.465484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.465577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.465804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.465899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.466114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.466230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.466529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.466637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.466785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.466897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.467079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.467219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.467386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.467488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.467704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.467806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.468007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.468103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.468314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.468409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.468631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.468726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.468946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.469041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.469253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.469355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.469562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.469662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.469880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.469981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.470248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.470362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.470519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.470621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.471352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.471537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.471788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.471902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.472125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.472220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.472441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.472534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.472758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.472863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.473069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.473163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.473378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.473471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.473683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.473789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.473996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.474090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.474330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.474437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.474635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.474738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.474938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.475033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.475248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.475341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.475570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.475665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.475880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.475981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.476195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.476339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.476516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.476733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.476863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.476977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.477126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.477225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.477416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.477514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.477725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.477818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.478027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.478131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.478354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.478449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.478657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.478764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.479001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.479110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.479313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.479415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.479617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.479718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.479932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.480035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.480253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.480354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.480561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.480654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.480871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.480974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.481177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.481278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.481485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.481618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.481794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.481944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.482104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.482233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.482439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.482544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.482746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.482839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.483052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.483154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.483361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.483463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.483672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.483774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.483982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.484075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.484291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.484391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.484597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.484698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.484904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.485127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.485228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.485445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.485548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.485801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.485903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.486150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.486419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.487109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.487424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.487543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.487706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.487810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.488025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.488168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.488342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.488442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.488665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.488767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.488988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.489097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.489307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.489410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.489618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.489711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.489925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.490032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.490260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.490370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.490568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.490663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.490871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.490965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.491181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.491273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.491485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.491579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.491788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.491880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.492092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.492197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.492400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.492539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.492702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.492797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.493005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.493108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.493307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.493401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.493610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.493711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.493920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.494026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.494243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.494339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.494558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.494643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.494863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.494970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.495185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.495279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.495493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.495593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.495793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.495887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.496094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.496195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.496401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.496512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.496745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.496846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.497051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.497153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.497425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.497551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.497713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.497835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.498040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.498183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.498365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.498461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.498669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.498765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.498993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.499096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.499296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.499403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.499600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.499694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.499902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.499996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.500210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.500317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.500515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.500609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.500816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.500918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.501127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.501229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.501436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.501529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.501742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.501881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.502054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.502306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.502471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.502623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.502803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.503029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.503190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.503339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.503510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.503657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.503823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.503973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.504134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.504260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.504452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.504548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.504782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.504883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.505101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.505203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.505431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.505527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.505742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.505841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.506045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.506141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.506386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.506510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.506688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.506820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.506991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.507093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.507291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.507385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.507598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.507717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.507905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.508036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.508209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.508327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.508529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.508642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.508837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.508932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.509139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.509233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.509440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.509548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.509747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.509842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.510049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.510143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.510375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.510480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.510681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.510775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.511004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.511106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.511318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.511422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.511620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.511723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.511928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.512023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.512243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.512347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.512530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.512631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.512832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.512925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.513140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.513243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.513442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.513535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.513742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.513850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.514042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.514206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.514371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.514468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.514676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.514780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.514998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.515098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.515305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.515585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.515678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.515898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.516001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.516204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.516305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.516542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.516641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.516846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.516946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.517205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.517298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.517508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.517659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.517908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.518014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.518256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.518439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.518571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.518665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.518885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.518977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.519196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.519291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.519498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.519594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.519812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.519907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.520121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.520222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.520432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.520526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.520735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.520836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.521037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.521132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.521347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.521440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.521656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.521748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.521962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.522056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.522304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.522416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.522627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.522721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.522949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.523051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.523252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.523345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.523559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.523665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.523869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.523964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.524173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.524268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.524479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.524583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.524784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.524892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.525089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.525182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.525395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.525562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.525703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.525808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.526010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.526112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.526349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.526450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.526654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.526744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.526963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.527047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.527273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.527395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.527579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.527662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.527908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.528012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.528281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.528379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.528511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.528602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.528815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.528907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.529117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.529201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.529427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.529510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.529730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.529821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.530071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.530222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.530413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.530498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.530729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.530827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.531043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.531128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.531361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.531468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.531924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.532026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.532236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.532320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.532541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.532638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.532844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.532970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.533152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.533263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.533994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.535919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.536130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.536216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.536440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.536523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.536756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.536848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.537057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.537140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.537366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.537459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.537670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.537751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.538020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.538127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.540344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.540492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.540601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.540694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.540796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.540893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.540988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.541909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.542950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.543961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.544055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.544154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.544249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.544335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.544573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.544669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.544929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.545034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.545238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.545347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.545577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.545675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.545891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.545995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.546247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.546346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.546554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.546648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.546857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.546954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.547164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.547297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.547470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.547599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.547774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.547870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.548140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.548282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.548379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.548478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.548688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.548793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.549080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.549669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.549976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.550094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.550333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.550444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.550650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.550759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.550980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.551091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.551300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.551404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.551619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.551714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.551935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.552043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.552261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.552356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.552584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.552675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.552891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.553035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.553204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.553309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.553507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.553602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.553811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.553915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.554114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.554280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.554470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.554580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.554790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.554892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.555110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.555214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.555428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.555535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.555746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.555850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.556062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.556165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.556374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.556477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.556690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.556785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.557006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.557138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.557320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.557451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.557642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.557770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.557955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.558051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.558287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.558394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.558590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.558685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.558900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.558994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.559205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.559302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.559511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.559607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.559815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.559952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.560122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.560272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.560425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.560590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.560733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.560907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.561025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.561223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.561346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.561540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.561635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.561864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.561969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.562202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.562314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.562521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.562665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.562860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.562958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.563162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.563301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.563505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.563610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.563806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.563908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.564133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.564236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.564441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.564545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.565949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.566228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.566342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.566513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.566623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.566845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.566956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.567140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.567236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.567448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.567573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.567765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.567892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.568080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.568205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.568400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.568634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.568960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.569071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.569280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.569380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.569592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.569699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.569904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.570003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.570247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.570358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.570563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.570681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.570879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.570980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.571191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.571301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.571500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.571599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.571809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.571924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.572118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.572234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.572441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.572536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.572754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.572898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.573078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.573185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.573408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.573504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.573722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.573823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.574034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.574137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.574373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.574491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.574687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.574823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.575042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.575139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.575349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.575452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.575656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.575765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.575967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.576068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.576284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.576378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.576595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.576699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.576900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.577059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.577207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.577312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.577517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.577659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.577828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.577925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.578134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.578266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.578465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.578595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.578780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.578888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.579090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.579197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.579403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.579506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.579731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.579825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.580040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.580140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.580452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.580561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.580786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.580946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.581190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.581296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.581523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.581713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.581837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.582028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.582184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.582402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.582511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.582731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.582878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.583054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.583187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.583373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.583513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.583690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.583796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.584020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.584116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.584328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.584431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.584633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.584741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.584944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.585037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.585252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.585348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.585558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.585698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.585879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.585975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.586216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.586332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.586522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.586626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.586841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.586950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.587151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.587248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.587533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.587689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.587847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.588046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.588148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.588366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.588460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.588697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.588800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.589026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.589128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.589344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.589453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.589652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.589744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.589962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.590057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.590298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.590406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.590607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.590715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.590923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.591026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.591235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.591339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.591536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.591638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.591838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.591933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.592145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.592246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.592450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.592628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.592753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.592847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.593061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.593197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.593363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.593478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.593687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.593771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.593991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.594086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.594320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.594417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.594625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.594721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.594937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.595032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.595241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.595336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.595544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.595634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.596423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.596536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.596741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.596917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.597064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.597243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.597387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.597553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.597710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.597867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.598190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.598288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.598509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.598623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.598815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.598910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.599126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.599229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.599479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.599583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.599804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.599899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.600109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.600204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.600411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.600516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.600728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.600824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.601037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.601138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.601351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.601447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.601664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.601757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.601977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.602071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.602361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.602464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.602676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.602768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.603000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.603211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.623597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.624017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.624150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.624279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.624978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.625897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.626031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.626725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.626957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.626957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.627947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.628949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.629183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.629350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.629512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.629669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.629796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.629944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.630072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.631095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.631238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.631385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.631535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.631695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.631808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.631953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.632825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.633079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.633185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.633316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.634363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.634471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.634580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.634580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.634803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.634922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.634922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.635981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.636077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.636179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.636314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.636451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.637220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.637220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.637560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.637676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.637798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.637928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.637928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.638970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.639935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.640999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.641892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.642026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.642197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.644364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.644503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.644624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.644742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.644858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.644995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.645955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.646925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.647056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.647189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.647317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.647474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.647691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.649966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.650991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.651979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.652964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.653020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.653158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.653318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.653474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.653632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.653772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.653886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.654041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.654201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.654336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.654873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.655951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.656909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.657895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.658236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.659785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.660545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.661337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.661715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.662046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.662485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.662718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.663042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.663422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.663742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.664065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.664382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.664702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.665018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.665334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.665647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.665996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.666366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.666694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.667032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.667354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.667687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.668007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.668336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.668668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.668998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.669316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.669659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.669985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.670328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.670650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.670968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.671287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.671604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.671941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.672277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.672590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.672924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.673253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.673582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.673905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.674274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.674616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.674935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.675252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.675567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.675885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.676203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.676526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.676843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.677159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.677482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.677803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.678139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.678546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.678863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.679201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.679544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.679901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.680222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.680576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.680914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.681237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.681557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.681872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:06:30.682120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:06:30.711121 n-d-852086-5 devstack@n-api.service[122407]: INFO dbcounter [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Registered counter for database nova_api Aug 27 03:06:30.732038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:30.739676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writer thread running {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:30.747379 n-d-852086-5 devstack@n-api.service[122408]: INFO dbcounter [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Registered counter for database nova_api Aug 27 03:06:30.767686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:30.775092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:30.797287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.context [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=122407) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:06:30.802375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.802922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.804537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.805298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.805749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.807783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.809843 n-d-852086-5 devstack@n-api.service[122407]: INFO dbcounter [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Registered counter for database nova_cell0 Aug 27 03:06:30.816680 n-d-852086-5 devstack@n-api.service[122407]: INFO dbcounter [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Registered counter for database nova_cell1 Aug 27 03:06:30.825870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:30.827471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:30.833174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.context [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=122408) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:06:30.834492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writer thread running {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:30.835821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writer thread running {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:30.837343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.837994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.839759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.840522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.840989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.843026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.845070 n-d-852086-5 devstack@n-api.service[122408]: INFO dbcounter [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Registered counter for database nova_cell0 Aug 27 03:06:30.850711 n-d-852086-5 devstack@n-api.service[122408]: INFO dbcounter [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Registered counter for database nova_cell1 Aug 27 03:06:30.858593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:30.864221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:31.001767 n-d-852086-5 devstack@n-api.service[122407]: INFO dbcounter [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Registered counter for database nova_cell0 Aug 27 03:06:31.011833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:31.013778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:31.016733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writer thread running {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:31.018359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:31.028997 n-d-852086-5 devstack@n-api.service[122408]: INFO dbcounter [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Registered counter for database nova_cell0 Aug 27 03:06:31.040517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:06:31.046775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 03:06:31.364292 n-d-852086-5 devstack@n-api.service[122407]: WARNING keystonemiddleware.auth_token [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:06:31.371574 n-d-852086-5 devstack@n-api.service[122407]: WARNING keystonemiddleware.auth_token [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:06:31.380009 n-d-852086-5 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:06:31.386093 n-d-852086-5 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:06:31.731604 n-d-852086-5 devstack@n-api.service[122407]: WARNING keystonemiddleware.auth_token [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:06:31.736138 n-d-852086-5 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:06:31.739255 n-d-852086-5 devstack@n-api.service[122407]: WARNING keystonemiddleware.auth_token [None req-9d0dc77f-5922-4652-818d-2068c4e8bd3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:06:31.742980 n-d-852086-5 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-cd977fd1-c650-497c-960e-97e7f0db7410 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:06:31.744213 n-d-852086-5 devstack@n-api.service[122407]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560c91a969c0 pid: 122407 (default app) Aug 27 03:06:31.748336 n-d-852086-5 devstack@n-api.service[122408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560c91a969c0 pid: 122408 (default app) Aug 27 03:07:14.037788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:14.041189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:14.043648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:14.044455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:14.321399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:14.322317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:14.324312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:14.326611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:15.611314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41fd757d-cb75-47ad-a5b0-8b7cfcd5a797 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-890015658", "ram": 512, "vcpus": 1, "disk": 10, "id": 448005102, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:15.699451 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41fd757d-cb75-47ad-a5b0-8b7cfcd5a797 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.670219 Aug 27 03:07:15.714628 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:14 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:16.166176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfe15288-6d97-47dd-8e2c-4cda98ca1ca9 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-144598868", "id": 771390675, "os-flavor-access:is_public": "True"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:16.173290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '.version_select at 0x7fe45dad1a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:16.224770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=122408) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 03:07:16.226883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.234962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.235590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.239865 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfe15288-6d97-47dd-8e2c-4cda98ca1ca9 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.518064 Aug 27 03:07:16.244343 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2/2] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:15 2022] POST /compute/v2.1/flavors => generated 426 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:16.332954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.333481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.335106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.381465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.389709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.390189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.416539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2188bec1-7d40-45a5-ab9f-e61a3b5eefdb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 2.101091 Aug 27 03:07:16.435291 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1/3] 10.222.0.69 () {58 vars in 1167 bytes} [Sat Aug 27 03:07:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:16.651774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:16.653503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.653990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.654516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.655255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.655709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.656154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.696668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cc0bda2-d8e6-495c-9785-746871f6861a tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:16.726599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f8715f12-2fe6-4a2a-a853-7aaab02471d7 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] 10.222.0.69 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.479720 Aug 27 03:07:16.727599 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3/4] 10.222.0.69 () {58 vars in 1164 bytes} [Sat Aug 27 03:07:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:07:16.763126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-3cc0bda2-d8e6-495c-9785-746871f6861a tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] HTTP exception thrown: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cc0bda2-d8e6-495c-9785-746871f6861a tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Request method failure captured: Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/flavors/448005102/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpflYrcfTclvHP9EFEqdy3PiVfk9E7W9VVxrh8TAU35lbJQOOYMwZCRrlejhS_gmA-MMasSDe1LReVhK4WMZTx11MRvdPamZ2U6-nDke2rLY7kUsL-932iBIJYw9aglBIT77xUG8FM7qsrRctxFiGeKNc57JVP48RSNskXWTEkrce8 Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:07:16.774411 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0bce32cf68824f92a6af645a1f4d180e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}] Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 62c89ce93d6647b292f9aa17e09d1757 Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:07:16.776081 n-d-852086-5 devstack@n-api.service[122408]: exception: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'flavor_id': '448005102', 'id': 'hw:cpu_thread_policy'} Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:16.776665 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:16.777720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cc0bda2-d8e6-495c-9785-746871f6861a tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Returning 404 to user: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:16.785723 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cc0bda2-d8e6-495c-9785-746871f6861a tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] 10.222.0.69 "GET /compute/v2.1/flavors/448005102/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.341782 Aug 27 03:07:16.791990 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2/5] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:07:16 2022] GET /compute/v2.1/flavors/448005102/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 356 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:16.951770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45d994700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:16.970188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=122407) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 03:07:16.971402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:16.972043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:16.973381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.045551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.048778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.049304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.083845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.084690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.085324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.092128 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10bc7494-a3b3-4c4c-a063-0b57418a20a8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.363508 Aug 27 03:07:17.093300 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4/6] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:17.104624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f3c5756-a846-4601-9bb9-b999a9d07725 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.169476 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f3c5756-a846-4601-9bb9-b999a9d07725 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/771390675" status: 202 len: 0 microversion: 2.1 time: 0.074868 Aug 27 03:07:17.174968 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 5/7] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:07:17 2022] DELETE /compute/v2.1/flavors/771390675 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:17.177999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ffae76d-4b61-404a-a201-8e0534d1287a tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-92378382", "name": "tempest-test_aggregate-1388942631"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:17.206452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-61054735", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:17.209393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-7ffae76d-4b61-404a-a201-8e0534d1287a tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid bae2ec53-5db5-4be4-ba22-d0eaa8626bed for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:07:17.330122 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ffae76d-4b61-404a-a201-8e0534d1287a tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.157410 Aug 27 03:07:17.338887 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 6/8] 10.222.0.69 () {60 vars in 1165 bytes} [Sat Aug 27 03:07:17 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:17.343718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.346332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.347887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.348783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.349783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.350448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.351050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.383445 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b6028b7-6a9f-4191-bb58-bdfddbbf44b6 tempest-AZAdminV2TestJSON-630832424 tempest-AZAdminV2TestJSON-630832424-project-admin] 10.222.0.69 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.043280 Aug 27 03:07:17.384349 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 7/9] 10.222.0.69 () {58 vars in 1185 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:17.389006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-506719ba-77d9-47ef-a9fc-42fe7291beb0 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:17.395581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-506719ba-77d9-47ef-a9fc-42fe7291beb0 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '62c89ce93d6647b292f9aa17e09d1757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce32cf68824f92a6af645a1f4d180e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-506719ba-77d9-47ef-a9fc-42fe7291beb0 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Request method failure captured: Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/flavors/448005102/os-extra_specs HTTP/1.1 Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 66 Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpflYrcfTclvHP9EFEqdy3PiVfk9E7W9VVxrh8TAU35lbJQOOYMwZCRrlejhS_gmA-MMasSDe1LReVhK4WMZTx11MRvdPamZ2U6-nDke2rLY7kUsL-932iBIJYw9aglBIT77xUG8FM7qsrRctxFiGeKNc57JVP48RSNskXWTEkrce8 Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:07:17.400579 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0bce32cf68824f92a6af645a1f4d180e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}] Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 62c89ce93d6647b292f9aa17e09d1757 Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 27 03:07:17.401741 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'flavor_id': '448005102', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:07:17.402734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 03:07:17.403656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:17.405926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-506719ba-77d9-47ef-a9fc-42fe7291beb0 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:17.408940 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-506719ba-77d9-47ef-a9fc-42fe7291beb0 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] 10.222.0.69 "POST /compute/v2.1/flavors/448005102/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023282 Aug 27 03:07:17.414368 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 8/10] 10.222.0.69 () {60 vars in 1221 bytes} [Sat Aug 27 03:07:17 2022] POST /compute/v2.1/flavors/448005102/os-extra_specs => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:17.420074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45d043f70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.422701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.423463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.424438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.447229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.447717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.448158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.461909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.462448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.463002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.471671 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce69f13b-a774-445f-ad51-0c753e5ccbc2 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.055423 Aug 27 03:07:17.472590 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 9/11] 10.222.0.69 () {58 vars in 1167 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:17.477518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-09496a00-0e73-4a55-a608-3c9fbf743220 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.522828 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-09496a00-0e73-4a55-a608-3c9fbf743220 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.048642 Aug 27 03:07:17.523848 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 10/12] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:17.529642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b172b805-75da-4fe6-86d0-174f82493b2e tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.550383 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b172b805-75da-4fe6-86d0-174f82493b2e tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.025319 Aug 27 03:07:17.554673 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 11/13] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:17.562236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b94df4f8-43b2-4978-b3f7-9b7084b1c206 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:17.634474 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b94df4f8-43b2-4978-b3f7-9b7084b1c206 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/448005102/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078115 Aug 27 03:07:17.635513 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 12/14] 10.222.0.69 () {60 vars in 1221 bytes} [Sat Aug 27 03:07:17 2022] POST /compute/v2.1/flavors/448005102/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:07:17.647720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45d883280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.649763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.649940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.657080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.687702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.688863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.689309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.717878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.718392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.719424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.740319 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6fa076c-5679-4a2e-b254-e1f1f55dbc37 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.103527 Aug 27 03:07:17.748382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 13/15] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:17.756926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-305d5d58-da62-45de-b776-5d2848bcd034 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-750819975", "id": 1490595605, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:17.791335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-305d5d58-da62-45de-b776-5d2848bcd034 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.041519 Aug 27 03:07:17.800122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 14/16] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:17 2022] POST /compute/v2.1/flavors => generated 416 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:17.806034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-93125a54-ae7a-48d3-9f50-8033512005fb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:17.822249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93125a54-ae7a-48d3-9f50-8033512005fb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.823006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93125a54-ae7a-48d3-9f50-8033512005fb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.823613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93125a54-ae7a-48d3-9f50-8033512005fb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.973263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:07:18.587131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:18.587694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:18.588011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:18.588419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:18.588831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:18.603527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.605965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.606692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.607476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.607930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.608360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.664631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Getting quotas for project c3bdab40b75c404eb968ed2afcc229f8. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:18.672860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Getting quotas for user a408d7b8e4104665b0223a81a73e0dfd and project c3bdab40b75c404eb968ed2afcc229f8. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:18.687032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:18.690726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:18.827987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22152067-62fe-47d5-8a87-e8338a83909d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.034547 Aug 27 03:07:18.830370 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3/17] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:07:18.841147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57a72431-7fb3-4fef-ad24-0908bb02837c tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:18.844163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57a72431-7fb3-4fef-ad24-0908bb02837c tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '62c89ce93d6647b292f9aa17e09d1757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce32cf68824f92a6af645a1f4d180e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57a72431-7fb3-4fef-ad24-0908bb02837c tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Request method failure captured: Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpflYrcfTclvHP9EFEqdy3PiVfk9E7W9VVxrh8TAU35lbJQOOYMwZCRrlejhS_gmA-MMasSDe1LReVhK4WMZTx11MRvdPamZ2U6-nDke2rLY7kUsL-932iBIJYw9aglBIT77xUG8FM7qsrRctxFiGeKNc57JVP48RSNskXWTEkrce8 Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:07:18.856536 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0bce32cf68824f92a6af645a1f4d180e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}] Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 62c89ce93d6647b292f9aa17e09d1757 Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:07:18.857895 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'flavor_id': '448005102', 'id': 'hw:numa_nodes'} Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:07:18.858611 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 03:07:18.860025 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:18.864495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57a72431-7fb3-4fef-ad24-0908bb02837c tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:18.865475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57a72431-7fb3-4fef-ad24-0908bb02837c tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] 10.222.0.69 "DELETE /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.033537 Aug 27 03:07:18.866714 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 4/18] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:07:18 2022] DELETE /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:18.876521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45d068820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:18.879339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.879572 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-93125a54-ae7a-48d3-9f50-8033512005fb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 311 microversion: 2.1 time: 1.076773 Aug 27 03:07:18.881281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.882096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.887072 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 15/19] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:07:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 311 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:18.905448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:18.906304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:18.908504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.909909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-94fddff8-14e8-4d1a-8ec5-88db4b29af87 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:18.916579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74db3f1f-5d40-48f8-81ea-75158ee60cec tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.048654 Aug 27 03:07:18.917485 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 5/20] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:07:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:18.960848 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-94fddff8-14e8-4d1a-8ec5-88db4b29af87 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5799 microversion: 2.1 time: 0.070200 Aug 27 03:07:18.983948 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 16/21] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:18 2022] GET /compute/v2.1/flavors/detail => generated 5799 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:18.983948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59a48f84-b745-4c15-bba0-1a6662aa630a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:18.983948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59a48f84-b745-4c15-bba0-1a6662aa630a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:19.214578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee57b5ef-7fe9-411e-9f50-8dd645e448d9 tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1599034075", "id": 1436103987, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:19.292932 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee57b5ef-7fe9-411e-9f50-8dd645e448d9 tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.372279 Aug 27 03:07:19.296211 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 6/22] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:07:18 2022] POST /compute/v2.1/flavors => generated 468 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:19.301119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bbde4d8-c179-40ea-b342-0bb50749aeff tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:19.390002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bbde4d8-c179-40ea-b342-0bb50749aeff tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/448005102/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.092502 Aug 27 03:07:19.391018 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 7/23] 10.222.0.69 () {60 vars in 1221 bytes} [Sat Aug 27 03:07:19 2022] POST /compute/v2.1/flavors/448005102/os-extra_specs => generated 66 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:07:19.399943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0d00d64-4455-4c80-bb12-94b26143bbc8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45d9554c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:19.403356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0d00d64-4455-4c80-bb12-94b26143bbc8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.403872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0d00d64-4455-4c80-bb12-94b26143bbc8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.404325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0d00d64-4455-4c80-bb12-94b26143bbc8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.449258 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0d00d64-4455-4c80-bb12-94b26143bbc8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.054365 Aug 27 03:07:19.451590 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 8/24] 10.222.0.69 () {58 vars in 1179 bytes} [Sat Aug 27 03:07:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:19.466215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2d61b9c-ff69-4114-b188-157dab03b34b tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:19.537482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2d61b9c-ff69-4114-b188-157dab03b34b tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1490595605" status: 202 len: 0 microversion: 2.1 time: 0.084185 Aug 27 03:07:19.541333 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 9/25] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:07:19 2022] DELETE /compute/v2.1/flavors/1490595605 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:19.606553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59a48f84-b745-4c15-bba0-1a6662aa630a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:19.646296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59a48f84-b745-4c15-bba0-1a6662aa630a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1218 microversion: 2.1 time: 0.682813 Aug 27 03:07:19.658522 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 17/26] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:18 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1218 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:19.821666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1108060561", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "availability_zone": "tempest-test_az-92378382"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:19.842148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.842917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.843505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.845402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.846035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.846798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.956933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:07:20.088645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e61bb035-74ad-4885-8488-c7ba9bbfe5cb tempest-FlavorsV261TestJSON-1115071669 tempest-FlavorsV261TestJSON-1115071669-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.129259 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e61bb035-74ad-4885-8488-c7ba9bbfe5cb tempest-FlavorsV261TestJSON-1115071669 tempest-FlavorsV261TestJSON-1115071669-project] 10.222.0.69 "GET /compute/v2.1/flavors/1436103987" status: 200 len: 468 microversion: 2.61 time: 0.479172 Aug 27 03:07:20.129836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 18/27] 10.222.0.69 () {60 vars in 1199 bytes} [Sat Aug 27 03:07:19 2022] GET /compute/v2.1/flavors/1436103987 => generated 468 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:20.146739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe940e4c-203b-45b7-9c17-b7912d417ca4 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:20.150012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fe940e4c-203b-45b7-9c17-b7912d417ca4 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '62c89ce93d6647b292f9aa17e09d1757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bce32cf68824f92a6af645a1f4d180e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe940e4c-203b-45b7-9c17-b7912d417ca4 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Request method failure captured: Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 22 Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpflYrcfTclvHP9EFEqdy3PiVfk9E7W9VVxrh8TAU35lbJQOOYMwZCRrlejhS_gmA-MMasSDe1LReVhK4WMZTx11MRvdPamZ2U6-nDke2rLY7kUsL-932iBIJYw9aglBIT77xUG8FM7qsrRctxFiGeKNc57JVP48RSNskXWTEkrce8 Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:07:20.152862 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0bce32cf68824f92a6af645a1f4d180e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0bce32cf68824f92a6af645a1f4d180e"}]}] Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0bce32cf68824f92a6af645a1f4d180e Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 62c89ce93d6647b292f9aa17e09d1757 Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: {"hw:numa_nodes": "1"} Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:07:20.153923 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'flavor_id': '448005102', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:07:20.154620 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 03:07:20.155574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.157793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe940e4c-203b-45b7-9c17-b7912d417ca4 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:20.159661 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fe940e4c-203b-45b7-9c17-b7912d417ca4 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989 tempest-FlavorsExtraSpecsNegativeTestJSON-788771989-project] 10.222.0.69 "PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017013 Aug 27 03:07:20.160629 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 19/28] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:07:20 2022] PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:20.168847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45cf3bc10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.171238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.172797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.173644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.206395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.208939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.210761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.238292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.242064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.243977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.259892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e6d41f8a-a7f4-4e37-af05-a62b379980af tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092843 Aug 27 03:07:20.263291 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 20/29] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:20.269606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:20.270035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:20.270629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:20.271204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:20.271628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:20.276864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9fbd390-06c0-4508-a231-2e810d73b753 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.293055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.293542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.293984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.295997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.296618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.298689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.317895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9fbd390-06c0-4508-a231-2e810d73b753 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.053077 Aug 27 03:07:20.318733 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 21/30] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:20.328302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e3ea0a0-1453-492a-bc46-afce42ce1e8c tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] Action: 'update', calling method: .version_select at 0x7fe45de9b0d0>, body: {"flavor": {"description": "new"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:20.351155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Getting quotas for project d2e8227a74394648bb22269c12712a97. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:20.362813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Getting quotas for user d76cf7013697454098207ea971e8f64d and project d2e8227a74394648bb22269c12712a97. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:20.387927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:20.390426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:20.404432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e3ea0a0-1453-492a-bc46-afce42ce1e8c tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/1436103987" status: 200 len: 469 microversion: 2.61 time: 0.084441 Aug 27 03:07:20.405817 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 22/31] 10.222.0.69 () {62 vars in 1219 bytes} [Sat Aug 27 03:07:20 2022] PUT /compute/v2.1/flavors/1436103987 => generated 469 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:20.428394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d95a3484-d5b9-421b-a5aa-47efed814cb0 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.446206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d95a3484-d5b9-421b-a5aa-47efed814cb0 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] HTTP exception thrown: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d95a3484-d5b9-421b-a5aa-47efed814cb0 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Request method failure captured: Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/flavors/448005102/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYphuvrehOIT6qfEtSmACx2tjfn45wITqzbC5mLkoLXbrJkHmsLeALxb4BJuL8Rc8YgxSA-nDKUNqpUATOygWkj3uCLGENAym64LiYynJTUCqJLmFTC7fje3OP0yjvxZu9UtJbixKyzzmrtGBiT3MILdqOTMr487umkW3Z3ZA9mtnvA Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0b6f450754924163a693619be6859c00 Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:07:20.449493 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0b6f450754924163a693619be6859c00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b6f450754924163a693619be6859c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0b6f450754924163a693619be6859c00", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b6f450754924163a693619be6859c00"}]}] Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0b6f450754924163a693619be6859c00 Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 253d9e7da61042d398f610b7a3d30c5d Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:07:20.450902 n-d-852086-5 devstack@n-api.service[122407]: exception: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'flavor_id': '448005102', 'id': 'hw:cpu_thread_policy'} Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:20.451610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.452847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d95a3484-d5b9-421b-a5aa-47efed814cb0 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Returning 404 to user: Flavor 448005102 has no extra specs with key hw:cpu_thread_policy. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:20.453371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d95a3484-d5b9-421b-a5aa-47efed814cb0 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/448005102/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.043693 Aug 27 03:07:20.456055 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 23/32] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:07:20 2022] DELETE /compute/v2.1/flavors/448005102/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:20.467394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45cf3baf0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.474996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.477591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.478601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.505631 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-226c4249-2ce9-49a6-9764-4bfdceba1588 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964841 Aug 27 03:07:20.508994 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 10/33] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:07:20.533438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfec3bfb-96c8-4df9-9464-e7149669ba5e tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-235263638", "id": 363915003, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:20.552991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:20.559826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.564708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.566043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.587767 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-452e3694-3150-4307-9853-6df48afd9bef tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.126383 Aug 27 03:07:20.592445 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 24/34] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:20.597362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8bf01b6-b392-4377-badb-2d720becfbc6 tempest-FlavorsV261TestJSON-1115071669 tempest-FlavorsV261TestJSON-1115071669-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.604734 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfec3bfb-96c8-4df9-9464-e7149669ba5e tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.087482 Aug 27 03:07:20.609287 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 11/35] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:20 2022] POST /compute/v2.1/flavors => generated 425 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:20.618142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76565881-3cb2-483c-a7c0-d0b3e445c979 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:20.632815 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-76565881-3cb2-483c-a7c0-d0b3e445c979 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76565881-3cb2-483c-a7c0-d0b3e445c979 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Request method failure captured: Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: request: PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 27 Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYphuvrehOIT6qfEtSmACx2tjfn45wITqzbC5mLkoLXbrJkHmsLeALxb4BJuL8Rc8YgxSA-nDKUNqpUATOygWkj3uCLGENAym64LiYynJTUCqJLmFTC7fje3OP0yjvxZu9UtJbixKyzzmrtGBiT3MILdqOTMr487umkW3Z3ZA9mtnvA Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0b6f450754924163a693619be6859c00 Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:07:20.637446 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0b6f450754924163a693619be6859c00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b6f450754924163a693619be6859c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0b6f450754924163a693619be6859c00", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b6f450754924163a693619be6859c00"}]}] Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0b6f450754924163a693619be6859c00 Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 253d9e7da61042d398f610b7a3d30c5d Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: {"hw:cpu_policy": "shared"} Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:07:20.639214 n-d-852086-5 devstack@n-api.service[122408]: exception: Request body and URI mismatch Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'flavor_id': '448005102', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.639917 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.640884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:20.640884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:20.640884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 27 03:07:20.640884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.645234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76565881-3cb2-483c-a7c0-d0b3e445c979 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:20.649269 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76565881-3cb2-483c-a7c0-d0b3e445c979 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.037855 Aug 27 03:07:20.650816 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 12/36] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:07:20 2022] PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:07:20.665382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2433a61-27ad-435b-87f9-6cee6fcaf94e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.669836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2433a61-27ad-435b-87f9-6cee6fcaf94e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:20.700387 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f8bf01b6-b392-4377-badb-2d720becfbc6 tempest-FlavorsV261TestJSON-1115071669 tempest-FlavorsV261TestJSON-1115071669-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 7194 microversion: 2.61 time: 0.106597 Aug 27 03:07:20.702389 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 25/37] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/flavors/detail => generated 7194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:20.724660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45d91c5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.726502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.727055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.727502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.760076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.760760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.761381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.773706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-009aed3e-a538-463c-b767-9498120ca219 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.068272 Aug 27 03:07:20.774989 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 26/38] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:20.780038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54ec6541-b1d0-4d96-8d02-5e2143e8671f tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.805125 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54ec6541-b1d0-4d96-8d02-5e2143e8671f tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/363915003" status: 202 len: 0 microversion: 2.1 time: 0.028665 Aug 27 03:07:20.806439 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 27/39] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:07:20 2022] DELETE /compute/v2.1/flavors/363915003 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:20.819216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f1a108b-e8f1-4ffa-a416-26154bdf2d7f tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f1a108b-e8f1-4ffa-a416-26154bdf2d7f tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Request method failure captured: Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 49 Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYphuvrehOIT6qfEtSmACx2tjfn45wITqzbC5mLkoLXbrJkHmsLeALxb4BJuL8Rc8YgxSA-nDKUNqpUATOygWkj3uCLGENAym64LiYynJTUCqJLmFTC7fje3OP0yjvxZu9UtJbixKyzzmrtGBiT3MILdqOTMr487umkW3Z3ZA9mtnvA Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0b6f450754924163a693619be6859c00 Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:07:20.825364 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0b6f450754924163a693619be6859c00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b6f450754924163a693619be6859c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0b6f450754924163a693619be6859c00", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0b6f450754924163a693619be6859c00"}]}] Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0b6f450754924163a693619be6859c00 Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 253d9e7da61042d398f610b7a3d30c5d Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 27 03:07:20.826607 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'flavor_id': '448005102', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance: Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 27 03:07:20.827228 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.828307 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:20.829957 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:20.829957 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:20.829957 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:07:20.829957 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:07:20.829957 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 03:07:20.829957 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:20.832680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f1a108b-e8f1-4ffa-a416-26154bdf2d7f tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:20.834495 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f1a108b-e8f1-4ffa-a416-26154bdf2d7f tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026643 Aug 27 03:07:20.836195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 28/40] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:07:20 2022] PUT /compute/v2.1/flavors/448005102/os-extra_specs/hw:numa_nodes => generated 117 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:07:20.855321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2433a61-27ad-435b-87f9-6cee6fcaf94e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:20.867434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.871377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:20.884436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2433a61-27ad-435b-87f9-6cee6fcaf94e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1241 microversion: 2.1 time: 0.230312 Aug 27 03:07:20.894315 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 13/41] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1241 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:20.896242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc3ccaa4-2a6d-45c6-a0cb-dcef750377b9 tempest-FlavorsV261TestJSON-1115071669 tempest-FlavorsV261TestJSON-1115071669-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:20.901749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.904625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.905680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.906107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:20.906887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:20.916187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:20.994588 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc3ccaa4-2a6d-45c6-a0cb-dcef750377b9 tempest-FlavorsV261TestJSON-1115071669 tempest-FlavorsV261TestJSON-1115071669-project] 10.222.0.69 "GET /compute/v2.1/flavors" status: 200 len: 3406 microversion: 2.61 time: 0.105902 Aug 27 03:07:21.006631 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 14/42] 10.222.0.69 () {60 vars in 1166 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/flavors => generated 3406 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:21.006631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Calling method '.version_select at 0x7fe45cf805e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.006631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.008000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.010828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.049925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.057229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.059229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.093685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.094231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.095098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.104617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:07:21.104735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51e8e7e0-4d56-47ac-97d0-1119065a4ce8 tempest-HypervisorAdminTestJSON-1680138174 tempest-HypervisorAdminTestJSON-1680138174-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:07:21.105765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.108672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.109153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.110517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.111094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.111526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.129677 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.rpcapi [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 03:07:21.130632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] Releasing lock "compute-rpcapi-router" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:07:21.176282 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2609720-d9d9-46ed-86eb-935e3c0a1643 None None] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.178960 Aug 27 03:07:21.177649 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 15/43] 10.222.0.69 () {58 vars in 1173 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:21.208263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-baeed6cd-784a-4b24-92bb-6a211be91f0c tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.307704 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-baeed6cd-784a-4b24-92bb-6a211be91f0c tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.127665 Aug 27 03:07:21.318958 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 16/44] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.334591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b63afa2d-e421-404b-98ee-c075cbb55433 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.378900 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b63afa2d-e421-404b-98ee-c075cbb55433 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/448005102" status: 202 len: 0 microversion: 2.1 time: 0.058586 Aug 27 03:07:21.380334 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 17/45] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:07:21 2022] DELETE /compute/v2.1/flavors/448005102 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:21.388730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-208573df-472f-428a-b135-f1195678fb73 tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.396544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:21.431938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-208573df-472f-428a-b135-f1195678fb73 tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1436103987" status: 202 len: 0 microversion: 2.61 time: 0.050151 Aug 27 03:07:21.432902 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 18/46] 10.222.0.69 () {60 vars in 1202 bytes} [Sat Aug 27 03:07:21 2022] DELETE /compute/v2.1/flavors/1436103987 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:21.434525 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02a03e01-317e-4ada-9e9a-3b5adfd819b8 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1234 microversion: 2.1 time: 0.596770 Aug 27 03:07:21.436832 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 29/47] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:20 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1234 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.443791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9688c385-7ab8-473a-b929-f32016810827 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.454885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd379835-798e-44f2-af31-e6c290af0960 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-450065668", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:21.481147 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9688c385-7ab8-473a-b929-f32016810827 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267 tempest-FlavorsExtraSpecsNegativeTestJSON-354284267-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042071 Aug 27 03:07:21.483036 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 30/48] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.491704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51b07871-b720-433a-8ca7-e2d292d5dcff tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.497632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:21.504851 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd379835-798e-44f2-af31-e6c290af0960 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.070707 Aug 27 03:07:21.514023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 19/49] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:21 2022] POST /compute/v2.1/flavors => generated 506 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:21.527201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a454503-57ac-4628-8858-556aa8f1dfa2 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.536523 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51b07871-b720-433a-8ca7-e2d292d5dcff tempest-FlavorsV261TestJSON-92341992 tempest-FlavorsV261TestJSON-92341992-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6327 microversion: 2.61 time: 0.051551 Aug 27 03:07:21.538197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 31/50] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/flavors/detail => generated 6327 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:21.583012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a454503-57ac-4628-8858-556aa8f1dfa2 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/68215c86-d01b-44ae-88b7-882bff39823a" status: 202 len: 0 microversion: 2.1 time: 0.064948 Aug 27 03:07:21.583588 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 20/51] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:21 2022] DELETE /compute/v2.1/flavors/68215c86-d01b-44ae-88b7-882bff39823a => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:21.592956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e9db719-13ce-469e-a9df-59f634c18e63 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.642424 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e9db719-13ce-469e-a9df-59f634c18e63 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048656 Aug 27 03:07:21.643486 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 32/52] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.665092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a17a899b-fad6-4225-b60a-8d0ef940e059 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-306608627", "id": "33655d4f-e2c0-4492-9ad3-f74f0ea4cd42", "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:21.706226 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a17a899b-fad6-4225-b60a-8d0ef940e059 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.044744 Aug 27 03:07:21.720496 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 21/53] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:21 2022] POST /compute/v2.1/flavors => generated 506 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:21.733631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14c91bc4-82f8-48db-9df4-1c75fa8bd17b tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.774875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14c91bc4-82f8-48db-9df4-1c75fa8bd17b tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/33655d4f-e2c0-4492-9ad3-f74f0ea4cd42" status: 202 len: 0 microversion: 2.1 time: 0.045118 Aug 27 03:07:21.784193 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 33/54] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:21 2022] DELETE /compute/v2.1/flavors/33655d4f-e2c0-4492-9ad3-f74f0ea4cd42 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:21.792262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-288c168f-2d9e-4b2f-9b5f-3f7b82692e7d tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.832965 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-288c168f-2d9e-4b2f-9b5f-3f7b82692e7d tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043991 Aug 27 03:07:21.841934 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 22/55] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.862756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-43a7342d-1d63-4f76-994d-c9e05fb9f85a tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-64702378", "id": 1388884561, "os-flavor-access:is_public": "True"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:21.908338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a618dd02-c031-4f51-9101-7d381cb69354 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.909137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a618dd02-c031-4f51-9101-7d381cb69354 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:21.917969 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-43a7342d-1d63-4f76-994d-c9e05fb9f85a tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.058002 Aug 27 03:07:21.923112 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 34/56] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:21 2022] POST /compute/v2.1/flavors => generated 412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:21.943163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84ed3735-973f-45ff-a251-b6828526dbda tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.967691 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84ed3735-973f-45ff-a251-b6828526dbda tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1388884561" status: 200 len: 412 microversion: 2.1 time: 0.038214 Aug 27 03:07:21.977141 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 35/57] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/flavors/1388884561 => generated 412 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:07:22.331477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a618dd02-c031-4f51-9101-7d381cb69354 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:22.352311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a618dd02-c031-4f51-9101-7d381cb69354 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1241 microversion: 2.1 time: 0.442991 Aug 27 03:07:22.367699 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 23/58] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1241 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:22.458523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.459350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:22.466873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e73db970-f5a9-4e52-8d96-74f130a1725c tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.482651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.485735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.487493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.490099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.492533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.493166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.521835 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e73db970-f5a9-4e52-8d96-74f130a1725c tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.541056 Aug 27 03:07:22.523689 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 36/59] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:22.549525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e76bef2-38b4-46b5-a9a0-3712b2645121 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.609373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e76bef2-38b4-46b5-a9a0-3712b2645121 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1388884561" status: 202 len: 0 microversion: 2.1 time: 0.063674 Aug 27 03:07:22.612944 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 37/60] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:07:22 2022] DELETE /compute/v2.1/flavors/1388884561 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:22.632350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2180edd7-5a82-4500-8d92-775163150079 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.687805 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2180edd7-5a82-4500-8d92-775163150079 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063489 Aug 27 03:07:22.688691 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 38/61] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:22.707961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51af571e-6058-4672-9dc4-1bf22df3f3cc tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-335216608", "id": 1692056647, "os-flavor-access:is_public": "False"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:22.744432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51af571e-6058-4672-9dc4-1bf22df3f3cc tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.041126 Aug 27 03:07:22.746512 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 39/62] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:22 2022] POST /compute/v2.1/flavors => generated 429 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:22.758198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35a1dc93-30a9-4605-be5f-38e6c4edac3b tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "1692056647"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:22.811348 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-35a1dc93-30a9-4605-be5f-38e6c4edac3b tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] HTTP exception thrown: Flavor 1692056647 could not be found. Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35a1dc93-30a9-4605-be5f-38e6c4edac3b tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] Request method failure captured: Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 107 Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpg-ItJpvq62Kb-Px56Vnp4hKyThPhhb1DajBzty0SQXcNtS6WO6xhthyFinDnb_0J4iPQu-Oc1jgcZKRwBazV3MYk3vUifPxkWi3zjIk_7fyO7l-3SameU5s6mQW6f1ApjAXIuFXc8kjwHydFnaieZ8cf_SOLPEkwrNyqQlMry2tQ Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: e2acf6a06ef94b929daccc2965794a24 Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FlavorsAdminTestJSON-957621149 Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:07:22.821700 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e2acf6a06ef94b929daccc2965794a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e2acf6a06ef94b929daccc2965794a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e2acf6a06ef94b929daccc2965794a24", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e2acf6a06ef94b929daccc2965794a24"}]}] Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FlavorsAdminTestJSON-957621149 Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: e2acf6a06ef94b929daccc2965794a24 Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-957621149 Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FlavorsAdminTestJSON-957621149-project Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: eaf954def6324962906ed08c2959c11a Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FlavorsAdminTestJSON-957621149-project Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "test", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "1692056647"}} Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:07:22.824838 n-d-852086-5 devstack@n-api.service[122407]: exception: Flavor 1692056647 could not be found. Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '1692056647'}}} Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1692056647 could not be found. Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:22.825532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1692056647 could not be found. Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:22.832264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:22.838667 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:22.838667 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:22.838667 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:22.838667 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1692056647 could not be found. Aug 27 03:07:22.838667 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:22.838667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35a1dc93-30a9-4605-be5f-38e6c4edac3b tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] Returning 400 to user: Flavor 1692056647 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:22.838667 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35a1dc93-30a9-4605-be5f-38e6c4edac3b tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.080573 Aug 27 03:07:22.839946 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 40/63] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:22 2022] POST /compute/v2.1/servers => generated 81 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:07:22.847853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8096b5e6-7f5e-46e4-8049-6271b1ceeb02 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.877768 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8096b5e6-7f5e-46e4-8049-6271b1ceeb02 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1692056647" status: 202 len: 0 microversion: 2.1 time: 0.036065 Aug 27 03:07:22.879074 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 41/64] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:07:22 2022] DELETE /compute/v2.1/flavors/1692056647 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:22.887429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a32f3e0-0a22-46b1-b7f5-78262a30ed16 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.946943 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a32f3e0-0a22-46b1-b7f5-78262a30ed16 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063851 Aug 27 03:07:22.948253 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 42/65] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:22.973057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-57b308d8-2f35-408b-94b7-341bfa5aa177 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1086697984", "id": 1852861318, "os-flavor-access:is_public": "False"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:23.037307 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-57b308d8-2f35-408b-94b7-341bfa5aa177 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.072837 Aug 27 03:07:23.038047 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 43/66] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:22 2022] POST /compute/v2.1/flavors => generated 415 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:23.053461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dcb13e1-7b4f-4b22-9d22-681dd89a0dab tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-394305486", "id": 2008093738, "os-flavor-access:is_public": "True"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:23.089244 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9dcb13e1-7b4f-4b22-9d22-681dd89a0dab tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.037311 Aug 27 03:07:23.100175 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 44/67] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:23 2022] POST /compute/v2.1/flavors => generated 413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:23.105812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2b51ce7-95e6-49a4-9bb6-26679184abd2 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.140114 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2b51ce7-95e6-49a4-9bb6-26679184abd2 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.038671 Aug 27 03:07:23.140699 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 45/68] 10.222.0.69 () {58 vars in 1169 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:23.154648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8cfbf17f-fe68-4caf-8017-19a741366aca tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.200430 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8cfbf17f-fe68-4caf-8017-19a741366aca tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.049323 Aug 27 03:07:23.208862 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 46/69] 10.222.0.69 () {58 vars in 1177 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:23.214444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b8b0484-e286-4f67-9686-dd77ed0fbd26 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.226355 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b8b0484-e286-4f67-9686-dd77ed0fbd26 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.015831 Aug 27 03:07:23.227622 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 47/70] 10.222.0.69 () {58 vars in 1171 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:23.244199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-855f9b79-7352-4710-a37d-aaba9fe300c9 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.244924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:23.264655 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-855f9b79-7352-4710-a37d-aaba9fe300c9 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.026556 Aug 27 03:07:23.266128 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 48/71] 10.222.0.69 () {58 vars in 1169 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:23.284839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2869f723-74ac-40de-bfe9-4198763e2925 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.300927 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-131df9c3-5c04-424b-bb96-170d9616463a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1296 microversion: 2.1 time: 0.847643 Aug 27 03:07:23.301533 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 24/72] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:22 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1296 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:23.316882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2869f723-74ac-40de-bfe9-4198763e2925 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.038769 Aug 27 03:07:23.318736 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 49/73] 10.222.0.69 () {58 vars in 1169 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:23.346644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-420fc314-213d-43e8-87b1-d254b6a401c6 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.387026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.387638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:23.404598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.405587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.406334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.407738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.409262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.412425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.431047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-420fc314-213d-43e8-87b1-d254b6a401c6 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.096482 Aug 27 03:07:23.431992 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 25/74] 10.222.0.69 () {58 vars in 1175 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:23.450492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-224721b0-d102-4ceb-9c6d-a48ff2a925cb tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.499072 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-224721b0-d102-4ceb-9c6d-a48ff2a925cb tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.052164 Aug 27 03:07:23.499676 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 26/75] 10.222.0.69 () {58 vars in 1173 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:23.522474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b29c47df-46c8-4503-810c-1da02dabc379 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.557622 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b29c47df-46c8-4503-810c-1da02dabc379 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.038736 Aug 27 03:07:23.558581 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 27/76] 10.222.0.69 () {58 vars in 1169 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:23.577692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd9b4c23-c069-4ac9-8c93-d7e60f0aab46 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.624095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:23.635396 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed154c06-3ccf-489c-997f-368a1068f1f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1289 microversion: 2.1 time: 0.251076 Aug 27 03:07:23.642753 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 50/77] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1289 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:23.649150 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd9b4c23-c069-4ac9-8c93-d7e60f0aab46 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/2008093738" status: 202 len: 0 microversion: 2.1 time: 0.075926 Aug 27 03:07:23.649977 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 28/78] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:07:23 2022] DELETE /compute/v2.1/flavors/2008093738 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:23.659657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff6c96a2-5f53-4b1c-870e-ad07fb50ef3c tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.719723 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff6c96a2-5f53-4b1c-870e-ad07fb50ef3c tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062537 Aug 27 03:07:23.721726 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 51/79] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:23.737870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-698b37a9-daf8-4eb7-9728-766af04e35c9 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.774543 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-698b37a9-daf8-4eb7-9728-766af04e35c9 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1852861318" status: 202 len: 0 microversion: 2.1 time: 0.040781 Aug 27 03:07:23.775494 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 29/80] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:07:23 2022] DELETE /compute/v2.1/flavors/1852861318 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:23.787823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45df279f-f38a-4559-85e5-4423cbceea98 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.836625 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45df279f-f38a-4559-85e5-4423cbceea98 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056310 Aug 27 03:07:23.838136 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 52/81] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:23.864609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f361fe2-a0d4-43a7-a32d-bfa031ebe133 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-64452232", "id": 255447739, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:23.900533 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f361fe2-a0d4-43a7-a32d-bfa031ebe133 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.047401 Aug 27 03:07:23.903080 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 30/82] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:23 2022] POST /compute/v2.1/flavors => generated 410 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:23.915961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dab8011b-2722-46bc-be83-db9353fd2bf1 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.954395 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dab8011b-2722-46bc-be83-db9353fd2bf1 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041619 Aug 27 03:07:23.955628 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 53/83] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:23.974905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-577b995f-ee19-474c-8180-75af8d050f6e tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.003542 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-577b995f-ee19-474c-8180-75af8d050f6e tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034389 Aug 27 03:07:24.004709 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 31/84] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:24.026083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a1a20a6-f8de-46f8-bde5-c9b93e1b56e8 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.083624 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a1a20a6-f8de-46f8-bde5-c9b93e1b56e8 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/255447739" status: 202 len: 0 microversion: 2.1 time: 0.061896 Aug 27 03:07:24.088696 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 54/85] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:07:24 2022] DELETE /compute/v2.1/flavors/255447739 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:24.096090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68e948c8-0f7a-42c3-8f62-64b68631649c tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.148092 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68e948c8-0f7a-42c3-8f62-64b68631649c tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057697 Aug 27 03:07:24.172123 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 32/86] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:24.222786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a7d1b011-3994-4be9-830b-b71688179ee7 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-432970872", "id": 1407487427, "os-flavor-access:is_public": "True"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:24.301086 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a7d1b011-3994-4be9-830b-b71688179ee7 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.098046 Aug 27 03:07:24.303611 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 55/87] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:24 2022] POST /compute/v2.1/flavors => generated 413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:24.315957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dcc296e2-dd88-4f1f-9a85-a8ebe7916a1e tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.330881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.334146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:24.366708 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dcc296e2-dd88-4f1f-9a85-a8ebe7916a1e tempest-FlavorsAdminTestJSON-957621149 tempest-FlavorsAdminTestJSON-957621149-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.054739 Aug 27 03:07:24.370884 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 33/88] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:24.383426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.384208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.386878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.387736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.388218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.390417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d5ca0c4-f3c8-4ace-bdae-d2aea42a5ac1 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.397032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.441513 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d5ca0c4-f3c8-4ace-bdae-d2aea42a5ac1 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1407487427" status: 202 len: 0 microversion: 2.1 time: 0.055905 Aug 27 03:07:24.442780 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 34/89] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:07:24 2022] DELETE /compute/v2.1/flavors/1407487427 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:24.450594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cfc9fb2-25b4-4573-8920-eaf927712218 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.492599 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cfc9fb2-25b4-4573-8920-eaf927712218 tempest-FlavorsAdminTestJSON-2130824840 tempest-FlavorsAdminTestJSON-2130824840-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045746 Aug 27 03:07:24.496159 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 35/90] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:24.667238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:24.667987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:24.678905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.682780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.686533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.687529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:24.689672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:24.691357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.810196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:24.826890 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d47ec19-a7ae-4939-9b36-ca0263ffb8d5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1296 microversion: 2.1 time: 0.504583 Aug 27 03:07:24.833433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 56/91] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1296 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:25.370817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:25.384961 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d2d59a9-3ca9-4c75-889b-f0a7763b57a7 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1295 microversion: 2.1 time: 0.721728 Aug 27 03:07:25.385730 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 36/92] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:24 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1295 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:25.855905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:25.858278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:25.879106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.882561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.886698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.887806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.889480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.892982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.135304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55f2be3e-cbbc-4038-8085-1f5c62dcb258 tempest-AZAdminNegativeTestJSON-316158154 tempest-AZAdminNegativeTestJSON-316158154-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:26.138215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-55f2be3e-cbbc-4038-8085-1f5c62dcb258 tempest-AZAdminNegativeTestJSON-316158154 tempest-AZAdminNegativeTestJSON-316158154-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'cebb1a2ef1e3482ab1c9dd254a2c27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d997b543dec4edc8a99944ff65adb88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55f2be3e-cbbc-4038-8085-1f5c62dcb258 tempest-AZAdminNegativeTestJSON-316158154 tempest-AZAdminNegativeTestJSON-316158154-project] Request method failure captured: Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpr_Ala7huQNKcFLFpgDvfGstZGzQMQUK4VIcsddIeo-0DgNslV-jCM5jLDaXLXss5NBOEAXVfY354YhRpJTJxqqR8Ki33JEee-8BvMz6ovGniebQ9QdBoSmIFSmJSpnxitc0bkzzIsTm1BgkAihm6csQXtJjcwMTUj9w2lyNv7ftE Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 2d997b543dec4edc8a99944ff65adb88 Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AZAdminNegativeTestJSON-316158154 Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:07:26.145824 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2d997b543dec4edc8a99944ff65adb88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d997b543dec4edc8a99944ff65adb88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2d997b543dec4edc8a99944ff65adb88", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d997b543dec4edc8a99944ff65adb88"}]}] Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AZAdminNegativeTestJSON-316158154 Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 2d997b543dec4edc8a99944ff65adb88 Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-316158154 Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AZAdminNegativeTestJSON-316158154-project Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: cebb1a2ef1e3482ab1c9dd254a2c27b2 Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AZAdminNegativeTestJSON-316158154-project Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 03:07:26.147540 n-d-852086-5 devstack@n-api.service[122407]: action_args: {} Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:07:26.148486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:26.151066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55f2be3e-cbbc-4038-8085-1f5c62dcb258 tempest-AZAdminNegativeTestJSON-316158154 tempest-AZAdminNegativeTestJSON-316158154-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:26.153162 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-55f2be3e-cbbc-4038-8085-1f5c62dcb258 tempest-AZAdminNegativeTestJSON-316158154 tempest-AZAdminNegativeTestJSON-316158154-project] 10.222.0.69 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.081311 Aug 27 03:07:26.153162 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 57/93] 10.222.0.69 () {58 vars in 1185 bytes} [Sat Aug 27 03:07:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1083 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:26.414716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:26.415980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:26.420298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:26.456569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.460599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.464984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.468657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.472255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.475312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.539818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:26.552872 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48afeed9-a2cb-4cb3-8b59-f30225637f1d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1296 microversion: 2.1 time: 0.701547 Aug 27 03:07:26.554972 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 37/94] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:25 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1296 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:27.007029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:27.029556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64bb02f6-f659-4f06-95a8-f740ed1c8696 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1295 microversion: 2.1 time: 0.619097 Aug 27 03:07:27.031290 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 58/95] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:26 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1295 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:27.576251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:27.576876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:27.589041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.593645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.594596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.603900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:27.604414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:27.605929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.054980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:28.055596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:28.057566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:28.075620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.075767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.079186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.080093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.080795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.081005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.830460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:28.844340 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f05e7207-d552-44ee-8c9d-5fac1f744ab2 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 1.271913 Aug 27 03:07:28.847914 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 38/96] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:27 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:29.635437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:29.870684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:29.871317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:29.885422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.885930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.886433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:29.887272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.887729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.914475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:29.944605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:29.963485 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-75f9c581-8b1d-4163-9be3-4c3311b998bf tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 1.903964 Aug 27 03:07:29.972060 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 59/97] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:28 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:30.700604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:30.717498 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b54b395-e53a-46f6-b6e4-04ebaa4a0dd5 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.850805 Aug 27 03:07:30.745019 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 39/98] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:29 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:30.998253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:30.999661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:31.016476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.039238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.040328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.041607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.042446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.045876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.742670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:31.743286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:31.754899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:31.758539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.760311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.765709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.766962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:31.768279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:31.771077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.142534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:32.165147 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9b655562-f8c7-47c6-821b-e045758f6dcd tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 1.162392 Aug 27 03:07:32.165936 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 60/99] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:30 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:32.339515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:32.367132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:32.404359 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08c83c78-300d-45ba-8a5f-3b7a2e2bd82b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.666296 Aug 27 03:07:32.410261 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 40/100] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:31 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:33.190775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:33.191562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:33.206108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.207162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.209646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.214834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.216231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.218698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.430854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:33.432761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:33.440538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.441041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.441482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.442227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.442688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.449183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:34.300174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:34.327515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:34.330058 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-367fc0c9-ff3a-4f05-a7c9-9728d10f862c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 1.144178 Aug 27 03:07:34.335165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 61/101] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:33 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:34.383501 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14847bb9-d47c-4045-956e-715753643610 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.944947 Aug 27 03:07:34.391891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 41/102] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:33 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:35.357580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:35.358419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:35.389907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.390441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.399212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.400124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.403711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.404163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.453012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Calling method '.version_select at 0x7fe45cdeca60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:35.455818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.456309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.456967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.489080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.489826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.491827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.558958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.559713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.560965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.570253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-97e71ec9-508c-4548-b179-5df51827944c tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.462952 Aug 27 03:07:35.571356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 62/103] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:35.578983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:35.580241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:35.596417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.596928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.597372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.598189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.598598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.599022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.430802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:36.456689 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1339ed5-354b-4073-9b1c-3a5077fdce65 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 1.103462 Aug 27 03:07:36.466964 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 42/104] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:35 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:36.472265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Calling method '.version_select at 0x7fe45ce44c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:36.482150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.483037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.483695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.532545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.539349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.539992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.628448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.629315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.629972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.650389 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74ac58cc-76ed-415a-9fbf-50e33ba11472 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/n-h2-852086-5/servers" status: 200 len: 275 microversion: 2.1 time: 0.181907 Aug 27 03:07:36.653741 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 43/105] 10.222.0.69 () {58 vars in 1212 bytes} [Sat Aug 27 03:07:36 2022] GET /compute/v2.1/os-hypervisors/n-h2-852086-5/servers => generated 275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:36.999688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:37.018564 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9b3eab65-7862-4b2f-8da4-75bc56aeb0dc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 1.445777 Aug 27 03:07:37.019664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 63/106] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:35 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:37.073225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ef7b0f53-c226-4b60-a697-b7f49fae08f8 req-e2066dd7-2933-4af3-ba51-f06ff39095ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f86c2d-e0c1-4a0a-be44-e628faecedb9", "tag": "3923b4b7-5ac4-4c24-a9ae-362676d42a1c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:37.135240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ef7b0f53-c226-4b60-a697-b7f49fae08f8 req-e2066dd7-2933-4af3-ba51-f06ff39095ed service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.143283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ef7b0f53-c226-4b60-a697-b7f49fae08f8 req-e2066dd7-2933-4af3-ba51-f06ff39095ed service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.144150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ef7b0f53-c226-4b60-a697-b7f49fae08f8 req-e2066dd7-2933-4af3-ba51-f06ff39095ed service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.223475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ef7b0f53-c226-4b60-a697-b7f49fae08f8 req-e2066dd7-2933-4af3-ba51-f06ff39095ed service nova] Creating event network-changed:3923b4b7-5ac4-4c24-a9ae-362676d42a1c for instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 on n-h2-852086-5 Aug 27 03:07:37.239443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ef7b0f53-c226-4b60-a697-b7f49fae08f8 req-e2066dd7-2933-4af3-ba51-f06ff39095ed service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.583084 Aug 27 03:07:37.249236 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 44/107] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.268837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Calling method '.version_select at 0x7fe45ceeb820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.271339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.282778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.286860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.367856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.368849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.369534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.389385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.390282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.391370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.400617 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba6b37b1-8574-4769-bd9d-0330203109ca tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.149401 Aug 27 03:07:37.401506 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 45/108] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.459783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-98a7de98-d151-4da4-957e-c904cb1ef533 tempest-InstanceUsageAuditLogTestJSON-1538340442 tempest-InstanceUsageAuditLogTestJSON-1538340442-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.510839 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-98a7de98-d151-4da4-957e-c904cb1ef533 tempest-InstanceUsageAuditLogTestJSON-1538340442 tempest-InstanceUsageAuditLogTestJSON-1538340442-project-admin] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 03:07:35" status: 200 len: 318 microversion: 2.1 time: 0.489743 Aug 27 03:07:37.526269 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 64/109] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2003%3A07%3A35 => generated 318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.535432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Calling method '.version_select at 0x7fe45cea34c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.541635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.550527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.554115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.647821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.648466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.648859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.665478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b61daf9d-8997-4a12-90de-91547b1cc7d7 tempest-HypervisorAdminUnderV252Test-1614120997 tempest-HypervisorAdminUnderV252Test-1614120997-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/n-h2-852086-5/search" status: 200 len: 104 microversion: 2.1 time: 0.137468 Aug 27 03:07:37.666701 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 65/110] 10.222.0.69 () {58 vars in 1209 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/os-hypervisors/n-h2-852086-5/search => generated 104 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.693201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.698643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:37.722408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.723308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.724078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.725817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.728600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.729464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.736024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:37.924876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e369878-23e5-4c6d-92a6-eff4cd64a4d9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.970667 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e369878-23e5-4c6d-92a6-eff4cd64a4d9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.563567 Aug 27 03:07:37.974691 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 46/111] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.985971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99ec1ae4-8d98-47be-9b2a-a4697314a4ef tempest-InstanceUsageAuditLogTestJSON-1538340442 tempest-InstanceUsageAuditLogTestJSON-1538340442-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:38.048018 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99ec1ae4-8d98-47be-9b2a-a4697314a4ef tempest-InstanceUsageAuditLogTestJSON-1538340442 tempest-InstanceUsageAuditLogTestJSON-1538340442-project-admin] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.070951 Aug 27 03:07:38.049349 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 47/112] 10.222.0.69 () {58 vars in 1185 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:38.101394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.115676 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7fa28f36-3cad-48c0-a472-7fab5dc550f8 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.445246 Aug 27 03:07:38.133934 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 66/113] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:38.146569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:38.147238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:38.155781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:38.157034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:38.157565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:38.159218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:38.159886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:38.160453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:38.409181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.430351 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6a5bf07-1967-45f1-811e-c09c8b99d02f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.293251 Aug 27 03:07:38.434930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 67/114] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:38 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:38.609726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7287ecda-ae58-43d6-be39-e94567465f3a tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1105184574", "id": 1930694512, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:38.637756 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7287ecda-ae58-43d6-be39-e94567465f3a tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.586765 Aug 27 03:07:38.638916 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 48/115] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:38 2022] POST /compute/v2.1/flavors => generated 425 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:38.652063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-563b91c1-4ac2-4181-876b-b25535a3562c tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:38.679948 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-563b91c1-4ac2-4181-876b-b25535a3562c tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032318 Aug 27 03:07:38.687369 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 68/116] 10.222.0.69 () {58 vars in 1182 bytes} [Sat Aug 27 03:07:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:07:38.705119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15a05cf5-782e-43bd-965e-d45b06a5323a tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-845411909", "id": 1730794779, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:38.753151 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15a05cf5-782e-43bd-965e-d45b06a5323a tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.053979 Aug 27 03:07:38.757145 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 49/117] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:38 2022] POST /compute/v2.1/flavors => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:38.769735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f3b7db32-9b5d-4bc1-8593-845b6ce62243 tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:38.785614 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f3b7db32-9b5d-4bc1-8593-845b6ce62243 tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020309 Aug 27 03:07:38.786755 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 69/118] 10.222.0.69 () {58 vars in 1182 bytes} [Sat Aug 27 03:07:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:07:38.807507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27dac6c4-47c5-4f10-8eff-db020d597611 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Action: 'create', calling method: .version_select at 0x7fe45cd74670>, body: {"keypair": {"name": "tempest-keypair-344888239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe7E5HYVO6rO+EkomHPB4ZuUk2FU7y9VKePoMgS2ezV5ogpCUW9NchqL7eDQwfx0BU4h2Z8Ld38yHJpq57x+5JK/GnNfTxXjabw9d/cPk7ujyqLHmmDwAGQGVmhImKM/Q=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:38.871461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-27dac6c4-47c5-4f10-8eff-db020d597611 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Getting quotas for project 1d3dc710fa9b46f889a756adbe3b0227. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:38.886963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-27dac6c4-47c5-4f10-8eff-db020d597611 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Getting quotas for user ae358d463a134431827d704089300d0c and project 1d3dc710fa9b46f889a756adbe3b0227. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:38.888771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:38.958414 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27dac6c4-47c5-4f10-8eff-db020d597611 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155961 Aug 27 03:07:38.961039 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 50/119] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:07:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:39.141448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:39.143322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:39.155227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.156122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.158715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.161399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.165546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.166998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.351161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-792961a4-fdc7-44e0-bec3-aea108de70c8 req-79afb80f-f914-4ed5-a7a0-cb84a2459458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a24b96-909e-41b4-99cb-b6f445ec32b5", "tag": "c79c35e8-bdbc-48d7-b175-49d57fd168cd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:39.371811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-792961a4-fdc7-44e0-bec3-aea108de70c8 req-79afb80f-f914-4ed5-a7a0-cb84a2459458 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.376156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-792961a4-fdc7-44e0-bec3-aea108de70c8 req-79afb80f-f914-4ed5-a7a0-cb84a2459458 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.376669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-792961a4-fdc7-44e0-bec3-aea108de70c8 req-79afb80f-f914-4ed5-a7a0-cb84a2459458 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.416899 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-792961a4-fdc7-44e0-bec3-aea108de70c8 req-79afb80f-f914-4ed5-a7a0-cb84a2459458 service nova] Creating event network-changed:c79c35e8-bdbc-48d7-b175-49d57fd168cd for instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 on n-h2-852086-5 Aug 27 03:07:39.435535 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-792961a4-fdc7-44e0-bec3-aea108de70c8 req-79afb80f-f914-4ed5-a7a0-cb84a2459458 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105235 Aug 27 03:07:39.439719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 51/120] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 03:07:39.467274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:39.469416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:39.484078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.488450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.488919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.489859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.491527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.494104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.920842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:39.938200 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1ccf9893-4511-4624-a193-19229f315a6c tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.799565 Aug 27 03:07:39.962410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 70/121] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:39 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:39.988216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:39.996724 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdb29050-fbb7-454f-b329-ee73d6fff966 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.534965 Aug 27 03:07:40.002940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 52/122] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:39 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:40.959482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:40.960773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:40.977161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:40.977653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:40.978088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:40.987121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:40.987851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:40.988438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.019340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:41.019881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:41.055260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.059007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.060932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.062706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.067587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.068292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.127432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:41.602532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:41.612905 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c26a3fa1-e07d-4ba2-bef4-b12c9e35e75e tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.598427 Aug 27 03:07:41.614333 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 53/123] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:41 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:41.676092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:41.684268 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-caa6a29c-0c73-46ab-9161-fa74fe6ec755 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.728555 Aug 27 03:07:41.687025 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 71/124] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:40 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:42.302032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6f1f2fe-c4fb-4483-a5f3-6877ba7d7adf tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-975756439", "id": 1689201752, "os-flavor-access:is_public": "True"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:42.326381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45cd74a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.330902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.334368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.336680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.339547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.340773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.341410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.370808 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6f1f2fe-c4fb-4483-a5f3-6877ba7d7adf tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.347934 Aug 27 03:07:42.382754 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 72/125] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:07:42 2022] POST /compute/v2.1/flavors => generated 470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:42.391837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00ee5627-d30b-4321-85f7-ced8cf76cdb4 tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:42.466091 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c19e9eb8-0288-40fe-bf0e-4b073fb801cc tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 396 microversion: 2.1 time: 0.849321 Aug 27 03:07:42.474891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 54/126] 10.222.0.69 () {58 vars in 1128 bytes} [Sat Aug 27 03:07:41 2022] GET /compute/v2.1/os-hosts => generated 396 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:42.480236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45ce44700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.488890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.490888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.491421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.495910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.496408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.496914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.590563 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01872291-df74-4544-a8a4-894d10dd46e8 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 396 microversion: 2.1 time: 0.104280 Aug 27 03:07:42.591455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 55/127] 10.222.0.69 () {58 vars in 1139 bytes} [Sat Aug 27 03:07:42 2022] GET /compute/v2.1/os-hosts?zone= => generated 396 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:07:42.603391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45ce14af0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.607356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.610757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.611467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.612431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.614457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.617263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.682010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d1eb995-f1ab-431f-aca1-46f27b3a8fbe tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.082208 Aug 27 03:07:42.683633 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 56/128] 10.222.0.69 () {58 vars in 1145 bytes} [Sat Aug 27 03:07:42 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:07:42.698038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.699141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:42.719558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.720424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.721092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.722042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.722730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.723607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.762127 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00ee5627-d30b-4321-85f7-ced8cf76cdb4 tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1689201752/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.374913 Aug 27 03:07:42.762127 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 73/129] 10.222.0.69 () {62 vars in 1265 bytes} [Sat Aug 27 03:07:42 2022] POST /compute/v2.1/flavors/1689201752/os-extra_specs => generated 62 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:42.767691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.768310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:42.777320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.777818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.778403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.779015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.783107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.783733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:43.288998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:43.297081 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-116d52d9-901c-410f-a64f-0f3c71a465ed tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.533599 Aug 27 03:07:43.297696 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 74/130] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:42 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:43.314990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ffcc810e-8657-498d-9123-103caa307b4e tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:43.357648 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ffcc810e-8657-498d-9123-103caa307b4e tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1689201752" status: 202 len: 0 microversion: 2.86 time: 0.058830 Aug 27 03:07:43.358304 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 75/131] 10.222.0.69 () {60 vars in 1202 bytes} [Sat Aug 27 03:07:43 2022] DELETE /compute/v2.1/flavors/1689201752 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:43.366478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8231f7f4-a4df-4894-af0b-5dceb0bce2ae tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:43.396851 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8231f7f4-a4df-4894-af0b-5dceb0bce2ae tempest-FlavorMetadataValidation-439586731 tempest-FlavorMetadataValidation-439586731-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.033877 Aug 27 03:07:43.397789 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 76/132] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:07:43 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:43.452385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:43.520082 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c8f5e56-8fdd-4ee3-90cf-4de2e9d5ab58 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.829837 Aug 27 03:07:43.520646 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 57/133] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:42 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:44.249616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-654845695", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "1730794779", "adminPass": "***", "networks": [{"uuid": "822bb5c8-b856-428e-8d2b-f5ee3be2cef6"}], "security_groups": [{"name": "tempest-securitygroup--335002305"}], "key_name": "tempest-keypair-344888239", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:44.320623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:44.321481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:44.341005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.345012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.347800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.350619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.351351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.352463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.732031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:44.741718 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b51a221-66c8-459c-869c-f133493a54a4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.426445 Aug 27 03:07:44.764403 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 58/134] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:44 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:44.776042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:44.778594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:44.788315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.789245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.790151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.791644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.792603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.793245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.268347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] validate_networks() for [('822bb5c8-b856-428e-8d2b-f5ee3be2cef6', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:07:45.291372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:45.307970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8e0a510-59e7-43d3-86ae-2e81722101c0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.539653 Aug 27 03:07:45.312988 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 59/135] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:44 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:45.771831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:45.773264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:45.796485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.797203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.809577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.810893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.812454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.813065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:46.066560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:46.094019 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e412e2f4-0ca7-4882-a791-69de752b010e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.329683 Aug 27 03:07:46.095388 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 60/136] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:45 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:46.337318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:46.338095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:46.360683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:46.361331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:46.361714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:46.362546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:46.362999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:46.368010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:46.682857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:46.701134 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f869d25-5d29-4129-b4e9-9512974470fa tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.369925 Aug 27 03:07:46.725964 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 61/137] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:46 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:47.204603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:47.205122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:47.206383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:47.206814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:47.207381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:47.251041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.255012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.255905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.259969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.260597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.260930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.332237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Getting quotas for project 1d3dc710fa9b46f889a756adbe3b0227. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:47.353468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Getting quotas for user ae358d463a134431827d704089300d0c and project 1d3dc710fa9b46f889a756adbe3b0227. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:47.356200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6376b8e1-44ae-41e9-8bdd-c5fa5576f38f tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 tempest-InstanceUsageAuditLogNegativeTestJSON-889435188-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.363949 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6376b8e1-44ae-41e9-8bdd-c5fa5576f38f tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 tempest-InstanceUsageAuditLogNegativeTestJSON-889435188-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6376b8e1-44ae-41e9-8bdd-c5fa5576f38f tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 tempest-InstanceUsageAuditLogNegativeTestJSON-889435188-project-admin] Request method failure captured: Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqCh5_LcsmpWLcI-ZSK2MxvXbpfKDZ-wuGqRGWY-0My0dS9agmcRP2nLjbPD6YuWdfeGgoOeOaHnPAxTHFpUtdOvggFN-CnRgtXpuyHgcFVEP-QWP4OaveCMckfNnBv-wKwLvaDQRBMApnJv8NmWK8v5P7LZEPQhOUvij2ygO1_-x0 Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: ee361363e9ee4aeb918a37fdd6a3d9d5 Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:07:47.376579 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ee361363e9ee4aeb918a37fdd6a3d9d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee361363e9ee4aeb918a37fdd6a3d9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ee361363e9ee4aeb918a37fdd6a3d9d5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ee361363e9ee4aeb918a37fdd6a3d9d5"}]}] Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: ee361363e9ee4aeb918a37fdd6a3d9d5 Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-889435188-project-admin Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 42d3c3abe53043188921b225b63a96a3 Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-889435188-project-admin Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:07:47.377864 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid timestamp for date invalid_time Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'invalid_time'} Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:47.379145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6376b8e1-44ae-41e9-8bdd-c5fa5576f38f tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 tempest-InstanceUsageAuditLogNegativeTestJSON-889435188-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:47.380427 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6376b8e1-44ae-41e9-8bdd-c5fa5576f38f tempest-InstanceUsageAuditLogNegativeTestJSON-889435188 tempest-InstanceUsageAuditLogNegativeTestJSON-889435188-project-admin] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.646290 Aug 27 03:07:47.381206 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 62/138] 10.222.0.69 () {58 vars in 1224 bytes} [Sat Aug 27 03:07:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 652 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:07:47.389070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:47.392564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.393185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:47.395427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:47.412219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.412730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.413369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.415275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.417640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.418885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.494823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a659246-b26b-4bc9-bc0d-5f3c3f9942b1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.250557 Aug 27 03:07:47.496081 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 77/139] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 3252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:07:47.671234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e2dd44f3-44e1-4b5b-8c15-fea86a50f691 req-25543e7a-1a3f-4957-8ce9-7aa37a360d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f86c2d-e0c1-4a0a-be44-e628faecedb9", "name": "network-vif-plugged", "status": "completed", "tag": "3923b4b7-5ac4-4c24-a9ae-362676d42a1c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:47.701589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e2dd44f3-44e1-4b5b-8c15-fea86a50f691 req-25543e7a-1a3f-4957-8ce9-7aa37a360d2e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.704615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e2dd44f3-44e1-4b5b-8c15-fea86a50f691 req-25543e7a-1a3f-4957-8ce9-7aa37a360d2e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.706137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e2dd44f3-44e1-4b5b-8c15-fea86a50f691 req-25543e7a-1a3f-4957-8ce9-7aa37a360d2e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.767110 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e2dd44f3-44e1-4b5b-8c15-fea86a50f691 req-25543e7a-1a3f-4957-8ce9-7aa37a360d2e service nova] Creating event network-vif-plugged:3923b4b7-5ac4-4c24-a9ae-362676d42a1c for instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 on n-h2-852086-5 Aug 27 03:07:47.768681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e2dd44f3-44e1-4b5b-8c15-fea86a50f691 req-25543e7a-1a3f-4957-8ce9-7aa37a360d2e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:07:47.770528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e2dd44f3-44e1-4b5b-8c15-fea86a50f691 req-25543e7a-1a3f-4957-8ce9-7aa37a360d2e service nova] Acquired lock "compute-rpcapi-router" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:07:47.772505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.775059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.776588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.778355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.779368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.784148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.804448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.817554 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ca22d44-7f5d-4dfc-a3dd-1182a410755b tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.437025 Aug 27 03:07:47.818426 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 63/140] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:47.833000 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.compute.rpcapi [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 03:07:47.836257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] Releasing lock "compute-rpcapi-router" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:07:47.893130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5bebc3c9-1e07-40a5-a5ff-e5e3b648f71f None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.395266 Aug 27 03:07:47.894014 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 78/141] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:47.902402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9fe0f81-ccd7-4c0c-82ec-f3c4c2732c14 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.903293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9fe0f81-ccd7-4c0c-82ec-f3c4c2732c14 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:48.021710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9fe0f81-ccd7-4c0c-82ec-f3c4c2732c14 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.031889 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9fe0f81-ccd7-4c0c-82ec-f3c4c2732c14 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1263 microversion: 2.1 time: 0.134467 Aug 27 03:07:48.038631 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 79/142] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1263 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:48.055336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.056180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:48.081954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.087373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.088003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.088741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.089308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.089965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.355257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d56ed523-ac03-4cae-9d43-140009a6035c tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.357342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d56ed523-ac03-4cae-9d43-140009a6035c tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a3510b7627a248009bd718e0ff7eec3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09424883233c480f899d26c831d0b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.358671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d56ed523-ac03-4cae-9d43-140009a6035c tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Request method failure captured: Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqBULiUfHePVz9cZATRUcNZix48FLpJEoCmAV7uRrFuU51FQN7drq5BVlMj2YqvfX_Cmajm4kK8RgerrBLOzH_2BzF2Ue9xyztwKscKOdQtOpd5X7HpLNC92l5Ic7_koboK4mZTBfDES-R4IJL8bvrO_DQTv9imzk492-ImUE2xmHw Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 09424883233c480f899d26c831d0b24e Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:07:48.360672 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/09424883233c480f899d26c831d0b24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/09424883233c480f899d26c831d0b24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_09424883233c480f899d26c831d0b24e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/09424883233c480f899d26c831d0b24e"}]}] Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 09424883233c480f899d26c831d0b24e Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: a3510b7627a248009bd718e0ff7eec3a Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project Aug 27 03:07:48.362128 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: action_args: {} Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:07:48.362788 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 03:07:48.363816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:07:48.368945 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b91fc0f-22fe-44b8-8301-1a130e8a40b7 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.328293 Aug 27 03:07:48.369502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d56ed523-ac03-4cae-9d43-140009a6035c tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:48.369641 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 80/143] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:48 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:48.371161 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d56ed523-ac03-4cae-9d43-140009a6035c tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.551721 Aug 27 03:07:48.371707 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 64/144] 10.222.0.69 () {58 vars in 1185 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 553 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:48.384031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fd13ead-4f79-4b41-9344-c10f82af900e tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.398908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3fd13ead-4f79-4b41-9344-c10f82af900e tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a3510b7627a248009bd718e0ff7eec3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09424883233c480f899d26c831d0b24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fd13ead-4f79-4b41-9344-c10f82af900e tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Request method failure captured: Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2003:07:48 HTTP/1.1 Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqBULiUfHePVz9cZATRUcNZix48FLpJEoCmAV7uRrFuU51FQN7drq5BVlMj2YqvfX_Cmajm4kK8RgerrBLOzH_2BzF2Ue9xyztwKscKOdQtOpd5X7HpLNC92l5Ic7_koboK4mZTBfDES-R4IJL8bvrO_DQTv9imzk492-ImUE2xmHw Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 09424883233c480f899d26c831d0b24e Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:07:48.405225 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/09424883233c480f899d26c831d0b24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/09424883233c480f899d26c831d0b24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_09424883233c480f899d26c831d0b24e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/09424883233c480f899d26c831d0b24e"}]}] Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 09424883233c480f899d26c831d0b24e Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: a3510b7627a248009bd718e0ff7eec3a Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project Aug 27 03:07:48.407565 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '2022-08-27 03:07:48'} Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:07:48.408501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 03:07:48.409670 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:07:48.415625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fd13ead-4f79-4b41-9344-c10f82af900e tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:48.419642 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fd13ead-4f79-4b41-9344-c10f82af900e tempest-InstanceUsageAuditLogNegativeTestJSON-892112504 tempest-InstanceUsageAuditLogNegativeTestJSON-892112504-project] 10.222.0.69 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 03:07:48" status: 403 len: 128 microversion: 2.1 time: 0.040633 Aug 27 03:07:48.423075 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 81/145] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:07:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2003%3A07%3A48 => generated 128 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:07:48.840400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.841350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:48.864875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.867750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.869701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.870948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.872074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.873219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.913815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:49.065564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:49.067157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:49.080841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.090249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.090975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.091860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.096608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.098023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.165863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.176565 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a4a0914-0552-4350-b05e-89404c233c85 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.341280 Aug 27 03:07:49.192586 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 65/146] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:48 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:49.227089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.236210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d8962f58-dfb9-4654-bcba-27754de3c659 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1315 microversion: 2.1 time: 0.176764 Aug 27 03:07:49.237206 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 82/147] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:49 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:49.392551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:49.394153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:49.403230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.404001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.407504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.409453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.411835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.413544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:49.652371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.663499 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3462641a-7f61-4a49-8a9c-614d7258eb82 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.277566 Aug 27 03:07:49.666849 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 83/148] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:49 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:49.800706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1273306612", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:49.904619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:07:49.956045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f92ee99e-ce25-4cb4-9ed5-c5cf6052e554 req-0d73b972-b47f-4916-8d9b-8e72575736bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a24b96-909e-41b4-99cb-b6f445ec32b5", "name": "network-vif-plugged", "status": "completed", "tag": "c79c35e8-bdbc-48d7-b175-49d57fd168cd"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:49.987283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f92ee99e-ce25-4cb4-9ed5-c5cf6052e554 req-0d73b972-b47f-4916-8d9b-8e72575736bd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:49.988649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f92ee99e-ce25-4cb4-9ed5-c5cf6052e554 req-0d73b972-b47f-4916-8d9b-8e72575736bd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:49.993164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f92ee99e-ce25-4cb4-9ed5-c5cf6052e554 req-0d73b972-b47f-4916-8d9b-8e72575736bd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.010873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f92ee99e-ce25-4cb4-9ed5-c5cf6052e554 req-0d73b972-b47f-4916-8d9b-8e72575736bd service nova] Creating event network-vif-plugged:c79c35e8-bdbc-48d7-b175-49d57fd168cd for instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 on n-h2-852086-5 Aug 27 03:07:50.023302 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f92ee99e-ce25-4cb4-9ed5-c5cf6052e554 req-0d73b972-b47f-4916-8d9b-8e72575736bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075371 Aug 27 03:07:50.027007 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 84/149] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:50.203350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:50.205878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:50.228109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.231895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.237676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.240399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.241752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.244479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.834079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:50.853591 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-892507a9-ce18-486a-98ac-38dbb20628e4 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 0.656486 Aug 27 03:07:50.854818 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 85/150] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:50 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:50.865160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:50.866237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:50.878844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.880098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.880711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.881630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.882299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.882881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.989884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.004549 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4e7ac7c1-52cd-4697-bdf1-d90a887a5063 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1321 microversion: 2.1 time: 0.147822 Aug 27 03:07:51.014731 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 86/151] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:50 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:51.025606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:51.026406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.052803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.057416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.074498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.083555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.084726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.087944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.263268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:51.264047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:51.264774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:51.283029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:51.283170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:51.310933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.311434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.314665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.315839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.316680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.317514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.373694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.409536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:51.420482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for user 3ad6820606064210a5a0e2fa2bfa4bb7 and project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:51.420797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c800ba06-5076-4b69-9f1d-1fa3be1d3378 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1338 microversion: 2.1 time: 0.404692 Aug 27 03:07:51.420797 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 87/152] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:51 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1338 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:51.449730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:51.464567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:51.551180 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b59238d3-f6ac-4569-a248-daa53c2c31d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.356621 Aug 27 03:07:51.552913 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 66/153] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:07:51.573740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37f35fe9-eb95-40b0-b8c4-dc59a0df82a2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:51.577368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-37f35fe9-eb95-40b0-b8c4-dc59a0df82a2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.752258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-37f35fe9-eb95-40b0-b8c4-dc59a0df82a2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.778818 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37f35fe9-eb95-40b0-b8c4-dc59a0df82a2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1213 microversion: 2.1 time: 0.206505 Aug 27 03:07:51.780155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 88/154] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:51 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1213 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:51.877780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:51.878527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.896098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.897236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.897940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.899024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.900034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.900841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.039497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:52.040786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:52.069989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.071443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.072843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.075093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.076890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.078895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.249542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:52.288766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2cf3a46-3f8e-4a61-a182-a05e9f7e2f51 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1321 microversion: 2.1 time: 0.262948 Aug 27 03:07:52.292376 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 89/155] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:52 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:52.443588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:52.443588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:52.473741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.478554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.479157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.479937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.480417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.480851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:53.077855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:53.090800 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-225d11bd-5d69-4df5-aca5-304c13ec9eb3 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1488 microversion: 2.1 time: 0.653848 Aug 27 03:07:53.091712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 90/156] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:52 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1488 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:53.114505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:53.115565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:53.117905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:53.128827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.129361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.129794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:53.130706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.131229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.131664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:53.196495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:53.214065 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1084d4d7-57cc-4d7b-b12b-92f7b0eed3ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1337 microversion: 2.1 time: 1.338151 Aug 27 03:07:53.215597 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 67/157] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:51 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1337 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:53.307180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:53.340511 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6c7a2fc2-eeb0-45e4-ab6d-a6d763a796c1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1217 microversion: 2.1 time: 0.247509 Aug 27 03:07:53.342474 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 91/158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:53 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:53.864105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed321572-a150-4559-98ae-dc1670dacbfe tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1078509993", "id": 82806015, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:54.001656 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed321572-a150-4559-98ae-dc1670dacbfe tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 443 microversion: 2.55 time: 0.784478 Aug 27 03:07:54.024160 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 68/159] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:07:53 2022] POST /compute/v2.1/flavors => generated 443 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:54.052471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:54.066047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:54.092298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.092949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.098549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.099911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.100752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.107706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.166003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:54.166956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:54.191861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.192732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.193474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.195762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.197472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.198253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.330205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:54.467249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:54.495218 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7180c04-74f3-4deb-a9ef-6bf4d787289c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.463279 Aug 27 03:07:54.496593 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 69/160] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:54 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:54.690586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aba1401b-04e1-41f9-87b0-41b4b395d947 tempest-FlavorsV255TestJSON-631975809 tempest-FlavorsV255TestJSON-631975809-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:54.703565 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aba1401b-04e1-41f9-87b0-41b4b395d947 tempest-FlavorsV255TestJSON-631975809 tempest-FlavorsV255TestJSON-631975809-project] 10.222.0.69 "GET /compute/v2.1/flavors/82806015" status: 200 len: 443 microversion: 2.55 time: 0.204494 Aug 27 03:07:54.704943 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 70/161] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 03:07:54 2022] GET /compute/v2.1/flavors/82806015 => generated 443 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:54.706653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:54.711153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:54.712241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:54.721114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.722105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.722821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.723828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.724832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.728436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.802862 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f2c8d964-9be6-4747-b98e-01d0fef4626a tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] 10.222.0.69 "DELETE /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 204 len: 0 microversion: 2.1 time: 1.445251 Aug 27 03:07:54.803913 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 92/162] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:53 2022] DELETE /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 0 bytes in 1461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:54.812600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:54.812600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:54.832549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.833104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.833562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.834319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:54.834998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:54.835584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.937080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:54.951847 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1121278b-5265-4616-86dd-85fc861d9714 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1217 microversion: 2.1 time: 0.143813 Aug 27 03:07:54.967040 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 93/163] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:54 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:54.981901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-797cb6aa-5add-4115-87e8-6ff179515434 tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:55.031306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:55.054570 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-437a480c-4fb3-499e-8e86-5da75c117c77 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1487 microversion: 2.1 time: 0.339418 Aug 27 03:07:55.055362 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-797cb6aa-5add-4115-87e8-6ff179515434 tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/82806015" status: 200 len: 444 microversion: 2.55 time: 0.086629 Aug 27 03:07:55.056157 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 94/164] 10.222.0.69 () {62 vars in 1213 bytes} [Sat Aug 27 03:07:54 2022] PUT /compute/v2.1/flavors/82806015 => generated 444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:55.058089 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 71/165] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:54 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1487 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:55.069733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-826f9145-eec4-4d09-97a1-19d95abd2f93 tempest-FlavorsV255TestJSON-631975809 tempest-FlavorsV255TestJSON-631975809-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.085566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.090468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:55.117433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.118226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.118880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.120175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.121172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.122700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.147712 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-826f9145-eec4-4d09-97a1-19d95abd2f93 tempest-FlavorsV255TestJSON-631975809 tempest-FlavorsV255TestJSON-631975809-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6590 microversion: 2.55 time: 0.080184 Aug 27 03:07:55.153513 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 72/166] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/flavors/detail => generated 6590 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:07:55.163793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.169032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:55.190806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.192710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.193422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.196079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.197992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.199197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.546715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:55.563532 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4add64fe-888d-4e97-be08-e5a66500fe46 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1494 microversion: 2.1 time: 0.484507 Aug 27 03:07:55.564772 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 95/167] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1494 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:55.588440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-efbee4c0-79c9-438f-addd-98e329fe72d0 tempest-FlavorsV255TestJSON-631975809 tempest-FlavorsV255TestJSON-631975809-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.628325 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-efbee4c0-79c9-438f-addd-98e329fe72d0 tempest-FlavorsV255TestJSON-631975809 tempest-FlavorsV255TestJSON-631975809-project] 10.222.0.69 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.55 time: 0.060883 Aug 27 03:07:55.629490 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 96/168] 10.222.0.69 () {60 vars in 1166 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:55.656468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.659639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:55.676501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.678406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.680405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.682954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.683452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.683979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.985883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:56.006410 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f2b7732-bcbb-44b2-a3ac-0430938bf1f7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.374828 Aug 27 03:07:56.007382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 97/169] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.018257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d769f7b2-b7cf-46cb-a7db-224b7529b6f0 tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.050323 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d769f7b2-b7cf-46cb-a7db-224b7529b6f0 tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/82806015" status: 202 len: 0 microversion: 2.55 time: 0.038250 Aug 27 03:07:56.051301 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 98/170] 10.222.0.69 () {60 vars in 1196 bytes} [Sat Aug 27 03:07:56 2022] DELETE /compute/v2.1/flavors/82806015 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:56.057371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.061393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.084682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.086252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.087140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.088176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.088864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.089507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.470258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:56.485261 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca4b69c3-b1e6-425f-ac3d-fea342bde60b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1265 microversion: 2.1 time: 0.432415 Aug 27 03:07:56.486581 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 99/171] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1265 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.492573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4939bfe-73ad-4c43-869b-9f61f2f79753 tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.537545 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4939bfe-73ad-4c43-869b-9f61f2f79753 tempest-FlavorsV255TestJSON-1045848264 tempest-FlavorsV255TestJSON-1045848264-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.049268 Aug 27 03:07:56.538772 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 100/172] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:07:56.559605 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a2b2b88-ccc1-4a42-a2b4-f43da53b43b7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1638 microversion: 2.1 time: 1.403466 Aug 27 03:07:56.561200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 73/173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1638 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.603137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.603702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.604258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.606568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.618535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.622289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.623327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.623576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.624741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.625289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.626217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.627195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.627821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.628485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.632719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.633135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.712978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:56.987040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-77bccadf-a42e-4d69-b268-a7609e8f2236 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "DELETE /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 204 len: 0 microversion: 2.1 time: 0.399328 Aug 27 03:07:56.987814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 101/174] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:56 2022] DELETE /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:56.997649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:57.000827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:57.018537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.020671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.021871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.025639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.026324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.028716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.283034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.302620 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a9ea5ed-a5cc-4025-a03c-406a9f49a28d tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1494 microversion: 2.1 time: 0.714727 Aug 27 03:07:57.305918 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 74/175] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1494 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:57.323704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:57.324321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:57.341229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.341742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.342842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.344347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.345271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.345922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.807958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:57.883681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.898914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81de1bd5-00de-4de7-843e-4edaaed807f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1493 microversion: 2.1 time: 0.905807 Aug 27 03:07:57.899688 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 102/176] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1493 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:57.914211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:57.915606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:57.932550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.933055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.933498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.934794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.937550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.938000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.241420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:58.272469 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ed32347-5cae-4814-b95a-2dd869e7d296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1271 microversion: 2.1 time: 0.370807 Aug 27 03:07:58.277679 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 103/177] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:57 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1271 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:58.330330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:58.344537 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eabb76aa-c1cf-4b1c-8ff3-e7901934862c tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 1.037178 Aug 27 03:07:58.345289 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 75/178] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:57 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:58.361782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.362913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.397964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.407410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.410621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.411533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.412515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.417835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.656793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14d46530-74ba-437b-9674-0d89ceddafda tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Action: 'create', calling method: .version_select at 0x7fe45cc99d30>, body: {"keypair": {"name": "tempest-keypair-1764357298", "type": "ssh", "user_id": "c004f5d25892402ba7f31c4ad4728f3f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdbdaAxoqDViXDm45CD2kfo8WlbZWHLG8eCylyMmNBbETlPacKxJFhTDgZvsXThVcCL8+S12TXMOaaBESrlg5fywA8VXXj2SoURGADW5iExgYasmnotr1x0bCsyWauVhQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:58.681405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-14d46530-74ba-437b-9674-0d89ceddafda tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Getting quotas for project 3e672f3f4dc54b3d911b49dfbd73493a. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:58.686325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-14d46530-74ba-437b-9674-0d89ceddafda tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Getting quotas for user 8deccfbbc88c40c08b7a549754977764 and project 3e672f3f4dc54b3d911b49dfbd73493a. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:58.735587 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14d46530-74ba-437b-9674-0d89ceddafda tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.455122 Aug 27 03:07:58.736716 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 104/179] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:07:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 459 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:07:58.804961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5a57a987-6667-4fa3-97d6-58be450d4cff req-dc51c296-3212-43b5-ba57-92beb6679b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d7f6bd-104d-4e57-b004-56b81816b5bf", "tag": "bce7b3ed-6f63-429a-b150-3d61e314704f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:58.817138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5a57a987-6667-4fa3-97d6-58be450d4cff req-dc51c296-3212-43b5-ba57-92beb6679b3e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.821567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5a57a987-6667-4fa3-97d6-58be450d4cff req-dc51c296-3212-43b5-ba57-92beb6679b3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.822279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5a57a987-6667-4fa3-97d6-58be450d4cff req-dc51c296-3212-43b5-ba57-92beb6679b3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.838873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5a57a987-6667-4fa3-97d6-58be450d4cff req-dc51c296-3212-43b5-ba57-92beb6679b3e service nova] Creating event network-changed:bce7b3ed-6f63-429a-b150-3d61e314704f for instance b8d7f6bd-104d-4e57-b004-56b81816b5bf on n-h1-852086-5 Aug 27 03:07:58.846643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5a57a987-6667-4fa3-97d6-58be450d4cff req-dc51c296-3212-43b5-ba57-92beb6679b3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107623 Aug 27 03:07:58.847624 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 105/180] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:58.852900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c376cf5-db71-414c-a6a2-22660b4aa8ab tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Action: 'create', calling method: .version_select at 0x7fe45cc1c5e0>, body: {"keypair": {"name": "tempest-keypair-215676789", "type": "ssh", "user_id": "c004f5d25892402ba7f31c4ad4728f3f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDqUiuDnCp4yRX9efGTBuXUmIiSGR2cNLYhaZkOaz7mXuEgYRJvyctVT1naGbL4weKe7C/mMxN2z2jkE9/I/RkM0DvrHIMaExN9AZAPd7VRXkqyQTvsuuEljQ+fx+PfoA=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:58.875092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9c376cf5-db71-414c-a6a2-22660b4aa8ab tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Getting quotas for project 3e672f3f4dc54b3d911b49dfbd73493a. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:58.880459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9c376cf5-db71-414c-a6a2-22660b4aa8ab tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Getting quotas for user 8deccfbbc88c40c08b7a549754977764 and project 3e672f3f4dc54b3d911b49dfbd73493a. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:58.916439 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c376cf5-db71-414c-a6a2-22660b4aa8ab tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.066512 Aug 27 03:07:58.917582 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 106/181] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:07:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:07:58.925883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.926857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.933778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.934663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.935250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.936111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.936909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.937493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.086937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.108146 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4bc3148-0a98-41a3-a94e-22116d2c9075 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1494 microversion: 2.1 time: 0.760386 Aug 27 03:07:59.110114 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 76/182] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:58 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1494 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:59.126570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c5adf96-2247-4b3f-8e68-efddd23ae2ef tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Calling method '.version_select at 0x7fe45cd243a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.141331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c5adf96-2247-4b3f-8e68-efddd23ae2ef tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-1764357298?user_id=c004f5d25892402ba7f31c4ad4728f3f" status: 200 len: 512 microversion: 2.10 time: 0.028991 Aug 27 03:07:59.142981 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 77/183] 10.222.0.69 () {60 vars in 1340 bytes} [Sat Aug 27 03:07:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1764357298?user_id=c004f5d25892402ba7f31c4ad4728f3f => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:59.163574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fddfeb8b-9082-48b3-a575-8a1fd7365360 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Action: 'create', calling method: .version_select at 0x7fe45ce444c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1632099680", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRyztamENnAgf2k23uZiB2sNfX7ZJWYtj47RH6TxD88bTkLNwwP2MrUVfH1AtNWrpZvbj5lL72vVkaoUW8Yj4aeuidLA5k7YlMjD3J7Qs/dQajvF2U4pHvYhsa3SeaeAA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:59.185914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fddfeb8b-9082-48b3-a575-8a1fd7365360 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Getting quotas for project 3e672f3f4dc54b3d911b49dfbd73493a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:59.192893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fddfeb8b-9082-48b3-a575-8a1fd7365360 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Getting quotas for user 8deccfbbc88c40c08b7a549754977764 and project 3e672f3f4dc54b3d911b49dfbd73493a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:59.243806 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fddfeb8b-9082-48b3-a575-8a1fd7365360 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.088888 Aug 27 03:07:59.245109 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 78/184] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:07:59 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:07:59.259181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b56da560-a694-43b3-b872-d439d4cbf9e8 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Calling method '.version_select at 0x7fe45cd2c670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.277030 n-d-852086-5 devstack@n-api.service[122408]: WARNING oslo_db.sqlalchemy.utils [None req-b56da560-a694-43b3-b872-d439d4cbf9e8 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:07:59.290027 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b56da560-a694-43b3-b872-d439d4cbf9e8 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "GET /compute/v2.1/os-keypairs?user_id=c004f5d25892402ba7f31c4ad4728f3f" status: 200 len: 725 microversion: 2.10 time: 0.037797 Aug 27 03:07:59.293246 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 79/185] 10.222.0.69 () {60 vars in 1259 bytes} [Sat Aug 27 03:07:59 2022] GET /compute/v2.1/os-keypairs?user_id=c004f5d25892402ba7f31c4ad4728f3f => generated 725 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:07:59.305784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.307437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:59.318138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.326100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.326832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.329557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.330297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.331125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.391541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:59.695479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.704768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-11b7caac-eaaa-4d54-877c-468c8f1e6e47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 0.410224 Aug 27 03:07:59.708940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 80/186] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:59 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:59.720703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-17421c5c-fd12-4d8a-b93f-9da1d6e76c5e tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Calling method '.version_select at 0x7fe45ce14af0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.761130 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-17421c5c-fd12-4d8a-b93f-9da1d6e76c5e tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1632099680" status: 204 len: 0 microversion: 2.10 time: 0.050433 Aug 27 03:07:59.766305 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 81/187] 10.222.0.69 () {60 vars in 1325 bytes} [Sat Aug 27 03:07:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1632099680 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:07:59.775120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:59.776775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:59.795623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.797050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.797858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.798865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.804400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.805082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.923766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.942006 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1427f19a-952d-43cc-8d1f-5a60afd63a89 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1493 microversion: 2.1 time: 1.018952 Aug 27 03:07:59.942700 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 107/188] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:58 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1493 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:59.947890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fba0a53b-92de-4e3d-87b4-2082592d6afb req-9adc1506-ab4e-4837-a3de-b59d2c13336a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f86c2d-e0c1-4a0a-be44-e628faecedb9", "name": "network-vif-deleted", "tag": "3923b4b7-5ac4-4c24-a9ae-362676d42a1c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:59.976768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fba0a53b-92de-4e3d-87b4-2082592d6afb req-9adc1506-ab4e-4837-a3de-b59d2c13336a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:59.981663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fba0a53b-92de-4e3d-87b4-2082592d6afb req-9adc1506-ab4e-4837-a3de-b59d2c13336a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:59.982503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fba0a53b-92de-4e3d-87b4-2082592d6afb req-9adc1506-ab4e-4837-a3de-b59d2c13336a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.009967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fba0a53b-92de-4e3d-87b4-2082592d6afb req-9adc1506-ab4e-4837-a3de-b59d2c13336a service nova] Creating event network-vif-deleted:3923b4b7-5ac4-4c24-a9ae-362676d42a1c for instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 on n-h2-852086-5 Aug 27 03:08:00.018933 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fba0a53b-92de-4e3d-87b4-2082592d6afb req-9adc1506-ab4e-4837-a3de-b59d2c13336a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074823 Aug 27 03:08:00.020123 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 108/189] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:00.038478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f286f12b-f032-4e4d-a438-c43c1b00125e tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Calling method '.version_select at 0x7fe45cc1c700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.079631 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f286f12b-f032-4e4d-a438-c43c1b00125e tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215676789?user_id=c004f5d25892402ba7f31c4ad4728f3f" status: 204 len: 0 microversion: 2.10 time: 0.058104 Aug 27 03:08:00.080239 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 109/190] 10.222.0.69 () {60 vars in 1340 bytes} [Sat Aug 27 03:08:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215676789?user_id=c004f5d25892402ba7f31c4ad4728f3f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:08:00.088487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a21ca711-8d3f-47bc-a730-2e15ff549367 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] Calling method '.version_select at 0x7fe45cb7e4c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.133083 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a21ca711-8d3f-47bc-a730-2e15ff549367 tempest-KeyPairsV210TestJSON-1443127479 tempest-KeyPairsV210TestJSON-1443127479-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764357298?user_id=c004f5d25892402ba7f31c4ad4728f3f" status: 204 len: 0 microversion: 2.10 time: 0.047803 Aug 27 03:08:00.133944 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 110/191] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:08:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764357298?user_id=c004f5d25892402ba7f31c4ad4728f3f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:08:00.139759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.140780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.159977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.160772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.161353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.162968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.163739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.164325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.207250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:00.211503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.212584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.213596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.214302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lazy-loading 'fault' on Instance uuid 74f86c2d-e0c1-4a0a-be44-e628faecedb9 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:00.220916 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c2086bc-7bc5-43d6-9f3b-09a0eb9e9b93 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.453202 Aug 27 03:08:00.224553 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 82/192] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:59 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:00.329465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:00.348429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d75013f-5e87-4ae6-82f3-6cd74da037cb tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 200 len: 1328 microversion: 2.1 time: 0.213040 Aug 27 03:08:00.349306 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 111/193] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:00 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:00.735449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.736524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.773198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:00.783085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.784026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.788656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.790360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.794903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.809087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.902396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-90080176-2f16-46f4-afef-97966fa97b31 req-06778c3b-2596-45c2-bc1f-3b5c2ac006c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50391137-b227-49eb-8694-c599b899a117", "tag": "3f471807-d996-408f-bf48-36d371055ba3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:00.957619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-90080176-2f16-46f4-afef-97966fa97b31 req-06778c3b-2596-45c2-bc1f-3b5c2ac006c5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.959285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-90080176-2f16-46f4-afef-97966fa97b31 req-06778c3b-2596-45c2-bc1f-3b5c2ac006c5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.963638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-90080176-2f16-46f4-afef-97966fa97b31 req-06778c3b-2596-45c2-bc1f-3b5c2ac006c5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.986964 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-90080176-2f16-46f4-afef-97966fa97b31 req-06778c3b-2596-45c2-bc1f-3b5c2ac006c5 service nova] Creating event network-changed:3f471807-d996-408f-bf48-36d371055ba3 for instance 50391137-b227-49eb-8694-c599b899a117 on n-h1-852086-5 Aug 27 03:08:00.996613 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-90080176-2f16-46f4-afef-97966fa97b31 req-06778c3b-2596-45c2-bc1f-3b5c2ac006c5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097872 Aug 27 03:08:00.997858 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 112/194] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:01.006577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:01.007651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:01.014953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.016462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.017199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.018114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.019382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.020186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.190841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76cf7013697454098207ea971e8f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e8227a74394648bb22269c12712a97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.206609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c1a61ba5-a454-44d9-a54c-019bd80112f1 tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 200 len: 1322 microversion: 2.1 time: 0.204350 Aug 27 03:08:01.211105 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 113/195] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:00 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:01.245649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:01.246418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:01.259032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.260885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.261512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.263013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.264242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.269283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.350837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:01.757478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.768996 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ce5f379-4392-4aef-aaff-615f91834ef9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 1.042397 Aug 27 03:08:01.771678 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 83/196] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:00 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:01.781191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:01.783048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:01.789779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.790303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.790894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.791804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.792914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.793494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.810699 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] HTTP exception thrown: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Request method failure captured: Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 HTTP/1.1 Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpg8e2vS6NRo18sMS2Vq6BWCtjDbru6spLctOi97zUiCZx2BbTlyHmh8MBJS6L8exAQbzydEYYQ4zMxenMu6LYWYFhAyu51QIio0oPokOu8Sv5qbs_GT581VqkX2ZXC1lp5mE7qeVcg1-NqHS7tTJI8-QOKXodmGsMhBEawurNK160 Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:01.816634 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c3bdab40b75c404eb968ed2afcc229f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}] Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: a408d7b8e4104665b0223a81a73e0dfd Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:01.817854 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '74f86c2d-e0c1-4a0a-be44-e628faecedb9'} Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:01.818535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:01.819594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:01.822864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Returning 404 to user: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:01.824308 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4dcbd714-374a-4442-8272-52e1fb18c0a9 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 404 len: 111 microversion: 2.1 time: 0.051593 Aug 27 03:08:01.824878 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 84/197] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:01 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:01.933527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.954975 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-616b59fe-fe20-48d3-86be-e655c7768a5d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.713446 Aug 27 03:08:01.960622 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 114/198] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:01 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:02.071523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2092916922", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:02.141560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:02.173168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-984281fd-3001-4688-982b-cebb08fedb85 req-2a94a008-6216-4a91-9449-adfd0dabac91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a24b96-909e-41b4-99cb-b6f445ec32b5", "name": "network-vif-deleted", "tag": "c79c35e8-bdbc-48d7-b175-49d57fd168cd"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:02.185631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-984281fd-3001-4688-982b-cebb08fedb85 req-2a94a008-6216-4a91-9449-adfd0dabac91 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.186468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-984281fd-3001-4688-982b-cebb08fedb85 req-2a94a008-6216-4a91-9449-adfd0dabac91 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.190253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-984281fd-3001-4688-982b-cebb08fedb85 req-2a94a008-6216-4a91-9449-adfd0dabac91 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.218737 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-984281fd-3001-4688-982b-cebb08fedb85 req-2a94a008-6216-4a91-9449-adfd0dabac91 service nova] Creating event network-vif-deleted:c79c35e8-bdbc-48d7-b175-49d57fd168cd for instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 on n-h2-852086-5 Aug 27 03:08:02.225453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-984281fd-3001-4688-982b-cebb08fedb85 req-2a94a008-6216-4a91-9449-adfd0dabac91 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059061 Aug 27 03:08:02.227398 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 115/199] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:02.241240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.243661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.263260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.264738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.265464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.266505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.267827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.268967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.288852 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] HTTP exception thrown: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Request method failure captured: Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 HTTP/1.1 Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpfFozMSJaOOPoEsvK3UhFdpidlnHy831ZiRWhWh2wPcQEq7grl5Kqc--zk0Da7YKctwusgHii5kGd_WZ7RXgFvbyb5PI_nDKnuliRBInfbkoiJoS597muly3TldADc6GTn_kIc9mfDcOc-RXc9n4km59k1J0NRKuvD7WCPIXqymJU Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d2e8227a74394648bb22269c12712a97 Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:02.294313 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d2e8227a74394648bb22269c12712a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2e8227a74394648bb22269c12712a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d2e8227a74394648bb22269c12712a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2e8227a74394648bb22269c12712a97"}]}] Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d2e8227a74394648bb22269c12712a97 Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminTestJSON-1886446157-project Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d76cf7013697454098207ea971e8f64d Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminTestJSON-1886446157-project Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:02.295553 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '23a24b96-909e-41b4-99cb-b6f445ec32b5'} Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:02.297249 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:02.299418 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.303430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Returning 404 to user: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:02.304428 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d1874bce-5873-4e60-bd61-2c877066152f tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 404 len: 111 microversion: 2.1 time: 0.075583 Aug 27 03:08:02.305355 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 116/200] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:02.316214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a11d42b-23d0-4cd2-8ce4-13398585d1c2 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:02.331517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:02.358338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a11d42b-23d0-4cd2-8ce4-13398585d1c2 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.363129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a11d42b-23d0-4cd2-8ce4-13398585d1c2 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.363900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a11d42b-23d0-4cd2-8ce4-13398585d1c2 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.604316 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a11d42b-23d0-4cd2-8ce4-13398585d1c2 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.294678 Aug 27 03:08:02.608576 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 117/201] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:02 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:02.617980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-266bbf65-0a29-483b-bb39-e11d454b7399 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.622945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:02.623673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:02.624406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:02.625206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:02.626273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:02.650871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.651719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.657136 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-266bbf65-0a29-483b-bb39-e11d454b7399 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.042456 Aug 27 03:08:02.662985 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 118/202] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:02 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 03:08:02.670871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.675165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.681085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf022f9b-22d4-4449-99d8-1637ff1c6218 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1961752123"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:02.682107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.682475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.696563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-cf022f9b-22d4-4449-99d8-1637ff1c6218 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid cbdf975c-396f-42c9-8daf-251271edef11 for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:02.720111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Getting quotas for project c3bdab40b75c404eb968ed2afcc229f8. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:02.729257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Getting quotas for user a408d7b8e4104665b0223a81a73e0dfd and project c3bdab40b75c404eb968ed2afcc229f8. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:02.739154 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf022f9b-22d4-4449-99d8-1637ff1c6218 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061842 Aug 27 03:08:02.748516 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 119/203] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:02.754390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4e4c3b9-9730-405e-a226-5b3f2e342986 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:02.758467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:02.768153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:02.778600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4e4c3b9-9730-405e-a226-5b3f2e342986 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.779793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4e4c3b9-9730-405e-a226-5b3f2e342986 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.781430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4e4c3b9-9730-405e-a226-5b3f2e342986 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.794186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:02.932852 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3353e9da-aa2b-4fc1-b6ee-656619474e2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862908 Aug 27 03:08:02.939451 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 85/204] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:02.962906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.966297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.982864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.984400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.990114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.991218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.996306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.997021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.053219 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4e4c3b9-9730-405e-a226-5b3f2e342986 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.303203 Aug 27 03:08:03.060579 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 120/205] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:03.066852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-496eb906-6920-4dcc-b037-9887b6f3d778 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:03.073082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-496eb906-6920-4dcc-b037-9887b6f3d778 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:03.222408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-496eb906-6920-4dcc-b037-9887b6f3d778 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.225032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=23 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:03.242797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-496eb906-6920-4dcc-b037-9887b6f3d778 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1220 microversion: 2.1 time: 0.180888 Aug 27 03:08:03.243476 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 121/206] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:03 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:03.256634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:03.257405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:03.268998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.269492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.269925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.275061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.275605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.276050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.478948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.503513 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba160eb0-26d1-470b-a613-ba4d2303212e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 0.561061 Aug 27 03:08:03.503971 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 86/207] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:03.515505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cb31eb5-b120-4c6e-8809-efc227053057 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:03.579362 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8cb31eb5-b120-4c6e-8809-efc227053057 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.070914 Aug 27 03:08:03.581573 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 87/208] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:08:03 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:03.596089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2475a891-a8ec-4f1f-9e16-1ccddee22884 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:03.638316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2475a891-a8ec-4f1f-9e16-1ccddee22884 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:03.639624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2475a891-a8ec-4f1f-9e16-1ccddee22884 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:03.643708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2475a891-a8ec-4f1f-9e16-1ccddee22884 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.661347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:03.672925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-70956b40-ff6f-44c5-b47f-2ee8588a1f64 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.428473 Aug 27 03:08:03.691219 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 122/209] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:03 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:04.264007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:04.266139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:04.279320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.282750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.283315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:04.285439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.289079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.290365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:04.317575 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2475a891-a8ec-4f1f-9e16-1ccddee22884 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.729783 Aug 27 03:08:04.333584 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 88/210] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:03 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:04.339184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a65edc6-86d9-4559-82e4-97033f5b9a02 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:04.403751 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a65edc6-86d9-4559-82e4-97033f5b9a02 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.068770 Aug 27 03:08:04.404344 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 89/211] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:04 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:04.421595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d5bd6a0-c68c-43af-bbd0-f15525b11426 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-330203173"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:04.433695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-1d5bd6a0-c68c-43af-bbd0-f15525b11426 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid 128ce876-7280-401f-a7b3-5948901ba7aa for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:04.466420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:04.480914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9eb589c8-7fc1-48b1-baf9-afa32dd50c5c tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1216 microversion: 2.1 time: 0.221621 Aug 27 03:08:04.484825 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d5bd6a0-c68c-43af-bbd0-f15525b11426 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065732 Aug 27 03:08:04.495898 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 90/212] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:04 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:04.505416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 123/213] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:04 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1216 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:04.510836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-044554bd-0d2f-4bb3-9805-833860c5bc5c tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:04.525941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:04.526590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:04.540097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-044554bd-0d2f-4bb3-9805-833860c5bc5c tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.540770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-044554bd-0d2f-4bb3-9805-833860c5bc5c tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.541355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-044554bd-0d2f-4bb3-9805-833860c5bc5c tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:04.544685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.552578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.553034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:04.553775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.554262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.554681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:04.805285 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-044554bd-0d2f-4bb3-9805-833860c5bc5c tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.308090 Aug 27 03:08:04.806458 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 91/214] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:04.813198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:04.814308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:04.850491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:04.868760 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-72d3bbc6-c993-4f55-a39e-0088859b6e09 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 0.345231 Aug 27 03:08:04.882819 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 124/215] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:04 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:04.882819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c846be87-5f67-41d5-b205-ae8f78537cce tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:04.920758 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c846be87-5f67-41d5-b205-ae8f78537cce tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.039021 Aug 27 03:08:04.922821 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 125/216] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:08:04 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:04.934915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f0565b4-dc86-4ca4-a287-982878fec503 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:04.962634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0565b4-dc86-4ca4-a287-982878fec503 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:04.968471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0565b4-dc86-4ca4-a287-982878fec503 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:04.969187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0565b4-dc86-4ca4-a287-982878fec503 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:05.117691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:05.121055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:05.121779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:05.122877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:05.123543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:05.125003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:05.256254 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f0565b4-dc86-4ca4-a287-982878fec503 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.325288 Aug 27 03:08:05.263718 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 126/217] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:05.484430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:05.497024 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56b827a6-0df1-4e0b-90a6-a3c768d6a08d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.689057 Aug 27 03:08:05.498052 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 92/218] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:04 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:05.505024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73d2a1ae-7c17-4a15-84ea-140393c0cd66 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:05.562734 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73d2a1ae-7c17-4a15-84ea-140393c0cd66 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.061928 Aug 27 03:08:05.565574 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 93/219] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:05.573377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:05.574306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:05.580170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1594991063", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:05.581784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:05.582283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:05.582717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:05.583416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:05.584185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:05.584718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:05.674717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:05.685691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] validate_networks() for [('1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:05.690680 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5870e3d-8d5d-4fa5-9b47-f53b7107d612 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1278 microversion: 2.1 time: 0.122952 Aug 27 03:08:05.691286 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 94/220] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:05 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:05.703526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4931f2e7-6fba-4e56-aa0f-9b05a83358f8 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-904930031"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:05.711538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-4931f2e7-6fba-4e56-aa0f-9b05a83358f8 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid 2ac190a9-6b49-47f2-b0fa-b6fc25cfd764 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:05.776402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4931f2e7-6fba-4e56-aa0f-9b05a83358f8 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083992 Aug 27 03:08:05.782919 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 95/221] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:05.793474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9e7191f-5f59-401b-840a-f32a328624d7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:05.841695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e7191f-5f59-401b-840a-f32a328624d7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:05.846930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e7191f-5f59-401b-840a-f32a328624d7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:05.847705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e7191f-5f59-401b-840a-f32a328624d7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.149709 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9e7191f-5f59-401b-840a-f32a328624d7 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.364178 Aug 27 03:08:06.150526 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 96/222] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:05 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:06.163402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:06.164029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:06.182263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.182769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.183213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.183942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.184404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.184835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.402322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:06.412810 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37600f12-a8d6-4039-8a8d-6631de7fd57b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 0.253563 Aug 27 03:08:06.414243 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 97/223] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:06 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:06.419079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d0328b85-0e98-4e4c-a1ca-668a13af675c req-3158e588-8ec8-4e1a-9bc4-0702dbafedaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d7f6bd-104d-4e57-b004-56b81816b5bf", "name": "network-vif-plugged", "status": "completed", "tag": "bce7b3ed-6f63-429a-b150-3d61e314704f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:06.430540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0328b85-0e98-4e4c-a1ca-668a13af675c req-3158e588-8ec8-4e1a-9bc4-0702dbafedaa service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.431284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0328b85-0e98-4e4c-a1ca-668a13af675c req-3158e588-8ec8-4e1a-9bc4-0702dbafedaa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.431952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0328b85-0e98-4e4c-a1ca-668a13af675c req-3158e588-8ec8-4e1a-9bc4-0702dbafedaa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.450121 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d0328b85-0e98-4e4c-a1ca-668a13af675c req-3158e588-8ec8-4e1a-9bc4-0702dbafedaa service nova] Creating event network-vif-plugged:bce7b3ed-6f63-429a-b150-3d61e314704f for instance b8d7f6bd-104d-4e57-b004-56b81816b5bf on n-h1-852086-5 Aug 27 03:08:06.457918 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d0328b85-0e98-4e4c-a1ca-668a13af675c req-3158e588-8ec8-4e1a-9bc4-0702dbafedaa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040971 Aug 27 03:08:06.459313 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 98/224] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:06.464836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca23bee7-770b-4234-898a-52ef55854261 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:06.477126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca23bee7-770b-4234-898a-52ef55854261 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.477910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca23bee7-770b-4234-898a-52ef55854261 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.478738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca23bee7-770b-4234-898a-52ef55854261 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.721005 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca23bee7-770b-4234-898a-52ef55854261 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.260089 Aug 27 03:08:06.728983 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 99/225] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:06.802824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:06.803418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:06.803792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:06.804264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:06.804735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:06.839942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.840742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.842148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.844447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:06.845681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:06.847694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:06.900229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:06.908697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for user 38c24c41cfbb4a1caea77801a0b3432d and project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:06.931135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:06.940496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:07.029975 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4880e772-d860-485d-8585-af8fa83bc475 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764558 Aug 27 03:08:07.037310 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 127/226] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:07.045178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.046202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:07.057693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.060572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.065751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.067193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.074271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.075242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.193226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e974927-b253-49f4-8806-b3bd0d193597 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Calling method '.version_select at 0x7fe45ccf8310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.195048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e974927-b253-49f4-8806-b3bd0d193597 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '100593953b2047ab9d1df2c63943e660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f9177644d1470386d2c4e430821b44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e974927-b253-49f4-8806-b3bd0d193597 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Request method failure captured: Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqUdn_7tB6dQmXAl6e9E4kdKn_zrCHYOID37mfDbG_uF1coItiBIM4styenFUVswF366Tgm8GtZx-dFrKQd5V5wiadS9z85tvxZz-ldyCfJOO4CbGJjPq250JRTB8t28JoFfJnLSRseSkAYEb3jA_NUDIqWzazjDmi6o_cPSFKRKbI Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:07.197249 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77f9177644d1470386d2c4e430821b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77f9177644d1470386d2c4e430821b44", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}] Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 100593953b2047ab9d1df2c63943e660 Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: action_args: {} Aug 27 03:08:07.198448 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:07.199175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 03:08:07.200152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.201113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e974927-b253-49f4-8806-b3bd0d193597 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:07.207736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e974927-b253-49f4-8806-b3bd0d193597 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.468379 Aug 27 03:08:07.208716 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 100/227] 10.222.0.69 () {58 vars in 1167 bytes} [Sat Aug 27 03:08:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:07.217863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.218626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:07.239713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.240129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.240569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.241282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.247107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.248310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.501918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:07.503935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:07.514708 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c1e14ae3-c99f-4b18-ad9e-49cd6c082d01 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.473672 Aug 27 03:08:07.526659 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 128/228] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:07.526970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-060e1bf0-293a-44a9-8c22-8f4033ba1a13 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.301492 Aug 27 03:08:07.527065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2ce7823-99e4-4692-8629-6c848206d659 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.527151 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 101/229] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:07.536670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5491bf51-865a-4cae-9a96-e7a0c83c444b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.537403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5491bf51-865a-4cae-9a96-e7a0c83c444b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:07.611500 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2ce7823-99e4-4692-8629-6c848206d659 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.095186 Aug 27 03:08:07.612600 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 129/230] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:07 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:07.623709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39d442b3-b6f3-4a60-868c-262b42eda994 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Calling method '.version_select at 0x7fe45ca1fb80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.626113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39d442b3-b6f3-4a60-868c-262b42eda994 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '100593953b2047ab9d1df2c63943e660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f9177644d1470386d2c4e430821b44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39d442b3-b6f3-4a60-868c-262b42eda994 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Request method failure captured: Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqUdn_7tB6dQmXAl6e9E4kdKn_zrCHYOID37mfDbG_uF1coItiBIM4styenFUVswF366Tgm8GtZx-dFrKQd5V5wiadS9z85tvxZz-ldyCfJOO4CbGJjPq250JRTB8t28JoFfJnLSRseSkAYEb3jA_NUDIqWzazjDmi6o_cPSFKRKbI Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:07.642849 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77f9177644d1470386d2c4e430821b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77f9177644d1470386d2c4e430821b44", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}] Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 100593953b2047ab9d1df2c63943e660 Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: action_args: {} Aug 27 03:08:07.644151 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:07.644999 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 03:08:07.650515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.651603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39d442b3-b6f3-4a60-868c-262b42eda994 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:07.651603 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39d442b3-b6f3-4a60-868c-262b42eda994 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.031500 Aug 27 03:08:07.651603 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 130/231] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:07.651603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.652521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:07.654890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5491bf51-865a-4cae-9a96-e7a0c83c444b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:07.665564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.666057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.666532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.667092 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5491bf51-865a-4cae-9a96-e7a0c83c444b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1211 microversion: 2.1 time: 0.137669 Aug 27 03:08:07.667238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.670002 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 102/232] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:07.673642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.674338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.687602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc18b47-6e5c-422c-9435-2519cd7b78d3 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1056811153"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:07.696516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-2bc18b47-6e5c-422c-9435-2519cd7b78d3 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid 0b2a4daf-680e-4f44-8e7e-768c4abf8ed7 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:07.771839 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bc18b47-6e5c-422c-9435-2519cd7b78d3 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100441 Aug 27 03:08:07.775535 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 103/233] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:07.788774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81e1ab54-782b-4a16-81f7-f05c3fa62efe tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Calling method '.version_select at 0x7fe45ce7e670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.791018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81e1ab54-782b-4a16-81f7-f05c3fa62efe tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '100593953b2047ab9d1df2c63943e660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f9177644d1470386d2c4e430821b44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81e1ab54-782b-4a16-81f7-f05c3fa62efe tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Request method failure captured: Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqUdn_7tB6dQmXAl6e9E4kdKn_zrCHYOID37mfDbG_uF1coItiBIM4styenFUVswF366Tgm8GtZx-dFrKQd5V5wiadS9z85tvxZz-ldyCfJOO4CbGJjPq250JRTB8t28JoFfJnLSRseSkAYEb3jA_NUDIqWzazjDmi6o_cPSFKRKbI Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:07.793029 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77f9177644d1470386d2c4e430821b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77f9177644d1470386d2c4e430821b44", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}] Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 100593953b2047ab9d1df2c63943e660 Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: action_args: {} Aug 27 03:08:07.794241 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:07.794946 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 03:08:07.796696 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:07.797726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81e1ab54-782b-4a16-81f7-f05c3fa62efe tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:07.797726 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81e1ab54-782b-4a16-81f7-f05c3fa62efe tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.011127 Aug 27 03:08:07.809584 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 104/234] 10.222.0.69 () {58 vars in 1179 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:07.816501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45cbd5430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.820877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.821062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.821556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.822478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.822988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.823683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:07.878779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d379fe24-4a9d-4eed-a545-55c1b285209b tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.067264 Aug 27 03:08:07.880512 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 105/235] 10.222.0.69 () {58 vars in 1128 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:07.885967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93696c71-df8f-4f0b-87d6-3cbcd1e554a1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.949422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93696c71-df8f-4f0b-87d6-3cbcd1e554a1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.067487 Aug 27 03:08:07.950224 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 106/236] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:07 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:07.960998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:07.979718 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7282564-5fad-4d1b-8c13-3a7e82bbbb3f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 0.331464 Aug 27 03:08:07.980259 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 131/237] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:07.989638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45ca0baf0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:07.993246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:07.993739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:07.994196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.012031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.015334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.018881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.069684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Calling method '.version_select at 0x7fe45cbd5b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.072469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.073286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.073727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.075368 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-220f597f-371b-4092-bf79-3605c3384dba tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.093663 Aug 27 03:08:08.076609 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 132/238] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.084435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-639483e3-592e-4e3d-a8ef-3bd168dc559d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.092710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-639483e3-592e-4e3d-a8ef-3bd168dc559d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-639483e3-592e-4e3d-a8ef-3bd168dc559d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Request method failure captured: Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpiZCUVsqtxl8z0CgwOqZoY0xTyBw6cGgKtqpzQAAlAxurtXU8jVwStC8drcz7lX04cxxErSL8GORucQUWUMmhdOVvgQI1vMghkUITFIpMEEn2UNeVrPBK8Lreiy9rklDi8lYcfvtrjv0G4N2X6zrVpsS_aXFo4XL_Yua8bsWWI2vU Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:08.097850 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/15c0754a026c41f2af55461725dddb70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_15c0754a026c41f2af55461725dddb70", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}] Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 694c985f20084dfdbb7c7f0ebd9c82bc Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: exception: Aggregate 5 could not be found. Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5'} Aug 27 03:08:08.100615 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.102317 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 03:08:08.104769 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.109326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-639483e3-592e-4e3d-a8ef-3bd168dc559d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:08.110445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:08.112200 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-639483e3-592e-4e3d-a8ef-3bd168dc559d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.033267 Aug 27 03:08:08.117586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.118134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.118610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.120173 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 133/239] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:08.127787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45ca0b9d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.133368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.134360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.135749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.136198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.136774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.137219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.138269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.140298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.141043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.156786 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2cbf49ec-ad4d-47b5-8929-4585da0a9e4e tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.200023 Aug 27 03:08:08.170609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b12491d-126c-4cd8-a17d-bcff16cddb48 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.049057 Aug 27 03:08:08.172043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 134/240] 10.222.0.69 () {58 vars in 1128 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.176789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b41f540-8799-4189-8a87-f0dc358d4205 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.182687 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 107/241] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.194773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ab05acad-da3e-480f-a039-629e9324cca1 req-fc9dd18d-4649-43ea-b07b-e36f8a6f0aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b026b67e-945d-4c78-9188-bf4ffe4b96f2", "tag": "c674c030-659b-495f-a3b6-78ae3f00e7d7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:08.195119 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7b41f540-8799-4189-8a87-f0dc358d4205 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b41f540-8799-4189-8a87-f0dc358d4205 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Request method failure captured: Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpiZCUVsqtxl8z0CgwOqZoY0xTyBw6cGgKtqpzQAAlAxurtXU8jVwStC8drcz7lX04cxxErSL8GORucQUWUMmhdOVvgQI1vMghkUITFIpMEEn2UNeVrPBK8Lreiy9rklDi8lYcfvtrjv0G4N2X6zrVpsS_aXFo4XL_Yua8bsWWI2vU Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:08.197346 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/15c0754a026c41f2af55461725dddb70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_15c0754a026c41f2af55461725dddb70", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}] Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 694c985f20084dfdbb7c7f0ebd9c82bc Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: exception: Aggregate 5 could not be found. Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5'} Aug 27 03:08:08.198660 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:08.199394 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.200485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.201601 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.201601 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:08.201601 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:08.201601 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 03:08:08.201601 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.203820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b41f540-8799-4189-8a87-f0dc358d4205 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:08.205146 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b41f540-8799-4189-8a87-f0dc358d4205 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.032165 Aug 27 03:08:08.206224 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 135/242] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:08.213572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-757fba5c-48ac-456e-9f33-3981fadfd3bc tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Calling method '.version_select at 0x7fe45ca0b700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.213783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab05acad-da3e-480f-a039-629e9324cca1 req-fc9dd18d-4649-43ea-b07b-e36f8a6f0aa1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.214454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab05acad-da3e-480f-a039-629e9324cca1 req-fc9dd18d-4649-43ea-b07b-e36f8a6f0aa1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.214986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab05acad-da3e-480f-a039-629e9324cca1 req-fc9dd18d-4649-43ea-b07b-e36f8a6f0aa1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.216689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-757fba5c-48ac-456e-9f33-3981fadfd3bc tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '100593953b2047ab9d1df2c63943e660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f9177644d1470386d2c4e430821b44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-757fba5c-48ac-456e-9f33-3981fadfd3bc tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Request method failure captured: Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqUdn_7tB6dQmXAl6e9E4kdKn_zrCHYOID37mfDbG_uF1coItiBIM4styenFUVswF366Tgm8GtZx-dFrKQd5V5wiadS9z85tvxZz-ldyCfJOO4CbGJjPq250JRTB8t28JoFfJnLSRseSkAYEb3jA_NUDIqWzazjDmi6o_cPSFKRKbI Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:08.220035 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77f9177644d1470386d2c4e430821b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77f9177644d1470386d2c4e430821b44", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}] Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 100593953b2047ab9d1df2c63943e660 Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1'} Aug 27 03:08:08.221484 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:08.222532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 03:08:08.223741 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.226139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-757fba5c-48ac-456e-9f33-3981fadfd3bc tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:08.227205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-757fba5c-48ac-456e-9f33-3981fadfd3bc tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019840 Aug 27 03:08:08.227903 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 136/243] 10.222.0.69 () {58 vars in 1173 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:08.242406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45ca0bca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.247051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ab05acad-da3e-480f-a039-629e9324cca1 req-fc9dd18d-4649-43ea-b07b-e36f8a6f0aa1 service nova] Creating event network-changed:c674c030-659b-495f-a3b6-78ae3f00e7d7 for instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 on n-h2-852086-5 Aug 27 03:08:08.258520 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ab05acad-da3e-480f-a039-629e9324cca1 req-fc9dd18d-4649-43ea-b07b-e36f8a6f0aa1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074310 Aug 27 03:08:08.260425 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 108/244] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.263466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.263991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.266480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.268089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63fcf625-ce98-4d25-9234-8513d25f69e1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1606161981", "name": "tempest-test_aggregate-1690433029"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:08.304648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-63fcf625-ce98-4d25-9234-8513d25f69e1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid 520a7b4e-1039-4a07-a278-a362ce7236d6 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:08.315446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.318247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.319208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.347112 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63fcf625-ce98-4d25-9234-8513d25f69e1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.082530 Aug 27 03:08:08.353374 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 109/245] 10.222.0.69 () {60 vars in 1165 bytes} [Sat Aug 27 03:08:08 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.369479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7612b2bd-a0ac-47f5-98f8-8d06c25e8643 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Calling method '.version_select at 0x7fe45ce7e040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.375843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7612b2bd-a0ac-47f5-98f8-8d06c25e8643 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] HTTP exception thrown: Hypervisor with ID '28af6661-44fb-4978-bbdb-65fe6877b951' could not be found. Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7612b2bd-a0ac-47f5-98f8-8d06c25e8643 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Request method failure captured: Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/28af6661-44fb-4978-bbdb-65fe6877b951/uptime HTTP/1.1 Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqWHkjM3pDMpNIdv-__JKoW0dx7QowgkuaDedcBuhlm2BIhg2Vzh8z8ut9Dlmk6tP-BniQbi2NYeAg8KHK3zN9on5Qgr3-SmWDBVVYIGmVaL_snmS2OM8e9h7w63RziXyrNXuTj_AOlktztktK4uqNsnJn4naiij6iMnmPKYT5T3rw Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 31a4c4e0afae41d69ca58550bf59be07 Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2108626781 Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:08:08.397695 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/31a4c4e0afae41d69ca58550bf59be07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/31a4c4e0afae41d69ca58550bf59be07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_31a4c4e0afae41d69ca58550bf59be07", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/31a4c4e0afae41d69ca58550bf59be07"}]}] Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2108626781 Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 31a4c4e0afae41d69ca58550bf59be07 Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2108626781 Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 38544d6151204c359ad8a10ef3ca1823 Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: exception: Hypervisor with ID '28af6661-44fb-4978-bbdb-65fe6877b951' could not be found. Aug 27 03:08:08.399053 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '28af6661-44fb-4978-bbdb-65fe6877b951'} Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '28af6661-44fb-4978-bbdb-65fe6877b951' Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 03:08:08.399765 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '28af6661-44fb-4978-bbdb-65fe6877b951' could not be found. Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.401136 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.403364 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.403364 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.403364 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.403364 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:08.403364 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:08.403364 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '28af6661-44fb-4978-bbdb-65fe6877b951' could not be found. Aug 27 03:08:08.403364 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.405603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7612b2bd-a0ac-47f5-98f8-8d06c25e8643 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Returning 404 to user: Hypervisor with ID '28af6661-44fb-4978-bbdb-65fe6877b951' could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:08.407268 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7612b2bd-a0ac-47f5-98f8-8d06c25e8643 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/28af6661-44fb-4978-bbdb-65fe6877b951/uptime" status: 404 len: 123 microversion: 2.1 time: 0.045456 Aug 27 03:08:08.408136 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 110/246] 10.222.0.69 () {58 vars in 1278 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-hypervisors/28af6661-44fb-4978-bbdb-65fe6877b951/uptime => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:08.416233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a22e1ed1-7a9b-454f-888e-a86d0fb40be2 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-h2-852086-5" status: 200 len: 598 microversion: 2.1 time: 0.179379 Aug 27 03:08:08.416763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43a34163-1e67-40cf-b6c2-b917adc740bb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.422801 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 137/247] 10.222.0.69 () {58 vars in 1170 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-hosts/n-h2-852086-5 => generated 598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.428346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Calling method '.version_select at 0x7fe45ca0b430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.430770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.431528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.433753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.455417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.456540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.457290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.467814 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43a34163-1e67-40cf-b6c2-b917adc740bb tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.056507 Aug 27 03:08:08.468468 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 111/248] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:08 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:08.473844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.474412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.475168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.483087 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f43ba87-300f-451b-a23f-c05c80da07b2 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058944 Aug 27 03:08:08.485336 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 138/249] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.485476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Calling method '.version_select at 0x7fe45cbe75e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.496071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c9bf515-37d4-405d-9cf6-a9cb1fb443f1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.502026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.504681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.505143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.525817 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-8c9bf515-37d4-405d-9cf6-a9cb1fb443f1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c9bf515-37d4-405d-9cf6-a9cb1fb443f1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Request method failure captured: Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpiZCUVsqtxl8z0CgwOqZoY0xTyBw6cGgKtqpzQAAlAxurtXU8jVwStC8drcz7lX04cxxErSL8GORucQUWUMmhdOVvgQI1vMghkUITFIpMEEn2UNeVrPBK8Lreiy9rklDi8lYcfvtrjv0G4N2X6zrVpsS_aXFo4XL_Yua8bsWWI2vU Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:08.528823 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/15c0754a026c41f2af55461725dddb70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_15c0754a026c41f2af55461725dddb70", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}] Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 694c985f20084dfdbb7c7f0ebd9c82bc Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: exception: Aggregate 6 could not be found. Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6'} Aug 27 03:08:08.530021 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.531469 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 27 03:08:08.532879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.539740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c9bf515-37d4-405d-9cf6-a9cb1fb443f1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:08.541580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.542096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.543765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.545379 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c9bf515-37d4-405d-9cf6-a9cb1fb443f1 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.054873 Aug 27 03:08:08.548132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 139/250] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:08.558374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31af7039-5e2d-4351-9940-1d474289a297 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Calling method '.version_select at 0x7fe45ca25ca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.562945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-31af7039-5e2d-4351-9940-1d474289a297 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '100593953b2047ab9d1df2c63943e660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f9177644d1470386d2c4e430821b44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31af7039-5e2d-4351-9940-1d474289a297 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Request method failure captured: Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqUdn_7tB6dQmXAl6e9E4kdKn_zrCHYOID37mfDbG_uF1coItiBIM4styenFUVswF366Tgm8GtZx-dFrKQd5V5wiadS9z85tvxZz-ldyCfJOO4CbGJjPq250JRTB8t28JoFfJnLSRseSkAYEb3jA_NUDIqWzazjDmi6o_cPSFKRKbI Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:08.566441 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77f9177644d1470386d2c4e430821b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77f9177644d1470386d2c4e430821b44", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77f9177644d1470386d2c4e430821b44"}]}] Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 77f9177644d1470386d2c4e430821b44 Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983 Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 100593953b2047ab9d1df2c63943e660 Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1772159983-project Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1'} Aug 27 03:08:08.567701 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:08.568429 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 03:08:08.569470 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:08.573720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31af7039-5e2d-4351-9940-1d474289a297 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:08.574957 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-31af7039-5e2d-4351-9940-1d474289a297 tempest-HypervisorAdminNegativeTestJSON-1772159983 tempest-HypervisorAdminNegativeTestJSON-1772159983-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.024349 Aug 27 03:08:08.581405 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 140/251] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:08.587908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.588919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:08.590852 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd5e648d-4a8b-4384-a766-73ba58b670f1 tempest-HostsAdminTestJSON-1099956058 tempest-HostsAdminTestJSON-1099956058-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-h1-852086-5" status: 200 len: 598 microversion: 2.1 time: 0.112975 Aug 27 03:08:08.592442 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 112/252] 10.222.0.69 () {58 vars in 1170 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/os-hosts/n-h1-852086-5 => generated 598 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:08.598045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.599401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.600019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.600933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.601819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.602445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.606608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:08.608169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:08.624514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.625064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.625745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:08.626524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:08.626994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:08.627532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:09.076500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:09.091136 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92a5aee8-e491-41f6-b82a-722724189ae7 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1388 microversion: 2.1 time: 0.508130 Aug 27 03:08:09.093848 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 141/253] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1388 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:09.102592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eed25e69-9b91-4439-ad21-451801ddee16 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:09.124931 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-eed25e69-9b91-4439-ad21-451801ddee16 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eed25e69-9b91-4439-ad21-451801ddee16 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Request method failure captured: Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpiZCUVsqtxl8z0CgwOqZoY0xTyBw6cGgKtqpzQAAlAxurtXU8jVwStC8drcz7lX04cxxErSL8GORucQUWUMmhdOVvgQI1vMghkUITFIpMEEn2UNeVrPBK8Lreiy9rklDi8lYcfvtrjv0G4N2X6zrVpsS_aXFo4XL_Yua8bsWWI2vU Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:09.127860 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/15c0754a026c41f2af55461725dddb70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_15c0754a026c41f2af55461725dddb70", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/15c0754a026c41f2af55461725dddb70"}]}] Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 15c0754a026c41f2af55461725dddb70 Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1585406636 Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 694c985f20084dfdbb7c7f0ebd9c82bc Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminTestJSON-1585406636-project-admin Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: exception: Aggregate 6 could not be found. Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6'} Aug 27 03:08:09.129115 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:09.129817 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.130853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:09.131949 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:09.131949 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:09.131949 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:09.131949 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 27 03:08:09.131949 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.133473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eed25e69-9b91-4439-ad21-451801ddee16 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:09.134734 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eed25e69-9b91-4439-ad21-451801ddee16 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.039109 Aug 27 03:08:09.142517 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 142/254] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:09.156128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b274bc9e-3238-4634-877a-2500a10ec106 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Calling method '.version_select at 0x7fe45ca25310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:09.158569 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b274bc9e-3238-4634-877a-2500a10ec106 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] HTTP exception thrown: Hypervisor with ID 'ae324ca7-bcfb-493c-97ec-a5a2bacfe48c' could not be found. Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b274bc9e-3238-4634-877a-2500a10ec106 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Request method failure captured: Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors/ae324ca7-bcfb-493c-97ec-a5a2bacfe48c HTTP/1.1 Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqWHkjM3pDMpNIdv-__JKoW0dx7QowgkuaDedcBuhlm2BIhg2Vzh8z8ut9Dlmk6tP-BniQbi2NYeAg8KHK3zN9on5Qgr3-SmWDBVVYIGmVaL_snmS2OM8e9h7w63RziXyrNXuTj_AOlktztktK4uqNsnJn4naiij6iMnmPKYT5T3rw Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 31a4c4e0afae41d69ca58550bf59be07 Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2108626781 Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:09.161257 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/31a4c4e0afae41d69ca58550bf59be07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/31a4c4e0afae41d69ca58550bf59be07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_31a4c4e0afae41d69ca58550bf59be07", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/31a4c4e0afae41d69ca58550bf59be07"}]}] Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2108626781 Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 31a4c4e0afae41d69ca58550bf59be07 Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2108626781 Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 38544d6151204c359ad8a10ef3ca1823 Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: exception: Hypervisor with ID 'ae324ca7-bcfb-493c-97ec-a5a2bacfe48c' could not be found. Aug 27 03:08:09.162601 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ae324ca7-bcfb-493c-97ec-a5a2bacfe48c'} Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ae324ca7-bcfb-493c-97ec-a5a2bacfe48c' Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 03:08:09.163455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:08:09.164577 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ae324ca7-bcfb-493c-97ec-a5a2bacfe48c' could not be found. Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ae324ca7-bcfb-493c-97ec-a5a2bacfe48c' could not be found. Aug 27 03:08:09.165610 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:09.169906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b274bc9e-3238-4634-877a-2500a10ec106 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] Returning 404 to user: Hypervisor with ID 'ae324ca7-bcfb-493c-97ec-a5a2bacfe48c' could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:09.174225 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b274bc9e-3238-4634-877a-2500a10ec106 tempest-HypervisorAdminNegativeTestJSON-2108626781 tempest-HypervisorAdminNegativeTestJSON-2108626781-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/ae324ca7-bcfb-493c-97ec-a5a2bacfe48c" status: 404 len: 123 microversion: 2.1 time: 0.029762 Aug 27 03:08:09.174896 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 143/255] 10.222.0.69 () {58 vars in 1257 bytes} [Sat Aug 27 03:08:09 2022] GET /compute/v2.1/os-hypervisors/ae324ca7-bcfb-493c-97ec-a5a2bacfe48c => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:09.205382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:09.212537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:09.224422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:09.251786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:09.252324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:09.253107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:09.257290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:09.257824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:09.259750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:09.268161 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6bf47ade-ef0c-4ab2-8f16-125646993e6b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.673804 Aug 27 03:08:09.279026 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 113/256] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:08 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:09.285177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-75262aab-28aa-40da-875e-53082b218f26 req-fd7dea93-fbac-4bf1-97d9-70645ddf9daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50391137-b227-49eb-8694-c599b899a117", "name": "network-vif-plugged", "status": "completed", "tag": "3f471807-d996-408f-bf48-36d371055ba3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:09.308570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75262aab-28aa-40da-875e-53082b218f26 req-fd7dea93-fbac-4bf1-97d9-70645ddf9daf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:09.310801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75262aab-28aa-40da-875e-53082b218f26 req-fd7dea93-fbac-4bf1-97d9-70645ddf9daf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:09.311611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75262aab-28aa-40da-875e-53082b218f26 req-fd7dea93-fbac-4bf1-97d9-70645ddf9daf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:09.343738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-75262aab-28aa-40da-875e-53082b218f26 req-fd7dea93-fbac-4bf1-97d9-70645ddf9daf service nova] Creating event network-vif-plugged:3f471807-d996-408f-bf48-36d371055ba3 for instance 50391137-b227-49eb-8694-c599b899a117 on n-h1-852086-5 Aug 27 03:08:09.364316 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-75262aab-28aa-40da-875e-53082b218f26 req-fd7dea93-fbac-4bf1-97d9-70645ddf9daf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081637 Aug 27 03:08:09.364965 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 114/257] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:09.379182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:09.379900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:09.399012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:09.400440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:09.401874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:09.403611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:09.404628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:09.405612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:09.810076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:09.825052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c102ae4-c7bd-4311-a381-1be5dd18ad7a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1271 microversion: 2.1 time: 0.649017 Aug 27 03:08:09.831438 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 144/258] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:09 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1271 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:09.836691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-597ceb04-be71-41f6-b187-782548a2271d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1049313945"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:09.853611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-597ceb04-be71-41f6-b187-782548a2271d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid cece12c5-3ea3-434d-8938-84dd8f91004b for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:09.871094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:09.914465 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-597ceb04-be71-41f6-b187-782548a2271d tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081476 Aug 27 03:08:09.915793 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 145/259] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:09.927846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-70a8bb68-8b60-4935-81e7-544a2b3cb68c tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:09.954226 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-70a8bb68-8b60-4935-81e7-544a2b3cb68c tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 227 microversion: 2.1 time: 0.030840 Aug 27 03:08:09.962248 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 146/260] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:08:09 2022] GET /compute/v2.1/os-aggregates/7 => generated 227 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:09.975961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-67b0b422-c6b7-492a-b391-e34ea1432382 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:10.028121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:10.035091 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-67b0b422-c6b7-492a-b391-e34ea1432382 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 265 microversion: 2.1 time: 0.064449 Aug 27 03:08:10.036502 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 147/261] 10.222.0.69 () {60 vars in 1191 bytes} [Sat Aug 27 03:08:09 2022] POST /compute/v2.1/os-aggregates/7/action => generated 265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:10.041935 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8d0217b-21b8-4fcf-b325-24593b710381 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 0.675659 Aug 27 03:08:10.042853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 115/262] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:09 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:10.064461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4a749db-a7c9-4797-9825-ef7fe2cedc10 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:10.085724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4a749db-a7c9-4797-9825-ef7fe2cedc10 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 241 microversion: 2.1 time: 0.029686 Aug 27 03:08:10.089626 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 148/263] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:08:10 2022] GET /compute/v2.1/os-aggregates/7 => generated 241 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:10.102446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e3be9a6-6889-4e4d-b949-eafd37c90571 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:10.116946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:10.117562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:10.134876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.135439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.135811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.136527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.143241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.145287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.146634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e3be9a6-6889-4e4d-b949-eafd37c90571 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.047951 Aug 27 03:08:10.149889 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 116/264] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:10 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:10.190267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8127810-df17-4e77-9cb0-7cb4ba46280e tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-975512706", "availability_zone": "tempest-test_az-1048649756"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:10.205261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-c8127810-df17-4e77-9cb0-7cb4ba46280e tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid a6c55b4c-e915-40b6-b74e-e3d359892bde for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:10.279143 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8127810-df17-4e77-9cb0-7cb4ba46280e tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.104690 Aug 27 03:08:10.286828 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 117/265] 10.222.0.69 () {60 vars in 1165 bytes} [Sat Aug 27 03:08:10 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:10.293824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53215b79-1c47-4d46-8d82-3bdb25c69092 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-975512706_new", "availability_zone": "tempest-test_az-1048649756_new"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:10.519911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215b79-1c47-4d46-8d82-3bdb25c69092 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.521043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215b79-1c47-4d46-8d82-3bdb25c69092 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.522696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215b79-1c47-4d46-8d82-3bdb25c69092 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.573090 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53215b79-1c47-4d46-8d82-3bdb25c69092 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-aggregates/8" status: 200 len: 335 microversion: 2.1 time: 0.283288 Aug 27 03:08:10.582083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 118/266] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:08:10 2022] PUT /compute/v2.1/os-aggregates/8 => generated 335 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:10.591246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:10.593365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:10.601371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.602673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.603224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.604166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.605059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.605993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.612858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:10.770975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:10.789804 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c311e49b-929d-403a-8a58-9656ef1c74c9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1588 microversion: 2.1 time: 0.676683 Aug 27 03:08:10.795142 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 149/267] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:10 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1588 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:10.823001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41a7b948-0806-400c-b494-b0cfa99beadc tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:10.833618 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41a7b948-0806-400c-b494-b0cfa99beadc tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.015673 Aug 27 03:08:10.836361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 150/268] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:08:10 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:10.846299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:10.847346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:10.855670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.856425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.857081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:10.858033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:10.859295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:10.859964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.103796 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e5311fe0-9217-4caf-82a8-6e619c261b7e tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.266031 Aug 27 03:08:11.105028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 151/269] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:08:10 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:11.118764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-447d0767-c890-42f4-bee3-6de4758b164f tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.168582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:11.178914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-447d0767-c890-42f4-bee3-6de4758b164f tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.064362 Aug 27 03:08:11.181432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-389fc780-4c61-4f0a-829e-ac3b2f3223f1 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.598025 Aug 27 03:08:11.182300 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 152/270] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:11.184783 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 119/271] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:10 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:11.201426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.204792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.210937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:11.212116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:11.229703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.230634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.231801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.232760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.233474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.234457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.235865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.236530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.246584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.247562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.248062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.248509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.469435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:11.488712 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-31a0717e-d731-40ca-9795-212cca6a1b34 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1269 microversion: 2.1 time: 0.304320 Aug 27 03:08:11.516575 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 153/272] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:11 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1269 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:11.523127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8509923c-d7cc-43ac-b28a-7cda3afdf579 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1760035157"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:11.526598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-8509923c-d7cc-43ac-b28a-7cda3afdf579 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Generated uuid 8c45b79b-18bb-4e4a-a85d-094e0f2abd61 for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:11.569783 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8509923c-d7cc-43ac-b28a-7cda3afdf579 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051842 Aug 27 03:08:11.573757 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 154/273] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:11.583023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab9d10e3-eb38-44c1-8964-f16feea0c100 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.592207 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab9d10e3-eb38-44c1-8964-f16feea0c100 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.012759 Aug 27 03:08:11.594502 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 155/274] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:08:11 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:11.606885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b5bf16d-9d6f-4ec4-9086-c8c999dbbb91 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.638754 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b5bf16d-9d6f-4ec4-9086-c8c999dbbb91 tempest-AggregatesAdminTestJSON-1585406636 tempest-AggregatesAdminTestJSON-1585406636-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.036918 Aug 27 03:08:11.640641 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 156/275] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:11 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:11.657336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.658211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:11.675818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.676610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.677751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.678752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.679644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.680860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.726735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] HTTP exception thrown: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Request method failure captured: Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 HTTP/1.1 Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpfFozMSJaOOPoEsvK3UhFdpidlnHy831ZiRWhWh2wPcQEq7grl5Kqc--zk0Da7YKctwusgHii5kGd_WZ7RXgFvbyb5PI_nDKnuliRBInfbkoiJoS597muly3TldADc6GTn_kIc9mfDcOc-RXc9n4km59k1J0NRKuvD7WCPIXqymJU Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d2e8227a74394648bb22269c12712a97 Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:11.732471 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d2e8227a74394648bb22269c12712a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2e8227a74394648bb22269c12712a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d2e8227a74394648bb22269c12712a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2e8227a74394648bb22269c12712a97"}]}] Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d2e8227a74394648bb22269c12712a97 Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminTestJSON-1886446157-project Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d76cf7013697454098207ea971e8f64d Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminTestJSON-1886446157-project Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.734431 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '23a24b96-909e-41b4-99cb-b6f445ec32b5'} Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:11.735071 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.736104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.737155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Returning 404 to user: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:11.738686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9e98f4c-0cc2-4f90-ab41-d809063690ae tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "DELETE /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 404 len: 111 microversion: 2.1 time: 0.091608 Aug 27 03:08:11.741678 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 157/276] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:11 2022] DELETE /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:11.771507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:11.772297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] [instance: 23a24b96-909e-41b4-99cb-b6f445ec32b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:11.779530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.780581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.782076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.782921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:11.783402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:11.783882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:11.806250 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] HTTP exception thrown: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Request method failure captured: Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 HTTP/1.1 Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpfFozMSJaOOPoEsvK3UhFdpidlnHy831ZiRWhWh2wPcQEq7grl5Kqc--zk0Da7YKctwusgHii5kGd_WZ7RXgFvbyb5PI_nDKnuliRBInfbkoiJoS597muly3TldADc6GTn_kIc9mfDcOc-RXc9n4km59k1J0NRKuvD7WCPIXqymJU Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d2e8227a74394648bb22269c12712a97 Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:11.808225 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d2e8227a74394648bb22269c12712a97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2e8227a74394648bb22269c12712a97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d2e8227a74394648bb22269c12712a97", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2e8227a74394648bb22269c12712a97"}]}] Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d2e8227a74394648bb22269c12712a97 Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1886446157 Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminTestJSON-1886446157-project Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d76cf7013697454098207ea971e8f64d Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminTestJSON-1886446157-project Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.809399 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '23a24b96-909e-41b4-99cb-b6f445ec32b5'} Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:11.810047 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. Aug 27 03:08:11.815048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:11.816350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] Returning 404 to user: Instance 23a24b96-909e-41b4-99cb-b6f445ec32b5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:11.816350 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c5f94f99-8bf5-4b73-a163-dbc47881f89e tempest-AggregatesAdminTestJSON-1886446157 tempest-AggregatesAdminTestJSON-1886446157-project] 10.222.0.69 "GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5" status: 404 len: 111 microversion: 2.1 time: 0.065182 Aug 27 03:08:11.816350 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 158/277] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:11 2022] GET /compute/v2.1/servers/23a24b96-909e-41b4-99cb-b6f445ec32b5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:12.191590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:12.211283 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e313a4a0-d605-4ca6-aacb-7fa227c11a98 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1313 microversion: 2.1 time: 1.025215 Aug 27 03:08:12.217521 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 120/278] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:11 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1313 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:12.221148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:12.222928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:12.242375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.245386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.246932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.252668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.253949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.255273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.525854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:12.526587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:12.540016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.540629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.542377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.543220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:12.548353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:12.548927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:12.690597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:12.699611 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3bc1b273-e41d-4c31-96f5-20aa42bf585e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1269 microversion: 2.1 time: 0.179475 Aug 27 03:08:12.713163 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 121/279] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:12 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:13.108138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:13.117644 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a35069f-768d-4c35-8763-bb82ee1df614 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.906981 Aug 27 03:08:13.118245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 159/280] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:12 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:13.237567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:13.238784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:13.250464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.257705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.266362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.267497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.268178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.268831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.666504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:13.700815 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b19b9d3c-4e64-4f4a-a76e-19f87853cf1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1463 microversion: 2.1 time: 0.467526 Aug 27 03:08:13.705000 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 122/281] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:13 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1463 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:13.722220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:13.722930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:13.736645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.737916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.738610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:13.740732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:13.741995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:13.744136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:14.311102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:14.313015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:14.334716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:14.337850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:14.338535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:14.343803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:14.349602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:14.351951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:14.580402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:14.594376 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-535af2d8-0274-4e81-85bf-0f51c5efe228 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.877321 Aug 27 03:08:14.595780 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 160/282] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:13 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:14.607984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:14.613522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:14.632046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:14.636395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:14.637245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:14.640497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:14.641700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:14.644332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:14.659275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:15.367985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:15.377577 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0161c45-00b4-40ee-bf2a-8c21782a0585 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.780499 Aug 27 03:08:15.393187 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 161/283] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:14 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:15.542382 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81157ce8-5e1e-4a2c-94c0-12aac437cc57 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1614 microversion: 2.1 time: 1.816687 Aug 27 03:08:15.557223 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 123/284] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:13 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1614 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:15.576271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:15.577179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:15.584006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:15.584740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:15.585367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:15.586283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:15.586905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:15.587492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:15.619443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:15.620356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:15.630779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:15.634932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:15.637493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:15.641046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:15.642348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:15.642964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.040657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:16.082983 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9cb505a-4604-43cf-96c0-11f54275409f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.465344 Aug 27 03:08:16.086725 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 124/285] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:15 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:16.141463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ef5cbd20c90c4e7ab72e0b54c68ed1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdf9335d2fe4a71ba5399d5341e7320', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:16.142094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 50391137-b227-49eb-8694-c599b899a117] flavor_id is None. Assuming migration. {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:08:16.142569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 50391137-b227-49eb-8694-c599b899a117] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:08:16.314450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:16.315582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:16.333648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.334792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.335220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.338370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.342284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.343292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.605894 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3593cdfc-07ed-4f44-b4d5-9ef63460865d tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117/action" status: 202 len: 0 microversion: 2.1 time: 1.032977 Aug 27 03:08:16.612939 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 162/286] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:08:15 2022] POST /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:08:16.630939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7bc512fe-1a7e-4188-ba43-f307913880c3 req-21fd328a-153a-4d5b-97fc-8c36002720b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d7f6bd-104d-4e57-b004-56b81816b5bf", "tag": "bce7b3ed-6f63-429a-b150-3d61e314704f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:16.672710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7bc512fe-1a7e-4188-ba43-f307913880c3 req-21fd328a-153a-4d5b-97fc-8c36002720b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.674345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7bc512fe-1a7e-4188-ba43-f307913880c3 req-21fd328a-153a-4d5b-97fc-8c36002720b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.677718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7bc512fe-1a7e-4188-ba43-f307913880c3 req-21fd328a-153a-4d5b-97fc-8c36002720b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.710527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7bc512fe-1a7e-4188-ba43-f307913880c3 req-21fd328a-153a-4d5b-97fc-8c36002720b8 service nova] Creating event network-changed:bce7b3ed-6f63-429a-b150-3d61e314704f for instance b8d7f6bd-104d-4e57-b004-56b81816b5bf on n-h1-852086-5 Aug 27 03:08:16.729495 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7bc512fe-1a7e-4188-ba43-f307913880c3 req-21fd328a-153a-4d5b-97fc-8c36002720b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114693 Aug 27 03:08:16.731149 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 163/287] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:16.756431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:16.769860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:16.774935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.783627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.784313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.786534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:16.787888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:16.789691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:16.922744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:17.257530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:17.268770 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9e1e792-6e3d-4fb8-9cfb-3917b6e2116f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.532777 Aug 27 03:08:17.269361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 164/288] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:16 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:17.294124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:17.299180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:17.322349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:17.328014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:17.328818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:17.331432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:17.332412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:17.333612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:17.339066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:17.354450 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b74f0ff-b3f5-43b8-8fff-b02bb2ae489d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 200 len: 1588 microversion: 2.1 time: 1.045496 Aug 27 03:08:17.360289 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 125/289] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:16 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 1588 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:17.378215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:17.379092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:17.398421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:17.401142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:17.405706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:17.408990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:17.410910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:17.412377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:17.661213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=18 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:17.836018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:17.928644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:17.945191 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f53d0a45-4cf8-420e-bea5-29c2d992ce55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1472 microversion: 2.1 time: 0.671987 Aug 27 03:08:17.947044 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 165/290] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:17 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1472 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:17.959713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-db741947-2ebf-4e35-8301-0202c66fcae5 req-77e99b0b-fd02-4919-b892-bdd5bf6fa5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b026b67e-945d-4c78-9188-bf4ffe4b96f2", "name": "network-vif-plugged", "status": "completed", "tag": "c674c030-659b-495f-a3b6-78ae3f00e7d7"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:17.999499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-db741947-2ebf-4e35-8301-0202c66fcae5 req-77e99b0b-fd02-4919-b892-bdd5bf6fa5a8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.001633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-db741947-2ebf-4e35-8301-0202c66fcae5 req-77e99b0b-fd02-4919-b892-bdd5bf6fa5a8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.002590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-db741947-2ebf-4e35-8301-0202c66fcae5 req-77e99b0b-fd02-4919-b892-bdd5bf6fa5a8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.035531 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-db741947-2ebf-4e35-8301-0202c66fcae5 req-77e99b0b-fd02-4919-b892-bdd5bf6fa5a8 service nova] Creating event network-vif-plugged:c674c030-659b-495f-a3b6-78ae3f00e7d7 for instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 on n-h2-852086-5 Aug 27 03:08:18.052709 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-db741947-2ebf-4e35-8301-0202c66fcae5 req-77e99b0b-fd02-4919-b892-bdd5bf6fa5a8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097594 Aug 27 03:08:18.055090 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 166/291] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:18.288757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:18.295924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:18.298787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:18.310722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.312570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.313501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.315867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.316595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.317919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.559461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:18.575097 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-954fa56c-97b8-4544-9768-0c2e28245409 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 1.206786 Aug 27 03:08:18.577455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 126/292] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:17 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:18.669229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:18.695051 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-425a81ba-1f14-4a24-bf40-a25e6ea41f0f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.406685 Aug 27 03:08:18.698948 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 167/293] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:18 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:18.786689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-83120466-2175-4812-9543-18625184ad16 req-47e8bbc4-432d-42e8-81c7-356e64e9bfce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037", "tag": "4334a30f-24f4-491f-8ecf-cdb1ac1394b1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:18.812811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-83120466-2175-4812-9543-18625184ad16 req-47e8bbc4-432d-42e8-81c7-356e64e9bfce service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.813631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-83120466-2175-4812-9543-18625184ad16 req-47e8bbc4-432d-42e8-81c7-356e64e9bfce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.814389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-83120466-2175-4812-9543-18625184ad16 req-47e8bbc4-432d-42e8-81c7-356e64e9bfce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.843375 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-83120466-2175-4812-9543-18625184ad16 req-47e8bbc4-432d-42e8-81c7-356e64e9bfce service nova] Creating event network-changed:4334a30f-24f4-491f-8ecf-cdb1ac1394b1 for instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 on n-h2-852086-5 Aug 27 03:08:18.854547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-83120466-2175-4812-9543-18625184ad16 req-47e8bbc4-432d-42e8-81c7-356e64e9bfce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070833 Aug 27 03:08:18.859551 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 168/294] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:18.969661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:18.970567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:18.982562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.985803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.986853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:18.989062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:18.990711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:18.992296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:19.316913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Calling method '.version_select at 0x7fe45cf60d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:19.320930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:19.321450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:19.322241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:19.322995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:19.323458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:19.323896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:19.396865 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38de0c7f-88b9-49fe-adca-3cefcc6906cd tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.810340 Aug 27 03:08:19.397546 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 127/295] 10.222.0.69 () {58 vars in 1128 bytes} [Sat Aug 27 03:08:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:19.471013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:19.497324 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-292647be-f78d-4b47-817a-214a3573fc8d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1472 microversion: 2.1 time: 0.528021 Aug 27 03:08:19.501171 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 169/296] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:18 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:19.600823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:19.602123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:19.612404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:19.619178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:19.621180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:19.623109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:19.623981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:19.627734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:19.854782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bf08948-a21d-4547-81eb-fa25638d0d3a tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Calling method '.version_select at 0x7fe45cb709d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:19.861368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6bf08948-a21d-4547-81eb-fa25638d0d3a tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'e6a6cf3cca1e4e148ef73581970c7edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fffe013a804a7b935c53081f9a6da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bf08948-a21d-4547-81eb-fa25638d0d3a tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Request method failure captured: Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqgMAHf37kjNHs3QVZoccsVkxbwN7nKZEl63cs9hoyMul_f5ju0wAOFdg2wtTqMyyvdne23oYUFYUXRX2fqr3JC6SUH4PlaqJmf47enqcPOLmJD68rAJtAcMJPiYdv1SnsJuWejZML_6j2_YGgud75EzsJUxXdkTbyplFYmiZjZ_W8 Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:19.863499 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47fffe013a804a7b935c53081f9a6da7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}] Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: e6a6cf3cca1e4e148ef73581970c7edb Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: action_args: {} Aug 27 03:08:19.864703 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:19.865482 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 03:08:19.866516 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:19.867624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bf08948-a21d-4547-81eb-fa25638d0d3a tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:19.867624 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6bf08948-a21d-4547-81eb-fa25638d0d3a tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] 10.222.0.69 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.458099 Aug 27 03:08:19.870345 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 128/297] 10.222.0.69 () {58 vars in 1128 bytes} [Sat Aug 27 03:08:19 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 465 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:19.996448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.019487 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3686c356-cb33-4c90-b692-701ce42e24b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.418504 Aug 27 03:08:20.034677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 170/298] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:19 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:20.034677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.034677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:20.042828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:20.043754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:20.044471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:20.047511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:20.052197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:20.053331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:20.101286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-77301355", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:20.190669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:20.241846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.261961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1992fffd-7ca8-4546-b20e-f2f920698353 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1320 microversion: 2.1 time: 0.237397 Aug 27 03:08:20.265786 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 171/299] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:20.283723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e520869b-3636-4cdb-931f-d200e5bf0b23 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Calling method '.version_select at 0x7fe45c918dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.285520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e520869b-3636-4cdb-931f-d200e5bf0b23 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'e6a6cf3cca1e4e148ef73581970c7edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fffe013a804a7b935c53081f9a6da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e520869b-3636-4cdb-931f-d200e5bf0b23 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Request method failure captured: Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hosts/n-d-852086-5/reboot HTTP/1.1 Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqgMAHf37kjNHs3QVZoccsVkxbwN7nKZEl63cs9hoyMul_f5ju0wAOFdg2wtTqMyyvdne23oYUFYUXRX2fqr3JC6SUH4PlaqJmf47enqcPOLmJD68rAJtAcMJPiYdv1SnsJuWejZML_6j2_YGgud75EzsJUxXdkTbyplFYmiZjZ_W8 Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:20.288849 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47fffe013a804a7b935c53081f9a6da7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}] Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: e6a6cf3cca1e4e148ef73581970c7edb Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'n-d-852086-5'} Aug 27 03:08:20.290311 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:20.291023 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 03:08:20.292011 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.294684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e520869b-3636-4cdb-931f-d200e5bf0b23 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:20.296530 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e520869b-3636-4cdb-931f-d200e5bf0b23 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-852086-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.027018 Aug 27 03:08:20.299032 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 172/300] 10.222.0.69 () {58 vars in 1188 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/os-hosts/n-d-852086-5/reboot => generated 111 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:20.312169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e454611f-901d-43c1-9464-4674290db1f4 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Calling method '.version_select at 0x7fe45ca258b0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.329873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-e454611f-901d-43c1-9464-4674290db1f4 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e454611f-901d-43c1-9464-4674290db1f4 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:20.335496 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'nonexistent_hostname'} Aug 27 03:08:20.336912 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:20.337639 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 03:08:20.339547 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.340742 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.344536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e454611f-901d-43c1-9464-4674290db1f4 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:20.348022 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e454611f-901d-43c1-9464-4674290db1f4 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.043055 Aug 27 03:08:20.349581 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 173/301] 10.222.0.69 () {58 vars in 1212 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:08:20.365408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01c6807f-aa0a-4750-8f89-d683f9246436 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Calling method '.version_select at 0x7fe45c918dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.382331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01c6807f-aa0a-4750-8f89-d683f9246436 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'e6a6cf3cca1e4e148ef73581970c7edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fffe013a804a7b935c53081f9a6da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01c6807f-aa0a-4750-8f89-d683f9246436 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Request method failure captured: Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hosts/n-d-852086-5 HTTP/1.1 Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqgMAHf37kjNHs3QVZoccsVkxbwN7nKZEl63cs9hoyMul_f5ju0wAOFdg2wtTqMyyvdne23oYUFYUXRX2fqr3JC6SUH4PlaqJmf47enqcPOLmJD68rAJtAcMJPiYdv1SnsJuWejZML_6j2_YGgud75EzsJUxXdkTbyplFYmiZjZ_W8 Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:20.385527 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47fffe013a804a7b935c53081f9a6da7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}] Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: e6a6cf3cca1e4e148ef73581970c7edb Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'n-d-852086-5'} Aug 27 03:08:20.386910 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:20.387642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 03:08:20.388734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.395312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01c6807f-aa0a-4750-8f89-d683f9246436 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:20.396582 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-01c6807f-aa0a-4750-8f89-d683f9246436 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-852086-5" status: 403 len: 109 microversion: 2.1 time: 0.042926 Aug 27 03:08:20.398852 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 174/302] 10.222.0.69 () {58 vars in 1167 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/os-hosts/n-d-852086-5 => generated 109 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:20.426797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7dc9affe-7464-4483-8d95-67df53b36d03 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Calling method '.version_select at 0x7fe45c850310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.455189 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7dc9affe-7464-4483-8d95-67df53b36d03 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7dc9affe-7464-4483-8d95-67df53b36d03 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:20.461725 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'nonexistent_hostname'} Aug 27 03:08:20.463290 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.464132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.465358 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.466542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7dc9affe-7464-4483-8d95-67df53b36d03 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:20.466542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7dc9affe-7464-4483-8d95-67df53b36d03 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.056245 Aug 27 03:08:20.472264 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 175/303] 10.222.0.69 () {58 vars in 1191 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:20.478727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad255f90-34ef-4b14-b9b5-7b3aa89eeef1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Calling method '.version_select at 0x7fe45c9181f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.483098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad255f90-34ef-4b14-b9b5-7b3aa89eeef1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'e6a6cf3cca1e4e148ef73581970c7edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fffe013a804a7b935c53081f9a6da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad255f90-34ef-4b14-b9b5-7b3aa89eeef1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Request method failure captured: Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hosts/n-d-852086-5/shutdown HTTP/1.1 Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqgMAHf37kjNHs3QVZoccsVkxbwN7nKZEl63cs9hoyMul_f5ju0wAOFdg2wtTqMyyvdne23oYUFYUXRX2fqr3JC6SUH4PlaqJmf47enqcPOLmJD68rAJtAcMJPiYdv1SnsJuWejZML_6j2_YGgud75EzsJUxXdkTbyplFYmiZjZ_W8 Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:20.495326 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47fffe013a804a7b935c53081f9a6da7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}] Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: e6a6cf3cca1e4e148ef73581970c7edb Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'n-d-852086-5'} Aug 27 03:08:20.498139 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:20.499821 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 03:08:20.500875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.507514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad255f90-34ef-4b14-b9b5-7b3aa89eeef1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:20.507514 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad255f90-34ef-4b14-b9b5-7b3aa89eeef1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-852086-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.031566 Aug 27 03:08:20.513610 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 176/304] 10.222.0.69 () {58 vars in 1194 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/os-hosts/n-d-852086-5/shutdown => generated 113 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:20.524052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc5e241b-ba9b-4c88-95e3-30440abc1f2a tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Calling method '.version_select at 0x7fe45ca1f040>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.585922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-dc5e241b-ba9b-4c88-95e3-30440abc1f2a tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc5e241b-ba9b-4c88-95e3-30440abc1f2a tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:20.598788 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'nonexistent_hostname'} Aug 27 03:08:20.600132 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:20.600904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 03:08:20.601880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:20.604450 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:20.607018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc5e241b-ba9b-4c88-95e3-30440abc1f2a tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:20.608069 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc5e241b-ba9b-4c88-95e3-30440abc1f2a tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.092637 Aug 27 03:08:20.614507 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 177/305] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:20.626810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.633101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:20.661792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:20.665885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:20.668306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:20.668306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:20.668306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:20.676917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:20.692245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:20.692871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:20.693472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:20.693990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:20.694503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:20.727258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:20.728106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:20.729901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:20.732453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:20.735001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:20.735839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:20.806843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Getting quotas for project 9451395d2b9e466e82bc66428aea7cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:20.813927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Getting quotas for user 0f8514e80d604c27ba5f05b5a4e43daa and project 9451395d2b9e466e82bc66428aea7cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:20.843835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:20.846437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:20.974352 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47f91617-caa4-4240-af54-4279f96a903e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094179 Aug 27 03:08:20.975322 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 129/306] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:20.993440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc029b4f-5cf4-4f8d-b838-4f9ccc9192c1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Calling method '.version_select at 0x7fe45ce30700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:20.995457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc029b4f-5cf4-4f8d-b838-4f9ccc9192c1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'e6a6cf3cca1e4e148ef73581970c7edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fffe013a804a7b935c53081f9a6da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc029b4f-5cf4-4f8d-b838-4f9ccc9192c1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Request method failure captured: Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts/n-d-852086-5/startup HTTP/1.1 Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqgMAHf37kjNHs3QVZoccsVkxbwN7nKZEl63cs9hoyMul_f5ju0wAOFdg2wtTqMyyvdne23oYUFYUXRX2fqr3JC6SUH4PlaqJmf47enqcPOLmJD68rAJtAcMJPiYdv1SnsJuWejZML_6j2_YGgud75EzsJUxXdkTbyplFYmiZjZ_W8 Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:20.997066 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47fffe013a804a7b935c53081f9a6da7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}] Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: e6a6cf3cca1e4e148ef73581970c7edb Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'n-d-852086-5'} Aug 27 03:08:20.998352 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:20.999649 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 03:08:21.000652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.001569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc029b4f-5cf4-4f8d-b838-4f9ccc9192c1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:21.001569 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc029b4f-5cf4-4f8d-b838-4f9ccc9192c1 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] 10.222.0.69 "GET /compute/v2.1/os-hosts/n-d-852086-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.022395 Aug 27 03:08:21.020215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 130/307] 10.222.0.69 () {58 vars in 1191 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/os-hosts/n-d-852086-5/startup => generated 110 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:21.037421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-daa2db51-cfc9-41f7-8f68-43968ba7329f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:21.038458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-daa2db51-cfc9-41f7-8f68-43968ba7329f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:21.086439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.098739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56e18cdc-e455-4c53-9b54-bd0da452918a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1472 microversion: 2.1 time: 0.485306 Aug 27 03:08:21.099731 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 178/308] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:20 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1472 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:21.121499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b62e9ba-7b4e-4971-91bf-70b580c0849e tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Calling method '.version_select at 0x7fe45c942280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:21.143574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-0b62e9ba-7b4e-4971-91bf-70b580c0849e tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b62e9ba-7b4e-4971-91bf-70b580c0849e tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:21.148886 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'nonexistent_hostname'} Aug 27 03:08:21.150144 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:21.150970 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 03:08:21.151944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b62e9ba-7b4e-4971-91bf-70b580c0849e tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:21.152945 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b62e9ba-7b4e-4971-91bf-70b580c0849e tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.050382 Aug 27 03:08:21.156169 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 179/309] 10.222.0.69 () {58 vars in 1215 bytes} [Sat Aug 27 03:08:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:21.168876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:21.170861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:21.172768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-daa2db51-cfc9-41f7-8f68-43968ba7329f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.180547 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-daa2db51-cfc9-41f7-8f68-43968ba7329f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1220 microversion: 2.1 time: 0.159181 Aug 27 03:08:21.184615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.185116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.185798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.187211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.187820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.189585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.195292 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 131/310] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:21 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1220 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:21.449379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Calling method '.version_select at 0x7fe45ce44700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:21.456989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.459053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.461485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.469091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.479290 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-469c81d6-2c48-464b-969c-7ffc755b61dc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.317443 Aug 27 03:08:21.493155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 180/311] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:21 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:21.498383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f633cd45-0774-48b5-8d0e-d7f9eb147697 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c942f70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f633cd45-0774-48b5-8d0e-d7f9eb147697 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/os-hosts/n-d-852086-5 HTTP/1.1 Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 51 Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:21.503693 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: {"status": "enable", "maintenance_mode": "invalid"} Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:21.505172 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'n-d-852086-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance: Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.505904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.507320 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.509563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.509563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:08:21.509563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:08:21.509563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.509563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.511819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f633cd45-0774-48b5-8d0e-d7f9eb147697 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:21.512410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.512844 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f633cd45-0774-48b5-8d0e-d7f9eb147697 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-852086-5" status: 400 len: 199 microversion: 2.1 time: 0.018356 Aug 27 03:08:21.513061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.513691 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 181/312] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:08:21 2022] PUT /compute/v2.1/os-hosts/n-d-852086-5 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:08:21.513842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.531212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:21.532102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:21.552776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.554496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.557867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.558763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.559260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.559704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.566021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.566730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.567322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.574730 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3b3e870-b776-413a-bc0b-c464b8c8b59b tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.378433 Aug 27 03:08:21.588249 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 132/313] 10.222.0.69 () {60 vars in 1208 bytes} [Sat Aug 27 03:08:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:08:21.593527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61df143a-20e5-4a3b-9b8c-1e82d485dbfe tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Action: 'update', calling method: .version_select at 0x7fe45ccf8430>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61df143a-20e5-4a3b-9b8c-1e82d485dbfe tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-hosts/n-d-852086-5 HTTP/1.1 Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 51 Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:08:21.607121 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: {"status": "invalid", "maintenance_mode": "enable"} Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:21.609269 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'n-d-852086-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance: Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.610365 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.612002 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.613550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.613550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:08:21.613550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:08:21.613550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 03:08:21.613550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.613550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61df143a-20e5-4a3b-9b8c-1e82d485dbfe tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:21.613550 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61df143a-20e5-4a3b-9b8c-1e82d485dbfe tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-852086-5" status: 400 len: 189 microversion: 2.1 time: 0.020301 Aug 27 03:08:21.616196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 133/314] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:08:21 2022] PUT /compute/v2.1/os-hosts/n-d-852086-5 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:08:21.620867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af507bc6-4969-4610-85b2-94098ff72fe4 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1239937579"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.624416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-af507bc6-4969-4610-85b2-94098ff72fe4 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Generated uuid 8587c53c-a486-48f2-babd-5f847b97c4fe for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:21.637205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:21.662016 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af507bc6-4969-4610-85b2-94098ff72fe4 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.045196 Aug 27 03:08:21.671038 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 134/315] 10.222.0.69 () {62 vars in 1205 bytes} [Sat Aug 27 03:08:21 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:08:21.678606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf0d5a6e-04e1-4059-9b29-d84df2f3ec99 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Action: 'update', calling method: .version_select at 0x7fe45cd54310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.684387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf0d5a6e-04e1-4059-9b29-d84df2f3ec99 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'e6a6cf3cca1e4e148ef73581970c7edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fffe013a804a7b935c53081f9a6da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf0d5a6e-04e1-4059-9b29-d84df2f3ec99 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Request method failure captured: Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-hosts/n-d-852086-5 HTTP/1.1 Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 50 Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqgMAHf37kjNHs3QVZoccsVkxbwN7nKZEl63cs9hoyMul_f5ju0wAOFdg2wtTqMyyvdne23oYUFYUXRX2fqr3JC6SUH4PlaqJmf47enqcPOLmJD68rAJtAcMJPiYdv1SnsJuWejZML_6j2_YGgud75EzsJUxXdkTbyplFYmiZjZ_W8 Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:21.686626 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47fffe013a804a7b935c53081f9a6da7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47fffe013a804a7b935c53081f9a6da7"}]}] Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 47fffe013a804a7b935c53081f9a6da7 Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-135846263 Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: e6a6cf3cca1e4e148ef73581970c7edb Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-135846263-project Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 03:08:21.687947 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'n-d-852086-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:21.688691 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 03:08:21.689724 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.692681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf0d5a6e-04e1-4059-9b29-d84df2f3ec99 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:21.694431 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf0d5a6e-04e1-4059-9b29-d84df2f3ec99 tempest-HostsAdminNegativeTestJSON-135846263 tempest-HostsAdminNegativeTestJSON-135846263-project] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-852086-5" status: 403 len: 111 microversion: 2.1 time: 0.021643 Aug 27 03:08:21.700461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 135/316] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:08:21 2022] PUT /compute/v2.1/os-hosts/n-d-852086-5 => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:21.708773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-576698aa-28d1-4b21-8aea-c2d092c776d7 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1454247381"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.768170 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-576698aa-28d1-4b21-8aea-c2d092c776d7 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.065023 Aug 27 03:08:21.775984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 136/317] 10.222.0.69 () {62 vars in 1213 bytes} [Sat Aug 27 03:08:21 2022] PUT /compute/v2.1/os-aggregates/10 => generated 300 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:08:21.781157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48cfc841-f098-4319-9766-5591fe75c123 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Action: 'update', calling method: .version_select at 0x7fe45ce23d30>, body: {"status": null, "maintenance_mode": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48cfc841-f098-4319-9766-5591fe75c123 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-hosts/n-d-852086-5 HTTP/1.1 Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 42 Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:08:21.791508 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: {"status": null, "maintenance_mode": null} Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 03:08:21.792757 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'n-d-852086-5', 'body': {'status': None, 'maintenance_mode': None}} Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance: Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi None Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.793536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.800974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.803279 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:08:21.803279 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:08:21.803279 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 03:08:21.803279 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.803279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48cfc841-f098-4319-9766-5591fe75c123 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:21.803279 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48cfc841-f098-4319-9766-5591fe75c123 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/n-d-852086-5" status: 400 len: 127 microversion: 2.1 time: 0.020624 Aug 27 03:08:21.803279 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 137/318] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:08:21 2022] PUT /compute/v2.1/os-hosts/n-d-852086-5 => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:08:21.807490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9084171-2bd3-485c-b289-4bb842378649 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:21.830107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9084171-2bd3-485c-b289-4bb842378649 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.035183 Aug 27 03:08:21.830896 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 138/319] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 03:08:21 2022] GET /compute/v2.1/os-aggregates/10 => generated 300 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:08:21.844931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cc7718c-6002-40aa-9743-3a81658542b0 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Action: 'update', calling method: .version_select at 0x7fe45ce44f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.853913 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.hosts [None req-4cc7718c-6002-40aa-9743-3a81658542b0 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Enabling host nonexistent_hostname. Aug 27 03:08:21.873437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:21.877898 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4cc7718c-6002-40aa-9743-3a81658542b0 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cc7718c-6002-40aa-9743-3a81658542b0 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Request method failure captured: Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 50 Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqiTOiUeMy4goT0_NQjTbG21ZkKei76j7mnhn46WL0SgmfqfrKbIA_lNnJe5URhNb4iyemMcP1vJN8exf8ErvStr6r_198D521VVlWyPTJu_JjPHQnHBNBxx8gbTQHTG_kCZveMVgRREXrrc52VRvPvNmKt7Ew3OwDp7s8J3ohB8cc Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:08:21.881254 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_920724f7307645b7ba90b9a23f7d713a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/920724f7307645b7ba90b9a23f7d713a"}]}] Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 920724f7307645b7ba90b9a23f7d713a Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-945411862 Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f939f017745542d0a6b63d1039206c4e Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-945411862-project-admin Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.882569 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 03:08:21.883560 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:21.893985 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:21.899158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cc7718c-6002-40aa-9743-3a81658542b0 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:21.901809 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cc7718c-6002-40aa-9743-3a81658542b0 tempest-HostsAdminNegativeTestJSON-945411862 tempest-HostsAdminNegativeTestJSON-945411862-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.051378 Aug 27 03:08:21.901809 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 139/320] 10.222.0.69 () {60 vars in 1211 bytes} [Sat Aug 27 03:08:21 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:21.901809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f384d71f-4ca8-4052-9dbf-da51a5ad7ae9 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.913199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7660d390-c884-44c5-b7d3-0b934345ee50 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1469 microversion: 2.1 time: 0.394305 Aug 27 03:08:21.914504 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 182/321] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:21 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:21.931011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f384d71f-4ca8-4052-9dbf-da51a5ad7ae9 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.931613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f384d71f-4ca8-4052-9dbf-da51a5ad7ae9 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.932146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f384d71f-4ca8-4052-9dbf-da51a5ad7ae9 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.935898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.946612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:21.964101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.969210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.969989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:21.971004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:21.971536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:21.972456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.260493 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0f2d079-4e3c-4580-9f16-7baef1f660bf tempest-DeleteServersAdminTestJSON-143054489 tempest-DeleteServersAdminTestJSON-143054489-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2/action" status: 202 len: 0 microversion: 2.1 time: 0.330076 Aug 27 03:08:22.268142 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f384d71f-4ca8-4052-9dbf-da51a5ad7ae9 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 315 microversion: 2.41 time: 0.381652 Aug 27 03:08:22.268743 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 140/322] 10.222.0.69 () {62 vars in 1235 bytes} [Sat Aug 27 03:08:21 2022] POST /compute/v2.1/os-aggregates/10/action => generated 315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:08:22.275825 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 183/323] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:08:21 2022] POST /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:08:22.279218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:22.280298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:22.297101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:22.297101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:22.303279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.304261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.306314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.307219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.309406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.310307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.311494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.312363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.312757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.313484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.313948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.314406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.440936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:22.443923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:22.452905 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45823fba-68ff-4333-846a-d03d83024fde tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1216 microversion: 2.1 time: 0.175732 Aug 27 03:08:22.453490 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 184/324] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:22 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:22.480009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6662f6a8-3156-4d39-b653-2c57b1bf495f tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:22.492839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6662f6a8-3156-4d39-b653-2c57b1bf495f tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.493352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6662f6a8-3156-4d39-b653-2c57b1bf495f tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.495755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6662f6a8-3156-4d39-b653-2c57b1bf495f tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.643953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:22.652303 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a210e02-d1ac-48df-9350-2b71e4caabce tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1472 microversion: 2.1 time: 0.381369 Aug 27 03:08:22.656339 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 141/325] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:22 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:22.662994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:22.664059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:22.688181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.688971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.690554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.691569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.692416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.693473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.783935 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6662f6a8-3156-4d39-b653-2c57b1bf495f tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 300 microversion: 2.41 time: 0.326404 Aug 27 03:08:22.794561 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 185/326] 10.222.0.69 () {62 vars in 1235 bytes} [Sat Aug 27 03:08:22 2022] POST /compute/v2.1/os-aggregates/10/action => generated 300 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:08:22.799977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:22.800583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:22.811365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.811959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.812407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.813079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lazy-loading 'fault' on Instance uuid b026b67e-945d-4c78-9188-bf4ffe4b96f2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:22.829400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.830261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.834046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:22.835313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:22.835974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:22.836604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:23.421899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:23.443902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a999d44c-bf80-49b3-acf1-22132f888838 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.646512 Aug 27 03:08:23.455890 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 186/327] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:22 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:23.470371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3abd7113-eb8e-4080-bfbf-48519db43b21 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:23.501519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:23.539421 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3abd7113-eb8e-4080-bfbf-48519db43b21 tempest-AggregatesAdminTestV241-1216271562 tempest-AggregatesAdminTestV241-1216271562-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.081199 Aug 27 03:08:23.547155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 187/328] 10.222.0.69 () {60 vars in 1196 bytes} [Sat Aug 27 03:08:23 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:23.554960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:23.556174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:23.577810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:23.578822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:23.579437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:23.580734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:23.581970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:23.583024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:23.690270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:23.711967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7cac4f7d-cb02-4a72-9cb3-be0a91388999 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1452 microversion: 2.1 time: 1.052755 Aug 27 03:08:23.713310 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 142/329] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:22 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1452 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:23.721162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:23.722067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:23.732297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:23.733482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:23.734642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:23.735809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:23.736427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:23.737014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:23.784023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:23.797503 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ae4831a-2fe5-4dd6-950c-50de9f36547f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1278 microversion: 2.1 time: 0.248974 Aug 27 03:08:23.799080 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 188/330] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:23 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:23.811745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:23.812619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:23.828498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:23.831640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:23.832310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:23.834036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:23.835306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:23.835893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:23.912257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:08:24.079308 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2598a009-1cc1-411c-ae00-03af2e60cc2f tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 204 len: 0 microversion: 2.1 time: 0.276861 Aug 27 03:08:24.084077 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 189/331] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:23 2022] DELETE /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:08:24.092756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:24.094199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:24.103074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.103748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.104278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.105138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.105687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.106223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.155770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.157439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.158130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.159438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lazy-loading 'fault' on Instance uuid b026b67e-945d-4c78-9188-bf4ffe4b96f2 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:24.517218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:24.556009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:24.565334 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01f30094-2df1-4512-ad29-2dfc9929ad3c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1472 microversion: 2.1 time: 0.849547 Aug 27 03:08:24.566648 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 143/332] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:23 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1472 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:24.567292 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d72bb6f2-d141-4b9f-9514-97eb95be3be0 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1458 microversion: 2.1 time: 0.481208 Aug 27 03:08:24.568443 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 190/333] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:24 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1458 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:24.587837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:24.590055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:24.615838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.617079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.617955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.634393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.635208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.636831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.824266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:24.831243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:24.841043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.841818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.843104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:24.844508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:24.845358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:24.846296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:25.127489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:25.143239 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09fa65b3-5b5c-41e0-9de0-3bc74f496cc5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.574492 Aug 27 03:08:25.145007 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 144/334] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:24 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:25.280911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:25.297836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62fafe50-a220-4b67-9730-c790d5b1b2bc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1278 microversion: 2.1 time: 0.478661 Aug 27 03:08:25.298743 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 191/335] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:24 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1278 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:25.593528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:25.595148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:25.601343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:25.604240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:25.617959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:25.618897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:25.619415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:25.620009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:25.620629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:25.621298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:25.622058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:25.622874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:25.623461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:25.624924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:25.626469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:25.627727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:25.776498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:25.781952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:25.784884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:25.787904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lazy-loading 'fault' on Instance uuid b026b67e-945d-4c78-9188-bf4ffe4b96f2 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:26.091206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:26.104051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5179fc0a-5b4f-4870-9869-d7e647977b2b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 0.516406 Aug 27 03:08:26.106856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 145/336] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:25 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:26.170121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:26.171642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:26.182934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:26.183704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:26.191413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:26.192523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:26.194045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:26.194689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:26.232547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:26.241972 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a13fdf16-b354-4d5c-928c-7545fe566d2b tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1458 microversion: 2.1 time: 0.654258 Aug 27 03:08:26.246394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 192/337] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:25 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1458 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:26.322208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:26.322208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:26.333812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:26.334407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:26.337157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:26.343662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:26.344318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:26.344694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:26.601084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:26.612926 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8d1fae6-bf19-4dec-8fa1-26489f2d86ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.447250 Aug 27 03:08:26.614356 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 146/338] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:26 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:26.875529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:26.891976 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e736b3e0-6041-438c-8fc6-cb6edd4aed7a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.576471 Aug 27 03:08:26.892563 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 193/339] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:26 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:27.133009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:27.134085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:27.142234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.153593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.154134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:27.155214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.158786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.159331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:27.175114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:27.199066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-057c1d10-a582-46a2-9faa-9dcd4cb4c10b req-c26108a8-36bc-4db8-b290-bcb3a9b40069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037", "name": "network-vif-plugged", "status": "completed", "tag": "4334a30f-24f4-491f-8ecf-cdb1ac1394b1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:27.230500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-057c1d10-a582-46a2-9faa-9dcd4cb4c10b req-c26108a8-36bc-4db8-b290-bcb3a9b40069 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.231676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-057c1d10-a582-46a2-9faa-9dcd4cb4c10b req-c26108a8-36bc-4db8-b290-bcb3a9b40069 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.232414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-057c1d10-a582-46a2-9faa-9dcd4cb4c10b req-c26108a8-36bc-4db8-b290-bcb3a9b40069 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:27.260148 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-057c1d10-a582-46a2-9faa-9dcd4cb4c10b req-c26108a8-36bc-4db8-b290-bcb3a9b40069 service nova] Creating event network-vif-plugged:4334a30f-24f4-491f-8ecf-cdb1ac1394b1 for instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 on n-h2-852086-5 Aug 27 03:08:27.267870 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-057c1d10-a582-46a2-9faa-9dcd4cb4c10b req-c26108a8-36bc-4db8-b290-bcb3a9b40069 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071994 Aug 27 03:08:27.269944 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 194/340] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:27.275682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:27.276816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:27.288386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.289150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.289831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:27.290881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.291579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.292237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:27.353898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.355540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.356266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:27.356968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lazy-loading 'fault' on Instance uuid b026b67e-945d-4c78-9188-bf4ffe4b96f2 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:27.849953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:27.860585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6959faf5-d25c-43e2-8eca-3633980ed58a tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1458 microversion: 2.1 time: 0.588844 Aug 27 03:08:27.882908 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 195/341] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:27 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1458 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:27.917363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:27.917985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:27.933899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.934429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.934869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:27.946295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:27.946917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:27.947370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.518429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:28.526679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:28.536573 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02d83dfe-3c8b-4e00-8941-6e194bbcb10f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 1.407560 Aug 27 03:08:28.539312 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 147/342] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:27 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:28.552179 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17ea46ca-5dff-40d4-ac02-37f16de9d8e9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1311 microversion: 2.1 time: 0.667211 Aug 27 03:08:28.556866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2482f7d6-c3e8-47cc-8b71-7824a8cfe00d req-8759737f-1c2b-4087-af62-3e062f43ed68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911a23b3-f713-43f3-a09f-09827e960e8f", "tag": "d5387121-e970-468a-a8be-3e556c0c3b13"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:28.557458 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 196/343] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:27 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1311 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:28.576879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2482f7d6-c3e8-47cc-8b71-7824a8cfe00d req-8759737f-1c2b-4087-af62-3e062f43ed68 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.577840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2482f7d6-c3e8-47cc-8b71-7824a8cfe00d req-8759737f-1c2b-4087-af62-3e062f43ed68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.582027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-14aaf4e8-42c2-4dea-bf38-747473426402 req-6b4521ce-9f99-4122-9925-c3e5346e5f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b026b67e-945d-4c78-9188-bf4ffe4b96f2", "name": "network-vif-deleted", "tag": "c674c030-659b-495f-a3b6-78ae3f00e7d7"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:28.598621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2482f7d6-c3e8-47cc-8b71-7824a8cfe00d req-8759737f-1c2b-4087-af62-3e062f43ed68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.618229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2482f7d6-c3e8-47cc-8b71-7824a8cfe00d req-8759737f-1c2b-4087-af62-3e062f43ed68 service nova] Creating event network-changed:d5387121-e970-468a-a8be-3e556c0c3b13 for instance 911a23b3-f713-43f3-a09f-09827e960e8f on n-h1-852086-5 Aug 27 03:08:28.636853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-14aaf4e8-42c2-4dea-bf38-747473426402 req-6b4521ce-9f99-4122-9925-c3e5346e5f43 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.640521 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2482f7d6-c3e8-47cc-8b71-7824a8cfe00d req-8759737f-1c2b-4087-af62-3e062f43ed68 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099890 Aug 27 03:08:28.641547 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 148/344] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:28.643544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-14aaf4e8-42c2-4dea-bf38-747473426402 req-6b4521ce-9f99-4122-9925-c3e5346e5f43 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.646406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-14aaf4e8-42c2-4dea-bf38-747473426402 req-6b4521ce-9f99-4122-9925-c3e5346e5f43 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.660045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:28.661238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:28.691042 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-14aaf4e8-42c2-4dea-bf38-747473426402 req-6b4521ce-9f99-4122-9925-c3e5346e5f43 service nova] Creating event network-vif-deleted:c674c030-659b-495f-a3b6-78ae3f00e7d7 for instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 on n-h2-852086-5 Aug 27 03:08:28.692814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.693666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.694445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.695626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.703549 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-14aaf4e8-42c2-4dea-bf38-747473426402 req-6b4521ce-9f99-4122-9925-c3e5346e5f43 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142323 Aug 27 03:08:28.705617 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 197/345] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:28.709514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.711283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.894801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:28.897224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:28.915327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.916494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.918363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.920144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.923202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.924614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.018023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:29.019838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:29.022861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.024918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lazy-loading 'fault' on Instance uuid b026b67e-945d-4c78-9188-bf4ffe4b96f2 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:29.275882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:29.306289 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4f0a645-d083-4827-92ff-ff44cd725192 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.654615 Aug 27 03:08:29.307419 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 149/346] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:28 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:29.331268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a408d7b8e4104665b0223a81a73e0dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bdab40b75c404eb968ed2afcc229f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:29.349887 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-db577bd0-596d-4e0f-98c7-241b50d7a308 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 200 len: 1310 microversion: 2.1 time: 0.462765 Aug 27 03:08:29.351421 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 198/347] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:28 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 1310 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:29.572690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:29.574540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:29.577289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:29.577923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:29.583371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:29.584150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:29.584758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.585758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:29.586562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:29.587643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.594650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:29.595299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:29.598668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.601457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:29.601967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:29.602941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.801506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:29.813967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8385c77-6612-4e19-9336-8d8b6ae8a7c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 0.257605 Aug 27 03:08:29.816204 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 150/348] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:29 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:30.059171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:30.090784 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fbf6c4f-db4d-466a-b695-c1bc4e509427 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1493 microversion: 2.1 time: 0.516699 Aug 27 03:08:30.091951 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 199/349] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:29 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1493 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:30.346645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:30.346645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:30.355770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:30.356596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:30.357084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:30.363696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:30.365432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:30.365870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:30.594200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:30.594827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:30.601754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:30.602273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:30.602710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:30.603570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:30.604026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:30.604449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:30.780987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:30.880556 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b17c9ed-52bb-42b2-b994-59e2bf0624a6 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1644 microversion: 2.1 time: 0.769449 Aug 27 03:08:30.881778 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 151/350] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:30 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1644 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:30.899192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:30.899701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:30.911112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:30.911605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:30.912239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:30.913136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:30.913771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:30.914389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:30.931344 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] HTTP exception thrown: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Request method failure captured: Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 HTTP/1.1 Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpg8e2vS6NRo18sMS2Vq6BWCtjDbru6spLctOi97zUiCZx2BbTlyHmh8MBJS6L8exAQbzydEYYQ4zMxenMu6LYWYFhAyu51QIio0oPokOu8Sv5qbs_GT581VqkX2ZXC1lp5mE7qeVcg1-NqHS7tTJI8-QOKXodmGsMhBEawurNK160 Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:30.933243 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c3bdab40b75c404eb968ed2afcc229f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}] Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: a408d7b8e4104665b0223a81a73e0dfd Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:30.934482 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b026b67e-945d-4c78-9188-bf4ffe4b96f2'} Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:30.935144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:30.936962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:30.940154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Returning 404 to user: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:30.941777 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5cef723e-973a-4ee9-80fe-d0ec2214ba78 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 404 len: 111 microversion: 2.1 time: 0.049856 Aug 27 03:08:30.942895 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 152/351] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:30 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:31.063733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:31.073839 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21fe7548-1964-4d69-a67a-951daca898cf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.734919 Aug 27 03:08:31.102199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 200/352] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:30 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:31.115468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.117110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.125316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.126057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.126743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.127638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.128276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.128852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.134038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:31.141575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.145470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.146616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.147363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.148110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.149017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.150657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.180354 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-509278d6-2ebb-417f-959d-7b01ebb50fb1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.236179 Aug 27 03:08:31.181941 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 153/353] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:08:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:31.183779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:31.193719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.194715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.201487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.202590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.203137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.203977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.204509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.205026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.341299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b6de9b5-0a39-44d7-9a0c-e40705c2f40c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1644 microversion: 2.1 time: 0.157969 Aug 27 03:08:31.341896 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 154/354] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:31 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1644 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:31.347638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.348257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.355026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.356170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.356675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.358386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.358753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.359339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.373020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] HTTP exception thrown: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Request method failure captured: Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 HTTP/1.1 Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpg8e2vS6NRo18sMS2Vq6BWCtjDbru6spLctOi97zUiCZx2BbTlyHmh8MBJS6L8exAQbzydEYYQ4zMxenMu6LYWYFhAyu51QIio0oPokOu8Sv5qbs_GT581VqkX2ZXC1lp5mE7qeVcg1-NqHS7tTJI8-QOKXodmGsMhBEawurNK160 Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:31.374656 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c3bdab40b75c404eb968ed2afcc229f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}] Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: a408d7b8e4104665b0223a81a73e0dfd Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.376110 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b026b67e-945d-4c78-9188-bf4ffe4b96f2'} Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:31.376819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.377992 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.379092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Returning 404 to user: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:31.379092 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c7dab52-4508-408b-bead-500cbc77a040 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 404 len: 111 microversion: 2.1 time: 0.032042 Aug 27 03:08:31.379092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 155/355] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:31 2022] DELETE /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:31.382955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-937da1ce-a777-46ee-b6a0-d9a3428a1e3f tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-676238469"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:31.386375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-937da1ce-a777-46ee-b6a0-d9a3428a1e3f tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid 27358701-aaf4-4289-93f3-83133f0ae322 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:31.422028 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-937da1ce-a777-46ee-b6a0-d9a3428a1e3f tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043190 Aug 27 03:08:31.428782 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 156/356] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:31.428782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.432713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.433435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.433617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.434545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.435147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.436958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.468458 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0801ed2-d125-44e9-bbc4-0e471630a43b tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042338 Aug 27 03:08:31.474285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:31.476838 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 157/357] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:08:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:31.482561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.483591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: b026b67e-945d-4c78-9188-bf4ffe4b96f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.486716 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ef6ba3f-1dc0-4f8a-a0bc-47d21db1de30 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 0.381473 Aug 27 03:08:31.487553 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 201/358] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:31 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:31.494637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.495095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b423383d-f282-43a4-aadc-9bab51205827 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:31.495268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.495723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.496446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.496904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.497332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.513663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423383d-f282-43a4-aadc-9bab51205827 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.515334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423383d-f282-43a4-aadc-9bab51205827 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.515894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423383d-f282-43a4-aadc-9bab51205827 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.526681 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] HTTP exception thrown: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Request method failure captured: Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 HTTP/1.1 Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpg8e2vS6NRo18sMS2Vq6BWCtjDbru6spLctOi97zUiCZx2BbTlyHmh8MBJS6L8exAQbzydEYYQ4zMxenMu6LYWYFhAyu51QIio0oPokOu8Sv5qbs_GT581VqkX2ZXC1lp5mE7qeVcg1-NqHS7tTJI8-QOKXodmGsMhBEawurNK160 Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:31.530353 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c3bdab40b75c404eb968ed2afcc229f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}] Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: a408d7b8e4104665b0223a81a73e0dfd Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.531972 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b026b67e-945d-4c78-9188-bf4ffe4b96f2'} Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:31.532631 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. Aug 27 03:08:31.534471 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.536842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Returning 404 to user: Instance b026b67e-945d-4c78-9188-bf4ffe4b96f2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:31.538482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a75c996-c4aa-4135-a3ab-40fb2a3bb3cf tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2" status: 404 len: 111 microversion: 2.1 time: 0.060102 Aug 27 03:08:31.539527 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 158/359] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:31 2022] GET /compute/v2.1/servers/b026b67e-945d-4c78-9188-bf4ffe4b96f2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:31.552446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852086-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:31.554947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.569806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.570574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.571369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.572780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.573380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.578696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.773879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b423383d-f282-43a4-aadc-9bab51205827 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.284311 Aug 27 03:08:31.775943 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 202/360] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:31 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:31.785077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.789681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.804431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.805055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.805491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.806235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.806690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.807109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.832407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] HTTP exception thrown: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Request method failure captured: Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 HTTP/1.1 Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpg8e2vS6NRo18sMS2Vq6BWCtjDbru6spLctOi97zUiCZx2BbTlyHmh8MBJS6L8exAQbzydEYYQ4zMxenMu6LYWYFhAyu51QIio0oPokOu8Sv5qbs_GT581VqkX2ZXC1lp5mE7qeVcg1-NqHS7tTJI8-QOKXodmGsMhBEawurNK160 Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:31.846784 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c3bdab40b75c404eb968ed2afcc229f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}] Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: a408d7b8e4104665b0223a81a73e0dfd Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:31.848232 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '74f86c2d-e0c1-4a0a-be44-e628faecedb9'} Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:31.849049 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:31.850379 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.853212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Returning 404 to user: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:31.854706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-55631942-bd0f-4a06-b42f-7452729cddcc tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "DELETE /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 404 len: 111 microversion: 2.1 time: 0.077302 Aug 27 03:08:31.857712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 203/361] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:31 2022] DELETE /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:31.865417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:31.892213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.894763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.895414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.945372 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-852086-5. Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 39 Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:31.966839 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: {"add_host": {"host": "n-h2-852086-5"}} Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:31.968895 n-d-852086-5 devstack@n-api.service[122407]: exception: Aggregate 11 already has host n-h2-852086-5. Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-852086-5'}}} Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result.read() Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 03:08:31.969787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-852086-5-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 03:08:31.971182 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 03:08:31.972443 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 03:08:31.973595 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result.read() Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-852086-5-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 3, 8, 31, 937489), 'updated_at': None, 'host': 'n-h2-852086-5', 'aggregate_id': 11}] Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.974948 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-852086-5. Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.976042 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-852086-5. Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:31.977308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:31.984436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-852086-5. Aug 27 03:08:31.984436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:31.984436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-852086-5. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:31.984436 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82d93bba-d17b-4136-ba53-efaebd6b8e6b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.110833 Aug 27 03:08:31.984436 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 204/362] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:31 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 27 03:08:31.984436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.984436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] [instance: 74f86c2d-e0c1-4a0a-be44-e628faecedb9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.990512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.990835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.991521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.992138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.992587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.993000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:32.026209 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] HTTP exception thrown: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Request method failure captured: Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 HTTP/1.1 Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpg8e2vS6NRo18sMS2Vq6BWCtjDbru6spLctOi97zUiCZx2BbTlyHmh8MBJS6L8exAQbzydEYYQ4zMxenMu6LYWYFhAyu51QIio0oPokOu8Sv5qbs_GT581VqkX2ZXC1lp5mE7qeVcg1-NqHS7tTJI8-QOKXodmGsMhBEawurNK160 Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:32.032101 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c3bdab40b75c404eb968ed2afcc229f8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c3bdab40b75c404eb968ed2afcc229f8"}]}] Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c3bdab40b75c404eb968ed2afcc229f8 Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1991656501 Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: a408d7b8e4104665b0223a81a73e0dfd Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1991656501-project Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:32.033381 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '74f86c2d-e0c1-4a0a-be44-e628faecedb9'} Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:32.034044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. Aug 27 03:08:32.035167 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:32.036342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] Returning 404 to user: Instance 74f86c2d-e0c1-4a0a-be44-e628faecedb9 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:32.037183 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7ef6336-9976-4596-82fc-44058fc96086 tempest-DeleteServersAdminTestJSON-1991656501 tempest-DeleteServersAdminTestJSON-1991656501-project] 10.222.0.69 "GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9" status: 404 len: 111 microversion: 2.1 time: 0.061150 Aug 27 03:08:32.037821 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 205/363] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:31 2022] GET /compute/v2.1/servers/74f86c2d-e0c1-4a0a-be44-e628faecedb9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:32.056108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41c77771-f2e1-48f5-a531-b3f055b56082 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:32.082770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41c77771-f2e1-48f5-a531-b3f055b56082 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:32.085751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41c77771-f2e1-48f5-a531-b3f055b56082 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:32.086220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41c77771-f2e1-48f5-a531-b3f055b56082 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:32.110687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lazy-loading 'flavor' on Instance uuid ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:08:32.208773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Going to try to live migrate instance to n-h1-852086-5 {{(pid=122408) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:08:32.270664 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41c77771-f2e1-48f5-a531-b3f055b56082 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.226810 Aug 27 03:08:32.271956 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 206/364] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:32 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:32.280779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:32.282755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:32.294430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:32.298556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:32.299788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:32.301319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:32.302189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:32.303034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:32.573126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:32.590922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3380eab-7bcc-4498-821d-057f1c46251e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.317626 Aug 27 03:08:32.591433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 207/365] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:32 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:32.596082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f6cb2ee-8472-4146-94f2-0a8f3a5367b5 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:32.628853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f6cb2ee-8472-4146-94f2-0a8f3a5367b5 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.036347 Aug 27 03:08:32.630814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 208/366] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:32 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:32.641260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:32.645450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:32.664217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:32.665028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:32.665645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:32.666591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:32.669778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:32.670712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:33.148348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:33.162904 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4de0d554-2648-43a7-92ee-2dc03cef9df8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 0.530832 Aug 27 03:08:33.163490 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 209/367] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:32 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:33.183117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41d55b4c-4ece-4207-8404-a55825427707 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1701642567"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:33.187143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-41d55b4c-4ece-4207-8404-a55825427707 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid a7900c86-5acb-4f4f-a887-1d79694db67c for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:33.213676 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41d55b4c-4ece-4207-8404-a55825427707 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033504 Aug 27 03:08:33.222234 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 210/368] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:33.589429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8946617-f154-4e90-8d88-33fe485b6fdc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:33.601724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d8946617-f154-4e90-8d88-33fe485b6fdc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'b6cee62092c342e2a1aae2f1214cfd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb9c4cf90442338cdd77bd91accad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8946617-f154-4e90-8d88-33fe485b6fdc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Request method failure captured: Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 39 Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqtzjWWB1nGntRrTd91maoLjPay5rNFGtkq9pw_i3z_ljN8WQJfv_LPqlaCLPlEw0Lw_-kSiDHYySIc4JeD4C1bb8n0dwHutJyKxSLBDW18H5jLb-B1aqsvhMS2A9kj8jU6Or3t_MFlYTEhQ6PF6_IyzSz7KLXe4XkcXvharbqEnRA Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:33.603687 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bdeb9c4cf90442338cdd77bd91accad8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}] Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: b6cee62092c342e2a1aae2f1214cfd48 Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: {"add_host": {"host": "n-h2-852086-5"}} Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:33.605138 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-852086-5'}}} Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:33.606044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 03:08:33.607369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:33.613283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8946617-f154-4e90-8d88-33fe485b6fdc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:33.615009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d8946617-f154-4e90-8d88-33fe485b6fdc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] 10.222.0.69 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.391484 Aug 27 03:08:33.617223 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 211/369] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:33 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 394 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:33.641687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:33.642466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:33.657990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:33.660173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:33.661313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:33.664449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:33.665106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:33.667091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:34.405004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:34.419241 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf5b0198-924d-451c-bebf-5a1b822e6112 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.796619 Aug 27 03:08:34.422802 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 212/370] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:33 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:34.431184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e197ec6-54fa-49d6-8b73-f7ba877479ff tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:34.466081 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e197ec6-54fa-49d6-8b73-f7ba877479ff tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.039306 Aug 27 03:08:34.482122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 213/371] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:34 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:34.501290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:34.502354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:34.517118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:34.519408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:34.523235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:34.524254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:34.524750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:34.525202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:34.964338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:34.976707 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4db58b8d-b12e-42a7-99c8-7c31c2ae4740 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 0.488848 Aug 27 03:08:34.993534 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 214/372] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:34 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:35.004272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f599c84a-db38-48f0-a098-dbccf39cc1c8 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1764208570"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:35.013633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-f599c84a-db38-48f0-a098-dbccf39cc1c8 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid d180b22d-b93a-4f07-8a39-a9aa697b5c33 for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:35.079313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f599c84a-db38-48f0-a098-dbccf39cc1c8 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084206 Aug 27 03:08:35.085985 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 215/373] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:35.093623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-167780414"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:35.131839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.132338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.132775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.149994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.150512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.158057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.174138 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-167780414 could not be found. Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 57 Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:35.185517 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: {"add_host": {"host": "tempest-nonexist_host-167780414"}} Aug 27 03:08:35.187696 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: exception: Compute host tempest-nonexist_host-167780414 could not be found. Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-167780414'}}} Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-167780414' is not mapped to any cell Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.188486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 27 03:08:35.189803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-167780414 could not be found. Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-167780414 could not be found. Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.191211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.192812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.192812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.192812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.192812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:35.192812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:35.192812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-167780414 could not be found. Aug 27 03:08:35.192812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.194782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-167780414 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:35.196301 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6898a59-6a7d-4440-9003-1d89eefaaa84 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.109496 Aug 27 03:08:35.197618 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 216/374] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:35 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:35.216101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07a77335-3ccd-45ac-bbf2-539038e1a1c3 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:35.248059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:35.270994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-07a77335-3ccd-45ac-bbf2-539038e1a1c3 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.069074 Aug 27 03:08:35.282089 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 217/375] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:35 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:35.292397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e993ca7a-d733-4eec-a4ea-fab0dbacd481 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e993ca7a-d733-4eec-a4ea-fab0dbacd481 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 283 Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:35.302244 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:35.303522 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:08:35.304096 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:35.304649 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.305537 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.306384 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:08:35.306384 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:08:35.306384 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:08:35.306384 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.313652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e993ca7a-d733-4eec-a4ea-fab0dbacd481 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:35.315161 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e993ca7a-d733-4eec-a4ea-fab0dbacd481 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031099 Aug 27 03:08:35.316433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 218/376] 10.222.0.69 () {60 vars in 1165 bytes} [Sat Aug 27 03:08:35 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:08:35.333664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5eea4f0-8a19-4598-a202-72687c0ac1b9 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5eea4f0-8a19-4598-a202-72687c0ac1b9 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 27 Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:35.349170 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: {"aggregate": {"name": ""}} Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:35.350818 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '' Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:35.351692 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:08:35.353232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.358751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5eea4f0-8a19-4598-a202-72687c0ac1b9 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:35.360788 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5eea4f0-8a19-4598-a202-72687c0ac1b9 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.035426 Aug 27 03:08:35.364228 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 219/377] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:35 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:08:35.387629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9af4d13-2780-45aa-b13b-af8cf724c114 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-37142833"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:35.395038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9af4d13-2780-45aa-b13b-af8cf724c114 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'b6cee62092c342e2a1aae2f1214cfd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb9c4cf90442338cdd77bd91accad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9af4d13-2780-45aa-b13b-af8cf724c114 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Request method failure captured: Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 58 Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqtzjWWB1nGntRrTd91maoLjPay5rNFGtkq9pw_i3z_ljN8WQJfv_LPqlaCLPlEw0Lw_-kSiDHYySIc4JeD4C1bb8n0dwHutJyKxSLBDW18H5jLb-B1aqsvhMS2A9kj8jU6Or3t_MFlYTEhQ6PF6_IyzSz7KLXe4XkcXvharbqEnRA Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:35.404593 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bdeb9c4cf90442338cdd77bd91accad8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}] Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: b6cee62092c342e2a1aae2f1214cfd48 Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: {"aggregate": {"name": "tempest-test_aggregate-37142833"}} Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:35.406341 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-37142833'}}} Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:35.407383 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:35.408494 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 03:08:35.410106 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:35.425432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9af4d13-2780-45aa-b13b-af8cf724c114 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:35.432299 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9af4d13-2780-45aa-b13b-af8cf724c114 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.059582 Aug 27 03:08:35.435255 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3f796d4-a220-424f-96b7-5386c01adbd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037/action" status: 202 len: 0 microversion: 2.1 time: 3.894404 Aug 27 03:08:35.436748 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 159/378] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:08:31 2022] POST /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037/action => generated 0 bytes in 3897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:08:35.437746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 220/379] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:35 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:35.445613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:35.449776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:35.455562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8ed63412-29c9-4989-86eb-48c6ffad0341 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1228490395"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:35.476394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.479913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-8ed63412-29c9-4989-86eb-48c6ffad0341 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid 3da9e4cf-ae80-4000-9ee5-2f79734d7f4a for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:35.484043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.485451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.487520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.490926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.494464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.644116 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8ed63412-29c9-4989-86eb-48c6ffad0341 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.197182 Aug 27 03:08:35.649117 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 221/380] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:35.676337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:35.677016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:35.708532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.709062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.709516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.715296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.717834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.725639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.015840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:36.026659 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2866b160-6fe6-49d1-9511-7603b25d07d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.376235 Aug 27 03:08:36.060464 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 222/381] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:35 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:36.068248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8567a98-f6c4-438c-9601-b666c84409de tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1228490395"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:36.073557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-f8567a98-f6c4-438c-9601-b666c84409de tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid 0a73b0c4-09f8-42ca-a9c7-2248d249f217 for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:36.120895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f8567a98-f6c4-438c-9601-b666c84409de tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1228490395 already exists. Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8567a98-f6c4-438c-9601-b666c84409de tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 60 Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:36.125737 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: {"aggregate": {"name": "tempest-test_aggregate-1228490395"}} Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:36.127253 n-d-852086-5 devstack@n-api.service[122407]: exception: Aggregate tempest-test_aggregate-1228490395 already exists. Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1228490395'}}} Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 27 03:08:36.128191 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1228490395 already exists. Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:36.129422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1228490395 already exists. Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1228490395 already exists. Aug 27 03:08:36.130728 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.134723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8567a98-f6c4-438c-9601-b666c84409de tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1228490395 already exists. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:36.136485 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f8567a98-f6c4-438c-9601-b666c84409de tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.071944 Aug 27 03:08:36.141299 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 223/382] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:36 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:36.147638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.148224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:36.158206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:36.158788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:36.159341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.160134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:36.160987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:36.161497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.429834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:36.464067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-605454be-df7e-4137-b8d8-d0cf5e46899c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 1.022829 Aug 27 03:08:36.468436 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 160/383] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:35 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:36.479655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-feacf60e-fff6-48a3-bf5e-b5f4676c1ab7 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.547983 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-feacf60e-fff6-48a3-bf5e-b5f4676c1ab7 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.078326 Aug 27 03:08:36.553493 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 161/384] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:36 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:36.558541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f25428f-e64a-4a00-947f-e5ba71f76265 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1737008688"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:36.589510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-2f25428f-e64a-4a00-947f-e5ba71f76265 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid 4344456e-256e-4ac1-b238-9c1e5e5e2904 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:36.645633 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f25428f-e64a-4a00-947f-e5ba71f76265 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087941 Aug 27 03:08:36.647742 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 162/385] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:36.674256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7576694a-3725-40dc-a8da-d2f4611f2ddc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.682572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7576694a-3725-40dc-a8da-d2f4611f2ddc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'b6cee62092c342e2a1aae2f1214cfd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb9c4cf90442338cdd77bd91accad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7576694a-3725-40dc-a8da-d2f4611f2ddc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Request method failure captured: Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqtzjWWB1nGntRrTd91maoLjPay5rNFGtkq9pw_i3z_ljN8WQJfv_LPqlaCLPlEw0Lw_-kSiDHYySIc4JeD4C1bb8n0dwHutJyKxSLBDW18H5jLb-B1aqsvhMS2A9kj8jU6Or3t_MFlYTEhQ6PF6_IyzSz7KLXe4XkcXvharbqEnRA Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:36.689351 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bdeb9c4cf90442338cdd77bd91accad8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}] Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b6cee62092c342e2a1aae2f1214cfd48 Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 03:08:36.690913 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '15'} Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:36.691660 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.692848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7576694a-3725-40dc-a8da-d2f4611f2ddc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:36.699290 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7576694a-3725-40dc-a8da-d2f4611f2ddc tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.036879 Aug 27 03:08:36.703622 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 163/386] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:08:36.717638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6708b86-bd45-4b71-b58d-ed32a2a2f130 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.765888 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6708b86-bd45-4b71-b58d-ed32a2a2f130 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.059893 Aug 27 03:08:36.772281 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 164/387] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:36.783776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-debae6a5-7043-4f75-babb-6bf53e4bebe3 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.800548 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-debae6a5-7043-4f75-babb-6bf53e4bebe3 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-debae6a5-7043-4f75-babb-6bf53e4bebe3 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:08:36.803760 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: exception: Aggregate -1 could not be found. Aug 27 03:08:36.804985 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '-1'} Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 03:08:36.805645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.806719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.808518 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.808518 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.808518 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:36.808518 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:36.808518 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 03:08:36.808518 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.810279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-debae6a5-7043-4f75-babb-6bf53e4bebe3 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:36.811857 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-debae6a5-7043-4f75-babb-6bf53e4bebe3 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.038228 Aug 27 03:08:36.817753 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 165/388] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:36 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:36.825194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45d7f842-e05c-44ef-9368-c15a43b227e1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1119372915"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:36.839564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-45d7f842-e05c-44ef-9368-c15a43b227e1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid 6de13850-709b-4d1a-8b55-6c3b25548f3f for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:36.880205 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45d7f842-e05c-44ef-9368-c15a43b227e1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.057709 Aug 27 03:08:36.881482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 166/389] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:36.896200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c0d50c4-53bf-4a0a-b0c8-9a5245fd0147 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.898174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c0d50c4-53bf-4a0a-b0c8-9a5245fd0147 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'b6cee62092c342e2a1aae2f1214cfd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb9c4cf90442338cdd77bd91accad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c0d50c4-53bf-4a0a-b0c8-9a5245fd0147 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Request method failure captured: Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqtzjWWB1nGntRrTd91maoLjPay5rNFGtkq9pw_i3z_ljN8WQJfv_LPqlaCLPlEw0Lw_-kSiDHYySIc4JeD4C1bb8n0dwHutJyKxSLBDW18H5jLb-B1aqsvhMS2A9kj8jU6Or3t_MFlYTEhQ6PF6_IyzSz7KLXe4XkcXvharbqEnRA Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:36.900191 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bdeb9c4cf90442338cdd77bd91accad8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}] Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b6cee62092c342e2a1aae2f1214cfd48 Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 03:08:36.901577 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '16'} Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:36.902421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 03:08:36.903687 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:36.906089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c0d50c4-53bf-4a0a-b0c8-9a5245fd0147 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:36.907527 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c0d50c4-53bf-4a0a-b0c8-9a5245fd0147 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] 10.222.0.69 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.018956 Aug 27 03:08:36.910128 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 167/390] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:36 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:36.923650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-132bbe39-3ba3-4a59-920c-348efb16cdeb tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.970683 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-132bbe39-3ba3-4a59-920c-348efb16cdeb tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.056667 Aug 27 03:08:36.976530 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 168/391] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:36 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 03:08:36.988832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e129dcff-d45a-4950-b4e4-f50e4d36be45 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:37.002228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e129dcff-d45a-4950-b4e4-f50e4d36be45 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e129dcff-d45a-4950-b4e4-f50e4d36be45 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:08:37.006021 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: exception: Aggregate -1 could not be found. Aug 27 03:08:37.007622 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '-1'} Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:37.008410 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 03:08:37.009786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.011727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e129dcff-d45a-4950-b4e4-f50e4d36be45 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:37.012907 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e129dcff-d45a-4950-b4e4-f50e4d36be45 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035052 Aug 27 03:08:37.017639 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 169/392] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:08:36 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:37.027352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93954bad-c0b6-4135-8de0-6475d8942817 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:37.032591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93954bad-c0b6-4135-8de0-6475d8942817 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'b6cee62092c342e2a1aae2f1214cfd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb9c4cf90442338cdd77bd91accad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93954bad-c0b6-4135-8de0-6475d8942817 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Request method failure captured: Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqtzjWWB1nGntRrTd91maoLjPay5rNFGtkq9pw_i3z_ljN8WQJfv_LPqlaCLPlEw0Lw_-kSiDHYySIc4JeD4C1bb8n0dwHutJyKxSLBDW18H5jLb-B1aqsvhMS2A9kj8jU6Or3t_MFlYTEhQ6PF6_IyzSz7KLXe4XkcXvharbqEnRA Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:37.034480 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bdeb9c4cf90442338cdd77bd91accad8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}] Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b6cee62092c342e2a1aae2f1214cfd48 Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 03:08:37.035847 n-d-852086-5 devstack@n-api.service[122408]: action_args: {} Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:37.036622 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 03:08:37.037659 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.039612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93954bad-c0b6-4135-8de0-6475d8942817 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:37.040792 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93954bad-c0b6-4135-8de0-6475d8942817 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017639 Aug 27 03:08:37.041806 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 170/393] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:08:37 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:08:37.057899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:37.059248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:37.066613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:37.074739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.075327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.075670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.076704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.077082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.077481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.241516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:37.250543 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41eb085a-fcd8-4950-9038-2d5ae6e6c093 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 1.107645 Aug 27 03:08:37.253314 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 224/394] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:36 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:37.266194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b5b97b2-7836-4f7a-8932-9c4e783c69da tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1985126631"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:37.276770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-2b5b97b2-7836-4f7a-8932-9c4e783c69da tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid 1af08548-395b-49f1-976b-bc3059f15b3e for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:37.324179 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b5b97b2-7836-4f7a-8932-9c4e783c69da tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069741 Aug 27 03:08:37.327804 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 225/395] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:37.340005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9c70550-0796-4b87-a3a7-cc5248e7c84e tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:37.382750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c70550-0796-4b87-a3a7-cc5248e7c84e tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.388056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c70550-0796-4b87-a3a7-cc5248e7c84e tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.390573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c70550-0796-4b87-a3a7-cc5248e7c84e tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.643652 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9c70550-0796-4b87-a3a7-cc5248e7c84e tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.307603 Aug 27 03:08:37.650290 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 226/396] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:37.652105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:37.652825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:37.669514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.670138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.670628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.674924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.678108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.678584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.786672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:37.796142 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-555c3f33-91cf-4b5d-b78f-6c8db20cbdc4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.746748 Aug 27 03:08:37.797345 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 171/397] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:37 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:37.816267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a67855b6-5510-40f8-b8f5-baf7a1ecf714 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:37.820454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a67855b6-5510-40f8-b8f5-baf7a1ecf714 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'b6cee62092c342e2a1aae2f1214cfd48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb9c4cf90442338cdd77bd91accad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a67855b6-5510-40f8-b8f5-baf7a1ecf714 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Request method failure captured: Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 42 Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqtzjWWB1nGntRrTd91maoLjPay5rNFGtkq9pw_i3z_ljN8WQJfv_LPqlaCLPlEw0Lw_-kSiDHYySIc4JeD4C1bb8n0dwHutJyKxSLBDW18H5jLb-B1aqsvhMS2A9kj8jU6Or3t_MFlYTEhQ6PF6_IyzSz7KLXe4XkcXvharbqEnRA Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:08:37.823090 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bdeb9c4cf90442338cdd77bd91accad8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bdeb9c4cf90442338cdd77bd91accad8"}]}] Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: bdeb9c4cf90442338cdd77bd91accad8 Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-747973465 Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b6cee62092c342e2a1aae2f1214cfd48 Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-747973465-project Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: {"remove_host": {"host": "n-h2-852086-5"}} Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:37.824308 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-852086-5'}}} Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:37.825078 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 03:08:37.827469 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:37.832359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a67855b6-5510-40f8-b8f5-baf7a1ecf714 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:37.836958 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a67855b6-5510-40f8-b8f5-baf7a1ecf714 tempest-AggregatesAdminNegativeTestJSON-747973465 tempest-AggregatesAdminNegativeTestJSON-747973465-project] 10.222.0.69 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.036767 Aug 27 03:08:37.839886 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 172/398] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:37.848875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a962e2c-2b86-4ea2-a317-c68089633fa1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:37.884761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a962e2c-2b86-4ea2-a317-c68089633fa1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.886013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a962e2c-2b86-4ea2-a317-c68089633fa1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.886822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a962e2c-2b86-4ea2-a317-c68089633fa1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.073304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:38.086007 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6fb907a-9540-410b-81df-f0e1a8074462 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.440330 Aug 27 03:08:38.095060 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a962e2c-2b86-4ea2-a317-c68089633fa1 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.250579 Aug 27 03:08:38.100191 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 227/399] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:37 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:38.105392 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 173/400] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:38.117259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-97690d62-7221-4b9b-ad73-c3fd68b6464b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:38.222747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-97690d62-7221-4b9b-ad73-c3fd68b6464b tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.114012 Aug 27 03:08:38.223440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 228/401] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:38 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:38.239681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6ed91d9-7e10-4942-8fb3-3482bcc0c9b2 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785362185"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:38.258721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.aggregate [None req-c6ed91d9-7e10-4942-8fb3-3482bcc0c9b2 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Generated uuid d9550ef6-11ce-47ef-80d1-26cae006c6ad for aggregate {{(pid=122407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:08:38.322606 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6ed91d9-7e10-4942-8fb3-3482bcc0c9b2 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.093319 Aug 27 03:08:38.323143 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 229/402] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:08:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:38.343401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:38.344051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:38.364727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.365189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.368087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.372329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.374063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.375527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.410027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a38297c-aff9-4abb-8c10-7d01d6513bdf tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-581078820", "id": 414419938, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:38.478065 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a38297c-aff9-4abb-8c10-7d01d6513bdf tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.362350 Aug 27 03:08:38.486668 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 174/403] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:38 2022] POST /compute/v2.1/flavors => generated 427 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:38.492043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:38.515287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.515842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.516287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.525614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.526151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.527395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.537637 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.compute.aggregates [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 03:08:38.538150 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Request method failure captured: Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 42 Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYquT8QpqzhtBATrIRm_xRM3kiRIR2SSChUAd8j84pVECZvHQfbutS3UKkG-3BnSF7BSMvp045f0ELbwBXuaXdKxobm4wwti0hRLdBhxRx85bk9u6JPrH8pygeJgMwh1rpd4HoDeXDzZ0DKJzfu5PzkmUI_Y4kn-MAZZ1soPi62UbQA Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:08:38.553766 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d46594745f74aa6a574eed6824259a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d46594745f74aa6a574eed6824259a5"}]}] Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1d46594745f74aa6a574eed6824259a5 Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316 Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: fd00bffae3d14c13b4fffc346b704aee Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: {"remove_host": {"host": "nonexist_host"}} Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:08:38.555224 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 03:08:38.555969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 27 03:08:38.557044 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.566407 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:38.574022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:38.574022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:38.574022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:38.574022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:38.574022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 27 03:08:38.574022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:08:38.577867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:38.579514 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2811fd8-d497-4978-a6fa-1f75465c5485 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.091374 Aug 27 03:08:38.580576 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 175/404] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:08:38 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:08:38.596193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a321ef1-5341-4b07-89df-8ed3929e0f86 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8b5f4890dada4a24998fd2c82a8ba0fb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:38.756681 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a321ef1-5341-4b07-89df-8ed3929e0f86 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/414419938/action" status: 200 len: 96 microversion: 2.1 time: 0.174010 Aug 27 03:08:38.757669 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 176/405] 10.222.0.69 () {60 vars in 1197 bytes} [Sat Aug 27 03:08:38 2022] POST /compute/v2.1/flavors/414419938/action => generated 96 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:38.768864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df7c81a2-5b01-4f5b-a489-12ca59ab3302 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:38.807299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df7c81a2-5b01-4f5b-a489-12ca59ab3302 tempest-AggregatesAdminNegativeTestJSON-1181077316 tempest-AggregatesAdminNegativeTestJSON-1181077316-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.043074 Aug 27 03:08:38.809953 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 177/406] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:08:38 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:39.071928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c82ac63-1a02-4254-8e8d-51ce9d948d66 tempest-FlavorsAccessTestJSON-556628375 tempest-FlavorsAccessTestJSON-556628375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:39.120234 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c82ac63-1a02-4254-8e8d-51ce9d948d66 tempest-FlavorsAccessTestJSON-556628375 tempest-FlavorsAccessTestJSON-556628375-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 6237 microversion: 2.1 time: 0.308700 Aug 27 03:08:39.129215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 178/407] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:38 2022] GET /compute/v2.1/flavors/detail => generated 6237 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:39.147473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:39.148455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:39.158331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:39.168577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:39.169337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:39.170659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:39.171580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:39.173680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-96ff0dee-dde9-4a38-8028-5d4c3677c1ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 0.849337 Aug 27 03:08:39.174704 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 230/408] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:38 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:39.177102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:39.177808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:39.183254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:39.187451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:39.208442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:39.209831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:39.211239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:39.214301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:39.215523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:39.218281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:39.665568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:39.677092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3cd30c97-0e47-4a75-9e52-c91c2f88e541 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.500158 Aug 27 03:08:39.682898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 231/409] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:39 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:39.691046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11834956-33de-421c-afef-f695fe27ae09 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8b5f4890dada4a24998fd2c82a8ba0fb"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:39.988228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:40.005600 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ddf853de-03ca-472a-b1b8-0e9da3f292b0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.875004 Aug 27 03:08:40.006194 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 179/410] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:39 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:40.023595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-229b1df3-d445-4bbb-87d2-9558893b2514 req-85eb081f-a046-42d4-a906-1b619778ef59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911a23b3-f713-43f3-a09f-09827e960e8f", "name": "network-vif-plugged", "status": "completed", "tag": "d5387121-e970-468a-a8be-3e556c0c3b13"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:40.036308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-229b1df3-d445-4bbb-87d2-9558893b2514 req-85eb081f-a046-42d4-a906-1b619778ef59 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.037233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-229b1df3-d445-4bbb-87d2-9558893b2514 req-85eb081f-a046-42d4-a906-1b619778ef59 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.037883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-229b1df3-d445-4bbb-87d2-9558893b2514 req-85eb081f-a046-42d4-a906-1b619778ef59 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.058485 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-229b1df3-d445-4bbb-87d2-9558893b2514 req-85eb081f-a046-42d4-a906-1b619778ef59 service nova] Creating event network-vif-plugged:d5387121-e970-468a-a8be-3e556c0c3b13 for instance 911a23b3-f713-43f3-a09f-09827e960e8f on n-h1-852086-5 Aug 27 03:08:40.066977 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-229b1df3-d445-4bbb-87d2-9558893b2514 req-85eb081f-a046-42d4-a906-1b619778ef59 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058164 Aug 27 03:08:40.068167 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 180/411] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:40.078322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-db319ef5-bb3f-4fec-8f5b-60648d8145da req-31a38d9a-f2cd-4c95-8f3f-cf8a61c0a9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037", "name": "network-vif-unplugged", "status": "completed", "tag": "4334a30f-24f4-491f-8ecf-cdb1ac1394b1"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:40.090371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db319ef5-bb3f-4fec-8f5b-60648d8145da req-31a38d9a-f2cd-4c95-8f3f-cf8a61c0a9a6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.102075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db319ef5-bb3f-4fec-8f5b-60648d8145da req-31a38d9a-f2cd-4c95-8f3f-cf8a61c0a9a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.111599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db319ef5-bb3f-4fec-8f5b-60648d8145da req-31a38d9a-f2cd-4c95-8f3f-cf8a61c0a9a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.137918 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-db319ef5-bb3f-4fec-8f5b-60648d8145da req-31a38d9a-f2cd-4c95-8f3f-cf8a61c0a9a6 service nova] Creating event network-vif-unplugged:4334a30f-24f4-491f-8ecf-cdb1ac1394b1 for instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 on n-h2-852086-5 Aug 27 03:08:40.149387 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-db319ef5-bb3f-4fec-8f5b-60648d8145da req-31a38d9a-f2cd-4c95-8f3f-cf8a61c0a9a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078867 Aug 27 03:08:40.150616 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 181/412] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:40.171108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11834956-33de-421c-afef-f695fe27ae09 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/414419938/action" status: 200 len: 21 microversion: 2.1 time: 0.486695 Aug 27 03:08:40.181986 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 232/413] 10.222.0.69 () {60 vars in 1197 bytes} [Sat Aug 27 03:08:39 2022] POST /compute/v2.1/flavors/414419938/action => generated 21 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:40.196515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.197928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:40.201452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34a4196a-6fed-4d39-896c-1d4d7030c3c9 tempest-FlavorsAccessTestJSON-556628375 tempest-FlavorsAccessTestJSON-556628375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.223986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.224599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.225223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.226044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.229172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.229775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.278423 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34a4196a-6fed-4d39-896c-1d4d7030c3c9 tempest-FlavorsAccessTestJSON-556628375 tempest-FlavorsAccessTestJSON-556628375-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.094791 Aug 27 03:08:40.288011 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 182/414] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:40.308432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29451dff-9a00-4a7a-b6ff-72de36e11e4f tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.353906 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29451dff-9a00-4a7a-b6ff-72de36e11e4f tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/414419938" status: 202 len: 0 microversion: 2.1 time: 0.048915 Aug 27 03:08:40.358433 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 183/415] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:08:40 2022] DELETE /compute/v2.1/flavors/414419938 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:08:40.371887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca4078cc-ad30-447c-9715-4261c2d1d436 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.412506 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca4078cc-ad30-447c-9715-4261c2d1d436 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.050410 Aug 27 03:08:40.426593 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 184/416] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:40.435512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78e0211b-a27f-4045-9ff7-e2f9db4f05be tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1365451516", "id": 1382849236, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:40.472394 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78e0211b-a27f-4045-9ff7-e2f9db4f05be tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.041223 Aug 27 03:08:40.473793 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 185/417] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:40 2022] POST /compute/v2.1/flavors => generated 431 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:40.487405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fee9c067-5839-43f5-8f37-ce6ab27da082 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.507399 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fee9c067-5839-43f5-8f37-ce6ab27da082 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1382849236/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024902 Aug 27 03:08:40.509889 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 186/418] 10.222.0.69 () {58 vars in 1209 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/flavors/1382849236/os-flavor-access => generated 21 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:08:40.522600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab45f68b-b39a-43c5-a188-881fb6458560 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.549729 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab45f68b-b39a-43c5-a188-881fb6458560 tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1382849236" status: 202 len: 0 microversion: 2.1 time: 0.033959 Aug 27 03:08:40.551253 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 187/419] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:08:40 2022] DELETE /compute/v2.1/flavors/1382849236 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:08:40.560784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9274e047-f7ac-42c0-b324-10d16220fc5d tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.591948 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9274e047-f7ac-42c0-b324-10d16220fc5d tempest-FlavorsAccessTestJSON-408002731 tempest-FlavorsAccessTestJSON-408002731-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.035795 Aug 27 03:08:40.593393 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 188/420] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:40.706551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.710222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:40.752179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.753208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.756683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.757936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.761928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.762917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:41.283943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:41.299965 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1755133-3c19-46b4-ae8e-98302711c159 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.598388 Aug 27 03:08:41.300375 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 189/421] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:41.312436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:41.314058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:41.324212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:41.325054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:41.328452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:41.329531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:41.330775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:41.331491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:41.512517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:41.567985 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a450c355-cfdd-4d6a-88f5-2c72f89a36f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 1.375302 Aug 27 03:08:41.581470 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 233/422] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:41.649978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:41.668613 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7dfb3e1-3583-4195-bebc-5d1c0590bab5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.366337 Aug 27 03:08:41.669209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 190/423] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:41 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:42.216958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-96f39e01-5d6b-451c-a649-e02addfb3676 req-e87b1b9a-4ebc-48ec-b97b-2914695e7a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037", "tag": "4334a30f-24f4-491f-8ecf-cdb1ac1394b1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:42.238995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96f39e01-5d6b-451c-a649-e02addfb3676 req-e87b1b9a-4ebc-48ec-b97b-2914695e7a78 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.239502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96f39e01-5d6b-451c-a649-e02addfb3676 req-e87b1b9a-4ebc-48ec-b97b-2914695e7a78 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.241084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96f39e01-5d6b-451c-a649-e02addfb3676 req-e87b1b9a-4ebc-48ec-b97b-2914695e7a78 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.282295 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-96f39e01-5d6b-451c-a649-e02addfb3676 req-e87b1b9a-4ebc-48ec-b97b-2914695e7a78 service nova] Creating event network-changed:4334a30f-24f4-491f-8ecf-cdb1ac1394b1 for instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 on n-h2-852086-5 Aug 27 03:08:42.299888 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-96f39e01-5d6b-451c-a649-e02addfb3676 req-e87b1b9a-4ebc-48ec-b97b-2914695e7a78 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086801 Aug 27 03:08:42.300994 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 234/424] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:42.321926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:42.322596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:42.337681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.339636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.340091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.347882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.348679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.349008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.371832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:42.608503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:42.609292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:42.623406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.623832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.625175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.627052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.630649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.631429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.786526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:42.795995 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ef9892f-d84b-4bc8-b024-7ebcdf279cd8 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1320 microversion: 2.1 time: 0.479413 Aug 27 03:08:42.804557 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 191/425] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:42 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:42.816917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:42.820262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:42.840928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.846255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.847387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.849409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.851665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.852383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:43.182794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:43.198820 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0d4c439-d4ff-4629-9b01-f3211c4f3418 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1477 microversion: 2.1 time: 0.593255 Aug 27 03:08:43.199842 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 235/426] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:42 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1477 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:43.555165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:43.570361 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f72e799c-60d6-4938-aab5-f187483dbb64 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.764372 Aug 27 03:08:43.571629 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 192/427] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:42 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:43.824940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:43.825560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:43.840359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:43.840788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:43.841378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:43.843178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:43.844068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:43.844630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:44.229997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:44.234728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:44.243812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:44.244779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:44.245985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:44.247480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:44.250182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:44.250973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:44.459295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:44.483524 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c05f004d-8cd8-4d6f-a264-c8c0e8670616 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1469 microversion: 2.1 time: 0.662326 Aug 27 03:08:44.484111 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 236/428] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:43 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1469 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:44.787092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:44.811003 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-675a89e8-b308-41c7-867c-0303caeb4f84 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1476 microversion: 2.1 time: 0.587273 Aug 27 03:08:44.815952 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 193/429] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:44 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1476 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:44.833710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:44.835546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:44.845364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:44.845904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:44.854490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:44.855415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:44.855910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:44.861149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:44.986829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-495fd4f2-dbbc-4aed-94c7-f79cd61c65cc tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:44.988363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-495fd4f2-dbbc-4aed-94c7-f79cd61c65cc tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] [instance: 677802c8-eb57-4b32-b5d5-6952b5bbdd10] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:44.999662 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-495fd4f2-dbbc-4aed-94c7-f79cd61c65cc tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] HTTP exception thrown: Instance 677802c8-eb57-4b32-b5d5-6952b5bbdd10 could not be found. Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-495fd4f2-dbbc-4aed-94c7-f79cd61c65cc tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Request method failure captured: Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/677802c8-eb57-4b32-b5d5-6952b5bbdd10/action HTTP/1.1 Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqiWf9HIj0i9qQ62gAeB20-7Y6etUOjZd_v20CJgU8TnaRYMYJCK6z3TC1MT_qyHbvqXW0p6Ifn_7NRdfNo4KVDiYF6yEoxh07beojX_8ptYKrRm8-_jn4MMvK0EuH0flBSxS3_3VOl3yEfB5T_7c4FIABfxB9hwc6G-DhucomrYlk Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:45.004412 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5fd0346409a249d68be629fb62a713ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}] Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ab7596845bf945cd87c522501624fe07 Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: {"migrate": {}} Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:08:45.005737 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 677802c8-eb57-4b32-b5d5-6952b5bbdd10 could not be found. Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '677802c8-eb57-4b32-b5d5-6952b5bbdd10', 'body': {'migrate': {}}} Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677802c8-eb57-4b32-b5d5-6952b5bbdd10 could not be found. Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:45.006557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677802c8-eb57-4b32-b5d5-6952b5bbdd10 could not be found. Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677802c8-eb57-4b32-b5d5-6952b5bbdd10 could not be found. Aug 27 03:08:45.007660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:45.013136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-495fd4f2-dbbc-4aed-94c7-f79cd61c65cc tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Returning 404 to user: Instance 677802c8-eb57-4b32-b5d5-6952b5bbdd10 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:45.015821 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-495fd4f2-dbbc-4aed-94c7-f79cd61c65cc tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/677802c8-eb57-4b32-b5d5-6952b5bbdd10/action" status: 404 len: 111 microversion: 2.1 time: 0.513855 Aug 27 03:08:45.018054 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 237/430] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:08:44 2022] POST /compute/v2.1/servers/677802c8-eb57-4b32-b5d5-6952b5bbdd10/action => generated 111 bytes in 517 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:08:45.028713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ce76fb76-2219-4a03-8a85-c36ec126e994 req-5b250ea0-10dc-45eb-8717-47a75af53794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50391137-b227-49eb-8694-c599b899a117", "name": "network-vif-unplugged", "status": "completed", "tag": "3f471807-d996-408f-bf48-36d371055ba3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:45.073608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ce76fb76-2219-4a03-8a85-c36ec126e994 req-5b250ea0-10dc-45eb-8717-47a75af53794 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.074105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ce76fb76-2219-4a03-8a85-c36ec126e994 req-5b250ea0-10dc-45eb-8717-47a75af53794 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.077561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ce76fb76-2219-4a03-8a85-c36ec126e994 req-5b250ea0-10dc-45eb-8717-47a75af53794 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.095312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:45.118421 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ce76fb76-2219-4a03-8a85-c36ec126e994 req-5b250ea0-10dc-45eb-8717-47a75af53794 service nova] Creating event network-vif-unplugged:3f471807-d996-408f-bf48-36d371055ba3 for instance 50391137-b227-49eb-8694-c599b899a117 on n-h2-852086-5 Aug 27 03:08:45.152505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:45.158952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-ce76fb76-2219-4a03-8a85-c36ec126e994 req-5b250ea0-10dc-45eb-8717-47a75af53794 service nova] Instance 50391137-b227-49eb-8694-c599b899a117 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:08:45.189671 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ce76fb76-2219-4a03-8a85-c36ec126e994 req-5b250ea0-10dc-45eb-8717-47a75af53794 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169216 Aug 27 03:08:45.192488 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 238/431] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:45.327275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-480889677", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:45.361492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:45.384743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3cea1b2-a380-423e-8017-b38ac8735c6c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.564318 Aug 27 03:08:45.385574 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 194/432] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:44 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:45.455603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:45.843263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:45.845292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:45.874903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.877092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.878537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.880331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.882961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.886426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.196737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:46.200413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:46.208402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:46.211954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:46.218996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:46.287697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.289633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.291812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.293851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.299906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.301795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.387642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Getting quotas for project 9451395d2b9e466e82bc66428aea7cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:46.416561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Getting quotas for user 0f8514e80d604c27ba5f05b5a4e43daa and project 9451395d2b9e466e82bc66428aea7cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:46.453912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:46.474898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:46.633683 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f7ac3218-68e9-4ff7-ad32-0c704b924d0b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311802 Aug 27 03:08:46.651542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 239/433] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:46.657888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:46.658863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:46.668197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.669053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.670261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.671349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.672315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.673179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:47.345437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:47.362797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-afe8bf7f-034f-454b-9cf6-18616c8fc27e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.709145 Aug 27 03:08:47.373322 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 240/434] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:46 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:47.387527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ba7d464-e485-46f9-9b0b-daafd32d8fdf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:47.387527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ba7d464-e485-46f9-9b0b-daafd32d8fdf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:47.459154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0ba7d464-e485-46f9-9b0b-daafd32d8fdf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:47.471278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ba7d464-e485-46f9-9b0b-daafd32d8fdf tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1221 microversion: 2.1 time: 0.093629 Aug 27 03:08:47.486717 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 241/435] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:47 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:47.495292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-59647818-0a20-454c-82c0-876816aac784 req-66cb2287-cc1c-4688-b852-fc6e7acf18a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50391137-b227-49eb-8694-c599b899a117", "tag": "3f471807-d996-408f-bf48-36d371055ba3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:47.505191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:47.537572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bc6defe-f86b-4eff-af5d-b98bdfcb8f10 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1476 microversion: 2.1 time: 1.699913 Aug 27 03:08:47.538927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 195/436] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:45 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1476 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:47.584385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-59647818-0a20-454c-82c0-876816aac784 req-66cb2287-cc1c-4688-b852-fc6e7acf18a5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:47.585408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-59647818-0a20-454c-82c0-876816aac784 req-66cb2287-cc1c-4688-b852-fc6e7acf18a5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:47.586824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-59647818-0a20-454c-82c0-876816aac784 req-66cb2287-cc1c-4688-b852-fc6e7acf18a5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:47.652093 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-59647818-0a20-454c-82c0-876816aac784 req-66cb2287-cc1c-4688-b852-fc6e7acf18a5 service nova] Creating event network-changed:3f471807-d996-408f-bf48-36d371055ba3 for instance 50391137-b227-49eb-8694-c599b899a117 on n-h2-852086-5 Aug 27 03:08:47.670593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-59647818-0a20-454c-82c0-876816aac784 req-66cb2287-cc1c-4688-b852-fc6e7acf18a5 service nova] Instance 50391137-b227-49eb-8694-c599b899a117 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:08:47.729265 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-59647818-0a20-454c-82c0-876816aac784 req-66cb2287-cc1c-4688-b852-fc6e7acf18a5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240371 Aug 27 03:08:47.742458 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 242/437] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:48.387279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:48.389649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:48.398637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.399134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.399572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.400274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.412032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.412504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.525571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:48.761902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:48.775231 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fdba06e8-2d36-4a7c-8cf8-d6cb54aa90ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.392163 Aug 27 03:08:48.776435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Calling method '.version_select at 0x7fe45c8e08b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:48.777134 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 243/438] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:48 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:48.780871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.781953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.782681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.794991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:48.796038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:48.807427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.807914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.808609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.809241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.810808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.811269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.812027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.815552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.816081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.827262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.828050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.828797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.836366 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e96caae-2418-490a-8059-399058d0a83f tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.637804 Aug 27 03:08:48.837575 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 196/439] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:48.848368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:48.850493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:48.858700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.860087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.860722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.862773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.863549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.864135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.927571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:48.940966 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2702c4fa-22e7-4059-a81e-40957303166f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1225 microversion: 2.1 time: 0.162553 Aug 27 03:08:48.941556 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 244/440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:48 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:49.151801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b7be96e-3155-4911-a010-25bca7a7dbb7 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-536050467", "ram": 512, "vcpus": 1, "disk": 10, "id": 1162873247, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:49.181322 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b7be96e-3155-4911-a010-25bca7a7dbb7 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.238392 Aug 27 03:08:49.182440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 245/441] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:48 2022] POST /compute/v2.1/flavors => generated 415 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:49.338961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:49.400352 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cda22852-98bc-4f33-b771-1ffb2c7fc19b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1474 microversion: 2.1 time: 0.560722 Aug 27 03:08:49.402075 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 197/442] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:48 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1474 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:49.409933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38b0db75-ac1b-4f4d-9005-99ce8f7019f1 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:49.420649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d69a92ff-358f-495a-9497-20bd82a39bb5 tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Calling method '.version_select at 0x7fe45c615040>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.422620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d69a92ff-358f-495a-9497-20bd82a39bb5 tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd51d7abdcc0f4a13a44599e046569f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '124b1b111aec4a21babc8506367c11fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d69a92ff-358f-495a-9497-20bd82a39bb5 tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Request method failure captured: Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors/n-h2-852086-5/search HTTP/1.1 Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYq-yJyT4xR0TiV-6sjJ8I7Iate7Sdmf8ykrNuyq-JyObcyuYXsNe1kGkudVMb4pvf4I0lONHPAILjgUzSUhQONAIMQrHHrplExjMagGjgqAoehWhtvmLWsmm3HRB_BVkajORnAINXcKM-N9gYUUDzHLxE9CtZVFpEcpDz26TkBphvs Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 124b1b111aec4a21babc8506367c11fc Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-613898367 Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:49.424341 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/124b1b111aec4a21babc8506367c11fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/124b1b111aec4a21babc8506367c11fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_124b1b111aec4a21babc8506367c11fc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/124b1b111aec4a21babc8506367c11fc"}]}] Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-613898367 Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 124b1b111aec4a21babc8506367c11fc Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-613898367 Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-613898367-project Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d51d7abdcc0f4a13a44599e046569f6f Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-613898367-project Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 03:08:49.425646 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'n-h2-852086-5'} Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:49.426344 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 03:08:49.427599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.428800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d69a92ff-358f-495a-9497-20bd82a39bb5 tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:49.428800 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d69a92ff-358f-495a-9497-20bd82a39bb5 tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/n-h2-852086-5/search" status: 403 len: 117 microversion: 2.1 time: 0.242032 Aug 27 03:08:49.439487 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 246/443] 10.222.0.69 () {58 vars in 1209 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/os-hypervisors/n-h2-852086-5/search => generated 117 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:49.455129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Calling method '.version_select at 0x7fe45c5cf5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.458685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.459188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.459815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.485443 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 03:08:49.487371 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38b0db75-ac1b-4f4d-9005-99ce8f7019f1 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1162873247/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083639 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Request method failure captured: Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYq_92yb-ufesAsq4_6L5iFfPbEwv6hhtms2IrzrmhiNyrynlCZGY8_dUqyl-TPbiEbaTeaYoCRm4YYGRQNXwR-bLeYqenfK6ygtJR3BAXiIjjTfrlG0WkMOAO12Jun9_CNfUwqKs0XsB7gAJcrSqDsy93GgcmCWRClK454xgDoeta0 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 285676be42dd4dc29b2215cf09556ef9 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-988680074 Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:49.488876 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/285676be42dd4dc29b2215cf09556ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/285676be42dd4dc29b2215cf09556ef9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_285676be42dd4dc29b2215cf09556ef9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/285676be42dd4dc29b2215cf09556ef9"}]}] Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-988680074 Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 285676be42dd4dc29b2215cf09556ef9 Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-988680074 Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ae060da1d7214ebdbd2a48b38078a8b6 Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 03:08:49.490839 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.491744 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.493637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.493637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:49.493637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:49.493637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 03:08:49.493637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.493914 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 198/444] 10.222.0.69 () {60 vars in 1224 bytes} [Sat Aug 27 03:08:49 2022] POST /compute/v2.1/flavors/1162873247/os-extra_specs => generated 66 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:49.494740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:49.495733 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-427e732f-3765-4472-83bf-81eda1bd51d9 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.048723 Aug 27 03:08:49.496777 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 247/445] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:49.508076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Calling method '.version_select at 0x7fe45c918dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.512015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.512808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.515782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.558561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.559354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.560802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.588851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.589354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.589798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.607479 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9a274a6-271a-4330-a5c8-4ebeb4f31b33 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102888 Aug 27 03:08:49.612634 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 248/446] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:49.628599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-28f1e906-ff1f-4cd6-b912-c9121bf74bcf tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Calling method '.version_select at 0x7fe45c622b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.635585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-28f1e906-ff1f-4cd6-b912-c9121bf74bcf tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd51d7abdcc0f4a13a44599e046569f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '124b1b111aec4a21babc8506367c11fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-28f1e906-ff1f-4cd6-b912-c9121bf74bcf tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Request method failure captured: Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYq-yJyT4xR0TiV-6sjJ8I7Iate7Sdmf8ykrNuyq-JyObcyuYXsNe1kGkudVMb4pvf4I0lONHPAILjgUzSUhQONAIMQrHHrplExjMagGjgqAoehWhtvmLWsmm3HRB_BVkajORnAINXcKM-N9gYUUDzHLxE9CtZVFpEcpDz26TkBphvs Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 124b1b111aec4a21babc8506367c11fc Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-613898367 Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:08:49.637763 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/124b1b111aec4a21babc8506367c11fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/124b1b111aec4a21babc8506367c11fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_124b1b111aec4a21babc8506367c11fc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/124b1b111aec4a21babc8506367c11fc"}]}] Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-613898367 Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 124b1b111aec4a21babc8506367c11fc Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-613898367 Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-613898367-project Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d51d7abdcc0f4a13a44599e046569f6f Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-613898367-project Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 03:08:49.640123 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1'} Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:08:49.641039 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 03:08:49.646423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.649665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-28f1e906-ff1f-4cd6-b912-c9121bf74bcf tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:49.649665 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-28f1e906-ff1f-4cd6-b912-c9121bf74bcf tempest-HypervisorAdminNegativeUnderV252Test-613898367 tempest-HypervisorAdminNegativeUnderV252Test-613898367-project] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.021026 Aug 27 03:08:49.649665 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 249/447] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:49.657134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Calling method '.version_select at 0x7fe45c615e50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.658912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.659392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.660037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.684645 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] HTTP exception thrown: No hypervisor matching 'f5799d90-129f-4e67-af90-7c7213b10572' could be found. Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Request method failure captured: Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-hypervisors/f5799d90-129f-4e67-af90-7c7213b10572/servers HTTP/1.1 Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYq_92yb-ufesAsq4_6L5iFfPbEwv6hhtms2IrzrmhiNyrynlCZGY8_dUqyl-TPbiEbaTeaYoCRm4YYGRQNXwR-bLeYqenfK6ygtJR3BAXiIjjTfrlG0WkMOAO12Jun9_CNfUwqKs0XsB7gAJcrSqDsy93GgcmCWRClK454xgDoeta0 Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 285676be42dd4dc29b2215cf09556ef9 Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-988680074 Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:08:49.686521 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/285676be42dd4dc29b2215cf09556ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/285676be42dd4dc29b2215cf09556ef9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_285676be42dd4dc29b2215cf09556ef9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/285676be42dd4dc29b2215cf09556ef9"}]}] Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-988680074 Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 285676be42dd4dc29b2215cf09556ef9 Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-988680074 Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ae060da1d7214ebdbd2a48b38078a8b6 Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: exception: No hypervisor matching 'f5799d90-129f-4e67-af90-7c7213b10572' could be found. Aug 27 03:08:49.688035 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f5799d90-129f-4e67-af90-7c7213b10572'} Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'f5799d90-129f-4e67-af90-7c7213b10572' could be found. Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.688861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:49.690180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:49.690180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:49.690180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:49.690180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:49.690180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'f5799d90-129f-4e67-af90-7c7213b10572' could be found. Aug 27 03:08:49.690180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:08:49.690180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] Returning 404 to user: No hypervisor matching 'f5799d90-129f-4e67-af90-7c7213b10572' could be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:49.690903 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65f44862-864e-4db7-b64a-fb7af54aa188 tempest-HypervisorAdminNegativeUnderV252Test-988680074 tempest-HypervisorAdminNegativeUnderV252Test-988680074-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/f5799d90-129f-4e67-af90-7c7213b10572/servers" status: 404 len: 123 microversion: 2.1 time: 0.038238 Aug 27 03:08:49.692150 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 250/448] 10.222.0.69 () {58 vars in 1281 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/os-hypervisors/f5799d90-129f-4e67-af90-7c7213b10572/servers => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:49.701255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.702140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:49.711519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.712633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.713527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.714883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.716217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.717292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.727325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7392db7f-bc14-4b60-93ed-3b96be380d12 tempest-FlavorsExtraSpecsTestJSON-2061979390 tempest-FlavorsExtraSpecsTestJSON-2061979390-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.741682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7392db7f-bc14-4b60-93ed-3b96be380d12 tempest-FlavorsExtraSpecsTestJSON-2061979390 tempest-FlavorsExtraSpecsTestJSON-2061979390-project] 10.222.0.69 "GET /compute/v2.1/flavors/1162873247/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.241623 Aug 27 03:08:49.743108 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 199/449] 10.222.0.69 () {58 vars in 1203 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/flavors/1162873247/os-extra_specs => generated 66 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:49.755516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c1419fa-39d9-4a1e-92d1-6fefd3f505b5 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:49.767218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:08:49.793113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:49.811114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c1419fa-39d9-4a1e-92d1-6fefd3f505b5 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1162873247/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058806 Aug 27 03:08:49.812666 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 200/450] 10.222.0.69 () {60 vars in 1224 bytes} [Sat Aug 27 03:08:49 2022] POST /compute/v2.1/flavors/1162873247/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:49.818575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.819580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:49.829119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.830010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.831410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.833269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.833987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.834772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.975430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:50.016832 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2ef1d101-bf89-48ea-b848-e3830408df60 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 204 len: 0 microversion: 2.1 time: 0.322996 Aug 27 03:08:50.017893 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 251/451] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:49 2022] DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:08:50.048061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc898e68-b859-4342-a38d-150c932e6ddb tempest-FlavorsExtraSpecsTestJSON-2061979390 tempest-FlavorsExtraSpecsTestJSON-2061979390-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:50.078662 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc898e68-b859-4342-a38d-150c932e6ddb tempest-FlavorsExtraSpecsTestJSON-2061979390 tempest-FlavorsExtraSpecsTestJSON-2061979390-project] 10.222.0.69 "GET /compute/v2.1/flavors/1162873247/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.058600 Aug 27 03:08:50.084315 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 252/452] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:08:50 2022] GET /compute/v2.1/flavors/1162873247/os-extra_specs/hw:numa_nodes => generated 22 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:50.098195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:50.098718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:50.105414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:50.108470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:50.108712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:50.109618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:50.110090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:50.110728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:50.397845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:50.412058 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-502f5d4e-3801-474f-a27b-70976455665f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1273 microversion: 2.1 time: 0.331692 Aug 27 03:08:50.429546 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 253/453] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:50 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:50.446155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2570e72-6291-42fb-bec1-34da9edd3810 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:50.481672 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2570e72-6291-42fb-bec1-34da9edd3810 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1162873247/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050298 Aug 27 03:08:50.482911 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 254/454] 10.222.0.69 () {60 vars in 1224 bytes} [Sat Aug 27 03:08:50 2022] POST /compute/v2.1/flavors/1162873247/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:50.493950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-25213220", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "1930694512", "adminPass": "***", "networks": [{"uuid": "822bb5c8-b856-428e-8d2b-f5ee3be2cef6"}], "security_groups": [{"name": "tempest-securitygroup--335002305"}], "key_name": "tempest-keypair-344888239", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:50.691424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:50.704600 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03b5a71e-892f-4e1d-8b9e-718e56a349c5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.890614 Aug 27 03:08:50.705192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 201/455] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:50.709617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:50.710251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:50.729744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:50.730426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:50.730701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:50.731407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:50.731860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:50.732512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:50.878779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] validate_networks() for [('822bb5c8-b856-428e-8d2b-f5ee3be2cef6', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:51.366996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:51.378461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8c69491-4534-4372-b192-5a2a6d4f52ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1471 microversion: 2.1 time: 0.672138 Aug 27 03:08:51.379368 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 202/456] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:50 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1471 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:51.385640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-456816be-e65d-4ae3-be52-0834d25b2d62 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:51.405491 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-456816be-e65d-4ae3-be52-0834d25b2d62 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1162873247/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024494 Aug 27 03:08:51.407405 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 203/457] 10.222.0.69 () {58 vars in 1203 bytes} [Sat Aug 27 03:08:51 2022] GET /compute/v2.1/flavors/1162873247/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:51.413558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:51.414358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:51.421801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.422940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.424442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.426064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.426860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.427438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.539159 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7bc9a9d4-4e9f-4ccf-b9fd-ef33dff6b1e0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117/action" status: 204 len: 0 microversion: 2.1 time: 0.130327 Aug 27 03:08:51.545484 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 204/458] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:08:51 2022] POST /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117/action => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:08:51.552831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43fccea6-4b68-41fd-aca6-6d33d3766a6a tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:51.600747 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43fccea6-4b68-41fd-aca6-6d33d3766a6a tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "PUT /compute/v2.1/flavors/1162873247/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.053195 Aug 27 03:08:51.601528 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 205/459] 10.222.0.69 () {60 vars in 1265 bytes} [Sat Aug 27 03:08:51 2022] PUT /compute/v2.1/flavors/1162873247/os-extra_specs/hw:numa_nodes => generated 22 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:51.610557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:51.611197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:51.618067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.618642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.619555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.619878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.620337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.620763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.886652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:51.909778 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d5ba05e-c9da-4bbe-9bca-b01affa1c7bb tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1279 microversion: 2.1 time: 0.302387 Aug 27 03:08:51.918217 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 206/460] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:51 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1279 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:51.929091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:51.929832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:51.943052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.943618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.944057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.944781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.945229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.945653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.190574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:52.192449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:52.193244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:52.194680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:52.195758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:52.219743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.221303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.221638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.222391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.222939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.223525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.244917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Getting quotas for project 1d3dc710fa9b46f889a756adbe3b0227. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:52.249681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Getting quotas for user ae358d463a134431827d704089300d0c and project 1d3dc710fa9b46f889a756adbe3b0227. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:52.261479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:52.264166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:52.325833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d703f102-5950-4892-92f8-93950f7f26e3 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.836757 Aug 27 03:08:52.327380 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 255/461] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:52.333479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d306b5b1-73f5-425a-9d03-e17076530855 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:52.343481 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d306b5b1-73f5-425a-9d03-e17076530855 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1162873247/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013861 Aug 27 03:08:52.344904 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 256/462] 10.222.0.69 () {58 vars in 1203 bytes} [Sat Aug 27 03:08:52 2022] GET /compute/v2.1/flavors/1162873247/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:52.349805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:52.350698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:52.358138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.359007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.359631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.360531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.361172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.361779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.984463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:52.996971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:53.009199 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63c2a804-1a31-4415-82c7-7019d03abe57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1471 microversion: 2.1 time: 1.095177 Aug 27 03:08:53.010268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 207/463] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:51 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1471 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:53.015912 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b288f17-67c2-4b64-8952-c9c5fb2bca33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.662277 Aug 27 03:08:53.020562 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 257/464] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:52 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:53.033289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ae722e7-5d8d-4fc2-8f0a-76f298ae9ae4 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.037053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c58f67b-c4a8-4e33-a5e0-3ea9ef65670c tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.037574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ae722e7-5d8d-4fc2-8f0a-76f298ae9ae4 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:53.124116 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c58f67b-c4a8-4e33-a5e0-3ea9ef65670c tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1162873247/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.101466 Aug 27 03:08:53.130359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 258/465] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:08:53 2022] DELETE /compute/v2.1/flavors/1162873247/os-extra_specs/hw:numa_nodes => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:53.151987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.156369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:53.178825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:53.181259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:53.183220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:53.185232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:53.187067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:53.188582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:53.424208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:53.435113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dfc20944-936b-4a7c-9939-ce3b1ab464e5 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1279 microversion: 2.1 time: 0.300997 Aug 27 03:08:53.436487 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 259/466] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:53 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1279 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:53.442572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-a9575d50-e9a2-4e2a-9367-e9fd3d42c8ad req-5df87e46-ee61-4eab-aa12-f275258e1390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50391137-b227-49eb-8694-c599b899a117", "name": "network-vif-plugged", "status": "completed", "tag": "3f471807-d996-408f-bf48-36d371055ba3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:53.456060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9575d50-e9a2-4e2a-9367-e9fd3d42c8ad req-5df87e46-ee61-4eab-aa12-f275258e1390 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:53.456552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9575d50-e9a2-4e2a-9367-e9fd3d42c8ad req-5df87e46-ee61-4eab-aa12-f275258e1390 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:53.456980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9575d50-e9a2-4e2a-9367-e9fd3d42c8ad req-5df87e46-ee61-4eab-aa12-f275258e1390 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:53.476598 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-a9575d50-e9a2-4e2a-9367-e9fd3d42c8ad req-5df87e46-ee61-4eab-aa12-f275258e1390 service nova] Creating event network-vif-plugged:3f471807-d996-408f-bf48-36d371055ba3 for instance 50391137-b227-49eb-8694-c599b899a117 on n-h2-852086-5 Aug 27 03:08:53.477891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ae722e7-5d8d-4fc2-8f0a-76f298ae9ae4 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:53.484831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-a9575d50-e9a2-4e2a-9367-e9fd3d42c8ad req-5df87e46-ee61-4eab-aa12-f275258e1390 service nova] Instance 50391137-b227-49eb-8694-c599b899a117 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:08:53.489205 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ae722e7-5d8d-4fc2-8f0a-76f298ae9ae4 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1262 microversion: 2.1 time: 0.477628 Aug 27 03:08:53.490252 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 208/467] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:53 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1262 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:53.498636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1491567a-7dd9-45b8-b1cb-c0ef36f5bf23 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.499657 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-a9575d50-e9a2-4e2a-9367-e9fd3d42c8ad req-5df87e46-ee61-4eab-aa12-f275258e1390 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060652 Aug 27 03:08:53.500938 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 260/468] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:53.542744 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1491567a-7dd9-45b8-b1cb-c0ef36f5bf23 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1162873247/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.050386 Aug 27 03:08:53.543358 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 209/469] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:08:53 2022] DELETE /compute/v2.1/flavors/1162873247/os-extra_specs/hw:cpu_policy => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:08:53.554869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84a01764-6ee1-4ce4-82d9-e486e7e066db tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.565639 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84a01764-6ee1-4ce4-82d9-e486e7e066db tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1162873247/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016495 Aug 27 03:08:53.566717 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 261/470] 10.222.0.69 () {58 vars in 1203 bytes} [Sat Aug 27 03:08:53 2022] GET /compute/v2.1/flavors/1162873247/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:08:53.585133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a923f9f-db9b-45e8-a1d6-9c1714a02892 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.610958 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a923f9f-db9b-45e8-a1d6-9c1714a02892 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1162873247" status: 202 len: 0 microversion: 2.1 time: 0.033685 Aug 27 03:08:53.612148 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 210/471] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:08:53 2022] DELETE /compute/v2.1/flavors/1162873247 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:08:53.624986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7541e91-f95f-4829-bf2c-7537d5243951 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.652304 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7541e91-f95f-4829-bf2c-7537d5243951 tempest-FlavorsExtraSpecsTestJSON-1933734160 tempest-FlavorsExtraSpecsTestJSON-1933734160-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.034006 Aug 27 03:08:53.654732 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 262/472] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:08:53 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:54.033631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:54.035119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:54.054331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:54.061366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:54.068520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.071438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.072405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.074869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.076677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.084345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.085390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.086143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.088806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.088940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.089539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.090154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.683379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:54.693768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1eb7c783-912e-430c-a600-9e46bc580d1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1471 microversion: 2.1 time: 0.666606 Aug 27 03:08:54.694372 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 211/473] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:54 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1471 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:54.713285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:54.713956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:54.731333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:54.734973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.735467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.735902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.736613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.737071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.739271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.741675 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8ed085a1-d562-490c-9e82-4732c53324e4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1503 microversion: 2.1 time: 0.701360 Aug 27 03:08:54.754191 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 263/474] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:54 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1503 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:54.754191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:54.754191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:54.786050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.786727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.788324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.789265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.789806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.790347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.064494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:55.103242 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-07e062ea-14c5-4ad4-9169-a1fdc79bcee6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1320 microversion: 2.1 time: 0.359369 Aug 27 03:08:55.105158 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 264/475] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:54 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:55.272684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:55.281238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7525bdac-d893-40a6-8b6c-9dbb8dc5e5fc tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1279 microversion: 2.1 time: 0.585835 Aug 27 03:08:55.298191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 212/476] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:54 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1279 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:55.722440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:55.723361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:55.750222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.753508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.756128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.767981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:55.768868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:55.773307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.775384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.775822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.780320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.780831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.781278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.792162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.793075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.797071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:56.828573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:56.850082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a22a1024-f867-476d-8e65-bc02904ef41f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1471 microversion: 2.1 time: 1.133420 Aug 27 03:08:56.861701 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 265/477] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:55 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1471 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:56.875750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:56.883142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:56.908834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:56.909337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:56.909822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:56.910520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:56.910980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:56.911408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.266081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:57.278183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:57.287324 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf1b7351-3530-40c8-9cd2-b7d048745a85 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1320 microversion: 2.1 time: 0.424116 Aug 27 03:08:57.289928 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 266/478] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:56 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:57.312482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:57.313293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:57.338274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:57.342647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.343385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.348572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.349807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.350465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.351207 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12f7a555-013f-4b5a-8029-0e9196885daf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1493 microversion: 2.1 time: 1.584242 Aug 27 03:08:57.351539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.352289 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 213/479] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:55 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1493 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:57.372239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fadbbab-18e6-40b8-bbf9-3d275dc0a75d tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '.version_select at 0x7fe45c95b670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:57.376223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fadbbab-18e6-40b8-bbf9-3d275dc0a75d tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.376902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fadbbab-18e6-40b8-bbf9-3d275dc0a75d tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.381987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fadbbab-18e6-40b8-bbf9-3d275dc0a75d tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.409442 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fadbbab-18e6-40b8-bbf9-3d275dc0a75d tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.041004 Aug 27 03:08:57.410353 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 214/480] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:08:57 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:08:57.425669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:57.426908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:57.486841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.490746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.491283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.492035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.494255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.494807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.602036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:57.912624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:57.924429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e79728e1-962b-4e31-b427-73117e92c992 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.632831 Aug 27 03:08:57.925024 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 267/481] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:57 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:57.937232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:57.942636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:57.965767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.970453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.972140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.975028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.975714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.978058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.343109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:58.359466 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1d4e6e31-134e-4022-b588-0ca235348902 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1463 microversion: 2.1 time: 0.430938 Aug 27 03:08:58.360738 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 268/482] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:57 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1463 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:58.369607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:58.373921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:58.395319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.395950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.396497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.397442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.398016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.398606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.827075 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5be2f768-37df-486b-8002-65b4730d6176 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1644 microversion: 2.1 time: 1.407794 Aug 27 03:08:58.833107 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 215/483] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:57 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1644 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:58.874678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:58.875344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:58.882153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:58.895572 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56859f5c-ae3c-47b9-bf8b-223b737248a1 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1387 microversion: 2.1 time: 0.530706 Aug 27 03:08:58.900769 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 269/484] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:58 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1387 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:58.907885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.911509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.912261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.916144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.917770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.918359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.948469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:58.949651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:58.958006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.959601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.960404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.963371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.964010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.964906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:59.549745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:59.567482 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2adff502-525f-42a9-a627-e0162164f921 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.622715 Aug 27 03:08:59.577689 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 270/485] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:58 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:59.585395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-317522650", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:59.724429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] validate_networks() for [('1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:00.768297 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-154f94f4-bc2a-4054-8754-4aa0f5d46c69 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1614 microversion: 2.1 time: 1.929861 Aug 27 03:09:00.773939 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 216/486] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:58 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1614 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:00.789112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7651f0b8-1d28-4da5-94a3-c507fa453093 req-407eb022-8ddc-47df-a2ef-83646f81f960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d7f6bd-104d-4e57-b004-56b81816b5bf", "name": "network-vif-deleted", "tag": "bce7b3ed-6f63-429a-b150-3d61e314704f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:00.821058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7651f0b8-1d28-4da5-94a3-c507fa453093 req-407eb022-8ddc-47df-a2ef-83646f81f960 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:00.821548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7651f0b8-1d28-4da5-94a3-c507fa453093 req-407eb022-8ddc-47df-a2ef-83646f81f960 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:00.821981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7651f0b8-1d28-4da5-94a3-c507fa453093 req-407eb022-8ddc-47df-a2ef-83646f81f960 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:00.854213 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7651f0b8-1d28-4da5-94a3-c507fa453093 req-407eb022-8ddc-47df-a2ef-83646f81f960 service nova] Creating event network-vif-deleted:bce7b3ed-6f63-429a-b150-3d61e314704f for instance b8d7f6bd-104d-4e57-b004-56b81816b5bf on n-h1-852086-5 Aug 27 03:09:00.884078 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7651f0b8-1d28-4da5-94a3-c507fa453093 req-407eb022-8ddc-47df-a2ef-83646f81f960 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105000 Aug 27 03:09:00.884751 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 217/487] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:00.896919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:00.900322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:00.921777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:00.922374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:00.922995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:00.923901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:00.924576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:00.926773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.533521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:01.550552 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45f0ec1d-ee83-421e-be64-9e7f86cfc4bf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1387 microversion: 2.1 time: 0.656413 Aug 27 03:09:01.551901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 218/488] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:00 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1387 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:01.842091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:01.842762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:01.843142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:01.843538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:01.844176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:01.865736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.866847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.867846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.869267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.869884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.870486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.918683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:01.932015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for user 38c24c41cfbb4a1caea77801a0b3432d and project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:01.960387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:01.965346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:02.032763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9df7c172-82c3-4882-91e2-d722c2a31039 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.451401 Aug 27 03:09:02.033418 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 271/489] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:02.041143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.042748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:02.055479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.056243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.056901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.058128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.059007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.059934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.143326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18007ffd-7c86-432b-897d-97d863d67f20 tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] Calling method '.version_select at 0x7fe45ca6b4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.166626 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18007ffd-7c86-432b-897d-97d863d67f20 tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.603845 Aug 27 03:09:02.167640 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 219/490] 10.222.0.69 () {58 vars in 1185 bytes} [Sat Aug 27 03:09:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:02.172597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b1ed973-1cee-4326-8ef4-eb2f36a2616e tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '.version_select at 0x7fe45c83df70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.176902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1ed973-1cee-4326-8ef4-eb2f36a2616e tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.177602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1ed973-1cee-4326-8ef4-eb2f36a2616e tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.178252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1ed973-1cee-4326-8ef4-eb2f36a2616e tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.192232 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b1ed973-1cee-4326-8ef4-eb2f36a2616e tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.023000 Aug 27 03:09:02.193020 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 220/491] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:02.205080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f86480-02eb-4df3-b033-7f8a064c6ac8", "tag": "46ac2d96-ec9a-42dc-87e4-23571d831e05"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:02.218672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.219172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.219612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.246207 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] Creating event network-changed:46ac2d96-ec9a-42dc-87e4-23571d831e05 for instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 on n-h1-852086-5 Aug 27 03:09:02.255799 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060888 Aug 27 03:09:02.257014 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 221/492] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:02.259445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.261361 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6ed5b5a3-5e40-4194-83b6-45852c469d5b req-aa540e35-871c-4083-8c76-f6b689b8a436 service nova] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002741 Aug 27 03:09:02.262504 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 222/493] 10.222.0.69 () {56 vars in 886 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 03:09:02.272958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3068e89-0cfa-4b61-b576-4792ad37c763 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.285891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3068e89-0cfa-4b61-b576-4792ad37c763 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:02.463055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:02.479102 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5cfbdd4-2904-489e-93d2-cda25283e873 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.443668 Aug 27 03:09:02.488799 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 272/494] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:02.502411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-29cbf27d-7a29-48f7-8277-4f45e1bc1b7b tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c5cf790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:02.585089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3068e89-0cfa-4b61-b576-4792ad37c763 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:02.598549 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3068e89-0cfa-4b61-b576-4792ad37c763 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1210 microversion: 2.1 time: 0.333845 Aug 27 03:09:02.614247 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 223/495] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1210 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:02.626963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-123553720", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:02.677019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:02.768338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:03.198636 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-29cbf27d-7a29-48f7-8277-4f45e1bc1b7b tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.703396 Aug 27 03:09:03.202820 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 273/496] 10.222.0.69 () {60 vars in 1206 bytes} [Sat Aug 27 03:09:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:03.213475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:03.214106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:03.221744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.222119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.222623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.223722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.224704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.225788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.249314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:03.250471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:03.251095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:03.251641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:03.252194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:03.263210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.264232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.264888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.265968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.266641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.267220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.291546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:03.300554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for user 3ad6820606064210a5a0e2fa2bfa4bb7 and project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:03.319383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:03.321864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:03.446486 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e51cb18f-2a71-4de6-96bb-c362a1671716 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827998 Aug 27 03:09:03.461353 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 224/497] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:03.477567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-88b5b3cc-40fe-42d7-91ba-348e57ac241b req-bd34fedb-6a15-43ad-9663-d8d61295248f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66c9f63-249a-4525-9989-2e52ee89fe37", "tag": "07f2e19c-33a2-4fe1-91f7-f66c7cca85da"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:03.510945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-88b5b3cc-40fe-42d7-91ba-348e57ac241b req-bd34fedb-6a15-43ad-9663-d8d61295248f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.511946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-88b5b3cc-40fe-42d7-91ba-348e57ac241b req-bd34fedb-6a15-43ad-9663-d8d61295248f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.514918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-88b5b3cc-40fe-42d7-91ba-348e57ac241b req-bd34fedb-6a15-43ad-9663-d8d61295248f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.550567 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-88b5b3cc-40fe-42d7-91ba-348e57ac241b req-bd34fedb-6a15-43ad-9663-d8d61295248f service nova] Creating event network-changed:07f2e19c-33a2-4fe1-91f7-f66c7cca85da for instance a66c9f63-249a-4525-9989-2e52ee89fe37 on n-h2-852086-5 Aug 27 03:09:03.557774 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-88b5b3cc-40fe-42d7-91ba-348e57ac241b req-bd34fedb-6a15-43ad-9663-d8d61295248f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094611 Aug 27 03:09:03.559024 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 225/498] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:03.566727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-84885ed5-c4db-4660-982a-bbba3bf83d9e tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] Calling method '.version_select at 0x7fe45c845ca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:03.590296 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-84885ed5-c4db-4660-982a-bbba3bf83d9e tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.028009 Aug 27 03:09:03.594751 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 226/499] 10.222.0.69 () {58 vars in 1185 bytes} [Sat Aug 27 03:09:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:03.612601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-887e3f75-93d2-4cbd-9575-88202f9d4731 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:03.617129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-887e3f75-93d2-4cbd-9575-88202f9d4731 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:03.770556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-887e3f75-93d2-4cbd-9575-88202f9d4731 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:03.787200 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-887e3f75-93d2-4cbd-9575-88202f9d4731 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1212 microversion: 2.1 time: 0.182448 Aug 27 03:09:03.787925 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 227/500] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:03 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1212 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:03.807600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:03.808217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:03.837753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.839471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.842551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.850223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.851057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.852176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:04.143624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:04.152867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae193dbe-137e-45c1-a087-cdca60f145e9 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1387 microversion: 2.1 time: 0.948878 Aug 27 03:09:04.153999 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 274/501] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:03 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1387 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:04.171857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50994ea0-e50e-4553-b67e-5b6eb731e69c tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c5e8e50>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:04.244990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:04.260226 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1237b709-dc89-424f-a2ac-f079532a4d8c tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.459660 Aug 27 03:09:04.263057 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 228/502] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:03 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:04.292371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:04.297949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:04.315407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:04.317765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:04.320477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:04.321511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:04.324065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:04.327436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:04.349514 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50994ea0-e50e-4553-b67e-5b6eb731e69c tempest-QuotaClassesAdminTestJSON-2135286206 tempest-QuotaClassesAdminTestJSON-2135286206-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.190768 Aug 27 03:09:04.350093 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 275/503] 10.222.0.69 () {60 vars in 1206 bytes} [Sat Aug 27 03:09:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:04.742663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-884853856", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "34528e57-9495-4744-8566-85d04ab8d770"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:04.850240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] validate_networks() for [('34528e57-9495-4744-8566-85d04ab8d770', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:05.132675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:05.148800 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-11802198-bb41-47f7-91fe-47b60c68bf4b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1262 microversion: 2.1 time: 0.882317 Aug 27 03:09:05.151907 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 229/504] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:04 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1262 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:05.168119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:05.169839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:05.198896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.199464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.201785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:05.203911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.204505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.206078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:05.375979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:05.388871 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2de6db39-189b-47c9-b0e3-45697095f54a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1264 microversion: 2.1 time: 0.232173 Aug 27 03:09:05.391097 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 230/505] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:05 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:05.401406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:05.404492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:05.429797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.430821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.431276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:05.432014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.432473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.437814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:05.980323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:05.995180 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-164c0015-1731-4751-8bd3-5ee0de367d88 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1387 microversion: 2.1 time: 0.601738 Aug 27 03:09:06.005829 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 231/506] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:05 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1387 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:06.053408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:06.058221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:06.099124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:06.107006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:06.109041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:06.114396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:06.118700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:06.120153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:06.120989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:06.802961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:06.813032 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27e4e59e-8d95-4964-b345-8e266dea0f04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.781167 Aug 27 03:09:06.813942 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 232/507] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:06 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:06.822644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:06.827827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:06.845838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:06.846937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:06.847764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:06.848825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:06.849561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:06.850321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:07.105307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:07.117331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-838f10a5-c38e-4e60-877d-5a79b21e44cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1268 microversion: 2.1 time: 0.301972 Aug 27 03:09:07.120491 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 233/508] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:06 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1268 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:07.140910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:07.142086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:07.160769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.161634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.162547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:07.163648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.164340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.164997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:07.313160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:07.326658 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a1815ea-c46f-4b8e-b294-9ecf48853aa5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1270 microversion: 2.1 time: 0.203996 Aug 27 03:09:07.327210 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 234/509] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:07 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:07.798474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:07.799499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:07.800137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:07.800734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:07.801302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:07.810586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=61,nova_cell0:UPDATE=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:07.816285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.821183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.821880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:07.822897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.823513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.824108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:07.875783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:07.886353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c276263-95a8-4d29-b98b-319cf4cfabfc tempest-NetworksTest-559337683 tempest-NetworksTest-559337683-project-admin] Calling method '.version_select at 0x7fe45c8e09d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:07.891180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for user 21a64079d45547ba80c22c309d216438 and project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:07.923640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:07.928238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:08.017748 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9e45ff2-70c7-45b9-8b02-efb4f0000f5e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.661635 Aug 27 03:09:08.019632 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 276/510] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:09:08.036298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:08.038490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:08.064619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:08.065470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:08.066233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:08.068295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:08.069482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:08.070642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:08.253144 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c276263-95a8-4d29-b98b-319cf4cfabfc tempest-NetworksTest-559337683 tempest-NetworksTest-559337683-project-admin] 10.222.0.69 "GET /compute/v2.1/os-networks" status: 200 len: 6065 microversion: 2.1 time: 0.924063 Aug 27 03:09:08.254266 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 235/511] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:09:07 2022] GET /compute/v2.1/os-networks => generated 6065 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:08.260731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:08.265185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:08.274974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:08.275490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:08.275916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:08.295212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:08.295855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:08.300187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:08.617978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.634747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-769eae1d-1cba-4a1b-bf68-ba3ee7387c34 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1387 microversion: 2.1 time: 0.607019 Aug 27 03:09:08.635403 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 277/512] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:08 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1387 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:08.654403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-de3edb1d-796f-4122-a056-23c667de6738 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:08.655395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-de3edb1d-796f-4122-a056-23c667de6738 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:08.657730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:INSERT=14,nova_api:SELECT=64,nova_api:UPDATE=22 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:08.760388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-de3edb1d-796f-4122-a056-23c667de6738 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.768939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-de3edb1d-796f-4122-a056-23c667de6738 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.776940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-de3edb1d-796f-4122-a056-23c667de6738 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.778145 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-de3edb1d-796f-4122-a056-23c667de6738 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1261 microversion: 2.25 time: 0.128512 Aug 27 03:09:08.783031 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 278/513] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:08 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:08.798566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.811050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:08.814639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:08.818241 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6346c717-0379-492a-9ed6-e80fdd56080b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.562507 Aug 27 03:09:08.821324 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 236/514] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:08 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:08.829884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:08.832179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:08.832816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:08.836002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:08.836155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c0557b4-20b7-4801-9975-beb38e597834 tempest-NetworksTest-559337683 tempest-NetworksTest-559337683-project-admin] Calling method '.version_select at 0x7fe45c831b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:08.836772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:08.837355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.248874 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c0557b4-20b7-4801-9975-beb38e597834 tempest-NetworksTest-559337683 tempest-NetworksTest-559337683-project-admin] 10.222.0.69 "GET /compute/v2.1/os-networks/279e5f41-bc2d-46f2-89e8-57d46bdfdebc" status: 200 len: 652 microversion: 2.1 time: 0.425107 Aug 27 03:09:09.251017 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 237/515] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:09:08 2022] GET /compute/v2.1/os-networks/279e5f41-bc2d-46f2-89e8-57d46bdfdebc => generated 652 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:09.259494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:09.261119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:09.271582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.272724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.273451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.275760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.276560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.277184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.379912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:09.396482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99588eca-5e3f-4212-b0ed-aaadc2b2641c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1270 microversion: 2.1 time: 0.143662 Aug 27 03:09:09.400207 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 238/516] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:09 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:09.409001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-155b3500-0107-47ab-b443-55be5e15a098 req-bd37a8e9-47dd-41bb-8427-08be976b2aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f86480-02eb-4df3-b033-7f8a064c6ac8", "name": "network-vif-plugged", "status": "completed", "tag": "46ac2d96-ec9a-42dc-87e4-23571d831e05"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:09.435822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-155b3500-0107-47ab-b443-55be5e15a098 req-bd37a8e9-47dd-41bb-8427-08be976b2aae service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.436307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-155b3500-0107-47ab-b443-55be5e15a098 req-bd37a8e9-47dd-41bb-8427-08be976b2aae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.436740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-155b3500-0107-47ab-b443-55be5e15a098 req-bd37a8e9-47dd-41bb-8427-08be976b2aae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.449056 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-155b3500-0107-47ab-b443-55be5e15a098 req-bd37a8e9-47dd-41bb-8427-08be976b2aae service nova] Creating event network-vif-plugged:46ac2d96-ec9a-42dc-87e4-23571d831e05 for instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 on n-h1-852086-5 Aug 27 03:09:09.456642 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-155b3500-0107-47ab-b443-55be5e15a098 req-bd37a8e9-47dd-41bb-8427-08be976b2aae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053331 Aug 27 03:09:09.457525 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 239/517] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:09.469620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ff88da9-f790-4d2b-b89f-95bacc1d6d39 tempest-NetworksTest-559337683 tempest-NetworksTest-559337683-project-admin] Calling method '.version_select at 0x7fe45c88d4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:09.736151 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ff88da9-f790-4d2b-b89f-95bacc1d6d39 tempest-NetworksTest-559337683 tempest-NetworksTest-559337683-project-admin] 10.222.0.69 "GET /compute/v2.1/os-networks" status: 200 len: 6065 microversion: 2.1 time: 0.276865 Aug 27 03:09:09.737412 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 240/518] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:09:09 2022] GET /compute/v2.1/os-networks => generated 6065 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:09.748047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:09.749306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:09.758465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.759836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.760552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.761589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.762172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.763262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.907965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:09.919284 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56fbe4e8-0113-468e-93a3-54f3835e2891 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 1.119062 Aug 27 03:09:09.923612 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 279/519] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:08 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:09.940569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:09.945576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:09.968780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.971112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.972681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.976874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.977658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.981193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.025496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.043034 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ae43c55-8b4a-462f-85a2-eb0a81663824 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1387 microversion: 2.1 time: 0.298780 Aug 27 03:09:10.045870 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 241/520] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:09 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1387 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:10.055416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:10.056315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:10.073625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.074777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.075310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.076057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.076533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.077387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.258579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.268712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.281890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.283362 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7d2b0f83-e575-437e-82a6-50bac6b40269 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1313 microversion: 2.25 time: 0.357611 Aug 27 03:09:10.299158 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 280/521] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:09 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:10.425922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:10.426914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:10.445507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.446236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.447072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.448331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.448992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.449610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.730845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:10.746478 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-733ea856-462e-47b1-9593-0373d062625d tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.697283 Aug 27 03:09:10.748668 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 242/522] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:10 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:10.955996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:10.956980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:11.008544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.011987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.014377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.016398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.018061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.021997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.039626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:11.051748 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f19600a9-8b2e-4cf5-a611-b2eef27051c9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.635183 Aug 27 03:09:11.084086 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 281/523] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:10 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:11.098551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:11.103788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:11.124678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.124678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.130582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.131878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.133186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.133847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.718329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:11.736786 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dace0b7b-949e-4d8e-bb98-bf9122470423 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.786125 Aug 27 03:09:11.738361 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 243/524] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:10 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:11.745515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:11.746433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:11.768230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.771089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.772535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.776060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.776587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.777021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.788117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:12.138983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.167924 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ada8ad7b-24d8-49eb-bf5a-3da6163085cf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1387 microversion: 2.1 time: 1.081482 Aug 27 03:09:12.168358 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 282/525] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:11 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1387 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:12.185824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2053615e-0fc5-4900-8aaf-c667c0aadd7b req-42ef166e-a060-430f-90bd-4e9c35283115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66c9f63-249a-4525-9989-2e52ee89fe37", "name": "network-vif-plugged", "status": "completed", "tag": "07f2e19c-33a2-4fe1-91f7-f66c7cca85da"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:12.218267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2053615e-0fc5-4900-8aaf-c667c0aadd7b req-42ef166e-a060-430f-90bd-4e9c35283115 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.221592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2053615e-0fc5-4900-8aaf-c667c0aadd7b req-42ef166e-a060-430f-90bd-4e9c35283115 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.222108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2053615e-0fc5-4900-8aaf-c667c0aadd7b req-42ef166e-a060-430f-90bd-4e9c35283115 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.255445 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-2053615e-0fc5-4900-8aaf-c667c0aadd7b req-42ef166e-a060-430f-90bd-4e9c35283115 service nova] Creating event network-vif-plugged:07f2e19c-33a2-4fe1-91f7-f66c7cca85da for instance a66c9f63-249a-4525-9989-2e52ee89fe37 on n-h2-852086-5 Aug 27 03:09:12.273025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.283554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.285116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.285707 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2053615e-0fc5-4900-8aaf-c667c0aadd7b req-42ef166e-a060-430f-90bd-4e9c35283115 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114630 Aug 27 03:09:12.290039 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 283/526] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:12.299209 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8dd5afe4-f3af-4367-ab95-833702287965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1361 microversion: 2.25 time: 0.550775 Aug 27 03:09:12.300143 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 244/527] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:11 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1361 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:12.309274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:12.314607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:12.360072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.360624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.361073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.367326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.367824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.368269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.776515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Calling method '.version_select at 0x7fe45c5e83a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:12.778534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.779257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.779921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.796308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.797129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.797795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.810114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.811345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.812016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.820688 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33ad981a-0b6d-42f0-a092-b061288b781b tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.519302 Aug 27 03:09:12.821663 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 284/528] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:09:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:12.845679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:12.847267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:12.864140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.865764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.867400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.868272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.870024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.873322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.220219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:13.234048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7ac5b79-a28a-485e-97f4-84a74e666e4f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.932457 Aug 27 03:09:13.235012 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 245/529] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:12 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:13.276790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:13.461714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:13.492435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-446373ee-cc55-44d1-93c0-c6f209f41325 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.669132 Aug 27 03:09:13.512257 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 285/530] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:12 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:13.538474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:13.550487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:13.573550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.582768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.583268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.584029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.584523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.584957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.598447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78323b70-b0e7-4ec8-9557-726ebe2af2c1 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Calling method '.version_select at 0x7fe45c8e0c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:13.782976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78323b70-b0e7-4ec8-9557-726ebe2af2c1 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 371 microversion: 2.1 time: 0.546773 Aug 27 03:09:13.783883 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 246/531] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:13.789388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Calling method '.version_select at 0x7fe45c8bc550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:13.792782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.793612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.795249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.814941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.815537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.815991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.823159 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-583a3d0e-55a8-4c95-86ca-b5652e7ac55a tempest-HypervisorAdminV228Test-266298701 tempest-HypervisorAdminV228Test-266298701-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.038001 Aug 27 03:09:13.833900 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 247/532] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:13.841780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8c4382ea-3325-4edd-a30a-a57b026aa48a req-2b41d46d-91b9-4c52-aab7-0713fad8de26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b27cbd-aa6c-43c5-9260-0a77d1b83677", "tag": "fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:13.852124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8c4382ea-3325-4edd-a30a-a57b026aa48a req-2b41d46d-91b9-4c52-aab7-0713fad8de26 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.852847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8c4382ea-3325-4edd-a30a-a57b026aa48a req-2b41d46d-91b9-4c52-aab7-0713fad8de26 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.853391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8c4382ea-3325-4edd-a30a-a57b026aa48a req-2b41d46d-91b9-4c52-aab7-0713fad8de26 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.867682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8c4382ea-3325-4edd-a30a-a57b026aa48a req-2b41d46d-91b9-4c52-aab7-0713fad8de26 service nova] Creating event network-changed:fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed for instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 on n-h2-852086-5 Aug 27 03:09:13.874595 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8c4382ea-3325-4edd-a30a-a57b026aa48a req-2b41d46d-91b9-4c52-aab7-0713fad8de26 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036842 Aug 27 03:09:13.875347 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 248/533] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:13.881782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:13.883451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:13.890600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.891399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.892686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.893796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.894490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.895918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.971150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:13.987599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dbf607e5-3acb-4ee5-ae95-602656cf0a28 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.474251 Aug 27 03:09:13.988197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 286/534] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:14.004243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:14.004872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:14.011326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.012082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.012559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.013785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.014478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.015063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.256588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.269409 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15e47705-a51f-42dd-9351-9a675dd36a70 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1587 microversion: 2.1 time: 0.391648 Aug 27 03:09:14.271198 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 249/535] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1587 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:14.281841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c8e0280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:14.517678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.549880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.552101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.553831 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d322bfa-4f78-41aa-84f0-c8c78073963f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1361 microversion: 2.25 time: 0.559904 Aug 27 03:09:14.555251 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 287/536] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1361 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:14.561690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-84e13bb7-10f4-433e-a327-dce268748a69 req-7a16f19a-cf34-429f-8a46-f89bbf19bab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3688d85b-42f3-4f81-8b01-dd440e545c13", "tag": "07f1d243-5821-46b5-9426-75ae4b014465"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:14.573752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84e13bb7-10f4-433e-a327-dce268748a69 req-7a16f19a-cf34-429f-8a46-f89bbf19bab3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.574538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84e13bb7-10f4-433e-a327-dce268748a69 req-7a16f19a-cf34-429f-8a46-f89bbf19bab3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.576136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84e13bb7-10f4-433e-a327-dce268748a69 req-7a16f19a-cf34-429f-8a46-f89bbf19bab3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.592826 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-84e13bb7-10f4-433e-a327-dce268748a69 req-7a16f19a-cf34-429f-8a46-f89bbf19bab3 service nova] Creating event network-changed:07f1d243-5821-46b5-9426-75ae4b014465 for instance 3688d85b-42f3-4f81-8b01-dd440e545c13 on n-h1-852086-5 Aug 27 03:09:14.617798 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-84e13bb7-10f4-433e-a327-dce268748a69 req-7a16f19a-cf34-429f-8a46-f89bbf19bab3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060152 Aug 27 03:09:14.618872 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 288/537] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:14.624385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.627730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.628287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:14.628638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.629105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:14.629770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.630903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.634416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.639232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.640038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.640997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.641814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.642375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.642871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.689883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:14.780808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ba12547-2587-4bf3-8443-28f3a9372f3b tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 328 microversion: 2.1 time: 0.501853 Aug 27 03:09:14.784002 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 250/538] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:09:14 2022] PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 328 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:14.798135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:14.799061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:14.817953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.820250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.820772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.822615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.824810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.826696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.271805 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09004260-cdc3-4fba-88dd-c15d3f080f87 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.486158 Aug 27 03:09:15.279133 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 251/539] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:09:14 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8/os-interface => generated 285 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:15.283188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:15.284003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:15.294489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.297110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.297666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.305321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.305908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.306453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.488600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:15.506150 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b678214-1f34-42ee-976f-31ff9c0e9b6a tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1321 microversion: 2.1 time: 0.884278 Aug 27 03:09:15.516512 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 289/540] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:14 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1321 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:15.522388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:15.523874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:15.539781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.540695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.541315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.542258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.542880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.544566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.685104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:15.693975 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8c9ab25-759d-43c8-9d67-d80224b3eb27 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.420153 Aug 27 03:09:15.695436 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 252/541] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:15 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:15.775586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:15.789689 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-beaada7d-2ea2-4f1b-8c44-01da079b739a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.271465 Aug 27 03:09:15.791897 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 290/542] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:15 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:15.799193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:15.800172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:15.808600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.809650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.810588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.811746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.812232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.813294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.993430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.003927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.005659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.007012 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21552c48-ecdd-4635-91f0-460c17b8b29c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1361 microversion: 2.25 time: 0.213353 Aug 27 03:09:16.019483 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 291/543] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:15 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:16.028962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cfca2fa8-c4fa-48bf-aa16-245a5331e729 req-d01180e5-29ab-4420-931c-717074738f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6506c3-9989-47ab-88c5-0258c00070d9", "tag": "de7751cd-3d09-4c1d-b715-b797a59a532e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:16.041825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cfca2fa8-c4fa-48bf-aa16-245a5331e729 req-d01180e5-29ab-4420-931c-717074738f9b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.042572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cfca2fa8-c4fa-48bf-aa16-245a5331e729 req-d01180e5-29ab-4420-931c-717074738f9b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.043182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cfca2fa8-c4fa-48bf-aa16-245a5331e729 req-d01180e5-29ab-4420-931c-717074738f9b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.057628 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cfca2fa8-c4fa-48bf-aa16-245a5331e729 req-d01180e5-29ab-4420-931c-717074738f9b service nova] Creating event network-changed:de7751cd-3d09-4c1d-b715-b797a59a532e for instance 0c6506c3-9989-47ab-88c5-0258c00070d9 on n-h2-852086-5 Aug 27 03:09:16.064669 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cfca2fa8-c4fa-48bf-aa16-245a5331e729 req-d01180e5-29ab-4420-931c-717074738f9b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043454 Aug 27 03:09:16.065391 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 292/544] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:16.079170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-59421236", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:16.167393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:16.551620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:16.552470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:16.567569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.568298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.569015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.570054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.570761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.571426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.892694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.908306 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44880fb7-70de-4314-8d28-aee17b5a1b04 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1470 microversion: 2.1 time: 0.365118 Aug 27 03:09:16.909558 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 293/545] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:16 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:16.925346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:16.926443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:16.935361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.936267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.936858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.937894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:16.938590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:16.939555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.111770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:17.113200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:17.114476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:17.117111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:17.118002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:17.136647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.138310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.139508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.141282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.142464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.143526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.198192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Getting quotas for project 3183def95b33403887e7059dbf4683c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:17.203680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:17.217415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Getting quotas for user 5515d623f5334e27a6713ae356da85f5 and project 3183def95b33403887e7059dbf4683c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:17.219464 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-78b62e4d-391e-498e-a282-ca94afdb4495 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.306851 Aug 27 03:09:17.238461 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 294/546] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:16 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:17.244823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:17.245789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:17.253458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.utils [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] cores quota exceeded for 3183def95b33403887e7059dbf4683c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122408) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 03:09:17.254353 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 03:09:17.254707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.255389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.256055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.257148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.257756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.258375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Request method failure captured: Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 143 Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrXzRk4yd5w2ThCQzCMxcy7ucYFL7N6-4hnSmfB7assUcpxDTJdRtIe1iY9oinb_4c5W5doreIOiN_7SFpQIyfd2dzBIkd0UQABvBnfUR6b78OEpzzZH8_lWTUUenvwQ5H1c7RksVQQ8AIxdfbfEgXi9NT9Z9x853Q2hwcQ-9Z21xQ Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:17.258580 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3183def95b33403887e7059dbf4683c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3183def95b33403887e7059dbf4683c7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}] Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 5515d623f5334e27a6713ae356da85f5 Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-59421236", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} Aug 27 03:09:17.260155 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-59421236', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452'}}} Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 03:09:17.261018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:17.262896 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:17.264305 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6729438-2f2a-4e20-925f-237668db6355 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.564003 Aug 27 03:09:17.265849 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 253/547] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:15 2022] POST /compute/v2.1/servers => generated 111 bytes in 1566 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:17.273236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:17.274223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:17.287751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.288343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.288989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.290452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.291306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.291756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.341103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lazy-loading 'flavor' on Instance uuid a66c9f63-249a-4525-9989-2e52ee89fe37 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:17.446220 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e9a91fb-b463-4893-af91-1bb1b2e15c6c tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37/action" status: 202 len: 0 microversion: 2.1 time: 0.180302 Aug 27 03:09:17.447242 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 254/548] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:17 2022] POST /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:09:17.457496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:17.458146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:17.465103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.466362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.466815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.467473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:17.467595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.468031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.468477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.477276 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00f6b5df-2687-4b2b-b34e-8cfa90d73cab tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.236593 Aug 27 03:09:17.478105 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 295/549] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:17 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:17.482713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c622940>, body: {"quota_set": {"cores": 20}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:17.753194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.753993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.754724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.755931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.756825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.757723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.773578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=9 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:17.859932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:17.870728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-950fa4a8-4def-4644-8a9c-36a468cc4377 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 329 microversion: 2.1 time: 0.391642 Aug 27 03:09:17.872262 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 296/550] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:09:17 2022] PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 329 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:17.884490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:17.886040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:17.888281 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76fb8386-9f32-4143-ae62-16cfc554a1b2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1361 microversion: 2.25 time: 0.434531 Aug 27 03:09:17.888711 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 255/551] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:17 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:17.903698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:17.904920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:17.914576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.915155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.915664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.916887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.917435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.917942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.960553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c5a03a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:18.318022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.327932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.328866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.330773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.331745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.332675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.492587 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-770994b0-da97-41c1-a469-f33b63ab59ee tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8" status: 200 len: 240 microversion: 2.36 time: 0.618344 Aug 27 03:09:18.499691 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 297/552] 10.222.0.69 () {62 vars in 1303 bytes} [Sat Aug 27 03:09:17 2022] PUT /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8 => generated 240 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:18.504933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce2579ff-9904-4ff7-8965-9d9a3b7550e4 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Calling method '.version_select at 0x7fe45c59bca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:18.525900 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65496eda-7481-4825-a30f-0f049b02cc15 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1629 microversion: 2.1 time: 0.635794 Aug 27 03:09:18.551548 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 256/553] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:17 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1629 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:18.559662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:18.560537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:18.569716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.570589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.570959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.571691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.572245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.572774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.851576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:18.863512 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efbc9d8f-ebd3-488a-823a-b91055796f46 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1587 microversion: 2.1 time: 0.310748 Aug 27 03:09:18.882198 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 257/554] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:18 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1587 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:18.889730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-dab2affe-8d27-4ad9-bb0f-6f138f44c68d req-495fa79b-2afb-4b51-986a-cb9730b818c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f86480-02eb-4df3-b033-7f8a064c6ac8", "tag": "46ac2d96-ec9a-42dc-87e4-23571d831e05"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:18.902675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dab2affe-8d27-4ad9-bb0f-6f138f44c68d req-495fa79b-2afb-4b51-986a-cb9730b818c1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.905210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dab2affe-8d27-4ad9-bb0f-6f138f44c68d req-495fa79b-2afb-4b51-986a-cb9730b818c1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.905210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dab2affe-8d27-4ad9-bb0f-6f138f44c68d req-495fa79b-2afb-4b51-986a-cb9730b818c1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.920550 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-dab2affe-8d27-4ad9-bb0f-6f138f44c68d req-495fa79b-2afb-4b51-986a-cb9730b818c1 service nova] Creating event network-changed:46ac2d96-ec9a-42dc-87e4-23571d831e05 for instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 on n-h1-852086-5 Aug 27 03:09:18.928933 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-dab2affe-8d27-4ad9-bb0f-6f138f44c68d req-495fa79b-2afb-4b51-986a-cb9730b818c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045195 Aug 27 03:09:18.930932 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 258/555] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:18.960308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:18.963022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:18.984258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.984918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.994484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.995661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.997280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.998960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.189797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce2579ff-9904-4ff7-8965-9d9a3b7550e4 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 371 microversion: 2.1 time: 0.693847 Aug 27 03:09:19.193530 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 298/556] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:09:18 2022] GET /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 371 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:19.210582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:19.214251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:19.231474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.238516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.238516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.240003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.240883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.242903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.545525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:19.556852 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79a3be7a-8fc9-4308-96d2-e49abed4c144 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.618219 Aug 27 03:09:19.558824 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 259/557] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:18 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:19.586358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Calling method '.version_select at 0x7fe45c749b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:19.625626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:19.633886 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-128c06d5-0fc8-4cb2-aa3b-18e6a9f41ed6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.439195 Aug 27 03:09:19.639602 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 299/558] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:19 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:19.645411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:19.647047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:19.655868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.656238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.656935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.657661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.664450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.669437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.968744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:19.984188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:19.987394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:20.002082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8bccebfe-dd76-4397-821a-c4c46f3f5496 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1361 microversion: 2.25 time: 0.354193 Aug 27 03:09:20.002961 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 300/559] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:19 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:20.009957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c541940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:20.132437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.132927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.137147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.140647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.151058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.151852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.218219 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21365936-7db9-4137-8298-6e6f2d23fd20 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8/detail" status: 200 len: 672 microversion: 2.36 time: 0.656222 Aug 27 03:09:20.220215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 260/560] 10.222.0.69 () {60 vars in 1304 bytes} [Sat Aug 27 03:09:19 2022] GET /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8/detail => generated 672 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:20.227314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:20.234062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:20.251225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.252379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.253165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.254602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.255795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.257892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.479637 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-024871e3-814d-4cd9-9747-8d51d1047c9a tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1612 microversion: 2.1 time: 0.256958 Aug 27 03:09:20.479637 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 261/561] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:20 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1612 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:20.503556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e4a6843b-02f7-421f-9549-ae268cf8fa61 req-2005cf9d-5f62-411c-a1b8-253cd6af91f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3688d85b-42f3-4f81-8b01-dd440e545c13", "name": "network-vif-plugged", "status": "completed", "tag": "07f1d243-5821-46b5-9426-75ae4b014465"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:20.514898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e4a6843b-02f7-421f-9549-ae268cf8fa61 req-2005cf9d-5f62-411c-a1b8-253cd6af91f2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.515379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e4a6843b-02f7-421f-9549-ae268cf8fa61 req-2005cf9d-5f62-411c-a1b8-253cd6af91f2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.515940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e4a6843b-02f7-421f-9549-ae268cf8fa61 req-2005cf9d-5f62-411c-a1b8-253cd6af91f2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.527488 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e4a6843b-02f7-421f-9549-ae268cf8fa61 req-2005cf9d-5f62-411c-a1b8-253cd6af91f2 service nova] Creating event network-vif-plugged:07f1d243-5821-46b5-9426-75ae4b014465 for instance 3688d85b-42f3-4f81-8b01-dd440e545c13 on n-h1-852086-5 Aug 27 03:09:20.533480 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e4a6843b-02f7-421f-9549-ae268cf8fa61 req-2005cf9d-5f62-411c-a1b8-253cd6af91f2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044485 Aug 27 03:09:20.534653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 262/562] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:20.551727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:20.553438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:20.583681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.584160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.584812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.585884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.586741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.588019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.627465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.630949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.631460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.632347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.634543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.636811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.723777 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9d429dc-1dfd-4c47-b420-b5d754ecf0ea tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 328 microversion: 2.1 time: 0.719511 Aug 27 03:09:20.729378 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] HTTP exception thrown: Cannot 'migrate' instance a66c9f63-249a-4525-9989-2e52ee89fe37 while it is in vm_state suspended Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Request method failure captured: Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37/action HTTP/1.1 Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 15 Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqiWf9HIj0i9qQ62gAeB20-7Y6etUOjZd_v20CJgU8TnaRYMYJCK6z3TC1MT_qyHbvqXW0p6Ifn_7NRdfNo4KVDiYF6yEoxh07beojX_8ptYKrRm8-_jn4MMvK0EuH0flBSxS3_3VOl3yEfB5T_7c4FIABfxB9hwc6G-DhucomrYlk Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:09:20.732266 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5fd0346409a249d68be629fb62a713ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}] Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ab7596845bf945cd87c522501624fe07 Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: {"migrate": {}} Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:09:20.733658 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'migrate' instance a66c9f63-249a-4525-9989-2e52ee89fe37 while it is in vm_state suspended Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'a66c9f63-249a-4525-9989-2e52ee89fe37', 'body': {'migrate': {}}} Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a66c9f63-249a-4525-9989-2e52ee89fe37 in vm_state suspended. Cannot resize while the instance is in this state. Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:20.734880 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a66c9f63-249a-4525-9989-2e52ee89fe37 while it is in vm_state suspended Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:20.736082 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:20.737358 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:20.737358 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:20.737358 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a66c9f63-249a-4525-9989-2e52ee89fe37 while it is in vm_state suspended Aug 27 03:09:20.737358 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:20.737358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Returning 409 to user: Cannot 'migrate' instance a66c9f63-249a-4525-9989-2e52ee89fe37 while it is in vm_state suspended {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:20.737358 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a95999a-3bdf-4423-ad9b-20fe229bd130 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37/action" status: 409 len: 148 microversion: 2.1 time: 0.198521 Aug 27 03:09:20.737358 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 263/563] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:20 2022] POST /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37/action => generated 148 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:20.737818 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 301/564] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:09:20 2022] PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 328 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:20.746047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:20.746865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:20.753381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.754142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.754758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.755631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.756233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.756816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.757389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:20.758006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:20.776947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.777446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.778425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.779262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:20.779716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:20.780136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:20.938904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:20.943081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:20.947475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27579b31-712f-4e49-bf2a-bf28d574c732 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.210966 Aug 27 03:09:20.948336 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 264/565] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:20 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:20.951848 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1ede12b-f6c1-41cb-864c-a35b516af22e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.212849 Aug 27 03:09:20.962966 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 302/566] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:20 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:20.969409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c5e80d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:21.105092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Calling method '.version_select at 0x7fe45c94e4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:21.110472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.111933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.113041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.119383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:21.135008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.135492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.136204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.137057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.138735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.139023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.139322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.140130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.140887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.174545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:21.192116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.192935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.193357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.193534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.193754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.194475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.195422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.196044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.196473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.207527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.208028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.208472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.260530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.261626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.263441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.280841 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87afb4e9-2dd8-491e-93b9-8435e546ff3d tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2231 microversion: 2.53 time: 0.331097 Aug 27 03:09:21.282044 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 265/567] 10.222.0.69 () {60 vars in 1243 bytes} [Sat Aug 27 03:09:20 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2231 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:21.287073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc515a3f-5812-48f2-a840-cd56513c800f tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc515a3f-5812-48f2-a840-cd56513c800f tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Request method failure captured: Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f/action HTTP/1.1 Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 39 Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqiWf9HIj0i9qQ62gAeB20-7Y6etUOjZd_v20CJgU8TnaRYMYJCK6z3TC1MT_qyHbvqXW0p6Ifn_7NRdfNo4KVDiYF6yEoxh07beojX_8ptYKrRm8-_jn4MMvK0EuH0flBSxS3_3VOl3yEfB5T_7c4FIABfxB9hwc6G-DhucomrYlk Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:09:21.290771 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5fd0346409a249d68be629fb62a713ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}] Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ab7596845bf945cd87c522501624fe07 Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: {"os-resetState": {"state": "invalid"}} Aug 27 03:09:21.292116 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '911a23b3-f713-43f3-a09f-09827e960e8f', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.292843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:09:21.296828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 03:09:21.299701 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.299701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc515a3f-5812-48f2-a840-cd56513c800f tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:21.299701 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc515a3f-5812-48f2-a840-cd56513c800f tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f/action" status: 400 len: 144 microversion: 2.1 time: 0.009140 Aug 27 03:09:21.299701 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 266/568] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:21 2022] POST /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:09:21.300348 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6c4c70bf-3938-45f2-8e64-f486575d55e4 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8?user_id=c8b4efa443bc4de6bd2abed656c045e3" status: 200 len: 240 microversion: 2.36 time: 0.328297 Aug 27 03:09:21.300348 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 303/569] 10.222.0.69 () {62 vars in 1384 bytes} [Sat Aug 27 03:09:20 2022] PUT /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8?user_id=c8b4efa443bc4de6bd2abed656c045e3 => generated 240 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:21.300676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1106215540", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:21.301943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:21.302443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:21.313317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.313930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.314746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.315441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.315936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.316357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.363615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:21.477726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:21.486784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:21.488209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:21.489498 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65406d1a-bfa6-491c-a018-3a26b51eea86 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1361 microversion: 2.25 time: 0.192629 Aug 27 03:09:21.498773 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 304/570] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:21 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:21.504616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a29fa34a-f04a-4cf1-bd29-fde96dd507e0 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] Calling method '.version_select at 0x7fe45c5a0b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:21.594445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:21.594941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:21.595125 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a29fa34a-f04a-4cf1-bd29-fde96dd507e0 tempest-QuotasAdminTestV236-1049973634 tempest-QuotasAdminTestV236-1049973634-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8?user_id=c8b4efa443bc4de6bd2abed656c045e3" status: 200 len: 282 microversion: 2.36 time: 0.098635 Aug 27 03:09:21.595355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:21.595768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:21.596191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:21.602421 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 305/571] 10.222.0.69 () {60 vars in 1364 bytes} [Sat Aug 27 03:09:21 2022] GET /compute/v2.1/os-quota-sets/dc7d44c456e3422ba58aef59d64d27a8?user_id=c8b4efa443bc4de6bd2abed656c045e3 => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:21.607373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Calling method '.version_select at 0x7fe45c943700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:21.612161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.612890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.613523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.620556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=35 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:21.626490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.627593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.628295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.629259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.630102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.631623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.635382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.635890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.636299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.647066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:21.656277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Getting quotas for project 3183def95b33403887e7059dbf4683c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:21.662944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Getting quotas for user 5515d623f5334e27a6713ae356da85f5 and project 3183def95b33403887e7059dbf4683c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:21.672710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.673326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.673878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.678146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.utils [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] instances quota exceeded for 3183def95b33403887e7059dbf4683c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122408) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 03:09:21.678876 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Request method failure captured: Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 145 Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrXzRk4yd5w2ThCQzCMxcy7ucYFL7N6-4hnSmfB7assUcpxDTJdRtIe1iY9oinb_4c5W5doreIOiN_7SFpQIyfd2dzBIkd0UQABvBnfUR6b78OEpzzZH8_lWTUUenvwQ5H1c7RksVQQ8AIxdfbfEgXi9NT9Z9x853Q2hwcQ-9Z21xQ Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:21.680821 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3183def95b33403887e7059dbf4683c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3183def95b33403887e7059dbf4683c7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}] Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 5515d623f5334e27a6713ae356da85f5 Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1106215540", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} Aug 27 03:09:21.682795 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1106215540', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452'}}} Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 03:09:21.683926 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.686128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.688797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67b5e6bc-2865-49a7-9bcc-40dac3da9864 tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.388321 Aug 27 03:09:21.691989 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 267/572] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:21 2022] POST /compute/v2.1/servers => generated 119 bytes in 393 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:21.693588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.693588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.693588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.694004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3718519-6b66-468c-b337-1183a29a8500 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3718519-6b66-468c-b337-1183a29a8500 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Request method failure captured: Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f/action HTTP/1.1 Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 31 Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqiWf9HIj0i9qQ62gAeB20-7Y6etUOjZd_v20CJgU8TnaRYMYJCK6z3TC1MT_qyHbvqXW0p6Ifn_7NRdfNo4KVDiYF6yEoxh07beojX_8ptYKrRm8-_jn4MMvK0EuH0flBSxS3_3VOl3yEfB5T_7c4FIABfxB9hwc6G-DhucomrYlk Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:09:21.696268 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5fd0346409a249d68be629fb62a713ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}] Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ab7596845bf945cd87c522501624fe07 Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: {"os-resetState": {"state": 1}} Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:09:21.699748 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '911a23b3-f713-43f3-a09f-09827e960e8f', 'body': {'os-resetState': {'state': 1}}} Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 1 Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:21.703225 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 03:09:21.709253 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.713091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3718519-6b66-468c-b337-1183a29a8500 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:21.713091 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3718519-6b66-468c-b337-1183a29a8500 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f/action" status: 400 len: 120 microversion: 2.1 time: 0.009598 Aug 27 03:09:21.713091 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 268/573] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:21 2022] POST /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f/action => generated 120 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:09:21.713091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c94e0d0>, body: {"quota_set": {"instances": 10}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:21.725696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.726211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.726650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.734394 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e238216-14b1-43f5-9dde-256d7666a8f3 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 923 microversion: 2.53 time: 0.130667 Aug 27 03:09:21.734963 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 306/574] 10.222.0.69 () {60 vars in 1222 bytes} [Sat Aug 27 03:09:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 923 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:21.740098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1535ffd-8384-441b-84ab-71e3d9cfb089 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:21.742344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1535ffd-8384-441b-84ab-71e3d9cfb089 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Failed to fetch instance by id 999 {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:09:21.742941 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f1535ffd-8384-441b-84ab-71e3d9cfb089 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1535ffd-8384-441b-84ab-71e3d9cfb089 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Request method failure captured: Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 37 Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqiWf9HIj0i9qQ62gAeB20-7Y6etUOjZd_v20CJgU8TnaRYMYJCK6z3TC1MT_qyHbvqXW0p6Ifn_7NRdfNo4KVDiYF6yEoxh07beojX_8ptYKrRm8-_jn4MMvK0EuH0flBSxS3_3VOl3yEfB5T_7c4FIABfxB9hwc6G-DhucomrYlk Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:09:21.744780 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5fd0346409a249d68be629fb62a713ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5fd0346409a249d68be629fb62a713ef"}]}] Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 5fd0346409a249d68be629fb62a713ef Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-985512968 Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ab7596845bf945cd87c522501624fe07 Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-985512968-project-admin Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: {"os-resetState": {"state": "error"}} Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:09:21.746038 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 999 could not be found. Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:21.747593 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1535ffd-8384-441b-84ab-71e3d9cfb089 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:21.751018 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1535ffd-8384-441b-84ab-71e3d9cfb089 tempest-ServersAdminNegativeTestJSON-985512968 tempest-ServersAdminNegativeTestJSON-985512968-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.010020 Aug 27 03:09:21.753041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 307/575] 10.222.0.69 () {60 vars in 1179 bytes} [Sat Aug 27 03:09:21 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:21.753679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Calling method '.version_select at 0x7fe45c59bca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:21.758942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.759993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.760436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.780808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.781350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.782186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.792535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd30a898-087b-440a-9ac8-4f58acd10711 tempest-HypervisorAdminV253TestBase-2027300425 tempest-HypervisorAdminV253TestBase-2027300425-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors/abfeb07b-336a-4cc6-99c2-7f1fef869574" status: 200 len: 792 microversion: 2.53 time: 0.042467 Aug 27 03:09:21.794007 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 308/576] 10.222.0.69 () {60 vars in 1298 bytes} [Sat Aug 27 03:09:21 2022] GET /compute/v2.1/os-hypervisors/abfeb07b-336a-4cc6-99c2-7f1fef869574 => generated 792 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:21.815158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:21.815720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:21.823507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.824277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.827234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.828239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.828856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.829435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.862597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:09:21.893654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:21.943506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.944669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.946294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.947751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.948401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.949155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.016538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-23807b7b-fff6-4faf-b231-64eee8e50916 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 204 len: 0 microversion: 2.1 time: 0.219933 Aug 27 03:09:22.020416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 309/577] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:09:21 2022] DELETE /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:09:22.033141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.033997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:22.040891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.041088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.041418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.042144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.042623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.043220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.066492 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a660ede-6f34-4c56-8016-19cd3f1a32b6 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 329 microversion: 2.1 time: 0.361410 Aug 27 03:09:22.068163 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 269/578] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:09:21 2022] PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 329 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:22.084304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.085204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:22.093695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.094724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.095881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.097088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.097606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.098053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.245104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.258816 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b4885d8-ac3a-4476-84f1-4226eafa0beb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.234367 Aug 27 03:09:22.262145 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 310/579] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:22.268413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.269179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:22.278808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.284888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.290499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.291902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.292384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.293244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.314700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.324932 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28186164-b51b-4e4a-bec2-6ecc1bfec8ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.255345 Aug 27 03:09:22.326286 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 270/580] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:22.331548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4251e5fb-c087-44b5-9987-b366403efdf2 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Calling method '.version_select at 0x7fe45c879430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.471088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.479742 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-449db7ed-fa5e-4c5d-a65a-194d1b7326d4 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1467 microversion: 2.1 time: 0.216167 Aug 27 03:09:22.480378 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 311/581] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1467 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:22.514077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.514723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:22.529035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.529035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.529035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.530034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.530879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.531898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.687436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4251e5fb-c087-44b5-9987-b366403efdf2 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 371 microversion: 2.1 time: 0.359549 Aug 27 03:09:22.694754 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 271/582] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:22.695078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-adb4afb1-9f2e-4f6d-ba63-3c659c38fd56 req-6bc7a06a-aea9-46f5-acb5-d23d76c1e234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b27cbd-aa6c-43c5-9260-0a77d1b83677", "name": "network-vif-plugged", "status": "completed", "tag": "fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:22.708190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-adb4afb1-9f2e-4f6d-ba63-3c659c38fd56 req-6bc7a06a-aea9-46f5-acb5-d23d76c1e234 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.708845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-adb4afb1-9f2e-4f6d-ba63-3c659c38fd56 req-6bc7a06a-aea9-46f5-acb5-d23d76c1e234 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.709430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-adb4afb1-9f2e-4f6d-ba63-3c659c38fd56 req-6bc7a06a-aea9-46f5-acb5-d23d76c1e234 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.723480 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-adb4afb1-9f2e-4f6d-ba63-3c659c38fd56 req-6bc7a06a-aea9-46f5-acb5-d23d76c1e234 service nova] Creating event network-vif-plugged:fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed for instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 on n-h2-852086-5 Aug 27 03:09:22.728487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-adb4afb1-9f2e-4f6d-ba63-3c659c38fd56 req-6bc7a06a-aea9-46f5-acb5-d23d76c1e234 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038607 Aug 27 03:09:22.729430 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 272/583] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:22.733544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.735422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c749b80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:22.744427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.746101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:22.753244 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df79b842-4122-4cf3-8092-22cfed03b2ff tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1558 microversion: 2.25 time: 0.244338 Aug 27 03:09:22.754269 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 312/584] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:09:22.835432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.836025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.836355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.837088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.837544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.837962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.968058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e8f22d9-61dd-4f8c-920b-a94ed5e5a888 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 325 microversion: 2.1 time: 0.237197 Aug 27 03:09:22.969450 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 273/585] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:09:22 2022] PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:22.997314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.998374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:23.009434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.010309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.010965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.011988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.012749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.014251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.190657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1871560774", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:23.278840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 3688d85b-42f3-4f81-8b01-dd440e545c13 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:23.283826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:23.370386 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dd92805d-9fd7-4770-8242-06ce2821979a tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 2050 microversion: 2.25 time: 0.587934 Aug 27 03:09:23.373071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 313/586] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 2050 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:23.384437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:23.385084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:23.405776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.407632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.408094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.410669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.411301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.411740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.599785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:23.609456 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-05516b64-6d80-4564-8af4-fb844d7532dc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.235269 Aug 27 03:09:23.610484 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 314/587] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:23 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:23.616214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:23.617751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:23.624924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.625406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.626003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.626972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.627722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.628414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.656999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:23.657819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:23.658034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:23.658625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:23.659025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:23.677460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.678289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.678967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.679887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.680342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.680764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.711949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Getting quotas for project 3183def95b33403887e7059dbf4683c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:23.719221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Getting quotas for user 5515d623f5334e27a6713ae356da85f5 and project 3183def95b33403887e7059dbf4683c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:23.744155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.utils [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] ram quota exceeded for 3183def95b33403887e7059dbf4683c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122408) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 03:09:23.745006 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Request method failure captured: Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 145 Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrXzRk4yd5w2ThCQzCMxcy7ucYFL7N6-4hnSmfB7assUcpxDTJdRtIe1iY9oinb_4c5W5doreIOiN_7SFpQIyfd2dzBIkd0UQABvBnfUR6b78OEpzzZH8_lWTUUenvwQ5H1c7RksVQQ8AIxdfbfEgXi9NT9Z9x853Q2hwcQ-9Z21xQ Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:23.748031 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3183def95b33403887e7059dbf4683c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3183def95b33403887e7059dbf4683c7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}] Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 5515d623f5334e27a6713ae356da85f5 Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1871560774", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} Aug 27 03:09:23.749685 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1871560774', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452'}}} Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 03:09:23.750428 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:23.755524 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:23.756810 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-336b5ef6-870a-45a2-95be-8c982da7c75f tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.564510 Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 274/588] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 566 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:23.758068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:23.759603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:23.768323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.768925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.770297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.771524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.772347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.772874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.815303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:23.824005 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-70c29a6e-7f23-40a1-b5f3-1058aa00edcb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.212178 Aug 27 03:09:23.825060 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 315/589] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:23 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:23.831515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:23.832137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:23.843773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.844282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.844728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.845794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:23.846296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:23.846940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.022465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 3688d85b-42f3-4f81-8b01-dd440e545c13 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:24.079903 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-995fea41-6ae4-4872-9c2c-99e9db427708 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 2050 microversion: 2.25 time: 0.328027 Aug 27 03:09:24.080494 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 275/590] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:23 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 2050 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:24.085988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c879ee0>, body: {"quota_set": {"ram": 51200}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:24.146230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:24.156306 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba8774cc-a847-436f-9bf9-a5f061509fc2 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1467 microversion: 2.1 time: 0.329846 Aug 27 03:09:24.157674 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 316/591] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:23 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1467 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:24.162514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:24.166178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.166684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.167373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.168438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.168907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.169337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.205738 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a277e63e-f1ab-43ba-aeca-0ddcdfd868ba tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046817 Aug 27 03:09:24.206672 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 317/592] 10.222.0.69 () {60 vars in 1217 bytes} [Sat Aug 27 03:09:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:24.229718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852086-5", "block_migration": "auto"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:24.234505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:24.243696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.247316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.248905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.249888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.250636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.252025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.368182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'flavor' on Instance uuid 3688d85b-42f3-4f81-8b01-dd440e545c13 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:24.433414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Going to try to live migrate instance to n-h2-852086-5 {{(pid=122407) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:09:24.463421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.464289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.464952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.467326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.468460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.469152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.598309 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f73f6ef0-3346-4e29-a813-9300e923cc30 tempest-QuotasAdminNegativeTest-664280299 tempest-QuotasAdminNegativeTest-664280299-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 200 len: 329 microversion: 2.1 time: 0.516455 Aug 27 03:09:24.608409 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 276/593] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:09:24 2022] PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 329 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:24.614912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af65e052-9bc8-42f7-87be-c3e6ba18c57d tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Action: 'update', calling method: .version_select at 0x7fe45c79ee50>, body: {"quota_set": {"ram": 0}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af65e052-9bc8-42f7-87be-c3e6ba18c57d tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '5515d623f5334e27a6713ae356da85f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3183def95b33403887e7059dbf4683c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af65e052-9bc8-42f7-87be-c3e6ba18c57d tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Request method failure captured: Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 HTTP/1.1 Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 25 Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrXzRk4yd5w2ThCQzCMxcy7ucYFL7N6-4hnSmfB7assUcpxDTJdRtIe1iY9oinb_4c5W5doreIOiN_7SFpQIyfd2dzBIkd0UQABvBnfUR6b78OEpzzZH8_lWTUUenvwQ5H1c7RksVQQ8AIxdfbfEgXi9NT9Z9x853Q2hwcQ-9Z21xQ Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:24.634910 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3183def95b33403887e7059dbf4683c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3183def95b33403887e7059dbf4683c7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3183def95b33403887e7059dbf4683c7"}]}] Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3183def95b33403887e7059dbf4683c7 Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1441298056 Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 5515d623f5334e27a6713ae356da85f5 Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-QuotasAdminNegativeTest-1441298056-project Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: {"quota_set": {"ram": 0}} Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 03:09:24.637609 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3183def95b33403887e7059dbf4683c7', 'body': {'quota_set': {'ram': 0}}} Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:24.639341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:24.643191 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af65e052-9bc8-42f7-87be-c3e6ba18c57d tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af65e052-9bc8-42f7-87be-c3e6ba18c57d tempest-QuotasAdminNegativeTest-1441298056 tempest-QuotasAdminNegativeTest-1441298056-project] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7" status: 403 len: 116 microversion: 2.1 time: 0.026524 Aug 27 03:09:24.647470 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 277/594] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:09:24 2022] PUT /compute/v2.1/os-quota-sets/3183def95b33403887e7059dbf4683c7 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:24.658480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:24.661038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:24.669137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.671003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.671651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.672732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.673584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.674432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.938744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:24.950900 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43cc792f-e255-46b3-80e7-9ff8b7c02c5e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.306045 Aug 27 03:09:24.951657 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 278/595] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:24 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:24.991035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4b9b2993-c5f3-47fa-aa12-17bc23c50988 req-ebe37243-4dc5-48da-a125-6978a08c9723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6506c3-9989-47ab-88c5-0258c00070d9", "name": "network-vif-plugged", "status": "completed", "tag": "de7751cd-3d09-4c1d-b715-b797a59a532e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:25.010502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4b9b2993-c5f3-47fa-aa12-17bc23c50988 req-ebe37243-4dc5-48da-a125-6978a08c9723 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.011551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4b9b2993-c5f3-47fa-aa12-17bc23c50988 req-ebe37243-4dc5-48da-a125-6978a08c9723 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.012177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4b9b2993-c5f3-47fa-aa12-17bc23c50988 req-ebe37243-4dc5-48da-a125-6978a08c9723 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.038331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4b9b2993-c5f3-47fa-aa12-17bc23c50988 req-ebe37243-4dc5-48da-a125-6978a08c9723 service nova] Creating event network-vif-plugged:de7751cd-3d09-4c1d-b715-b797a59a532e for instance 0c6506c3-9989-47ab-88c5-0258c00070d9 on n-h2-852086-5 Aug 27 03:09:25.055788 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4b9b2993-c5f3-47fa-aa12-17bc23c50988 req-ebe37243-4dc5-48da-a125-6978a08c9723 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073634 Aug 27 03:09:25.057375 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 279/596] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:25.068542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:25.069778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:25.081862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.082620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.083250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.084371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.085993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.086656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.420137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:25.428324 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2deb1cc2-1a28-407a-8b16-a42a8e96f974 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1310 microversion: 2.1 time: 0.367020 Aug 27 03:09:25.428907 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 280/597] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:25 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1310 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:25.434615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:25.435240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:25.447390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.447887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.448331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.449052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.450756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.451321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.556887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:25.571896 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ec8900e-c659-451f-91f3-04f5ed7bdfd9 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1425 microversion: 2.1 time: 0.141831 Aug 27 03:09:25.572604 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 281/598] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:25 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1425 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:25.592554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-44a34c46-42ae-42de-905c-cd7debfffd24 req-928502b0-4daf-4931-9f46-6bad8b7706fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66c9f63-249a-4525-9989-2e52ee89fe37", "name": "network-vif-deleted", "tag": "07f2e19c-33a2-4fe1-91f7-f66c7cca85da"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:25.605581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-44a34c46-42ae-42de-905c-cd7debfffd24 req-928502b0-4daf-4931-9f46-6bad8b7706fd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.606421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-44a34c46-42ae-42de-905c-cd7debfffd24 req-928502b0-4daf-4931-9f46-6bad8b7706fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.608508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-44a34c46-42ae-42de-905c-cd7debfffd24 req-928502b0-4daf-4931-9f46-6bad8b7706fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.622207 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-44a34c46-42ae-42de-905c-cd7debfffd24 req-928502b0-4daf-4931-9f46-6bad8b7706fd service nova] Creating event network-vif-deleted:07f2e19c-33a2-4fe1-91f7-f66c7cca85da for instance a66c9f63-249a-4525-9989-2e52ee89fe37 on n-h2-852086-5 Aug 27 03:09:25.628670 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-44a34c46-42ae-42de-905c-cd7debfffd24 req-928502b0-4daf-4931-9f46-6bad8b7706fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054473 Aug 27 03:09:25.629236 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 282/599] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:25.981728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:25.982751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:25.992148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.992660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.993829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.994561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.994673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.995057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.263921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:26.283599 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e89b9a43-14df-474e-ad73-69c3079aaa57 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1312 microversion: 2.1 time: 0.309714 Aug 27 03:09:26.284673 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 283/600] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:25 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:26.453917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:26.454650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:26.462241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.462860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.463401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.474894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.476235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.480854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.750956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:26.761138 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abaf363a-0b5d-4ab1-963b-5b0bc8b45949 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1491 microversion: 2.1 time: 0.313556 Aug 27 03:09:26.761723 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 284/601] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:26 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1491 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:26.792473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:26.794071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:26.803690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.804400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.805072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.806009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.806677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.807373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.867437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.867928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.869748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.870514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lazy-loading 'fault' on Instance uuid a66c9f63-249a-4525-9989-2e52ee89fe37 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:26.947811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:26.970792 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47de327a-2ca4-42ab-9bfc-ae582c123d7b tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 200 len: 1311 microversion: 2.1 time: 0.198438 Aug 27 03:09:26.972900 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 285/602] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:26 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 1311 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:26.987689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:26.989792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:26.998769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.999773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.000191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.000932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.001396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.001816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.241820 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bad67ee2-5c8c-4af1-ad5b-0d93065d1bf6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13/action" status: 202 len: 0 microversion: 2.25 time: 3.021605 Aug 27 03:09:27.244713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 318/603] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:09:24 2022] POST /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13/action => generated 0 bytes in 3027 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:09:27.273703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:27.275668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:27.296263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.297608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.299300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.301207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.303049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.304280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.334945 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d2b7ca0-1e7f-4def-ac90-6a865ebbbdae tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1642 microversion: 2.1 time: 0.359731 Aug 27 03:09:27.340799 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 286/604] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:26 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1642 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:27.365859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:27.367496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:27.388790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.390124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.391766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.395689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.396849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.398929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.692693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.725284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.736222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.742811 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a40d59a4-ca9e-49a8-a26d-6a89f7aa4f73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 0.488088 Aug 27 03:09:27.745661 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 319/605] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:27 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:27.758566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:27.759463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:27.770577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.771070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.771505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.772335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.772779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.773365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.873923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.890014 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-507ede07-4af8-4b32-b4b5-a2ed6e93d7bd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1462 microversion: 2.1 time: 0.546918 Aug 27 03:09:27.902494 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 287/606] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:27 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1462 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:27.925428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:27.932149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:27.946310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.954326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.955062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.955854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.956332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.956768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.133266 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc5fff0c-d7c3-47b7-b893-4fe5fb11dbe8 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1642 microversion: 2.1 time: 0.385744 Aug 27 03:09:28.135147 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 320/607] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:27 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1642 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:28.145189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:28.146842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: a66c9f63-249a-4525-9989-2e52ee89fe37] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.171897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.172774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.173546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.174811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.182473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.183321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.221471 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] HTTP exception thrown: Instance a66c9f63-249a-4525-9989-2e52ee89fe37 could not be found. Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Request method failure captured: Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 HTTP/1.1 Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqggBPmlTmq-BDDPZBxxgoCwDSxarKp22U6Wv8gS7afoSewrhQ9MZ6L-KNaePAU-RTcAaDX-vWoR3z0QJDBf9tRLzpET5HFd1-JlHvP-rfTfad45rZzOVNStqxNFsAp-lOimmP1eWWMzBvm_j5d4tv7dKkwkdCJy0bh21k-0tHoXZE Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9451395d2b9e466e82bc66428aea7cbc Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1186367776 Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:09:28.224569 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9451395d2b9e466e82bc66428aea7cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9451395d2b9e466e82bc66428aea7cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9451395d2b9e466e82bc66428aea7cbc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9451395d2b9e466e82bc66428aea7cbc"}]}] Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1186367776 Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9451395d2b9e466e82bc66428aea7cbc Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1186367776 Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdminNegativeTestJSON-1186367776-project Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0f8514e80d604c27ba5f05b5a4e43daa Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1186367776-project Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance a66c9f63-249a-4525-9989-2e52ee89fe37 could not be found. Aug 27 03:09:28.227028 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'a66c9f63-249a-4525-9989-2e52ee89fe37'} Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66c9f63-249a-4525-9989-2e52ee89fe37 could not be found. Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:28.228426 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66c9f63-249a-4525-9989-2e52ee89fe37 could not be found. Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66c9f63-249a-4525-9989-2e52ee89fe37 could not be found. Aug 27 03:09:28.234073 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:28.242435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Returning 404 to user: Instance a66c9f63-249a-4525-9989-2e52ee89fe37 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:28.242435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3613155a-db71-4172-9a23-7f10bed1af98 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37" status: 404 len: 111 microversion: 2.1 time: 0.089307 Aug 27 03:09:28.242435 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 321/608] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:28 2022] GET /compute/v2.1/servers/a66c9f63-249a-4525-9989-2e52ee89fe37 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:28.242435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:28.242435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.245764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.245764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.246262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:28.247040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.247040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.247040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.249566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:28.252809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:09:28.272853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:28.275985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:28.276863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:28.278144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:28.279180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:28.283871 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc21a472-316e-49f0-8544-88d8fd323dcd tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055083 Aug 27 03:09:28.297103 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 322/609] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:09:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:28.297103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:28.297103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.306267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.307079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.307859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.309047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.309825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.310574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.387690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:28.413063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:09:28.537250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:28.557125 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-894b6791-cbfe-45db-9b68-819f0e43d8ac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9/action" status: 202 len: 0 microversion: 2.1 time: 0.640285 Aug 27 03:09:28.558983 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 288/610] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:27 2022] POST /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:09:28.574029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:28.575446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.595217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.595737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.596640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.602787 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-67135701-6b92-460d-bd9f-181105b1406f tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "DELETE /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 204 len: 0 microversion: 2.1 time: 0.314400 Aug 27 03:09:28.604708 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 323/611] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:09:28 2022] DELETE /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:09:28.610536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.613170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.615201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.753249 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-346af76a-ed5e-4d87-8452-bf39a8585d90 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677/action" status: 202 len: 0 microversion: 2.1 time: 0.191619 Aug 27 03:09:28.753780 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 289/612] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:28 2022] POST /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:09:28.760060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:28.761061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.769422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.769993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.770745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.771461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.772170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.772602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.004909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:29.011326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1249144811", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:29.014977 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb5a6a1c-1117-4e00-bd55-36826b508ca2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1471 microversion: 2.1 time: 0.259240 Aug 27 03:09:29.016123 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 290/613] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:28 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:29.029690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:29.031252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:29.047319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.048020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.048530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.050734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.051890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.052737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.127109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:29.452368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:29.463437 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fba86819-188e-4c11-abf1-5a926bf96b96 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1475 microversion: 2.1 time: 0.445553 Aug 27 03:09:29.464296 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 291/614] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:29 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1475 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:29.476600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:29.477521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:29.492712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.493298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.493745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.498454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.499008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.499462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.752164 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-204ed7a6-0022-4edb-9300-317be483a5fa tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1627 microversion: 2.1 time: 0.283956 Aug 27 03:09:29.753340 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 292/615] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:29 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1627 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:29.759700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:29.760606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:29.768219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.768716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.769416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.770142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.771401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.771839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.954745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:29.955242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:29.955621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:29.956024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:29.956431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:29.963064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:29.969955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.970731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.971482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.972673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.973313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.973904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.975058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:29.976912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:29.978550 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3bc25e1-c137-48f8-b192-e2a5d72685ce tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 0.224058 Aug 27 03:09:29.979756 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 293/616] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:29 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:30.002617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Getting quotas for project fd9c7fa6872a425298d2b501e9121af3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:30.014539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Getting quotas for user b7d0abe77aa743688dbae2f2e7064f1c and project fd9c7fa6872a425298d2b501e9121af3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:30.034200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:30.036774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:30.092867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a805ca22-893f-4aab-82dd-cc13158064a5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.485669 Aug 27 03:09:30.094319 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 324/617] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:30.102872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852086-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:30.107611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:30.112502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:30.117548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.118786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.119587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.120750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.121605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.122216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.166541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lazy-loading 'flavor' on Instance uuid b8b27cbd-aa6c-43c5-9260-0a77d1b83677 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:30.195625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Going to try to live migrate instance to n-h1-852086-5 {{(pid=122407) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:09:30.209456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c52edc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:30.355140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.355627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.356098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.356817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.357351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.367101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.700778 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4315f815-9298-4e75-aaa2-0770785c17c1 tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8" status: 200 len: 148 microversion: 2.57 time: 0.719556 Aug 27 03:09:30.710073 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 294/618] 10.222.0.69 () {62 vars in 1303 bytes} [Sat Aug 27 03:09:29 2022] PUT /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8 => generated 148 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:30.720814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:30.721428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:30.767699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.768232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.768679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.773802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.774360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.774902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.196357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:31.221034 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f2acf54-e963-4fcb-9793-b140c2fa5524 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1471 microversion: 2.1 time: 0.515681 Aug 27 03:09:31.222978 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 295/619] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:30 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1471 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:31.229459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2729ff6b-91b4-403b-a4dd-dc517e6cce5a req-7c887183-4385-4304-9710-20eaffb19572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3688d85b-42f3-4f81-8b01-dd440e545c13", "name": "network-vif-unplugged", "status": "completed", "tag": "07f1d243-5821-46b5-9426-75ae4b014465"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:31.249746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2729ff6b-91b4-403b-a4dd-dc517e6cce5a req-7c887183-4385-4304-9710-20eaffb19572 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.251765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2729ff6b-91b4-403b-a4dd-dc517e6cce5a req-7c887183-4385-4304-9710-20eaffb19572 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.252500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2729ff6b-91b4-403b-a4dd-dc517e6cce5a req-7c887183-4385-4304-9710-20eaffb19572 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.278850 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2729ff6b-91b4-403b-a4dd-dc517e6cce5a req-7c887183-4385-4304-9710-20eaffb19572 service nova] Creating event network-vif-unplugged:07f1d243-5821-46b5-9426-75ae4b014465 for instance 3688d85b-42f3-4f81-8b01-dd440e545c13 on n-h1-852086-5 Aug 27 03:09:31.285961 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2729ff6b-91b4-403b-a4dd-dc517e6cce5a req-7c887183-4385-4304-9710-20eaffb19572 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060610 Aug 27 03:09:31.287271 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 296/620] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:31.298611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:31.299423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:31.308113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.309067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.309908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.310935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.311638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.313006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.417321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:31.438389 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-664794a4-2972-4c22-a353-8bfe56c4d1b6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1215 microversion: 2.1 time: 0.149068 Aug 27 03:09:31.440298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 297/621] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:31 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:31.457190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:31.458615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:31.476610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.484993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.486269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.487609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.488477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.489352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.666013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8514e80d604c27ba5f05b5a4e43daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9451395d2b9e466e82bc66428aea7cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:31.675603 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8668bb11-0ec4-4c31-b00e-d4a084e4fa4e tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 200 len: 1305 microversion: 2.1 time: 0.233408 Aug 27 03:09:31.676826 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 298/622] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:31 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 1305 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:31.682295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Calling method '.version_select at 0x7fe45c8791f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:32.007450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.008213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.008639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:32.010230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.012527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.013259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:32.039374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdd40dd4-41c9-4186-857e-47916241d37e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8/detail" status: 200 len: 463 microversion: 2.57 time: 0.360572 Aug 27 03:09:32.041284 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 299/623] 10.222.0.69 () {60 vars in 1304 bytes} [Sat Aug 27 03:09:31 2022] GET /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8/detail => generated 463 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:32.046932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:32.049110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:32.060077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.061030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.062441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:32.063478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.064333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.065112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:32.268556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:32.278774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:32.280276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:32.281711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9ec6a30-f130-4cdc-a5d9-b95e874dc22a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 0.239019 Aug 27 03:09:32.282295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 300/624] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:32 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:32.286735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6b977e75-b27d-4378-b913-53746914ca7d req-ab2a25f2-e135-43b7-a604-328ac15afb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911a23b3-f713-43f3-a09f-09827e960e8f", "name": "network-vif-deleted", "tag": "d5387121-e970-468a-a8be-3e556c0c3b13"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:32.297839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6b977e75-b27d-4378-b913-53746914ca7d req-ab2a25f2-e135-43b7-a604-328ac15afb7f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.298347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6b977e75-b27d-4378-b913-53746914ca7d req-ab2a25f2-e135-43b7-a604-328ac15afb7f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.298773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6b977e75-b27d-4378-b913-53746914ca7d req-ab2a25f2-e135-43b7-a604-328ac15afb7f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:32.311171 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6b977e75-b27d-4378-b913-53746914ca7d req-ab2a25f2-e135-43b7-a604-328ac15afb7f service nova] Creating event network-vif-deleted:d5387121-e970-468a-a8be-3e556c0c3b13 for instance 911a23b3-f713-43f3-a09f-09827e960e8f on n-h1-852086-5 Aug 27 03:09:32.317383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6b977e75-b27d-4378-b913-53746914ca7d req-ab2a25f2-e135-43b7-a604-328ac15afb7f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033910 Aug 27 03:09:32.318001 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 301/625] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:32.398677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1201198572", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:32.467650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:33.274051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:33.275286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:33.275688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:33.276836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:33.277896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:33.296141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.297036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.297836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.299342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.300202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.300921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.340170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:33.351215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:33.381700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:33.383615 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-679920c1-57f0-4e85-8a11-5b69860cdc04 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677/action" status: 202 len: 0 microversion: 2.1 time: 3.287049 Aug 27 03:09:33.389917 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 325/626] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:30 2022] POST /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677/action => generated 0 bytes in 3290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:09:33.393519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:33.402319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c59b5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:33.572850 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42da7277-c854-4a30-8009-8dbf492c6c3b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253188 Aug 27 03:09:33.575113 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 302/627] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:33.588632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:33.589583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:33.594795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.596900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.598672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.601917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.603177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.604384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.604759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.605735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.606821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.608532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.609456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.610059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.690878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.691650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.692243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.693180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.693996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.694779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.796368 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b2a3627-74da-462d-9024-b485d6b9cb9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8?user_id=847d9568e0254f4797afc76fb92b27f6" status: 200 len: 148 microversion: 2.57 time: 0.409044 Aug 27 03:09:33.798011 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 326/628] 10.222.0.69 () {62 vars in 1384 bytes} [Sat Aug 27 03:09:33 2022] PUT /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8?user_id=847d9568e0254f4797afc76fb92b27f6 => generated 148 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:33.804947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:33.806001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:33.815248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.816158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.816949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.818043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.818761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.819407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.950395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:33.958932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:33.966728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-028c143f-2eff-49af-a070-19ba722f93e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1277 microversion: 2.1 time: 0.166793 Aug 27 03:09:33.968774 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 327/629] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:33 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:33.986599 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f82dc13-212f-4339-819c-ac7435a7161f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1471 microversion: 2.1 time: 0.399103 Aug 27 03:09:34.004587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.005610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] [instance: 911a23b3-f713-43f3-a09f-09827e960e8f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.012230 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 303/630] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:33 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:34.019306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.019836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.020773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.024408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.025536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.025869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.026685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.027137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.055871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.057243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.058349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.065403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.066702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.067809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.069305 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] HTTP exception thrown: Instance 911a23b3-f713-43f3-a09f-09827e960e8f could not be found. Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Request method failure captured: Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f HTTP/1.1 Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqggBPmlTmq-BDDPZBxxgoCwDSxarKp22U6Wv8gS7afoSewrhQ9MZ6L-KNaePAU-RTcAaDX-vWoR3z0QJDBf9tRLzpET5HFd1-JlHvP-rfTfad45rZzOVNStqxNFsAp-lOimmP1eWWMzBvm_j5d4tv7dKkwkdCJy0bh21k-0tHoXZE Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9451395d2b9e466e82bc66428aea7cbc Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1186367776 Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:09:34.071850 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9451395d2b9e466e82bc66428aea7cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9451395d2b9e466e82bc66428aea7cbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9451395d2b9e466e82bc66428aea7cbc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9451395d2b9e466e82bc66428aea7cbc"}]}] Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1186367776 Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9451395d2b9e466e82bc66428aea7cbc Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1186367776 Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdminNegativeTestJSON-1186367776-project Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0f8514e80d604c27ba5f05b5a4e43daa Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1186367776-project Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 911a23b3-f713-43f3-a09f-09827e960e8f could not be found. Aug 27 03:09:34.076512 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '911a23b3-f713-43f3-a09f-09827e960e8f'} Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911a23b3-f713-43f3-a09f-09827e960e8f could not be found. Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:34.078886 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911a23b3-f713-43f3-a09f-09827e960e8f could not be found. Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911a23b3-f713-43f3-a09f-09827e960e8f could not be found. Aug 27 03:09:34.081388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:34.089238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] Returning 404 to user: Instance 911a23b3-f713-43f3-a09f-09827e960e8f could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:34.095309 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f6de973-5acd-4403-a32f-bd7b9c0e1069 tempest-ServersAdminNegativeTestJSON-1186367776 tempest-ServersAdminNegativeTestJSON-1186367776-project] 10.222.0.69 "GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f" status: 404 len: 111 microversion: 2.1 time: 0.095601 Aug 27 03:09:34.102012 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 328/631] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:33 2022] GET /compute/v2.1/servers/911a23b3-f713-43f3-a09f-09827e960e8f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:34.117762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.120050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.140225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.143724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.147182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.151511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.153369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.155922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.646419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.662745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.670690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.672278 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8343474-ab77-40c2-ba25-45f082e33355 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 0.658560 Aug 27 03:09:34.673020 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 304/632] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:34.703484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-906d4a93-93e4-4123-b974-eab118beea62 req-ee2b60a7-17e6-479e-b34e-924ea7e88b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3688d85b-42f3-4f81-8b01-dd440e545c13", "tag": "07f1d243-5821-46b5-9426-75ae4b014465"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:34.720601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.742089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-906d4a93-93e4-4123-b974-eab118beea62 req-ee2b60a7-17e6-479e-b34e-924ea7e88b68 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.742089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-906d4a93-93e4-4123-b974-eab118beea62 req-ee2b60a7-17e6-479e-b34e-924ea7e88b68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.742599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f3ec0c55-096e-4f24-82c0-d1955874122f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1501 microversion: 2.1 time: 0.634998 Aug 27 03:09:34.742748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-906d4a93-93e4-4123-b974-eab118beea62 req-ee2b60a7-17e6-479e-b34e-924ea7e88b68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.747221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 329/633] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1501 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:34.752507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.753132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.769631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.773241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.774092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.775091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.775739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.777904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.778427 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-906d4a93-93e4-4123-b974-eab118beea62 req-ee2b60a7-17e6-479e-b34e-924ea7e88b68 service nova] Creating event network-changed:07f1d243-5821-46b5-9426-75ae4b014465 for instance 3688d85b-42f3-4f81-8b01-dd440e545c13 on n-h1-852086-5 Aug 27 03:09:34.787577 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-906d4a93-93e4-4123-b974-eab118beea62 req-ee2b60a7-17e6-479e-b34e-924ea7e88b68 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111407 Aug 27 03:09:34.788491 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 305/634] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:34.796828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8ae6302-582e-4246-b70d-31cc52a81c9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] Calling method '.version_select at 0x7fe45c79e700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.969200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.983387 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b708f117-56d2-43b2-8c6c-b8aa7ef1b826 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1221 microversion: 2.1 time: 0.234622 Aug 27 03:09:34.996361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 330/635] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1221 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:35.008709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:35.009700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:35.033438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.033979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.035535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.036625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.037106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.037540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.233807 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8ae6302-582e-4246-b70d-31cc52a81c9e tempest-QuotasAdminTestV257-1405609489 tempest-QuotasAdminTestV257-1405609489-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8?user_id=847d9568e0254f4797afc76fb92b27f6" status: 200 len: 190 microversion: 2.57 time: 0.443347 Aug 27 03:09:35.235931 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 306/636] 10.222.0.69 () {60 vars in 1364 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/os-quota-sets/ff7c3f9eae2047f79c5f89b743623ea8?user_id=847d9568e0254f4797afc76fb92b27f6 => generated 190 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:35.241961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:35.243098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:35.253753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.254309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.254759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.255508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.256275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.256953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.369680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:35.383092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-93731e4f-8886-4a25-ab2c-c560fe8269db tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1319 microversion: 2.1 time: 0.381223 Aug 27 03:09:35.406348 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 331/637] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:35.706714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:35.707688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:35.732386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.735514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.736218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.739599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.743773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.749226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.892425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:35.907270 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e400dc2e-744d-488f-8178-0e5f6f506cc0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.669887 Aug 27 03:09:35.909370 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 307/638] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:35.941248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:35.941877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:35.957496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.958000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.958469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.959198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.959660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.960088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.011226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:36.607932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.622067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a6c8420-ae48-4fe4-93eb-b07f9c661b93 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1501 microversion: 2.1 time: 0.710439 Aug 27 03:09:36.639452 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 308/639] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1501 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:36.646541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:36.647978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:36.679918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.683447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.684668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.685708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.686327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.687065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.798644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.817996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.820298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.822450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3c2a9d7-cb0c-400f-bdbb-ad9c224c0f79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 1.123049 Aug 27 03:09:36.824034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 332/640] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:09:36.833589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:36.834975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:36.860381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.867429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.869248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.870526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.872638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.874408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.874933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.880579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe558167-7f4d-4612-9ff3-a39ce782e0e2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1275 microversion: 2.1 time: 0.239245 Aug 27 03:09:36.882761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 309/641] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:36 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:36.901078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4909c69b-9dd3-4f53-b22b-c1f55f222c4a req-14522620-751c-4e43-b54b-586a34e75a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b27cbd-aa6c-43c5-9260-0a77d1b83677", "name": "network-vif-unplugged", "status": "completed", "tag": "fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:36.928081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4909c69b-9dd3-4f53-b22b-c1f55f222c4a req-14522620-751c-4e43-b54b-586a34e75a21 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.928695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4909c69b-9dd3-4f53-b22b-c1f55f222c4a req-14522620-751c-4e43-b54b-586a34e75a21 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.929401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4909c69b-9dd3-4f53-b22b-c1f55f222c4a req-14522620-751c-4e43-b54b-586a34e75a21 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.955031 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4909c69b-9dd3-4f53-b22b-c1f55f222c4a req-14522620-751c-4e43-b54b-586a34e75a21 service nova] Creating event network-vif-unplugged:fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed for instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 on n-h2-852086-5 Aug 27 03:09:36.960736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4909c69b-9dd3-4f53-b22b-c1f55f222c4a req-14522620-751c-4e43-b54b-586a34e75a21 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076399 Aug 27 03:09:36.961570 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 310/642] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:36.968359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:36.969769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:36.988860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.989820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.990676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.991835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.992639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.993289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.472191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:37.491184 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2459672d-bd43-48a5-830b-9cc3c927d5fd tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.526541 Aug 27 03:09:37.508449 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 311/643] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:36 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:37.650551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:37.660818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:37.664143 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee9c91ca-9c5a-43e7-bde4-0cb0b81b7ae1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1319 microversion: 2.1 time: 0.837501 Aug 27 03:09:37.665134 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 333/644] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:36 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1319 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:37.666796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:37.714579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.717120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.720354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.723019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.726000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.728364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.741458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-116a7343-7495-4eea-a660-10c57f3b11a4 req-fa9b7e83-e8b6-4b1e-89d1-bdf764003add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f651cdea-2174-4ec4-8e1e-e357a81d3b08", "tag": "03fb416f-f10e-4fc5-bb78-7b7f20b5d114"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:37.766113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-116a7343-7495-4eea-a660-10c57f3b11a4 req-fa9b7e83-e8b6-4b1e-89d1-bdf764003add service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.766986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-116a7343-7495-4eea-a660-10c57f3b11a4 req-fa9b7e83-e8b6-4b1e-89d1-bdf764003add service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.771456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-116a7343-7495-4eea-a660-10c57f3b11a4 req-fa9b7e83-e8b6-4b1e-89d1-bdf764003add service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.797008 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-116a7343-7495-4eea-a660-10c57f3b11a4 req-fa9b7e83-e8b6-4b1e-89d1-bdf764003add service nova] Creating event network-changed:03fb416f-f10e-4fc5-bb78-7b7f20b5d114 for instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 on n-h1-852086-5 Aug 27 03:09:37.803253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-116a7343-7495-4eea-a660-10c57f3b11a4 req-fa9b7e83-e8b6-4b1e-89d1-bdf764003add service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073989 Aug 27 03:09:37.804979 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 334/645] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:37.859989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:37.862054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:37.878368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.879429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.882037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.886887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.887705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.889425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.157272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.174651 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd386aab-2d82-42f1-a674-aa30ad7c43dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1501 microversion: 2.1 time: 0.525072 Aug 27 03:09:38.178406 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 312/646] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:37 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1501 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:38.184326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:38.185038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:38.208953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.211367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.212194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.213126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.213842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.217126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.400746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.418530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.422361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.424422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d79116f3-6819-4176-81bc-1a6291eea903 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 0.570203 Aug 27 03:09:38.425979 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 335/647] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:37 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:09:38.472873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.500032 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6211996-29fc-4bef-b1e5-f4e1b491c013 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1275 microversion: 2.1 time: 0.319443 Aug 27 03:09:38.502243 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 313/648] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:38 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1275 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:38.520909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:38.521988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:38.533833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.535084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.535848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.537669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.538674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.539498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.698378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:38.699638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:38.711840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.712712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.713651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.715742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.716880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.718086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.999207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:39.010299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:39.024287 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6203b70b-58df-40bd-b751-17574f4f0a13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.509557 Aug 27 03:09:39.025878 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39622eb8-d217-4700-9637-c46499853770 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1319 microversion: 2.1 time: 0.333443 Aug 27 03:09:39.043882 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 336/649] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:38 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:39.043882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e221d7e3-25a5-4954-a524-9b6cf4d122da req-08b10e1c-e027-4010-9277-4a81d938bb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b27cbd-aa6c-43c5-9260-0a77d1b83677", "tag": "fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:39.049344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e221d7e3-25a5-4954-a524-9b6cf4d122da req-08b10e1c-e027-4010-9277-4a81d938bb56 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.049843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e221d7e3-25a5-4954-a524-9b6cf4d122da req-08b10e1c-e027-4010-9277-4a81d938bb56 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.050303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e221d7e3-25a5-4954-a524-9b6cf4d122da req-08b10e1c-e027-4010-9277-4a81d938bb56 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.054456 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 314/650] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:38 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:39.064259 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e221d7e3-25a5-4954-a524-9b6cf4d122da req-08b10e1c-e027-4010-9277-4a81d938bb56 service nova] Creating event network-changed:fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed for instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 on n-h2-852086-5 Aug 27 03:09:39.069760 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e221d7e3-25a5-4954-a524-9b6cf4d122da req-08b10e1c-e027-4010-9277-4a81d938bb56 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041688 Aug 27 03:09:39.070476 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 337/651] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:39.208857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:39.210469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:39.222530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.224204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.225197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.227633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.228713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.229810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.530881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa81fa85-ddf3-464e-99c6-cc723963dd55 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Calling method '.version_select at 0x7fe45c58edc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:39.582301 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-aa81fa85-ddf3-464e-99c6-cc723963dd55 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] HTTP exception thrown: Image not found. Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa81fa85-ddf3-464e-99c6-cc723963dd55 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Request method failure captured: Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/dc10d378-1024-4210-b143-e8d9b733941a/metadata/os_distro HTTP/1.1 Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYry7bN3dMqPHpG0jg1_Sga0YGJ1VqkPreXqHUYX_Tn_x4lxGqdXKkdUDRT_iQykETmE4NLf_eg5QY8WWirUyN8d3q_mXz0cRYYvpuzhqt61bXaDs7HSDDCukHLx5dPjenHoYJvNusk-hB3P3Djo3UGqXmHUZOxmwqb6t0ADBS5cNX8 Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:39.612129 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b047e44c1a3447c09c52c679e4a2d64a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}] Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 141035356beb49e6ad9ec4326bd1506e Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'image_id': 'dc10d378-1024-4210-b143-e8d9b733941a', 'id': 'os_distro'} Aug 27 03:09:39.614235 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:39.615343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dc10d378-1024-4210-b143-e8d9b733941a Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:39.616402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc10d378-1024-4210-b143-e8d9b733941a could not be found. Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:09:39.617531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:39.620175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa81fa85-ddf3-464e-99c6-cc723963dd55 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:39.623142 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa81fa85-ddf3-464e-99c6-cc723963dd55 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] 10.222.0.69 "DELETE /compute/v2.1/images/dc10d378-1024-4210-b143-e8d9b733941a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.508173 Aug 27 03:09:39.623142 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 315/652] 10.222.0.69 () {58 vars in 1293 bytes} [Sat Aug 27 03:09:39 2022] DELETE /compute/v2.1/images/dc10d378-1024-4210-b143-e8d9b733941a/metadata/os_distro => generated 62 bytes in 510 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:39.629120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:39.631466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:39.656085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.656931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.657453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.659039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.659787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.662074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.019137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:40.033211 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-607211ca-562b-4a1f-9a3e-5ecd27da548c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1501 microversion: 2.1 time: 0.831818 Aug 27 03:09:40.034672 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 338/653] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:39 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1501 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:40.062750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:40.063793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:40.070518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.071184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.071689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.072636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.073169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.073666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.349908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:40.380604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:40.390424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:40.402744 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bf09e5a-d92e-4385-8ee6-b5967f4eed2d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 0.773357 Aug 27 03:09:40.419134 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 316/654] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:39 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:40.431003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8dac9d1-cbeb-4242-95a9-7c2e3a390ff1 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Calling method '.version_select at 0x7fe45c59a550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:40.521498 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f8dac9d1-cbeb-4242-95a9-7c2e3a390ff1 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] HTTP exception thrown: Image not found. Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8dac9d1-cbeb-4242-95a9-7c2e3a390ff1 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Request method failure captured: Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/images/ef1e4bfe-cbbd-413c-b926-d6e1da24039f/metadata/os_version HTTP/1.1 Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYry7bN3dMqPHpG0jg1_Sga0YGJ1VqkPreXqHUYX_Tn_x4lxGqdXKkdUDRT_iQykETmE4NLf_eg5QY8WWirUyN8d3q_mXz0cRYYvpuzhqt61bXaDs7HSDDCukHLx5dPjenHoYJvNusk-hB3P3Djo3UGqXmHUZOxmwqb6t0ADBS5cNX8 Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:40.532006 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b047e44c1a3447c09c52c679e4a2d64a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}] Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 141035356beb49e6ad9ec4326bd1506e Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'image_id': 'ef1e4bfe-cbbd-413c-b926-d6e1da24039f', 'id': 'os_version'} Aug 27 03:09:40.534780 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:40.536228 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ef1e4bfe-cbbd-413c-b926-d6e1da24039f Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:40.538148 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef1e4bfe-cbbd-413c-b926-d6e1da24039f could not be found. Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:09:40.540240 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:09:40.541828 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:40.547096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8dac9d1-cbeb-4242-95a9-7c2e3a390ff1 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:40.547096 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8dac9d1-cbeb-4242-95a9-7c2e3a390ff1 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] 10.222.0.69 "GET /compute/v2.1/images/ef1e4bfe-cbbd-413c-b926-d6e1da24039f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.124766 Aug 27 03:09:40.547096 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 317/655] 10.222.0.69 () {58 vars in 1293 bytes} [Sat Aug 27 03:09:40 2022] GET /compute/v2.1/images/ef1e4bfe-cbbd-413c-b926-d6e1da24039f/metadata/os_version => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:40.577036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:40.584778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:40.589537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:40.612821 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6a09ecda-5d64-474c-a6d3-3f51049dff4c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 0.575775 Aug 27 03:09:40.615318 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 339/656] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:40 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:40.615846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.616570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.619501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.620339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.621210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.621659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.628689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:40.629644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:40.640211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.641083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.641805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.643300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.643999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.644599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.111329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:41.122208 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-358c485a-8a97-4013-b745-0da2218109ad tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.561012 Aug 27 03:09:41.123882 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 318/657] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:40 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:41.129643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73eb36d1-b268-4ad9-912f-1da3a0e945a9 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Calling method '.version_select at 0x7fe45c59a9d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:41.153456 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-73eb36d1-b268-4ad9-912f-1da3a0e945a9 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] HTTP exception thrown: Image not found. Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73eb36d1-b268-4ad9-912f-1da3a0e945a9 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Request method failure captured: Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/images/0a3c1cc3-9a12-45b6-a233-beba3c1306e5/metadata HTTP/1.1 Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYry7bN3dMqPHpG0jg1_Sga0YGJ1VqkPreXqHUYX_Tn_x4lxGqdXKkdUDRT_iQykETmE4NLf_eg5QY8WWirUyN8d3q_mXz0cRYYvpuzhqt61bXaDs7HSDDCukHLx5dPjenHoYJvNusk-hB3P3Djo3UGqXmHUZOxmwqb6t0ADBS5cNX8 Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:41.157398 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b047e44c1a3447c09c52c679e4a2d64a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}] Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 141035356beb49e6ad9ec4326bd1506e Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'image_id': '0a3c1cc3-9a12-45b6-a233-beba3c1306e5'} Aug 27 03:09:41.160031 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.161238 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0a3c1cc3-9a12-45b6-a233-beba3c1306e5 Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.163212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a3c1cc3-9a12-45b6-a233-beba3c1306e5 could not be found. Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:09:41.164554 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.165822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73eb36d1-b268-4ad9-912f-1da3a0e945a9 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:41.171826 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73eb36d1-b268-4ad9-912f-1da3a0e945a9 tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] 10.222.0.69 "GET /compute/v2.1/images/0a3c1cc3-9a12-45b6-a233-beba3c1306e5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033998 Aug 27 03:09:41.171826 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 319/658] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:09:41 2022] GET /compute/v2.1/images/0a3c1cc3-9a12-45b6-a233-beba3c1306e5/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:41.171826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:41.171826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:41.195247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.195981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.196674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.196959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.197687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.198254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.264116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:41.282336 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8ac3e093-2234-4db8-911c-04ba96f55d0c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1319 microversion: 2.1 time: 0.662465 Aug 27 03:09:41.283670 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 340/659] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:40 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1319 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:41.295365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0537ae1-633c-40fd-a434-415d7566472c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Action: 'update_all', calling method: .version_select at 0x7fe45c40f430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:41.350919 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f0537ae1-633c-40fd-a434-415d7566472c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] HTTP exception thrown: Image not found. Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0537ae1-633c-40fd-a434-415d7566472c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Request method failure captured: Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/images/8897f245-b291-42ac-b225-84d92ad95068/metadata HTTP/1.1 Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 57 Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYry7bN3dMqPHpG0jg1_Sga0YGJ1VqkPreXqHUYX_Tn_x4lxGqdXKkdUDRT_iQykETmE4NLf_eg5QY8WWirUyN8d3q_mXz0cRYYvpuzhqt61bXaDs7HSDDCukHLx5dPjenHoYJvNusk-hB3P3Djo3UGqXmHUZOxmwqb6t0ADBS5cNX8 Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:09:41.362692 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b047e44c1a3447c09c52c679e4a2d64a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}] Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 141035356beb49e6ad9ec4326bd1506e Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:09:41.364053 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'image_id': '8897f245-b291-42ac-b225-84d92ad95068', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.364871 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8897f245-b291-42ac-b225-84d92ad95068 Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.365902 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8897f245-b291-42ac-b225-84d92ad95068 could not be found. Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:41.367029 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:09:41.368086 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.369261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0537ae1-633c-40fd-a434-415d7566472c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:41.369261 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0537ae1-633c-40fd-a434-415d7566472c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] 10.222.0.69 "PUT /compute/v2.1/images/8897f245-b291-42ac-b225-84d92ad95068/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080542 Aug 27 03:09:41.369261 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 341/660] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:09:41 2022] PUT /compute/v2.1/images/8897f245-b291-42ac-b225-84d92ad95068/metadata => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:41.396822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0fc0fd2-c891-43d2-864e-1f16e8247b2c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Action: 'update', calling method: .version_select at 0x7fe45c4160d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:41.501961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f0fc0fd2-c891-43d2-864e-1f16e8247b2c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] HTTP exception thrown: Image not found. Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0fc0fd2-c891-43d2-864e-1f16e8247b2c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Request method failure captured: Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/images/9d3ac943-ade6-4be2-a6db-19152b7a8025/metadata/os_distro HTTP/1.1 Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 30 Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYry7bN3dMqPHpG0jg1_Sga0YGJ1VqkPreXqHUYX_Tn_x4lxGqdXKkdUDRT_iQykETmE4NLf_eg5QY8WWirUyN8d3q_mXz0cRYYvpuzhqt61bXaDs7HSDDCukHLx5dPjenHoYJvNusk-hB3P3Djo3UGqXmHUZOxmwqb6t0ADBS5cNX8 Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:09:41.504777 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b047e44c1a3447c09c52c679e4a2d64a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}] Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 141035356beb49e6ad9ec4326bd1506e Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: {"meta": {"os_distro": "alt"}} Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:09:41.506475 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'image_id': '9d3ac943-ade6-4be2-a6db-19152b7a8025', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.507299 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9d3ac943-ade6-4be2-a6db-19152b7a8025 Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.508495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d3ac943-ade6-4be2-a6db-19152b7a8025 could not be found. Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:41.510089 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:09:41.512107 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.515882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0fc0fd2-c891-43d2-864e-1f16e8247b2c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:41.516825 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0fc0fd2-c891-43d2-864e-1f16e8247b2c tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] 10.222.0.69 "PUT /compute/v2.1/images/9d3ac943-ade6-4be2-a6db-19152b7a8025/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.141656 Aug 27 03:09:41.517410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 342/661] 10.222.0.69 () {60 vars in 1310 bytes} [Sat Aug 27 03:09:41 2022] PUT /compute/v2.1/images/9d3ac943-ade6-4be2-a6db-19152b7a8025/metadata/os_distro => generated 62 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:41.526286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:41.527172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:41.535813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.536585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.537184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.538068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.538708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.539314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.573675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:41.673644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:41.687736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13237254-6a9c-444e-b1fc-796cdc935382 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1501 microversion: 2.1 time: 0.525922 Aug 27 03:09:41.693230 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 320/662] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:41 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1501 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:41.710498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-174e998a-d9b2-451f-8a3e-9c7b8f55d8ae tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Action: 'create', calling method: .version_select at 0x7fe45c4fe9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:41.748327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-174e998a-d9b2-451f-8a3e-9c7b8f55d8ae tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] HTTP exception thrown: Image not found. Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-174e998a-d9b2-451f-8a3e-9c7b8f55d8ae tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Request method failure captured: Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/images/96000657-b42f-47ba-9fbf-96e4f72ac3f5/metadata HTTP/1.1 Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 57 Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYry7bN3dMqPHpG0jg1_Sga0YGJ1VqkPreXqHUYX_Tn_x4lxGqdXKkdUDRT_iQykETmE4NLf_eg5QY8WWirUyN8d3q_mXz0cRYYvpuzhqt61bXaDs7HSDDCukHLx5dPjenHoYJvNusk-hB3P3Djo3UGqXmHUZOxmwqb6t0ADBS5cNX8 Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:09:41.761039 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b047e44c1a3447c09c52c679e4a2d64a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b047e44c1a3447c09c52c679e4a2d64a"}]}] Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b047e44c1a3447c09c52c679e4a2d64a Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-543214887 Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 141035356beb49e6ad9ec4326bd1506e Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-543214887-project Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:09:41.768788 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'image_id': '96000657-b42f-47ba-9fbf-96e4f72ac3f5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.773867 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 96000657-b42f-47ba-9fbf-96e4f72ac3f5 Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:09:41.778386 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96000657-b42f-47ba-9fbf-96e4f72ac3f5 could not be found. Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:41.782658 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:09:41.785862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.790311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-174e998a-d9b2-451f-8a3e-9c7b8f55d8ae tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:41.790311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-174e998a-d9b2-451f-8a3e-9c7b8f55d8ae tempest-ImagesMetadataNegativeTestJSON-543214887 tempest-ImagesMetadataNegativeTestJSON-543214887-project] 10.222.0.69 "POST /compute/v2.1/images/96000657-b42f-47ba-9fbf-96e4f72ac3f5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068225 Aug 27 03:09:41.790311 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 321/663] 10.222.0.69 () {60 vars in 1281 bytes} [Sat Aug 27 03:09:41 2022] POST /compute/v2.1/images/96000657-b42f-47ba-9fbf-96e4f72ac3f5/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:41.790311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:41.790311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:41.791186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.791780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.792613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.793882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.798187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.798187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.004145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:42.018850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:42.020539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:42.021977 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f7c6855-b57f-4bde-af39-91397d9f4b73 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1568 microversion: 2.25 time: 0.503255 Aug 27 03:09:42.022723 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 343/664] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:41 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1568 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:42.086857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:42.141070 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be54a510-722c-49e7-8948-e50104488712 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 0.371311 Aug 27 03:09:42.141806 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 322/665] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:41 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:42.147063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:42.148037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:42.174605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.176497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.180160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.181748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.189849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.191108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.312635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:42.315614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:42.339652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.340499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.340972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.342146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.342657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.343334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.612936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:42.622777 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d637b68-0ea3-495d-b0b8-8fce82180e49 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.481367 Aug 27 03:09:42.628292 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 344/666] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:42 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:42.714522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2c978ab3-3eeb-4f38-a61d-287322190220 req-af4cc83b-6a57-4385-850a-b5ce18a26e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9", "tag": "0eecd510-c530-4560-b0bd-4b7338ca22be"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:42.745729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2c978ab3-3eeb-4f38-a61d-287322190220 req-af4cc83b-6a57-4385-850a-b5ce18a26e1f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.747096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2c978ab3-3eeb-4f38-a61d-287322190220 req-af4cc83b-6a57-4385-850a-b5ce18a26e1f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.748524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2c978ab3-3eeb-4f38-a61d-287322190220 req-af4cc83b-6a57-4385-850a-b5ce18a26e1f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.779320 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-2c978ab3-3eeb-4f38-a61d-287322190220 req-af4cc83b-6a57-4385-850a-b5ce18a26e1f service nova] Creating event network-changed:0eecd510-c530-4560-b0bd-4b7338ca22be for instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 on n-h2-852086-5 Aug 27 03:09:42.791708 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2c978ab3-3eeb-4f38-a61d-287322190220 req-af4cc83b-6a57-4385-850a-b5ce18a26e1f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083181 Aug 27 03:09:42.806465 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 345/667] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:09:42.831935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:42.841962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:42.850362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:42.862847 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4df2cf8b-d126-4219-a15e-e295b697263c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1319 microversion: 2.1 time: 0.556063 Aug 27 03:09:42.865196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.866107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.866645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.867452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.868399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.868902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.881058 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 323/668] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:42 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:43.052409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:43.054278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:43.086919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:43.095407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.096206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.097210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.099830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.100712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.102623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.324627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=22 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:43.348249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.357908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.359859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.362537 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a93ace12-a426-4a40-bfb0-4da64ef6f443 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1558 microversion: 2.25 time: 0.320477 Aug 27 03:09:43.374754 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 324/669] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:43 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1558 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:09:43.400567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:43.404465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:43.415038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.415543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.415989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.416773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.417236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.417665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.577441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.585788 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45b9c857-db84-42db-b77d-4a438b095042 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1501 microversion: 2.1 time: 0.778189 Aug 27 03:09:43.586440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 346/670] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:42 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1501 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:43.593042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-28886195-fd78-4a93-a867-fc4b8d04a612 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '.version_select at 0x7fe45c3e3c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:43.596813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28886195-fd78-4a93-a867-fc4b8d04a612 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.597512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28886195-fd78-4a93-a867-fc4b8d04a612 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.598099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28886195-fd78-4a93-a867-fc4b8d04a612 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.622903 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-28886195-fd78-4a93-a867-fc4b8d04a612 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 2609 microversion: 2.25 time: 0.035191 Aug 27 03:09:43.624350 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 347/671] 10.222.0.69 () {60 vars in 1184 bytes} [Sat Aug 27 03:09:43 2022] GET /compute/v2.1/os-migrations => generated 2609 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:43.641125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:43.641977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:43.650365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.651231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.651865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.653204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.653950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.654721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.700748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.710937 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df6146c9-535d-45da-8b76-9175d43153ca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 0.334405 Aug 27 03:09:43.712303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=21 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:43.722237 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 325/672] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:43 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:43.744083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:43.745235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:43.756261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.757265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.758406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.759176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.759889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.760262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.780455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=67 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:43.961758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.972340 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2b3f48e-40f7-480a-951d-9170dbe1a2a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.236769 Aug 27 03:09:43.978831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 326/673] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:43 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:43.987794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:43.988824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:43.996227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.997263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.997923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.998883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.999524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.000425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.080268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 3688d85b-42f3-4f81-8b01-dd440e545c13 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:44.097516 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-43f89c66-f2a4-42db-9509-62af9a54173f tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 2050 microversion: 2.25 time: 0.460843 Aug 27 03:09:44.144518 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 348/674] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:43 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 2050 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:44.224187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:44.233273 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5f16dd3-5117-46f1-b1e9-69975fbb88d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1319 microversion: 2.1 time: 0.252487 Aug 27 03:09:44.233861 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 327/675] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:43 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:44.519804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2137030830", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "34528e57-9495-4744-8566-85d04ab8d770"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:44.541419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f412f2ba-ab0e-4b51-9351-01552105b72c req-7f25226e-ec23-41c1-ae4d-546e221848a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f651cdea-2174-4ec4-8e1e-e357a81d3b08", "name": "network-vif-plugged", "status": "completed", "tag": "03fb416f-f10e-4fc5-bb78-7b7f20b5d114"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:44.557456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f412f2ba-ab0e-4b51-9351-01552105b72c req-7f25226e-ec23-41c1-ae4d-546e221848a2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.560337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f412f2ba-ab0e-4b51-9351-01552105b72c req-7f25226e-ec23-41c1-ae4d-546e221848a2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.561921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f412f2ba-ab0e-4b51-9351-01552105b72c req-7f25226e-ec23-41c1-ae4d-546e221848a2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.589683 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f412f2ba-ab0e-4b51-9351-01552105b72c req-7f25226e-ec23-41c1-ae4d-546e221848a2 service nova] Creating event network-vif-plugged:03fb416f-f10e-4fc5-bb78-7b7f20b5d114 for instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 on n-h1-852086-5 Aug 27 03:09:44.604344 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f412f2ba-ab0e-4b51-9351-01552105b72c req-7f25226e-ec23-41c1-ae4d-546e221848a2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065156 Aug 27 03:09:44.605698 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 328/676] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:44.621754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:44.624381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:44.636117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.642100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.643013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.645335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.646382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.647028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.676459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] validate_networks() for [('34528e57-9495-4744-8566-85d04ab8d770', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:44.971907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:44.980113 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b76b871a-5aa2-49f4-9ad6-8019667802cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1501 microversion: 2.1 time: 0.368883 Aug 27 03:09:44.989676 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 329/677] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:44 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1501 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:44.997544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:44.998304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:45.006513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.007012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.007685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.008411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.008878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.009310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.047198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:45.221988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:45.225367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=57 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:45.235888 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-142197e8-2e21-4386-8e42-79b5ad149eaf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 0.244291 Aug 27 03:09:45.236927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 330/678] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:44 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:45.478765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:45.481943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:45.482806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:45.484362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:45.485012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:45.494708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.495194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.495649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.496789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.497347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.497767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.515904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:45.525135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for user 21a64079d45547ba80c22c309d216438 and project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:45.538063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:45.540928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:45.583737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2005885425", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:45.598828 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4999b834-f996-4a10-bccf-3681ea943d6d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.085238 Aug 27 03:09:45.602327 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 349/679] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:09:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:09:45.610320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:45.611514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:45.618064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.618587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.619021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.619727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.620178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.620786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.673245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:45.867618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:45.879307 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f662ea9c-0d16-45a3-9d9f-781916f0ba83 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.274925 Aug 27 03:09:45.896671 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 350/680] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:45 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:45.910505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:45.911320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:45.919953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.930091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.930832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.931798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:45.932432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:45.932432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.995024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:45.995692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:45.997723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:45.998849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:45.999579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:46.023010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.024301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.039388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.041118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.046392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.047304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.084554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Getting quotas for project 82ec502ce3cc43bb969abf2fa3637591. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:46.104548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Getting quotas for user 1150c8244e514ef098f87f12f04f964b and project 82ec502ce3cc43bb969abf2fa3637591. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:46.126854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:46.129899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:46.189097 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-537ed741-30b3-4da2-840e-5d5bd6737adc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950385 Aug 27 03:09:46.212022 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 331/681] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:46.296432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Calling method '.version_select at 0x7fe45c5e9d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:46.309601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.310248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.311045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.311995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.312660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.313416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.337784 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c354a980-e719-4305-b54a-66f4c7136868 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] 10.222.0.69 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.124262 Aug 27 03:09:46.338815 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 332/682] 10.222.0.69 () {58 vars in 1122 bytes} [Sat Aug 27 03:09:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:46.344906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:46.345878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:46.352413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.353122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.353753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.354894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.356155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.356999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.417393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.435416 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9f431d2e-7c43-4eda-b094-0a7e88c5c867 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1319 microversion: 2.1 time: 0.537314 Aug 27 03:09:46.436252 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 351/683] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:45 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:46.441359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:46.442184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:46.456663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.458598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.459434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.462721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.463327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.463922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.506405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.518456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.520335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.521737 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a7c4579e-8c39-4fdd-88e6-fe14419508da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1266 microversion: 2.25 time: 0.181940 Aug 27 03:09:46.522875 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 333/684] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:46 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:46.532932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:46.533862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:46.551648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.552278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.552818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.561593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.561593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.561593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.770027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.790139 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-602937ad-1bff-43a4-938c-242fdaa959ab tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 0.265352 Aug 27 03:09:46.802325 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 334/685] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:46 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:46.822002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1759196765", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:46.912795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:46.960058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.971296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-165593a9-8ddb-4cef-802c-5242b8dcc006 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1476 microversion: 2.1 time: 0.533371 Aug 27 03:09:46.972303 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 352/686] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:46 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1476 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:46.990473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-150613789", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:47.100202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:47.232243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:47.233029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:47.233977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:47.234840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:47.235672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:47.255655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.256565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.257685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.259120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.259883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.260832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.286183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Getting quotas for project 82ec502ce3cc43bb969abf2fa3637591. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:47.292522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Getting quotas for user 1150c8244e514ef098f87f12f04f964b and project 82ec502ce3cc43bb969abf2fa3637591. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:47.310427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:47.316404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:47.406350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Getting quotas for project 51f8861d82c84bac998c95cbcaea1474. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:47.410792 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14866b28-5edf-4273-9377-b0eec2c7a698 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616831 Aug 27 03:09:47.412041 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 335/687] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:47.420156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Getting quotas for user 98348ccc497a4454a2be0dbd247e5a1c and project 51f8861d82c84bac998c95cbcaea1474. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:47.424931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.435166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:47.437303 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Request method failure captured: Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 1751 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYr5n01iOIkhxzev6whM7epv4guNFxAVgdBxjbsPf6_pSgeaX3xLBcoKxozKXGwdE2Xa4rSKdeTdnF1lW3ZNuF5sZdSrYPWAzs5_UPEyJwZPqZEiQHolxFn0jkvB3K6eaVHsKpqU8nagroVfGWpYr2OP9K2I-eumaDO2zqnIpzkHfgQ Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 51f8861d82c84bac998c95cbcaea1474 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2064177810 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/51f8861d82c84bac998c95cbcaea1474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/51f8861d82c84bac998c95cbcaea1474"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_51f8861d82c84bac998c95cbcaea1474", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/51f8861d82c84bac998c95cbcaea1474"}]}] Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2064177810 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 51f8861d82c84bac998c95cbcaea1474 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2064177810 Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 98348ccc497a4454a2be0dbd247e5a1c Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-150613789", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:09:47.442430 n-d-852086-5 devstack@n-api.service[122407]: exception: Maximum number of metadata items exceeds 128 Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-150613789', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:47.444724 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:09:47.450257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:47.453172 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30e0eaa1-84bc-4b93-bfc5-70ab9dc44433 tempest-AbsoluteLimitsNegativeTestJSON-2064177810 tempest-AbsoluteLimitsNegativeTestJSON-2064177810-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.465324 Aug 27 03:09:47.453172 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 353/688] 10.222.0.69 () {60 vars in 1148 bytes} [Sat Aug 27 03:09:46 2022] POST /compute/v2.1/servers => generated 87 bytes in 480 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:09:47.453471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.454810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.455982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.457795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.458584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.471583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5fe247a0-cf1f-4004-83b8-9187f36b3347 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '.version_select at 0x7fe45c40faf0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.478536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.502769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fe247a0-cf1f-4004-83b8-9187f36b3347 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.505822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fe247a0-cf1f-4004-83b8-9187f36b3347 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.507036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fe247a0-cf1f-4004-83b8-9187f36b3347 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.535906 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5fe247a0-cf1f-4004-83b8-9187f36b3347 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.081542 Aug 27 03:09:47.547383 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 354/689] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:47.560429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d65253c8-07ac-4b76-a91c-7b3823e036db tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.562935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d65253c8-07ac-4b76-a91c-7b3823e036db tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:47.702699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d65253c8-07ac-4b76-a91c-7b3823e036db tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:47.710138 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d65253c8-07ac-4b76-a91c-7b3823e036db tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1214 microversion: 2.1 time: 0.161388 Aug 27 03:09:47.713677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 355/690] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:47.733462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.734363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:47.736838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:47.745660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.746869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.747628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.748837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.749771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.750438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.898614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:47.926520 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6c0f5dc-a7f2-4614-b4cd-bd22b8f3a2c3 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.505637 Aug 27 03:09:47.928295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 336/691] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:47.951418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.952379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:47.959808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.960511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.970494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.971644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.972339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.972924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:48.155356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.192781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.194255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.204424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.208952 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-61f3a4b8-5706-43a4-963c-d48d1eceb4e6 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1469 microversion: 2.1 time: 0.480127 Aug 27 03:09:48.209190 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-068fed48-6bcf-4693-8688-8cc559b1b83b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1320 microversion: 2.25 time: 0.261415 Aug 27 03:09:48.212371 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 337/692] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:48.228714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:48.235735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:48.237614 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 356/693] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1469 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:48.243252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:48.244692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:48.256870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:48.257832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:48.258672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:48.259002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:48.259841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:48.260351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:48.263931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:48.264708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:48.265175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:48.266094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:48.266331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:48.267728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:48.581612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a46765b-2875-4217-9714-2509b24490b4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1627 microversion: 2.1 time: 0.364235 Aug 27 03:09:48.582245 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 338/694] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:48 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1627 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:48.683846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.697223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4d881a2-f505-4c6d-b470-827861cdd635 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 0.458039 Aug 27 03:09:48.699966 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 357/695] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:48 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:48.706609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7959321-dbbb-4557-97a2-9b7eeb76703e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Action: 'create', calling method: .version_select at 0x7fe45c2ff310>, body: {"keypair": {"name": "tempest-keypair-1060680721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO5R+p5t2sbtmyYsrV2Vk4JG2pPzanMyPD/ZbrPUAMCQR70EAEZ5fy5wOkU41BWhSdmh1LLIAFGm6qJ10QmsWuEg+Rn9zq7r13lhOvlcGYYeLcsUQ2f+/uOpBJMfcdIbA=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:48.731620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b7959321-dbbb-4557-97a2-9b7eeb76703e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:48.740537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b7959321-dbbb-4557-97a2-9b7eeb76703e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for user 38c24c41cfbb4a1caea77801a0b3432d and project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:48.805402 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7959321-dbbb-4557-97a2-9b7eeb76703e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103812 Aug 27 03:09:48.806222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 358/696] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:09:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:48.816146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:48.816989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:48.825992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:48.826649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:48.827325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:48.828622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:48.829514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:48.830071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.015079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.030473 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a9ff0c6-3bfe-494e-bc05-2b41427c6c29 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1210 microversion: 2.1 time: 0.222300 Aug 27 03:09:49.048224 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 359/697] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:48 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1210 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:49.063504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-847832872", "block_migration": true, "disk_over_commit": false}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:49.066227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.071026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:49.072758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.076264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.077051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.077837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.079111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.079821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.080953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.095354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.099703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.100407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.101580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.102336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.106742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.136450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lazy-loading 'flavor' on Instance uuid f651cdea-2174-4ec4-8e1e-e357a81d3b08 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:09:49.180142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Going to try to live migrate instance to tempest-host-847832872 {{(pid=122408) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:09:49.204074 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] HTTP exception thrown: Compute host tempest-host-847832872 could not be found. Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Request method failure captured: Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08/action HTTP/1.1 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 106 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYroWrQ-88BFXvVlV6slvcDUc8CTIbk-9LvbeaBglxaZp1I5ZG2ZhNlw66D1YxdvAHzbU1USfiR7QmUcPDpi-6UAuYwNGMs7colKbxoYRKMfEvphxANoV19NWbi692n95HKsIXmxMez4kbegf44rPpdqWAsm5pV6sVWmo9qP2ewD6ho Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4c1c54cd7c8b4ee581a9e98ba82ac362 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveMigrationNegativeTest-961179662 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4c1c54cd7c8b4ee581a9e98ba82ac362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4c1c54cd7c8b4ee581a9e98ba82ac362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4c1c54cd7c8b4ee581a9e98ba82ac362", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4c1c54cd7c8b4ee581a9e98ba82ac362"}]}] Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-LiveMigrationNegativeTest-961179662 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4c1c54cd7c8b4ee581a9e98ba82ac362 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-961179662 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-LiveMigrationNegativeTest-961179662-project-admin Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: cb63a814dd9344d793e6339aeab5c081 Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-LiveMigrationNegativeTest-961179662-project-admin Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: {"os-migrateLive": {"host": "tempest-host-847832872", "block_migration": true, "disk_over_commit": false}} Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: exception: Compute host tempest-host-847832872 could not be found. Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'f651cdea-2174-4ec4-8e1e-e357a81d3b08', 'body': {'os-migrateLive': {'host': 'tempest-host-847832872', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 27 03:09:49.232184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-847832872 could not be found. Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-847832872 could not be found. Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-847832872 could not be found. Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Returning 400 to user: Compute host tempest-host-847832872 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2aa75d42-991c-4c25-beef-3dd8a63c6a52 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08/action" status: 400 len: 99 microversion: 2.1 time: 0.651168 Aug 27 03:09:49.237372 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 339/698] 10.222.0.69 () {60 vars in 1279 bytes} [Sat Aug 27 03:09:48 2022] POST /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08/action => generated 99 bytes in 652 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:09:49.258382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:49.259087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.276938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.277837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.278565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.283084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.283796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.284926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.458105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.473588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.476912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.479196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-286a13c0-c139-439a-8265-f54e5e085086 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1320 microversion: 2.25 time: 0.234584 Aug 27 03:09:49.482361 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 340/699] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:49 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:49.491588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:49.492537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.501820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.504807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.505649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.507941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.508995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.509726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.604231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.615867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c5cbc49-2d47-43b4-9a8e-8121f7869ac6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.566119 Aug 27 03:09:49.617001 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 360/700] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:49 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:49.622694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-47bbe85c-68af-4e02-ba7e-bba2ede931b9 req-3a4cb88f-3062-4495-a0ed-ffea3b676f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9", "name": "network-vif-plugged", "status": "completed", "tag": "0eecd510-c530-4560-b0bd-4b7338ca22be"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:49.634402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47bbe85c-68af-4e02-ba7e-bba2ede931b9 req-3a4cb88f-3062-4495-a0ed-ffea3b676f6b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.634903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47bbe85c-68af-4e02-ba7e-bba2ede931b9 req-3a4cb88f-3062-4495-a0ed-ffea3b676f6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.635439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47bbe85c-68af-4e02-ba7e-bba2ede931b9 req-3a4cb88f-3062-4495-a0ed-ffea3b676f6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.654402 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-47bbe85c-68af-4e02-ba7e-bba2ede931b9 req-3a4cb88f-3062-4495-a0ed-ffea3b676f6b service nova] Creating event network-vif-plugged:0eecd510-c530-4560-b0bd-4b7338ca22be for instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 on n-h2-852086-5 Aug 27 03:09:49.661463 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-47bbe85c-68af-4e02-ba7e-bba2ede931b9 req-3a4cb88f-3062-4495-a0ed-ffea3b676f6b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043135 Aug 27 03:09:49.662577 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 361/701] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:49.724535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:49.725506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.757550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.758923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.759570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.762149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.764174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.765958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.996391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:50.007157 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8eae5b1-d4a2-425a-a3e1-db2c124272fa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1469 microversion: 2.1 time: 0.521621 Aug 27 03:09:50.010862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 341/702] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:49 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:50.061242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:50.062616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:50.071735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.079526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.085195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.089020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.090437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.090989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.258192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:50.267840 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb59e98d-b1ef-4283-940d-120b7aa0ca33 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1274 microversion: 2.1 time: 0.211326 Aug 27 03:09:50.288984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 342/703] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:50 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:50.340908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-399825927", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:50.426101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:50.801108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:50.816782 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fb61d3c0-bd30-4ed5-aafd-41e8d9b6b357 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 1.099100 Aug 27 03:09:50.834372 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 362/704] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:49 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:50.850221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:50.851696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:50.862126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.863421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.864448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.865871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.867035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.868022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.980586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:50.981165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:50.981731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:50.982461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:50.982915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:50.999160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.999783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.000394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.001565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:51.002217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.003814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.037931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Getting quotas for project fd9c7fa6872a425298d2b501e9121af3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:51.077564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Getting quotas for user b7d0abe77aa743688dbae2f2e7064f1c and project fd9c7fa6872a425298d2b501e9121af3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:51.099639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:51.101838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:51.231396 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0fcbe1d2-9c6b-42a7-9dab-3cdf4a794a9c tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896472 Aug 27 03:09:51.232694 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 343/705] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:09:51.238071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:51.239004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:51.246705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:51.247528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.248163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.249083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:51.249917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.250606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.358939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.377413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.385577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.389261 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-01af4e1b-7505-42bf-b8c9-6f11c08a9a5b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1362 microversion: 2.25 time: 0.552773 Aug 27 03:09:51.393269 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 363/706] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:50 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1362 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:51.403180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-03b328c2-9807-4498-b9fd-46e23bdac0aa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:51.405856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-03b328c2-9807-4498-b9fd-46e23bdac0aa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:51.597029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-03b328c2-9807-4498-b9fd-46e23bdac0aa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.620349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-03b328c2-9807-4498-b9fd-46e23bdac0aa tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1218 microversion: 2.1 time: 0.225027 Aug 27 03:09:51.622641 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 364/707] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:51 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1218 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:51.641767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:51.643039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:51.651818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:51.653196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.654000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.655619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:51.656337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.657406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.818912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.831968 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19a3b3ba-07ac-44c0-b5df-128bc250c369 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1272 microversion: 2.1 time: 0.207132 Aug 27 03:09:51.843308 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 365/708] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:51 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:51.854128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:51.856086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:51.875005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:51.875670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.877580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.878716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:51.880160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:51.882100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:51.971023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.993986 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a6e118c-6556-4c8d-ae7d-d83261e7f67f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.758992 Aug 27 03:09:52.015645 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 344/709] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:51 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:52.391235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:52.417093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:52.425155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:52.426679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:52.431621 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc996ec9-0501-4ab7-9ff7-05ba7e615689 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1317 microversion: 2.1 time: 0.582996 Aug 27 03:09:52.432217 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 366/710] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:51 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:52.449669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.450538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.451192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.452151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.452816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.453463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.524568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-52734ef9-0f4f-46ab-882d-43b08f387094 req-eac1cf29-21ea-42d9-bc3f-72330d3b7d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c4b4e2-b5c0-44d3-b520-c1571ceee8ef", "tag": "4485a129-6aee-4bcf-a63f-aa2d14a240e9"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:52.545234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52734ef9-0f4f-46ab-882d-43b08f387094 req-eac1cf29-21ea-42d9-bc3f-72330d3b7d6b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.545971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52734ef9-0f4f-46ab-882d-43b08f387094 req-eac1cf29-21ea-42d9-bc3f-72330d3b7d6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.548188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52734ef9-0f4f-46ab-882d-43b08f387094 req-eac1cf29-21ea-42d9-bc3f-72330d3b7d6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.580518 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-52734ef9-0f4f-46ab-882d-43b08f387094 req-eac1cf29-21ea-42d9-bc3f-72330d3b7d6b service nova] Creating event network-changed:4485a129-6aee-4bcf-a63f-aa2d14a240e9 for instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef on n-h1-852086-5 Aug 27 03:09:52.586619 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-52734ef9-0f4f-46ab-882d-43b08f387094 req-eac1cf29-21ea-42d9-bc3f-72330d3b7d6b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066712 Aug 27 03:09:52.596455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 367/711] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:09:52.653725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:52.654556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:52.673309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.674341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.675026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.676622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.678566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.680184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.870480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:52.889089 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d81d80a0-1e23-4489-ae30-61c6e3f54db1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1214 microversion: 2.1 time: 0.245469 Aug 27 03:09:52.907800 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 368/712] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:52 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:52.917090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:52.921829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:52.929506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.930335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.930988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.931713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.932173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.932608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.996014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.017563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.021681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.023012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc47fd8d-8905-4a25-84b7-6937c5d8aed1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1362 microversion: 2.25 time: 0.602642 Aug 27 03:09:53.024239 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 345/713] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:52 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:09:53.043832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:53.043998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:53.069042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.069211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.070419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.071400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.073251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.074414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.493045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.517274 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c4aa1a47-20c5-4db1-b23b-bbeb07f90453 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.606556 Aug 27 03:09:53.529851 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 369/714] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:52 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:53.560488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:53.561419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:53.570421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.571062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.571603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.572664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.573344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.576689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.719076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.729383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbe8bf11-c74a-4860-b3aa-8a139309189b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.699589 Aug 27 03:09:53.747269 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 346/715] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:53 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:53.915814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:53.915814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:53.938271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.938593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.938944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.939686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.940125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.940552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.303194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:54.329160 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a7117b4a-2cb1-4630-9414-dc629f6735d2 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1276 microversion: 2.1 time: 0.417110 Aug 27 03:09:54.331146 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 347/716] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:53 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1276 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:54.337881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:54.340719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:54.352884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.353833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.354319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.355235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.355710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.356216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.513444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:54.525990 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64b983ff-0a02-436a-87fd-eeb5a4d1a94a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1466 microversion: 2.1 time: 1.000600 Aug 27 03:09:54.543478 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 370/717] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:53 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1466 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:54.554692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2059828231", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb"}], "security_groups": [{"name": "tempest-securitygroup--344675471"}], "key_name": "tempest-keypair-1060680721", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:54.689898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:54.707600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:54.709560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:54.711195 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a47672f-4fad-475f-b14f-87febce675a2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1362 microversion: 2.25 time: 0.377751 Aug 27 03:09:54.728080 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 348/718] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:54 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:54.738102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3069bf88-72f8-4c3c-baca-802ebae5bb64 req-ee07fac4-3b76-42bf-b605-a32b55662afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd3b4a0-b115-4688-af4f-27f15a0eaea0", "tag": "a94fdd64-5583-4e14-bd48-74552e561a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:54.751998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3069bf88-72f8-4c3c-baca-802ebae5bb64 req-ee07fac4-3b76-42bf-b605-a32b55662afb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.752656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3069bf88-72f8-4c3c-baca-802ebae5bb64 req-ee07fac4-3b76-42bf-b605-a32b55662afb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.753192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3069bf88-72f8-4c3c-baca-802ebae5bb64 req-ee07fac4-3b76-42bf-b605-a32b55662afb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.766648 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3069bf88-72f8-4c3c-baca-802ebae5bb64 req-ee07fac4-3b76-42bf-b605-a32b55662afb service nova] Creating event network-changed:a94fdd64-5583-4e14-bd48-74552e561a6b for instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 on n-h1-852086-5 Aug 27 03:09:54.772870 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3069bf88-72f8-4c3c-baca-802ebae5bb64 req-ee07fac4-3b76-42bf-b605-a32b55662afb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041246 Aug 27 03:09:54.773630 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 349/719] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:54.781155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:54.782685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:54.795983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.797004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.798102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.800063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.800796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.801339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.806835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:55.021432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:55.038470 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-233fe88f-56b2-47c2-bc77-b501952f1fee tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.262846 Aug 27 03:09:55.056329 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 350/720] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:54 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:55.311726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] validate_networks() for [('1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:55.396625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:55.397963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:55.404232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:55.412520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:55.413409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:55.414178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:55.415826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:55.416674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:55.417268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:55.507189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:56.070662 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-578d295a-f1cf-4d9e-b648-3594456c2d75 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1617 microversion: 2.1 time: 1.009208 Aug 27 03:09:56.088404 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 351/721] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:55 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1617 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:56.088404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:56.088404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:56.096892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.097476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.098027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.099046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.099872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.100565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.345468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.364553 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-916bbcde-83a3-423e-b803-db2073c9efed tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.282908 Aug 27 03:09:56.367668 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 352/722] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:56 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:56.381720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:56.382331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:56.391419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.392156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.392740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.394273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.395178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.396193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.449855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:09:56.616652 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-796bde35-473f-41cf-a066-e871b552a35d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 204 len: 0 microversion: 2.1 time: 0.245962 Aug 27 03:09:56.618529 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 353/723] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:09:56 2022] DELETE /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:09:56.626792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:56.627918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:56.639045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.639688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.640205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.641075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.642072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.642613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.752582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.760989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a898e447-7257-4552-854d-ff768a8b6cc3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1276 microversion: 2.1 time: 0.140961 Aug 27 03:09:56.762422 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 354/724] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:56 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:56.771609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:56.772247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:56.783156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.783662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.784191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.785506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.785981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.786448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.982369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.994665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.996696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:56.998780 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4db9c17b-6280-4591-a688-5550562528dc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1362 microversion: 2.25 time: 0.231178 Aug 27 03:09:56.999859 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 355/725] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:56 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:57.008222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:57.008976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:57.016463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.016972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.017421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.018139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.018674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.019108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.230966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:57.242811 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f1a1174a-e981-4db7-91f6-88660e6ec6ba tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.241382 Aug 27 03:09:57.243214 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 356/726] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:56 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:57.249365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6af8cf02-8379-4acb-9ac1-dc806686f4c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: .version_select at 0x7fe45c45f8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1727603991", "policies": ["affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:57.272509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6af8cf02-8379-4acb-9ac1-dc806686f4c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:57.280217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6af8cf02-8379-4acb-9ac1-dc806686f4c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:57.349309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6af8cf02-8379-4acb-9ac1-dc806686f4c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:57.355832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6af8cf02-8379-4acb-9ac1-dc806686f4c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:57.371718 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6af8cf02-8379-4acb-9ac1-dc806686f4c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.127343 Aug 27 03:09:57.386232 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 357/727] 10.222.0.69 () {60 vars in 1174 bytes} [Sat Aug 27 03:09:57 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:57.386232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:57.386232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:57.400327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.401110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.403126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.404018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.404724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.405595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.486578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:57.487216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:57.487482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:57.487845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:57.488323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:57.509157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.512991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.513850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.514916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.516537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.518017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.573399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:57.581857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for user 38c24c41cfbb4a1caea77801a0b3432d and project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:57.597406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:57.600061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:57.618814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:57.666523 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87c5eb23-a579-4d0a-9dbb-4b5fb6613d71 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.121229 Aug 27 03:09:57.667622 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 371/728] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 3123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:57.669568 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9241dff0-fbe7-4a47-bde0-8f21fa661081 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1712 microversion: 2.1 time: 0.294839 Aug 27 03:09:57.674461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 358/729] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:57 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1712 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:57.680969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:57.684181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:57.690189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-384112325", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a44222a2-5c52-4d8c-a3fc-2cd318d4cca8"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:57.723035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.724318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.724537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.729761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.736127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.736939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.795990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:58.018431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:58.046904 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08a1840b-98fc-4d3d-9829-77f8b94baa1c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.366639 Aug 27 03:09:58.049650 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 359/730] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:57 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:58.072552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34b70e77-cfc9-490a-ad16-10854b3ecd90 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:58.076075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34b70e77-cfc9-490a-ad16-10854b3ecd90 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:58.190577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34b70e77-cfc9-490a-ad16-10854b3ecd90 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:58.209959 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34b70e77-cfc9-490a-ad16-10854b3ecd90 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1235 microversion: 2.1 time: 0.158128 Aug 27 03:09:58.210864 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 360/731] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:58 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1235 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:58.217037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-61d28581-b502-4402-a755-fa4bd77310b3 req-b7650f95-4476-4e4b-a544-51f1581e6b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b6f613-7f60-4e14-8283-4617c9b0f283", "tag": "a09097d9-1bf0-429e-ad65-3ea59a299e7e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:58.259242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61d28581-b502-4402-a755-fa4bd77310b3 req-b7650f95-4476-4e4b-a544-51f1581e6b66 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.259737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61d28581-b502-4402-a755-fa4bd77310b3 req-b7650f95-4476-4e4b-a544-51f1581e6b66 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.260182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61d28581-b502-4402-a755-fa4bd77310b3 req-b7650f95-4476-4e4b-a544-51f1581e6b66 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.298687 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-61d28581-b502-4402-a755-fa4bd77310b3 req-b7650f95-4476-4e4b-a544-51f1581e6b66 service nova] Creating event network-changed:a09097d9-1bf0-429e-ad65-3ea59a299e7e for instance 53b6f613-7f60-4e14-8283-4617c9b0f283 on n-h2-852086-5 Aug 27 03:09:58.303884 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-61d28581-b502-4402-a755-fa4bd77310b3 req-b7650f95-4476-4e4b-a544-51f1581e6b66 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091621 Aug 27 03:09:58.304936 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 361/732] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:58.320561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:58.321283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:58.335608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.336620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.337301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.338581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.339668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.347116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.700050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:58.713980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9accc001-fed9-41d8-abe8-902411dbde47 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.407635 Aug 27 03:09:58.731655 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 362/733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:58 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:58.737030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:58.743517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:58.758324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.762803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.763221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.764203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.764881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.765860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.100809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:59.112554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:59.114870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:59.116211 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d61180a-871d-4f6d-8c69-70ae63016a13 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1362 microversion: 2.25 time: 0.383241 Aug 27 03:09:59.117115 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 363/734] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:09:58 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:09:59.157099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:59.158930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:59.174532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.175325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.177060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.177961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.178861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.179486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.598971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:59.599500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:59.599950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:59.600660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:59.601200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:59.622458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:59.633376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ebfc1af-1a14-4e7c-9b4e-23fc54b14a43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.493813 Aug 27 03:09:59.634473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 364/735] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:59 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:59.637260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.637969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.638615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.639522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.640426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.640605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:59.641178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.641300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:59.648379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.649281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.649799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.651321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.651909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.652741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.666205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:59.675525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:59.694756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Going to run 2 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:59.697528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:59.767824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:59.782630 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bfbf0613-149b-4dcc-8cbe-939469dfb21d tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1645 microversion: 2.1 time: 0.146753 Aug 27 03:09:59.783599 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 365/736] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:59 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1645 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:59.789003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:59.789216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:59.791698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122407) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 03:09:59.797565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.797972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.798446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.799223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.799629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.802056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.862566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:59.891714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:59.998809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:00.010072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:00.023604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:00.055262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=65bc4962-c5bb-4892-9540-3e657d0b2a54,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:00.176204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:00.186767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:00.256868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:00.266949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:00.326465 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-67987082-b55b-4c64-8d79-adfa6c27ebff tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.639847 Aug 27 03:10:00.327927 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 372/737] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 2642 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 03:10:00.339747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:00.341252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:00.361806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.364068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.365184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.370673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.373441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.376365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.404499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.423796 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f34e0c8c-9410-4877-b518-10250ed07b01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.638992 Aug 27 03:10:00.437305 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 366/738] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:59 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:00.447320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:00.449351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:00.466686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.468167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.470356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.472364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.473072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.474644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.765700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.777768 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81b4d868-f550-4331-96db-b4596102390c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1293 microversion: 2.1 time: 0.446811 Aug 27 03:10:00.778800 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 373/739] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:00 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1293 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:00.800658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:00.802762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:00.839795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.841164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.842208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.845723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.853854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:00.855231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.855537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.856214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.859287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b5c53f1-d383-4906-afe5-add130b21d78 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.420694 Aug 27 03:10:00.860700 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 367/740] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:00 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:00.865377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:00.872294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.873086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Searching by: {'deleted': False, 'project_id': '587c41ae3469462b8099222b2bb2a278'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:00.911053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.911611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.918730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.919550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.920039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.920597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.133087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:10:01.288156 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c31f7d82-e2ca-41ac-b3bb-2c6e0e168dcd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.426316 Aug 27 03:10:01.289082 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 368/741] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:10:00 2022] GET /compute/v2.1/servers => generated 1002 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:01.305024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-588b0908-3ea6-48fd-9ae9-e6b16e45d183 req-72ffae04-95a3-413f-ab3e-14a262cb7341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4b4e2-b5c0-44d3-b520-c1571ceee8ef", "name": "network-vif-plugged", "status": "completed", "tag": "4485a129-6aee-4bcf-a63f-aa2d14a240e9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:01.321145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-588b0908-3ea6-48fd-9ae9-e6b16e45d183 req-72ffae04-95a3-413f-ab3e-14a262cb7341 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.321663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-588b0908-3ea6-48fd-9ae9-e6b16e45d183 req-72ffae04-95a3-413f-ab3e-14a262cb7341 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.322109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-588b0908-3ea6-48fd-9ae9-e6b16e45d183 req-72ffae04-95a3-413f-ab3e-14a262cb7341 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.355313 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-588b0908-3ea6-48fd-9ae9-e6b16e45d183 req-72ffae04-95a3-413f-ab3e-14a262cb7341 service nova] Creating event network-vif-plugged:4485a129-6aee-4bcf-a63f-aa2d14a240e9 for instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef on n-h1-852086-5 Aug 27 03:10:01.369637 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-588b0908-3ea6-48fd-9ae9-e6b16e45d183 req-72ffae04-95a3-413f-ab3e-14a262cb7341 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071344 Aug 27 03:10:01.370750 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 369/742] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:01.376379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d9db878c-e9a8-41c2-aaeb-a29b8bf55e66 req-c58e7721-fa1b-4923-aa7f-b0a8cee916b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f86480-02eb-4df3-b033-7f8a064c6ac8", "name": "network-vif-deleted", "tag": "46ac2d96-ec9a-42dc-87e4-23571d831e05"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:01.388368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d9db878c-e9a8-41c2-aaeb-a29b8bf55e66 req-c58e7721-fa1b-4923-aa7f-b0a8cee916b2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.388963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d9db878c-e9a8-41c2-aaeb-a29b8bf55e66 req-c58e7721-fa1b-4923-aa7f-b0a8cee916b2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.389570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d9db878c-e9a8-41c2-aaeb-a29b8bf55e66 req-c58e7721-fa1b-4923-aa7f-b0a8cee916b2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.408237 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d9db878c-e9a8-41c2-aaeb-a29b8bf55e66 req-c58e7721-fa1b-4923-aa7f-b0a8cee916b2 service nova] Creating event network-vif-deleted:46ac2d96-ec9a-42dc-87e4-23571d831e05 for instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 on n-h1-852086-5 Aug 27 03:10:01.417402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d9db878c-e9a8-41c2-aaeb-a29b8bf55e66 req-c58e7721-fa1b-4923-aa7f-b0a8cee916b2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044441 Aug 27 03:10:01.420174 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 370/743] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:01.433975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.438024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.453801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.454636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.455240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.456352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.457738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.458511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.701841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.716163 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b881ece4-733a-45c2-bea3-84f0368948d0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.293701 Aug 27 03:10:01.717047 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 371/744] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:01.727628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.728679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.739475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.740458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.741545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.744003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.744906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.745837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.746534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.766853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.768442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.772289 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec16e64e-11a7-4941-b457-f991fbb4182b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1362 microversion: 2.25 time: 0.991592 Aug 27 03:10:01.774766 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 374/745] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:00 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1362 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:01.788079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab6d13ab-bb50-47f8-a67d-64f6cc0073a1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.789527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab6d13ab-bb50-47f8-a67d-64f6cc0073a1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.794212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.794711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.797810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.798519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lazy-loading 'fault' on Instance uuid d4f86480-02eb-4df3-b033-7f8a064c6ac8 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:01.861864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae358d463a134431827d704089300d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3dc710fa9b46f889a756adbe3b0227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.875141 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de4af730-9f38-4596-870f-b974096c1a4f tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 200 len: 1352 microversion: 2.1 time: 0.156792 Aug 27 03:10:01.876289 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 372/746] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 1352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:01.883235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.884712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.904091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.904849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.905631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.907759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.908588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.908852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab6d13ab-bb50-47f8-a67d-64f6cc0073a1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.909350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.922149 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab6d13ab-bb50-47f8-a67d-64f6cc0073a1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1218 microversion: 2.1 time: 0.145525 Aug 27 03:10:01.923041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 375/747] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:01.934865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.934865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.947272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.947776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.948440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.949692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.950352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.950939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.116715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:02.127599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4b41849-e9b0-4aee-a320-d9665c56e170 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1293 microversion: 2.1 time: 0.202543 Aug 27 03:10:02.147660 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 376/748] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:02.155271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:02.156710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:02.165268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.165791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.166260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.166974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.167597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.168577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.254555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:02.279839 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7fa2b596-fc32-4866-a470-5cf824022e13 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.401967 Aug 27 03:10:02.281955 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 373/749] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:02.294876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bb60d695-d5ef-4f76-8d55-25e96eb7f99e req-ea9788e9-e7ff-4669-aa68-6ae47fee6d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782b01df-d140-43ab-a3c7-72da7fae9f0a", "tag": "eda7639a-a67d-4718-a767-6b0da80ac50a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:02.311193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bb60d695-d5ef-4f76-8d55-25e96eb7f99e req-ea9788e9-e7ff-4669-aa68-6ae47fee6d93 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.311949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bb60d695-d5ef-4f76-8d55-25e96eb7f99e req-ea9788e9-e7ff-4669-aa68-6ae47fee6d93 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.312711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bb60d695-d5ef-4f76-8d55-25e96eb7f99e req-ea9788e9-e7ff-4669-aa68-6ae47fee6d93 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.335646 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bb60d695-d5ef-4f76-8d55-25e96eb7f99e req-ea9788e9-e7ff-4669-aa68-6ae47fee6d93 service nova] Creating event network-changed:eda7639a-a67d-4718-a767-6b0da80ac50a for instance 782b01df-d140-43ab-a3c7-72da7fae9f0a on n-h2-852086-5 Aug 27 03:10:02.348284 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bb60d695-d5ef-4f76-8d55-25e96eb7f99e req-ea9788e9-e7ff-4669-aa68-6ae47fee6d93 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063265 Aug 27 03:10:02.349351 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 374/750] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:02.741516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:02.743070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:02.769245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.769677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.770493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.771739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.772518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.773182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.194493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.207784 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-901ed6fe-adfb-45eb-b038-ed95d6d4ceaf tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 1.058529 Aug 27 03:10:03.215488 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 377/751] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:02 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:03.229136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.231011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.247953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.248585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.249022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.249741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.250213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.250640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.426909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.448371 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a076ebd3-c7e0-4c0d-b99f-945a8f8c34d2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.712317 Aug 27 03:10:03.452994 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 375/752] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:02 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:03.470901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.473594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.492745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.493242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.493689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.496765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.497238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.497676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.521731 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] HTTP exception thrown: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Request method failure captured: Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 HTTP/1.1 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpnR7wZ6knGHWTVPJkRlkcum33OuIi1i0noRZWQNa74PUIVXxD5L0buguyfvquSZIxxzjTkhWRuRXfd9v-JeK-aXu9U0Nk7dC-3YhA0FZF6gekFBzmFH2Rg37ubz489bPd7XXIMEbhCwc_1DnsTy907X55nTrsG_55dU3s1T-rCWQo Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d3dc710fa9b46f889a756adbe3b0227", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}] Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ae358d463a134431827d704089300d0c Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'd4f86480-02eb-4df3-b033-7f8a064c6ac8'} Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:03.524986 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:03.530805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Returning 404 to user: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:03.539398 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecb27cad-56ed-4666-af2f-4a7b0b18a5d5 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 404 len: 111 microversion: 2.1 time: 0.082752 Aug 27 03:10:03.540156 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 376/753] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:03.548379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.551796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.569014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.569789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.570406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.571300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.572703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.574720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.675958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.693018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.695534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.697370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a7382de-f4f2-4950-a7e0-76d1d25d831d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1362 microversion: 2.25 time: 0.484371 Aug 27 03:10:03.704706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.710816 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 378/754] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:03.725367 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9bd2ad2c-c7c9-4410-9d2a-b616b66744b0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1270 microversion: 2.1 time: 0.181726 Aug 27 03:10:03.728918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.731007 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 377/755] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:03.738798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.745098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.747319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.763040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.765382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.768159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.772784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.775118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.780338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.789147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.791293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.795632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.799064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.799634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.800275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.955202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.964808 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ed66e79-afd6-4ba1-ad04-687e720f2050 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1293 microversion: 2.1 time: 0.252223 Aug 27 03:10:03.968462 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 379/756] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1293 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:03.973832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.981969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.011917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.014585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.017567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.022446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.023156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.023699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.042843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] HTTP exception thrown: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Request method failure captured: Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf HTTP/1.1 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpnR7wZ6knGHWTVPJkRlkcum33OuIi1i0noRZWQNa74PUIVXxD5L0buguyfvquSZIxxzjTkhWRuRXfd9v-JeK-aXu9U0Nk7dC-3YhA0FZF6gekFBzmFH2Rg37ubz489bPd7XXIMEbhCwc_1DnsTy907X55nTrsG_55dU3s1T-rCWQo Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d3dc710fa9b46f889a756adbe3b0227", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}] Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ae358d463a134431827d704089300d0c Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'b8d7f6bd-104d-4e57-b004-56b81816b5bf'} Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:04.044644 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Returning 404 to user: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:04.054823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9a82f378-71e2-45b9-95f7-7f3de23801f6 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 404 len: 111 microversion: 2.1 time: 0.076108 Aug 27 03:10:04.056451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:04.059719 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 380/757] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:03 2022] DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:04.072160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.072778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.072954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fb9effe-4434-4c4c-abda-33f40d313aac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.340407 Aug 27 03:10:04.078458 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 378/758] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:04.092720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.093603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.094400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.096900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.098274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.099594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.125263 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] HTTP exception thrown: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Request method failure captured: Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf HTTP/1.1 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpnR7wZ6knGHWTVPJkRlkcum33OuIi1i0noRZWQNa74PUIVXxD5L0buguyfvquSZIxxzjTkhWRuRXfd9v-JeK-aXu9U0Nk7dC-3YhA0FZF6gekFBzmFH2Rg37ubz489bPd7XXIMEbhCwc_1DnsTy907X55nTrsG_55dU3s1T-rCWQo Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d3dc710fa9b46f889a756adbe3b0227", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}] Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ae358d463a134431827d704089300d0c Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'b8d7f6bd-104d-4e57-b004-56b81816b5bf'} Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.128203 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:04.134979 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:04.137618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Returning 404 to user: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:04.138965 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b69b8380-15d7-4a9d-bbd7-899b9e385cde tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 404 len: 111 microversion: 2.1 time: 0.078206 Aug 27 03:10:04.144132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 381/759] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:04 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:04.148678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb63a014-48af-409a-a8d7-dc0385114210 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '.version_select at 0x7fe45c79e940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.176030 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb63a014-48af-409a-a8d7-dc0385114210 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344888239" status: 202 len: 0 microversion: 2.1 time: 0.031048 Aug 27 03:10:04.177131 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 379/760] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344888239 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:10:04.232347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.233586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.247237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.260075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.261638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.262917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.264363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.272815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.477668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.478336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.489230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.495713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.496499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.497438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.498875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.499498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.163298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.174553 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-626c6945-1ebf-483a-944c-1d9dce711654 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.699066 Aug 27 03:10:05.175191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 380/761] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:04 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:05.223327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:05.224465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:05.242879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.243158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.243870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.244828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.246648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.247625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.596165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.615779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95b37350-9c10-486c-bffd-73ebec85a2b4 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 1.386812 Aug 27 03:10:05.642189 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 382/762] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:04 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:05.645956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:05.653970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:05.669819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.670515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.674511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.675455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.676192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.676913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.882192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.896108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d648fba5-bd08-4c49-9236-99d07fe204ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1276 microversion: 2.1 time: 0.265564 Aug 27 03:10:05.906235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 383/763] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:05 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:05.920786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:05.921584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:05.942570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.946735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.948057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.950308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.951688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.952794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.010346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.029047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.035570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.041221 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70fa6148-fe68-442e-8985-0b427f4f655c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1558 microversion: 2.25 time: 0.849319 Aug 27 03:10:06.041841 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 381/764] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:05 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1558 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:06.064607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.065452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.075041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.077312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.077942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.080020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.080682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.081265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.784675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.799915 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd71294a-7fae-4dba-b8c4-9fef8a9e6fee tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.747764 Aug 27 03:10:06.801575 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 382/765] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:06.824776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.826893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.832610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:06.848620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.849477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.850359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.851623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.852402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.853016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.938764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.946936 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a394c0c0-13f0-40d0-90c6-8895732df7fc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1360 microversion: 2.1 time: 1.048416 Aug 27 03:10:06.958786 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 384/766] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:05 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1360 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:06.965411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.966439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.984691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.985190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.985662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.986369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.986827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.987254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.384024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.400855 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-36e68b39-1d59-4079-a3c3-548258f0edc6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.439151 Aug 27 03:10:07.417140 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 385/767] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:07.424582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:07.425518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:07.433676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.434646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.435352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.436524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.437212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.437897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.780925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.794943 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a368049-889f-46c9-84ae-266581d3b1dc tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.389486 Aug 27 03:10:07.795723 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 386/768] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:07 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:07.804447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:07.805260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:07.815644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.822702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.822702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.822702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.822702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.822702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.840636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:07.861633 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8aa76b0-065e-450e-8a71-27353c94a660 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 2051 microversion: 2.25 time: 1.058240 Aug 27 03:10:07.875510 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 383/769] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 2051 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:07.889240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f7b05410-50b8-47c4-ba8c-41e068ee77eb req-ff1b8c01-6e23-47d2-9cbc-c6dff9bf87b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd3b4a0-b115-4688-af4f-27f15a0eaea0", "name": "network-vif-plugged", "status": "completed", "tag": "a94fdd64-5583-4e14-bd48-74552e561a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:07.909246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f7b05410-50b8-47c4-ba8c-41e068ee77eb req-ff1b8c01-6e23-47d2-9cbc-c6dff9bf87b6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.910090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f7b05410-50b8-47c4-ba8c-41e068ee77eb req-ff1b8c01-6e23-47d2-9cbc-c6dff9bf87b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.910602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f7b05410-50b8-47c4-ba8c-41e068ee77eb req-ff1b8c01-6e23-47d2-9cbc-c6dff9bf87b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.927116 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f7b05410-50b8-47c4-ba8c-41e068ee77eb req-ff1b8c01-6e23-47d2-9cbc-c6dff9bf87b6 service nova] Creating event network-vif-plugged:a94fdd64-5583-4e14-bd48-74552e561a6b for instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 on n-h1-852086-5 Aug 27 03:10:07.932653 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f7b05410-50b8-47c4-ba8c-41e068ee77eb req-ff1b8c01-6e23-47d2-9cbc-c6dff9bf87b6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055207 Aug 27 03:10:07.934065 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 384/770] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:07.940500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:07.940823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:07.951797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.955443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.955960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.956409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.957516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.959381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:07.959892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.960662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.965409 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f92172c-c2b8-4af4-b63e-e65de6a5df1d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1276 microversion: 2.1 time: 0.166023 Aug 27 03:10:07.966785 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 387/771] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:07 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:07.976217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:07.977942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:07.989448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.990502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.992205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.994930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.997802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.998677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.195922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=30 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:08.400615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:08.411780 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6dd4fe1-640e-48e8-9ed8-494f05475bbb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1476 microversion: 2.1 time: 0.476126 Aug 27 03:10:08.412267 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 385/772] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:07 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1476 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:08.431988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:08.432867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:08.455859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.456437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.456889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.457623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.458084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.458547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.731618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:08.751491 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b58924a4-74db-46be-b17b-8368bf0785aa tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 2051 microversion: 2.25 time: 0.782755 Aug 27 03:10:08.752730 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 388/773] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:07 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 2051 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:08.758009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-25f54e4b-f305-4820-81a4-1372e28c583f req-4ca688fc-cc31-472f-9252-cbcef9101c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3433e1f2-f285-4966-92cb-9379c704c79f", "tag": "9ebee722-b0c2-440d-bedb-e10ee3451871"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:08.770921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-25f54e4b-f305-4820-81a4-1372e28c583f req-4ca688fc-cc31-472f-9252-cbcef9101c02 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.772123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-25f54e4b-f305-4820-81a4-1372e28c583f req-4ca688fc-cc31-472f-9252-cbcef9101c02 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.772794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-25f54e4b-f305-4820-81a4-1372e28c583f req-4ca688fc-cc31-472f-9252-cbcef9101c02 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.791008 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-25f54e4b-f305-4820-81a4-1372e28c583f req-4ca688fc-cc31-472f-9252-cbcef9101c02 service nova] Creating event network-changed:9ebee722-b0c2-440d-bedb-e10ee3451871 for instance 3433e1f2-f285-4966-92cb-9379c704c79f on n-h1-852086-5 Aug 27 03:10:08.800933 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-25f54e4b-f305-4820-81a4-1372e28c583f req-4ca688fc-cc31-472f-9252-cbcef9101c02 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046430 Aug 27 03:10:08.802697 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 389/774] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:08.810803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:08.811737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:08.829402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.830246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.830867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.831756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.835067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.836652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.133407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.147865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.151036 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c5826ab8-7598-4288-b0c6-67053510d427 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.345922 Aug 27 03:10:09.152914 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 390/775] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:08 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:09.160549 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04e6a24d-91ac-4b81-9108-28b0b065a521 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1360 microversion: 2.1 time: 0.747161 Aug 27 03:10:09.161008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.161550 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 386/776] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:08 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1360 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:09.168252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.169185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.169399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.170220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.171623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.172676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.173764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:09.174709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.195599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.196110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.196562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.202727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.203917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.208587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.235576 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c3f53a7-6fb1-4bf0-8d8a-0661f1f9ffe9 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.080298 Aug 27 03:10:09.237471 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 391/777] 10.222.0.69 () {60 vars in 1217 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:10:09.248715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.250536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:09.266439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.267322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.268608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.271138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.272244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.273220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.406135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.432906 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21fb2de5-9f28-475b-a4fa-410094892ed0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1276 microversion: 2.1 time: 0.193488 Aug 27 03:10:09.433522 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 392/778] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:09.455845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b62df82-23e3-4891-ba39-430a16a128de tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.479064 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b62df82-23e3-4891-ba39-430a16a128de tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1730794779" status: 202 len: 0 microversion: 2.1 time: 0.027592 Aug 27 03:10:09.480229 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 393/779] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:10:09 2022] DELETE /compute/v2.1/flavors/1730794779 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:09.499809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:09.507189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:09.540231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.541434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.546492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.549425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.563195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.571228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.651076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.681138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:09.692523 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a125d9b7-ab8a-4f31-b386-943ee995372d tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.524156 Aug 27 03:10:09.695747 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 387/780] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:09.719195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.720830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:09.751891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.755434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.759394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.762653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.766386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.767886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.836681 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac36e9d6-9ca2-4c72-9582-90fd67d81a11 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef/action" status: 202 len: 0 microversion: 2.25 time: 0.352962 Aug 27 03:10:09.841720 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 394/781] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:10:09 2022] POST /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:09.870654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1792414-449e-4940-bcc2-e31025036b3d tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.924060 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a1792414-449e-4940-bcc2-e31025036b3d tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.080015 Aug 27 03:10:09.925368 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 395/782] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:10.149641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55d7ee16-ac26-4f9f-8120-74f5b1751b5f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe45c435700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1206129246", "description": "tempest-description-1560839231"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:10.206740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.220236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8627e8ad-731d-4ffe-89a9-1706b7426bc7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1475 microversion: 2.1 time: 0.522463 Aug 27 03:10:10.221682 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 388/783] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1475 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:10.227711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:10.228563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:10.235855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.236672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.237318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.238681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.240147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.240973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.613484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:10.631777 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-52c34a12-5b6b-46bc-9650-224039f3fb32 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 2056 microversion: 2.25 time: 0.407712 Aug 27 03:10:10.633118 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 389/784] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:10 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 2056 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:10.638901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19d85940-598b-4876-863a-54b2ea808906 tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:10.664029 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-55d7ee16-ac26-4f9f-8120-74f5b1751b5f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.737128 Aug 27 03:10:10.666410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 396/785] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:10:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:10.680974 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19d85940-598b-4876-863a-54b2ea808906 tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1930694512" status: 202 len: 0 microversion: 2.1 time: 0.044774 Aug 27 03:10:10.688612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f6b80a60-8d59-4fa5-9a2c-858f73be9cce req-44cb2c68-2575-4f49-981d-2e4219e9bf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b6f613-7f60-4e14-8283-4617c9b0f283", "name": "network-vif-plugged", "status": "completed", "tag": "a09097d9-1bf0-429e-ad65-3ea59a299e7e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:10.689352 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 390/786] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:10:10 2022] DELETE /compute/v2.1/flavors/1930694512 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:10.696941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:10.698006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:10.707001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.708353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.709409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.711065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.711700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.712423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.714724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6b80a60-8d59-4fa5-9a2c-858f73be9cce req-44cb2c68-2575-4f49-981d-2e4219e9bf10 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.715485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6b80a60-8d59-4fa5-9a2c-858f73be9cce req-44cb2c68-2575-4f49-981d-2e4219e9bf10 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.716276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6b80a60-8d59-4fa5-9a2c-858f73be9cce req-44cb2c68-2575-4f49-981d-2e4219e9bf10 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.754625 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f6b80a60-8d59-4fa5-9a2c-858f73be9cce req-44cb2c68-2575-4f49-981d-2e4219e9bf10 service nova] Creating event network-vif-plugged:a09097d9-1bf0-429e-ad65-3ea59a299e7e for instance 53b6f613-7f60-4e14-8283-4617c9b0f283 on n-h2-852086-5 Aug 27 03:10:10.764203 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f6b80a60-8d59-4fa5-9a2c-858f73be9cce req-44cb2c68-2575-4f49-981d-2e4219e9bf10 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094570 Aug 27 03:10:10.765693 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 397/787] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:10.778114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:10.780138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:10.793164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.794633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.795702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.797187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.798102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.798753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.019808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:11.140328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:11.148906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:11.160147 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-efc90173-542e-4a24-8df1-959fb37aa793 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1314 microversion: 2.1 time: 0.391158 Aug 27 03:10:11.161561 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 398/788] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:10 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:11.164479 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3247acb7-b815-4297-a53e-e28a446a2c0a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1360 microversion: 2.1 time: 0.473074 Aug 27 03:10:11.165215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 391/789] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:10 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1360 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:11.186242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65d1babe-9952-4f79-88d0-cfbda390a09d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe45c45ef70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-726731045", "description": "tempest-description-795495147"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:11.199599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.202810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:11.224437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.225371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.225983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.226928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.227574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.228175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.424864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:11.436733 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff5e9dbe-029b-4595-85a9-64489fda01e6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1318 microversion: 2.1 time: 0.272742 Aug 27 03:10:11.452027 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 399/790] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:11.493269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e838613b-167e-442d-b97e-41bc3939c503 tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.554010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e838613b-167e-442d-b97e-41bc3939c503 tempest-ServersWithSpecificFlavorTestJSON-685573741 tempest-ServersWithSpecificFlavorTestJSON-685573741-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.100402 Aug 27 03:10:11.563199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 400/791] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:11.595376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.596506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:11.618932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.619461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.620488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.621614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.627128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.628329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.782152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65d1babe-9952-4f79-88d0-cfbda390a09d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.615188 Aug 27 03:10:11.784504 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 392/792] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:10:11 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:11.794112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.795493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:11.808068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.809098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.810101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.811579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.812532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.813375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.917736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=48 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:12.415854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.436166 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b5428bf-6cf0-48e6-a40e-2d4bf970b2f1 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.856506 Aug 27 03:10:12.437016 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 401/793] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:12.476064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:12.476579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:12.516828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.517827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.518760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.519716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.520565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.521489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.548315 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] HTTP exception thrown: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Request method failure captured: Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 HTTP/1.1 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYpnR7wZ6knGHWTVPJkRlkcum33OuIi1i0noRZWQNa74PUIVXxD5L0buguyfvquSZIxxzjTkhWRuRXfd9v-JeK-aXu9U0Nk7dC-3YhA0FZF6gekFBzmFH2Rg37ubz489bPd7XXIMEbhCwc_1DnsTy907X55nTrsG_55dU3s1T-rCWQo Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d3dc710fa9b46f889a756adbe3b0227", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}] Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ae358d463a134431827d704089300d0c Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd4f86480-02eb-4df3-b033-7f8a064c6ac8'} Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:12.550345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:12.553945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:12.555952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Returning 404 to user: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:12.557013 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b07944a2-1694-4343-870b-c4248259c888 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 404 len: 111 microversion: 2.1 time: 0.118807 Aug 27 03:10:12.558973 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 402/794] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:12 2022] DELETE /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:12.574054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:12.577194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:12.584031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:12.585724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.586980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.587597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.589688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.590625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.591337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.631279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.646210 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-84041531-3af6-4052-a034-91975c6b4db1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1475 microversion: 2.1 time: 0.859709 Aug 27 03:10:12.666710 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 393/795] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1475 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:12.683396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-142475635", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "d0d61aeb-6578-4809-8b65-8c47d7949dcd"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:12.813453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] validate_networks() for [('d0d61aeb-6578-4809-8b65-8c47d7949dcd', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:13.538968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:13.588430 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95128b30-a95c-44d6-86f3-b077802ab084 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 2036 microversion: 2.25 time: 1.027670 Aug 27 03:10:13.593204 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 403/796] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:12 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 2036 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:13.609458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:13.611214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:13.628819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.631457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.632224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:13.634944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.636282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.641683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.119624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:14.175471 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e1c91017-ff7f-46cd-9dcf-00df48b5c21a tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1463 microversion: 2.1 time: 0.578217 Aug 27 03:10:14.177921 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 404/797] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:13 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1463 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:14.200353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:14.209026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:14.230429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.231784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.233015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.234856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.236308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.239220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.057290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:15.059957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:15.061298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:15.062720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:15.064727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:15.095945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.097156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.099275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.107041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.108693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.110275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.143518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Getting quotas for project 90ebbb9e792148aca468510c69c89d14. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:15.158419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Getting quotas for user 657d8e0c58fa4aa58c4e8e1b1bfa74d3 and project 90ebbb9e792148aca468510c69c89d14. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:15.175403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:15.181638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:15.201030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.226830 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f23d903c-ff19-4d75-9615-ec4aeeabc366 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1360 microversion: 2.1 time: 1.045973 Aug 27 03:10:15.229465 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 405/798] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:14 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1360 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:15.242012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:15.244403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:15.270121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.271166 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13a509f0-4738-4a17-afbb-bb7f4daea66d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.601963 Aug 27 03:10:15.271903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.272627 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 394/799] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:15.273434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.275495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.276793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.278471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.280256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:15.282132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: d4f86480-02eb-4df3-b033-7f8a064c6ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:15.292410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.292981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.293429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.294183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.294665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.295112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.311578 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] HTTP exception thrown: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Request method failure captured: Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 HTTP/1.1 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpnR7wZ6knGHWTVPJkRlkcum33OuIi1i0noRZWQNa74PUIVXxD5L0buguyfvquSZIxxzjTkhWRuRXfd9v-JeK-aXu9U0Nk7dC-3YhA0FZF6gekFBzmFH2Rg37ubz489bPd7XXIMEbhCwc_1DnsTy907X55nTrsG_55dU3s1T-rCWQo Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d3dc710fa9b46f889a756adbe3b0227", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}] Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ae358d463a134431827d704089300d0c Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'd4f86480-02eb-4df3-b033-7f8a064c6ac8'} Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:15.313461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Returning 404 to user: Instance d4f86480-02eb-4df3-b033-7f8a064c6ac8 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f1f0111-4882-42f7-a5e6-707f44586abf tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8" status: 404 len: 111 microversion: 2.1 time: 0.041078 Aug 27 03:10:15.322299 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 395/800] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:15 2022] GET /compute/v2.1/servers/d4f86480-02eb-4df3-b033-7f8a064c6ac8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:15.326919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:15.326919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:15.338036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.348828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.349293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.350071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.350588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.351025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.686300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.696867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-70fbac6e-71b5-4e59-a51e-4c549e4295dc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1318 microversion: 2.1 time: 0.465644 Aug 27 03:10:15.697580 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 406/801] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:15 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:15.702957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-388324e5-a541-4393-83ed-e81bdfca1277 req-095b4923-fec7-47f5-b6e5-c79890c046d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6506c3-9989-47ab-88c5-0258c00070d9", "name": "network-vif-unplugged", "status": "completed", "tag": "de7751cd-3d09-4c1d-b715-b797a59a532e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:15.714065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-388324e5-a541-4393-83ed-e81bdfca1277 req-095b4923-fec7-47f5-b6e5-c79890c046d0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.715116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-388324e5-a541-4393-83ed-e81bdfca1277 req-095b4923-fec7-47f5-b6e5-c79890c046d0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.715769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-388324e5-a541-4393-83ed-e81bdfca1277 req-095b4923-fec7-47f5-b6e5-c79890c046d0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.746098 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-388324e5-a541-4393-83ed-e81bdfca1277 req-095b4923-fec7-47f5-b6e5-c79890c046d0 service nova] Creating event network-vif-unplugged:de7751cd-3d09-4c1d-b715-b797a59a532e for instance 0c6506c3-9989-47ab-88c5-0258c00070d9 on n-h1-852086-5 Aug 27 03:10:15.757574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-388324e5-a541-4393-83ed-e81bdfca1277 req-095b4923-fec7-47f5-b6e5-c79890c046d0 service nova] Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:10:15.778685 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-388324e5-a541-4393-83ed-e81bdfca1277 req-095b4923-fec7-47f5-b6e5-c79890c046d0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078879 Aug 27 03:10:15.780532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 407/802] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:15.788538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.818200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852086-5", "block_migration": "auto"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:15.818946 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e31d4af-6ac9-43f3-a4c9-b884c878ec3f tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.495492 Aug 27 03:10:15.825787 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 396/803] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:15 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:15.832079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:15.840027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:15.841382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:15.852663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.853225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.854056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.855397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.856027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.856887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.858616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.859508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.860883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.861454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.861626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.862718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.914527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'flavor' on Instance uuid 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:15.941105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Going to try to live migrate instance to n-h2-852086-5 {{(pid=122407) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:10:16.004733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:16.102624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.116083 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e5220c8-6f54-43e1-8136-a17f40a2a737 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1473 microversion: 2.1 time: 0.288122 Aug 27 03:10:16.130199 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 397/804] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:15 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.130199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-cc298faa-0f72-44a6-950d-c9a88ff60cba req-8f86767b-b3a2-4a32-9b35-a5cb3ca64c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65bc4962-c5bb-4892-9540-3e657d0b2a54", "tag": "4215d1f8-9911-4f91-8d07-2d6aa16d23e7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:16.139221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cc298faa-0f72-44a6-950d-c9a88ff60cba req-8f86767b-b3a2-4a32-9b35-a5cb3ca64c78 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.139756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cc298faa-0f72-44a6-950d-c9a88ff60cba req-8f86767b-b3a2-4a32-9b35-a5cb3ca64c78 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.140198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cc298faa-0f72-44a6-950d-c9a88ff60cba req-8f86767b-b3a2-4a32-9b35-a5cb3ca64c78 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.157022 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-cc298faa-0f72-44a6-950d-c9a88ff60cba req-8f86767b-b3a2-4a32-9b35-a5cb3ca64c78 service nova] Creating event network-changed:4215d1f8-9911-4f91-8d07-2d6aa16d23e7 for instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 on n-h2-852086-5 Aug 27 03:10:16.162855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-cc298faa-0f72-44a6-950d-c9a88ff60cba req-8f86767b-b3a2-4a32-9b35-a5cb3ca64c78 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042829 Aug 27 03:10:16.163465 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 398/805] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:16.169497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.170347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.177370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.178377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.179322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.180293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.181187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.181875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.392654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.402870 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4610e96-d5a1-4f9b-b6db-6d698e94326c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1463 microversion: 2.1 time: 0.238007 Aug 27 03:10:16.404173 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 399/806] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1463 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.412482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.413278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.426413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.429001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.430366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.431863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.433581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.434319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.566912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.578104 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2983593-6d29-4810-bb0c-fc4fd5991d0d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1219 microversion: 2.1 time: 0.172386 Aug 27 03:10:16.581537 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 400/807] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.587169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.590682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.603995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.605101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.605745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.606684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.607253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.608823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.635153 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] HTTP exception thrown: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Request method failure captured: Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf HTTP/1.1 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpnR7wZ6knGHWTVPJkRlkcum33OuIi1i0noRZWQNa74PUIVXxD5L0buguyfvquSZIxxzjTkhWRuRXfd9v-JeK-aXu9U0Nk7dC-3YhA0FZF6gekFBzmFH2Rg37ubz489bPd7XXIMEbhCwc_1DnsTy907X55nTrsG_55dU3s1T-rCWQo Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d3dc710fa9b46f889a756adbe3b0227", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}] Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ae358d463a134431827d704089300d0c Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b8d7f6bd-104d-4e57-b004-56b81816b5bf'} Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:16.637777 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:16.642578 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:16.644339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Returning 404 to user: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:16.645211 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe5182bd-2ce7-4d05-945a-734815ba20e8 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 404 len: 111 microversion: 2.1 time: 0.062393 Aug 27 03:10:16.646146 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 401/808] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:16 2022] DELETE /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:16.651945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.652878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.659670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.660511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.661028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.661980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.662701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.663384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.837090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.847202 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42947f4d-f0b2-4d4b-87e6-206e8619876a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1360 microversion: 2.1 time: 0.199567 Aug 27 03:10:16.847853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 402/809] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1360 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.852677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1688888297", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "acd3b4a0-b115-4688-af4f-27f15a0eaea0"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:16.918522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:17.186799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:17.187559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:17.187879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:17.188336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:17.188757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:17.204176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.204900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.205360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.206122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.206628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.207068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.228447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Getting quotas for project 82ec502ce3cc43bb969abf2fa3637591. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:17.235811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Getting quotas for user 1150c8244e514ef098f87f12f04f964b and project 82ec502ce3cc43bb969abf2fa3637591. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:17.250863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:17.253229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:17.305281 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a0335e8d-700b-4744-9f90-9db716081a50 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455580 Aug 27 03:10:17.305695 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 403/810] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:17.310687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.311513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] [instance: b8d7f6bd-104d-4e57-b004-56b81816b5bf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.318681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.319391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.319840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.320558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.321025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.323507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.340323 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] HTTP exception thrown: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Request method failure captured: Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf HTTP/1.1 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYpnR7wZ6knGHWTVPJkRlkcum33OuIi1i0noRZWQNa74PUIVXxD5L0buguyfvquSZIxxzjTkhWRuRXfd9v-JeK-aXu9U0Nk7dC-3YhA0FZF6gekFBzmFH2Rg37ubz489bPd7XXIMEbhCwc_1DnsTy907X55nTrsG_55dU3s1T-rCWQo Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1d3dc710fa9b46f889a756adbe3b0227", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1d3dc710fa9b46f889a756adbe3b0227"}]}] Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1d3dc710fa9b46f889a756adbe3b0227 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016 Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ae358d463a134431827d704089300d0c Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-98356016-project Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b8d7f6bd-104d-4e57-b004-56b81816b5bf'} Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:17.341909 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] Returning 404 to user: Instance b8d7f6bd-104d-4e57-b004-56b81816b5bf could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa7cf347-f029-4b74-8fb1-585f73686b77 tempest-ServersWithSpecificFlavorTestJSON-98356016 tempest-ServersWithSpecificFlavorTestJSON-98356016-project] 10.222.0.69 "GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf" status: 404 len: 111 microversion: 2.1 time: 0.036651 Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 404/811] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/b8d7f6bd-104d-4e57-b004-56b81816b5bf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:17.350536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d020fbdf-8fbe-435e-896b-f1ed42af278c req-b1a5042c-90c7-4cca-bd64-16ceea1a7c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3433e1f2-f285-4966-92cb-9379c704c79f", "name": "network-vif-plugged", "status": "completed", "tag": "9ebee722-b0c2-440d-bedb-e10ee3451871"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:17.361774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d020fbdf-8fbe-435e-896b-f1ed42af278c req-b1a5042c-90c7-4cca-bd64-16ceea1a7c33 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.362300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d020fbdf-8fbe-435e-896b-f1ed42af278c req-b1a5042c-90c7-4cca-bd64-16ceea1a7c33 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.362804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d020fbdf-8fbe-435e-896b-f1ed42af278c req-b1a5042c-90c7-4cca-bd64-16ceea1a7c33 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.376490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d020fbdf-8fbe-435e-896b-f1ed42af278c req-b1a5042c-90c7-4cca-bd64-16ceea1a7c33 service nova] Creating event network-vif-plugged:9ebee722-b0c2-440d-bedb-e10ee3451871 for instance 3433e1f2-f285-4966-92cb-9379c704c79f on n-h1-852086-5 Aug 27 03:10:17.383422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d020fbdf-8fbe-435e-896b-f1ed42af278c req-b1a5042c-90c7-4cca-bd64-16ceea1a7c33 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037944 Aug 27 03:10:17.386545 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 405/812] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:17.392614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.393420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.401694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.402458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.402911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.403629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.404081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.404677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.724275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.739889 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2a3fb66-340c-408e-b714-fe4fa45f4cf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1318 microversion: 2.1 time: 0.351030 Aug 27 03:10:17.741255 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 406/813] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:17.763020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.764185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.776077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.776952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.777693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.779727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.780560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.781850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.078607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.087349 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-371c2743-2713-4892-b159-1e5c88525670 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.344371 Aug 27 03:10:18.091063 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 407/814] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.113070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.119307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.142052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.143867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.145760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.147422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.148621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.149275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.435478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.450725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-442ecd4b-0c13-4521-a5ed-936ccb2a5deb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1473 microversion: 2.1 time: 0.358045 Aug 27 03:10:18.451775 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 408/815] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.461994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.463006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.475574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.476262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.477109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.478315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.478783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.479788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.576114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.592351 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28996f90-6f2e-4b39-be86-1a3bf08bae6e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1210 microversion: 2.1 time: 0.138266 Aug 27 03:10:18.593576 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 409/816] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.598659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.599495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.612539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.613345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.613793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.614585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.615076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.615703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.741189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.743587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:18.756540 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78e4c49d-3749-4490-befd-e480cb7d5726 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1211 microversion: 2.1 time: 0.161647 Aug 27 03:10:18.757352 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 410/817] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.762572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3e1027c0-be70-467d-85d0-8cd3f427be8b req-f8f4ad26-ebdf-45b4-861a-0b31879ea38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6506c3-9989-47ab-88c5-0258c00070d9", "tag": "de7751cd-3d09-4c1d-b715-b797a59a532e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:18.773254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e1027c0-be70-467d-85d0-8cd3f427be8b req-f8f4ad26-ebdf-45b4-861a-0b31879ea38f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.773726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e1027c0-be70-467d-85d0-8cd3f427be8b req-f8f4ad26-ebdf-45b4-861a-0b31879ea38f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.774400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e1027c0-be70-467d-85d0-8cd3f427be8b req-f8f4ad26-ebdf-45b4-861a-0b31879ea38f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.789972 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3e1027c0-be70-467d-85d0-8cd3f427be8b req-f8f4ad26-ebdf-45b4-861a-0b31879ea38f service nova] Creating event network-changed:de7751cd-3d09-4c1d-b715-b797a59a532e for instance 0c6506c3-9989-47ab-88c5-0258c00070d9 on n-h1-852086-5 Aug 27 03:10:18.796657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-3e1027c0-be70-467d-85d0-8cd3f427be8b req-f8f4ad26-ebdf-45b4-861a-0b31879ea38f service nova] Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:10:18.812367 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3e1027c0-be70-467d-85d0-8cd3f427be8b req-f8f4ad26-ebdf-45b4-861a-0b31879ea38f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053409 Aug 27 03:10:18.813109 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 411/818] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:18.818321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.819039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.826431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.827452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.827452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.828049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.828480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.828896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.190544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:19.496761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.506704 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edbdec72-7490-4dc3-aad4-b57b8d8bdab8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1360 microversion: 2.1 time: 0.692125 Aug 27 03:10:19.518636 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 412/819] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1360 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:19.523941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9ef78ba3-e7f5-4104-9937-6caee77ef2c6 req-a11eb1c9-3c87-4efb-a321-d91d78d7141b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1496e039-42a3-469e-b6c9-8b6539bcff34", "tag": "48335665-e640-480f-bd82-a959289c828f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:19.550292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ef78ba3-e7f5-4104-9937-6caee77ef2c6 req-a11eb1c9-3c87-4efb-a321-d91d78d7141b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.551040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ef78ba3-e7f5-4104-9937-6caee77ef2c6 req-a11eb1c9-3c87-4efb-a321-d91d78d7141b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.551645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ef78ba3-e7f5-4104-9937-6caee77ef2c6 req-a11eb1c9-3c87-4efb-a321-d91d78d7141b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.572144 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9ef78ba3-e7f5-4104-9937-6caee77ef2c6 req-a11eb1c9-3c87-4efb-a321-d91d78d7141b service nova] Creating event network-changed:48335665-e640-480f-bd82-a959289c828f for instance 1496e039-42a3-469e-b6c9-8b6539bcff34 on n-h2-852086-5 Aug 27 03:10:19.585273 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9ef78ba3-e7f5-4104-9937-6caee77ef2c6 req-a11eb1c9-3c87-4efb-a321-d91d78d7141b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065058 Aug 27 03:10:19.586460 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 413/820] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:19.594147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:19.604363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.615583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.616405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.617021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.617922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.618591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.619024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.093828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.117086 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af86561c-d7fb-4654-8d56-e0505a5ce5f2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1318 microversion: 2.1 time: 0.528653 Aug 27 03:10:20.119056 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 414/821] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:19 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:20.126843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:20.128021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:20.141835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.143390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.144008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.145459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.147085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.148068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.408843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b16f3219-a0aa-424d-82a2-cab99e0f6b76 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef/action" status: 202 len: 0 microversion: 2.25 time: 4.611394 Aug 27 03:10:20.412173 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 408/822] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:10:15 2022] POST /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef/action => generated 0 bytes in 4619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:20.428131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-dcad94b0-2e52-40ab-94a2-d14d0f7d866e req-bb4ce662-8848-488c-bcf6-7f6be2670771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782b01df-d140-43ab-a3c7-72da7fae9f0a", "name": "network-vif-plugged", "status": "completed", "tag": "eda7639a-a67d-4718-a767-6b0da80ac50a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:20.501943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dcad94b0-2e52-40ab-94a2-d14d0f7d866e req-bb4ce662-8848-488c-bcf6-7f6be2670771 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.508970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dcad94b0-2e52-40ab-94a2-d14d0f7d866e req-bb4ce662-8848-488c-bcf6-7f6be2670771 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.509421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dcad94b0-2e52-40ab-94a2-d14d0f7d866e req-bb4ce662-8848-488c-bcf6-7f6be2670771 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.594527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-dcad94b0-2e52-40ab-94a2-d14d0f7d866e req-bb4ce662-8848-488c-bcf6-7f6be2670771 service nova] Creating event network-vif-plugged:eda7639a-a67d-4718-a767-6b0da80ac50a for instance 782b01df-d140-43ab-a3c7-72da7fae9f0a on n-h2-852086-5 Aug 27 03:10:20.605673 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-dcad94b0-2e52-40ab-94a2-d14d0f7d866e req-bb4ce662-8848-488c-bcf6-7f6be2670771 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188974 Aug 27 03:10:20.607111 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 409/823] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:20.622818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:20.624143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:20.635064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.636037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.636789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.638522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.639604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.640295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.903248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.923530 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e37fec1c-20fd-49a5-9cbf-bd8a757caf41 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 0.801820 Aug 27 03:10:20.936980 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 415/824] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:20 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:20.950669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:20.953326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:20.962924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.964678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.965376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.966741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.967611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.968360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.101449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.112196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b158e1d-0854-4501-8d92-5df884c5cab1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1210 microversion: 2.1 time: 0.173157 Aug 27 03:10:21.121502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.128219 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 416/825] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:20 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1210 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:21.136708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.137464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.142003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:21.148254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.148601 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-770368f2-6194-4afa-99bf-ebafbd370d12 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1470 microversion: 2.1 time: 0.535624 Aug 27 03:10:21.148769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.149175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.149902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.150502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.151551 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 410/826] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:20 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1470 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:21.168472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.180595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.181655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.194759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.195431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.195881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.196595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.197239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.198783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.411309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.423626 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81c1e045-2999-450e-a600-f1906a727156 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1267 microversion: 2.1 time: 0.294186 Aug 27 03:10:21.438997 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 417/827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1267 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:21.445925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.446832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.457323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.458958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.459689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.460677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.461348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.461994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.800873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.834932 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1e1d094-9ea9-46ff-b5bc-ff88c5b5f9a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1541 microversion: 2.1 time: 0.393444 Aug 27 03:10:21.835856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 418/828] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1541 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:21.847810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.850033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.867438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.869080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.870623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.872463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.874900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.875439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.020435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:22.038145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:22.041620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:22.046524 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f8e7bd4f-c81c-4a33-929d-0d8de6bebfb5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.891254 Aug 27 03:10:22.064045 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 411/829] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:22.064045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:22.064045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.078674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.079421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.080312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.081123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.081740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.082346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.216003 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4aa67d2-1872-4402-a445-349aad2d7e5f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9/action" status: 204 len: 0 microversion: 2.1 time: 0.162465 Aug 27 03:10:22.217892 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 412/830] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:22 2022] POST /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9/action => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:22.230209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:22.231392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.253419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.256349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:22.258718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.261136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.265216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.268824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.269509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c33b7385-8d18-429a-b794-93cc7d989de3 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1318 microversion: 2.1 time: 0.431298 Aug 27 03:10:22.271239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.271710 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 419/831] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:22.277519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:22.279779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.300855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.301768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.302464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.303432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.304163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.307743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.548702 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b5470f5-0671-4ef2-acc8-1fe88d4e7268 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.328755 Aug 27 03:10:22.549898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 413/832] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:10:22 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:22.555181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:22.556105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.575077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.575851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.578076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.582015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.583955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.584663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.857635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:22.868215 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd88f8e6-7ba5-41ec-916a-1433f97c4c3b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1274 microversion: 2.1 time: 0.317019 Aug 27 03:10:22.877318 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 414/833] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:22 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:22.882961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:22.889066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.903253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.904815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.905479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.907102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.912648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.913256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.319563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.360653 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44bd18a6-c263-4fa3-8864-3619fd155136 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1318 microversion: 2.1 time: 1.085256 Aug 27 03:10:23.362778 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 420/834] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:22 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1318 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:23.398716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.400306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.425485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.429216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.434557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.435473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.436896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.438008 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4c58a14-ab51-4b14-91e2-416826ebd96c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1470 microversion: 2.1 time: 0.559262 Aug 27 03:10:23.439978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.441128 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 415/835] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:22 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1470 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:23.458286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b02db686-3310-4a29-a0fa-ecaec01021e2 req-b7b32daf-50bf-4244-a9ef-0471172fa7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496e039-42a3-469e-b6c9-8b6539bcff34", "name": "network-vif-plugged", "status": "completed", "tag": "48335665-e640-480f-bd82-a959289c828f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:23.471383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.482132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b02db686-3310-4a29-a0fa-ecaec01021e2 req-b7b32daf-50bf-4244-a9ef-0471172fa7e0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.483877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b02db686-3310-4a29-a0fa-ecaec01021e2 req-b7b32daf-50bf-4244-a9ef-0471172fa7e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.484884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b02db686-3310-4a29-a0fa-ecaec01021e2 req-b7b32daf-50bf-4244-a9ef-0471172fa7e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.513319 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b02db686-3310-4a29-a0fa-ecaec01021e2 req-b7b32daf-50bf-4244-a9ef-0471172fa7e0 service nova] Creating event network-vif-plugged:48335665-e640-480f-bd82-a959289c828f for instance 1496e039-42a3-469e-b6c9-8b6539bcff34 on n-h2-852086-5 Aug 27 03:10:23.542268 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b02db686-3310-4a29-a0fa-ecaec01021e2 req-b7b32daf-50bf-4244-a9ef-0471172fa7e0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084541 Aug 27 03:10:23.543532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 416/836] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:23.550307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.551199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.558585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.559557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.560193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.561114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.561737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.562365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.803162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.818199 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d82a1c8-6497-4800-bf04-7bd2f3a17771 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1273 microversion: 2.1 time: 0.452868 Aug 27 03:10:23.830279 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 421/837] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:23 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1273 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:23.830709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.832233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.852133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.852812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.853442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.855983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.856472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.856879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.345827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.355952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.357447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.359159 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-083b1cff-fa13-4c1e-aa19-b39b5c953a3a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.813649 Aug 27 03:10:24.359928 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 417/838] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:23 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:24.365597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:24.366445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:24.373836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.374368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.374991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.387529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.388261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.388964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.528242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.540192 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fdad761e-3ace-4bb1-829f-d2a28e4bdc35 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1272 microversion: 2.1 time: 0.178868 Aug 27 03:10:24.544237 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 418/839] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:24.565186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:24.566138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:24.573706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.574578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.575243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.576183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.576839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.577467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.736171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.751576 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7506c436-654a-46e8-8de8-400bc66bd8fd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1318 microversion: 2.1 time: 0.929565 Aug 27 03:10:24.766218 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 422/840] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:23 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1318 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:24.773250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:24.774121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:24.785625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.786548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.787322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.792331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.792910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.794004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.992211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:25.002059 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d6d24d4a-c244-4d8c-aedf-5f63a8d5de58 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1468 microversion: 2.1 time: 0.456401 Aug 27 03:10:25.003040 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 419/841] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:25.012722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.014067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.023028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.023871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.024468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.025339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.025990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.026756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.386030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:25.404511 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2a1e3bc-08cf-46eb-9b7e-c6cc85475803 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1470 microversion: 2.1 time: 0.641956 Aug 27 03:10:25.406191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 423/842] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1470 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:25.415880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:25.417496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.424996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:25.434131 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-68c1b972-a87d-4c74-a33b-eb749ddee77a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.429536 Aug 27 03:10:25.434906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.436862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.438360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.440680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.442118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.443139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.450458 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 420/843] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:25 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:25.452672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.453287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.471520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.480010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.481824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.486624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.488720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.490298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.551585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lazy-loading 'flavor' on Instance uuid 782b01df-d140-43ab-a3c7-72da7fae9f0a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:25.693347 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4887ce6-3e3e-4dca-b2f9-78c00e34a5ae tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.284909 Aug 27 03:10:25.698732 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 424/844] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:25 2022] POST /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:25.709209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.710339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.740159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.742590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.746734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.747930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.750010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.750786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.068458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.094539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.098274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.101972 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ddc6d1e-bca8-479c-8e9f-332ce7454ed6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.652611 Aug 27 03:10:26.104174 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 421/845] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:25 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:26.127228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6506c3-9989-47ab-88c5-0258c00070d9", "name": "network-vif-plugged", "status": "completed", "tag": "de7751cd-3d09-4c1d-b715-b797a59a532e"}, {"server_uuid": "65bc4962-c5bb-4892-9540-3e657d0b2a54", "name": "network-vif-plugged", "status": "completed", "tag": "4215d1f8-9911-4f91-8d07-2d6aa16d23e7"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:26.163636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.165743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.167552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.197469 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] Creating event network-vif-plugged:de7751cd-3d09-4c1d-b715-b797a59a532e for instance 0c6506c3-9989-47ab-88c5-0258c00070d9 on n-h1-852086-5 Aug 27 03:10:26.198742 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] Creating event network-vif-plugged:4215d1f8-9911-4f91-8d07-2d6aa16d23e7 for instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 on n-h2-852086-5 Aug 27 03:10:26.207460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:10:26.231763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b0843f6b-0966-4ace-9335-2fa2ab6219a7 req-7a02c0bd-428e-44e1-864c-2dd9a8310be0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125830 Aug 27 03:10:26.236133 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 422/846] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:26.249271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:26.250465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.259545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.261213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.262279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.263607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.265502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.266121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.812925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.827529 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a38dda91-d033-48d3-bc6f-d790dd0bf915 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 1.123580 Aug 27 03:10:26.828628 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 425/847] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:25 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:26.835577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:26.837669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.852657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.853777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.855229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.857163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.859274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.861227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.896685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.918495 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6faa6b6-4938-4639-b330-09fa439da3da tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1476 microversion: 2.1 time: 0.680675 Aug 27 03:10:26.920647 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 423/848] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:26 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1476 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:26.930310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:26.931390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.940535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.941023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.941755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.942656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.943199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.943808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.216661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:27.245245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:27.365099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:27.375594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:27.392921 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff7092ff-4524-471b-9014-897eb20cab95 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1467 microversion: 2.1 time: 0.562401 Aug 27 03:10:27.408439 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 426/849] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:26 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1467 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:27.425994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.427830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.445506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.447721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.449440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.451004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.452120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.453164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.527029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:27.570983 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c880dcb9-0ea6-4bf4-b59c-12405e836560 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1470 microversion: 2.1 time: 0.648205 Aug 27 03:10:27.573196 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 424/850] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:26 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1470 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:27.582659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d8d4b011-2510-4f80-9c11-e15a2c3c95ba req-d91dcdd5-cce0-4d31-bb05-dda3da1ea823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4b4e2-b5c0-44d3-b520-c1571ceee8ef", "name": "network-vif-unplugged", "status": "completed", "tag": "4485a129-6aee-4bcf-a63f-aa2d14a240e9"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:27.623616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d8d4b011-2510-4f80-9c11-e15a2c3c95ba req-d91dcdd5-cce0-4d31-bb05-dda3da1ea823 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.625974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d8d4b011-2510-4f80-9c11-e15a2c3c95ba req-d91dcdd5-cce0-4d31-bb05-dda3da1ea823 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.627122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d8d4b011-2510-4f80-9c11-e15a2c3c95ba req-d91dcdd5-cce0-4d31-bb05-dda3da1ea823 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.657935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:27.665185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d8d4b011-2510-4f80-9c11-e15a2c3c95ba req-d91dcdd5-cce0-4d31-bb05-dda3da1ea823 service nova] Creating event network-vif-unplugged:4485a129-6aee-4bcf-a63f-aa2d14a240e9 for instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef on n-h1-852086-5 Aug 27 03:10:27.682100 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d8d4b011-2510-4f80-9c11-e15a2c3c95ba req-d91dcdd5-cce0-4d31-bb05-dda3da1ea823 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105788 Aug 27 03:10:27.685583 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 425/851] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:27.702144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.705220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.727327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:27.730030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.731580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.732891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.734770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.735858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.737805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.748391 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-018af619-3105-4dc4-b9d2-916e61955492 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.337970 Aug 27 03:10:27.749348 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 427/852] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:27.758244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.759827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.775244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.776711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.779377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.780189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.780870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.783645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.185410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.198251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.204700 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c263ceda-f55d-4159-847d-1037de94c0c6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 200 len: 1318 microversion: 2.1 time: 0.451439 Aug 27 03:10:28.208007 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 428/853] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:28.211292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.219108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.220649 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10a78200-6fb0-46e1-a508-08984eedaaee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.532548 Aug 27 03:10:28.234583 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 426/854] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:28.240967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:28.242075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:28.251348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-abb8740e-6e23-438d-8cae-4c375c940fce req-e01b7dab-9ab9-40e4-93f8-bda43cc78f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3433e1f2-f285-4966-92cb-9379c704c79f", "tag": "9ebee722-b0c2-440d-bedb-e10ee3451871"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:28.255805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.256685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.257389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.258421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.259672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.260926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.294696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-abb8740e-6e23-438d-8cae-4c375c940fce req-e01b7dab-9ab9-40e4-93f8-bda43cc78f58 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.296060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-abb8740e-6e23-438d-8cae-4c375c940fce req-e01b7dab-9ab9-40e4-93f8-bda43cc78f58 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.300422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-abb8740e-6e23-438d-8cae-4c375c940fce req-e01b7dab-9ab9-40e4-93f8-bda43cc78f58 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.344808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-abb8740e-6e23-438d-8cae-4c375c940fce req-e01b7dab-9ab9-40e4-93f8-bda43cc78f58 service nova] Creating event network-changed:9ebee722-b0c2-440d-bedb-e10ee3451871 for instance 3433e1f2-f285-4966-92cb-9379c704c79f on n-h1-852086-5 Aug 27 03:10:28.350776 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-abb8740e-6e23-438d-8cae-4c375c940fce req-e01b7dab-9ab9-40e4-93f8-bda43cc78f58 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141218 Aug 27 03:10:28.351829 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 429/855] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:28.372245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:28.373187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:28.381526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.387271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.388143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.389330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.390095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.390844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.679519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.697974 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-73795dd4-6dd9-4989-8436-af3c428c86bc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.461195 Aug 27 03:10:28.702972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 427/856] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:28 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:28.708580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:28.709181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:28.725381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.726585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.727603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.732155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.733526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.734916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.884377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.893970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d86555c-218d-4fb5-8f3d-0a49849c9140 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1459 microversion: 2.1 time: 0.540287 Aug 27 03:10:28.900307 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 430/857] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:28 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1459 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:28.909255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:28.914799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:28.942751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.943780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.944923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.946613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.949061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.949238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.365017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:29.372918 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b960a11-8cf6-4f90-934b-5a42e5ad145c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.470519 Aug 27 03:10:29.394856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 431/858] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:28 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:29.399185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:29.400594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:29.419018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.420164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.424752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.428264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.433535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.433943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.834178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:29.850065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce508213-a5f8-40b4-931a-d85114a3f312 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1470 microversion: 2.1 time: 1.145772 Aug 27 03:10:29.850709 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 428/859] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:28 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1470 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:29.870762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:29.878932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:29.892404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.893289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.893915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.894945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.895560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.902383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.439295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:30.459064 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3789861-ac88-48a5-9945-073349a1195b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 200 len: 1467 microversion: 2.1 time: 0.593128 Aug 27 03:10:30.461000 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 429/860] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:29 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 1467 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:30.470567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.472528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.484527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.486578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.491904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.493676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.496272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.498354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.505960 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7da721ee-5740-436e-ae69-5a35f20a79cd tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1610 microversion: 2.1 time: 1.110197 Aug 27 03:10:30.507060 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 432/861] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:29 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1610 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:30.517746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c4b4e2-b5c0-44d3-b520-c1571ceee8ef", "tag": "4485a129-6aee-4bcf-a63f-aa2d14a240e9"}, {"name": "network-changed", "server_uuid": "f1cdac2b-b8ff-487a-9b33-de6c454b9c4a", "tag": "a9c175a8-47b9-4f77-83cc-a385824167d1"}, {"name": "network-changed", "server_uuid": "9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982", "tag": "36227945-5d9d-4e96-9626-0e4cec52fea3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:30.538986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.539711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.540311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.559742 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] Creating event network-changed:4485a129-6aee-4bcf-a63f-aa2d14a240e9 for instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef on n-h1-852086-5 Aug 27 03:10:30.560777 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] Creating event network-changed:a9c175a8-47b9-4f77-83cc-a385824167d1 for instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a on n-h1-852086-5 Aug 27 03:10:30.561443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] Creating event network-changed:36227945-5d9d-4e96-9626-0e4cec52fea3 for instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 on n-h1-852086-5 Aug 27 03:10:30.574267 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-59029483-03b6-4b41-a2c4-e89482b4239d req-79997151-b04c-4c7d-9c2e-7b936e355c82 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.064843 Aug 27 03:10:30.576191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 433/862] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:30.585514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.587107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.595497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.596034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.596637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.597365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.597845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.598544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.826219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:30.836047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e918f3e0-b4c2-4e04-9c1a-f2a76d7be228 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.257929 Aug 27 03:10:30.849742 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 434/863] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:30.858578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.859786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.872853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.873727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.874876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.876158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.877157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.877957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.997818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.013705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.015520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.017094 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-236903c3-4286-4caf-8c10-e02e99a443de tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.554235 Aug 27 03:10:31.018304 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 430/864] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:31.027838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:31.038975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.040989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Searching by: {'reservation_id': 'r-cp3x8qi1', 'deleted': False, 'project_id': '587c41ae3469462b8099222b2bb2a278'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:31.054469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.055330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.056390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.057971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.059065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.060088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.126115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.141931 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-763680de-b53a-436c-911c-5b70655188f8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.291960 Aug 27 03:10:31.155901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 435/865] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:31.181131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:31.189307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.190250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.191260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.192830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.193875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.195498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.267675 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12452643-ee0c-4552-9ccf-c8e084000bbb tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.103034 Aug 27 03:10:31.269196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 436/866] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:10:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:31.279877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:31.281051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:31.294437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.295662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.296450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.297780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.298688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.300050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.359308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:10:31.551791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.566417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.567201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.567793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.686010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.701038 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2323dec-faa4-44f6-991b-2aee70a85d29 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1462 microversion: 2.1 time: 0.429323 Aug 27 03:10:31.701862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 437/867] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:31 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1462 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:31.711070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852086-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:31.720583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:31.736658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.739077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.741220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.742214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.743195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.744883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.790035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Lazy-loading 'flavor' on Instance uuid 782b01df-d140-43ab-a3c7-72da7fae9f0a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:31.815911 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 782b01df-d140-43ab-a3c7-72da7fae9f0a while it is in vm_state suspended Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Request method failure captured: Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a/action HTTP/1.1 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 97 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYroWrQ-88BFXvVlV6slvcDUc8CTIbk-9LvbeaBglxaZp1I5ZG2ZhNlw66D1YxdvAHzbU1USfiR7QmUcPDpi-6UAuYwNGMs7colKbxoYRKMfEvphxANoV19NWbi692n95HKsIXmxMez4kbegf44rPpdqWAsm5pV6sVWmo9qP2ewD6ho Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4c1c54cd7c8b4ee581a9e98ba82ac362 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveMigrationNegativeTest-961179662 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4c1c54cd7c8b4ee581a9e98ba82ac362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4c1c54cd7c8b4ee581a9e98ba82ac362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4c1c54cd7c8b4ee581a9e98ba82ac362", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4c1c54cd7c8b4ee581a9e98ba82ac362"}]}] Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-LiveMigrationNegativeTest-961179662 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4c1c54cd7c8b4ee581a9e98ba82ac362 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-961179662 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-LiveMigrationNegativeTest-961179662-project-admin Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: cb63a814dd9344d793e6339aeab5c081 Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-LiveMigrationNegativeTest-961179662-project-admin Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: {"os-migrateLive": {"host": "n-h1-852086-5", "block_migration": true, "disk_over_commit": false}} Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'os-migrateLive' instance 782b01df-d140-43ab-a3c7-72da7fae9f0a while it is in vm_state suspended Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '782b01df-d140-43ab-a3c7-72da7fae9f0a', 'body': {'os-migrateLive': {'host': 'n-h1-852086-5', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 782b01df-d140-43ab-a3c7-72da7fae9f0a in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.817920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 782b01df-d140-43ab-a3c7-72da7fae9f0a while it is in vm_state suspended Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 782b01df-d140-43ab-a3c7-72da7fae9f0a while it is in vm_state suspended Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 782b01df-d140-43ab-a3c7-72da7fae9f0a while it is in vm_state suspended {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:31.828703 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e35a813b-ad08-4c24-a435-d6f348e06074 tempest-LiveMigrationNegativeTest-961179662 tempest-LiveMigrationNegativeTest-961179662-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a/action" status: 409 len: 155 microversion: 2.1 time: 0.116277 Aug 27 03:10:31.835207 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 438/868] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:31 2022] POST /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a/action => generated 155 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:10:31.837714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:31.838120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:31.845377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.845887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.846574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.847539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.848239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.848866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.922923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a95659a1-3807-4702-a909-b697b632a9b1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?reservation_id=r-cp3x8qi1" status: 200 len: 2927 microversion: 2.1 time: 0.902474 Aug 27 03:10:31.938225 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 431/869] 10.222.0.69 () {58 vars in 1197 bytes} [Sat Aug 27 03:10:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-cp3x8qi1 => generated 2927 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:31.940149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:31.941989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:31.955608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.958853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.961714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.963262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.964581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.965333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.019027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:32.201188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.210873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7047b8e9-138a-444e-919e-2789b7812e75 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "DELETE /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 204 len: 0 microversion: 2.1 time: 0.282721 Aug 27 03:10:32.216972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 432/870] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:31 2022] DELETE /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:32.225031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.226209 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09998e12-a2aa-4b72-938f-3fdbe5858103 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1462 microversion: 2.1 time: 0.392508 Aug 27 03:10:32.226484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.235116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.236172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.237294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.238856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.240174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.240331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.245353 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 439/871] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:31 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1462 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:32.257232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6d0ff5d-fddb-488c-b61d-05c760a53fa1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.325390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.server_groups [None req-c6d0ff5d-fddb-488c-b61d-05c760a53fa1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Querying cell c415b947-a476-436d-b81a-456a5f662c42(cell1) for 2 instances {{(pid=122408) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 03:10:32.326527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0ff5d-fddb-488c-b61d-05c760a53fa1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.327327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0ff5d-fddb-488c-b61d-05c760a53fa1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.328342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0ff5d-fddb-488c-b61d-05c760a53fa1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.386257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6d0ff5d-fddb-488c-b61d-05c760a53fa1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/a44222a2-5c52-4d8c-a3fc-2cd318d4cca8" status: 200 len: 266 microversion: 2.1 time: 0.137375 Aug 27 03:10:32.386859 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 440/872] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/os-server-groups/a44222a2-5c52-4d8c-a3fc-2cd318d4cca8 => generated 266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:32.394583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.395650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.405854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.406363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.407396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.408333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.409152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.409903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.615664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.622106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.631370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.634304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.636738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14e4f995-3d55-4302-a03f-f46d6dc27901 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.248414 Aug 27 03:10:32.636975 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2c24c42e-a017-408c-b39d-0eccb748480d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.417360 Aug 27 03:10:32.642252 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 433/874] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:32.642525 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 441/874] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:32.645828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.646982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.657867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.659377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.660298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.661106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.662464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.663395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.664195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.668406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.679034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.679695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.680622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.681714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.683093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.683796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.878835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.893706 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60b729d9-96ab-4842-be6a-dcc965e304e0 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1465 microversion: 2.1 time: 0.254138 Aug 27 03:10:32.895110 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 442/875] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1465 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:32.903929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1a38a3e-730c-4a0d-9551-b19110ff68b8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'create', calling method: .version_select at 0x7fe45c79e790>, body: {"keypair": {"name": "tempest-keypair-237474216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK1GNBWEpUXo2wuD7jWUsRiLS07NthEJxrbxumbppr6WdoPRP049dxA5ekBdgqwPup/G+70BT9nnO52D1FQfoCOYPqdDaED+t4L60afA3sDyilpCoDNaQG5wZQS+al0Hg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:32.929396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e1a38a3e-730c-4a0d-9551-b19110ff68b8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for project 82d80176cbd24a32922fe33269a9ae59. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:32.939295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e1a38a3e-730c-4a0d-9551-b19110ff68b8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for user 3ad6820606064210a5a0e2fa2bfa4bb7 and project 82d80176cbd24a32922fe33269a9ae59. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:32.971736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1a38a3e-730c-4a0d-9551-b19110ff68b8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075085 Aug 27 03:10:32.972344 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 443/876] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:10:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:32.977459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.978145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.986349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.986863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.987286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.988212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.988916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.989470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.019246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:33.044483 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fa304dad-33e2-4379-88a9-ab7f6904260f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.404740 Aug 27 03:10:33.047396 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 434/877] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:33.374465 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c1c7af8-9e45-40ea-959c-c1abffcaa1ac tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 200 len: 1618 microversion: 2.1 time: 0.400390 Aug 27 03:10:33.391380 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 444/878] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 1618 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:33.419661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:33.421343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:33.434210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.435086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.436212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.437488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.438335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.439082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.676178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:33.678237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:33.692286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.693494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.694333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.695240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.695972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.696506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.795878 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3d46161f-0e77-406a-9989-dfced226f03c tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 200 len: 1618 microversion: 2.1 time: 0.384730 Aug 27 03:10:33.802921 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 435/879] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:33 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 1618 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:33.827988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:33.828911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:33.848994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.849590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.850520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.853104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.853514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.856227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:34.159393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:34.174651 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86a56564-48bb-428e-9b00-5d0351faf70c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.505681 Aug 27 03:10:34.178652 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 445/880] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:33 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:34.188492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83dd6b7c-722a-429d-b5b3-94ee31b2ab1e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: .version_select at 0x7fe45cd44a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2123826401", "policies": ["anti-affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:34.242065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-83dd6b7c-722a-429d-b5b3-94ee31b2ab1e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:34.251916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-83dd6b7c-722a-429d-b5b3-94ee31b2ab1e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:34.315854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:34.347286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:34.351639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-83dd6b7c-722a-429d-b5b3-94ee31b2ab1e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:34.353418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:34.355853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bdc6f3e8-12a5-426e-bb11-3fcd178163e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.551103 Aug 27 03:10:34.362962 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 436/881] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:33 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:34.368986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-83dd6b7c-722a-429d-b5b3-94ee31b2ab1e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:34.369958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:34.370713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:34.386008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:34.389205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:34.389774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:34.391046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:34.391596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:34.395284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:34.397921 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83dd6b7c-722a-429d-b5b3-94ee31b2ab1e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.216058 Aug 27 03:10:34.399962 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 446/882] 10.222.0.69 () {60 vars in 1174 bytes} [Sat Aug 27 03:10:34 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:34.413430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:34.414908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:34.430766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:34.432704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:34.433466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:34.441625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:34.447182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:34.450851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:34.829161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:34.837956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:34.841050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3749370b-5ff3-464d-8400-fda96ac54398 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.436147 Aug 27 03:10:34.854749 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 447/883] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:34 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:34.860969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-624636184", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fc4e2058-4f1f-46af-9394-dd13393d7437"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:34.876238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:34.940365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:35.016691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:35.038203 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10ca0146-f7f3-4c4d-84b1-0b835fd2c1ac tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1465 microversion: 2.1 time: 0.674413 Aug 27 03:10:35.038809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 437/884] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:34 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1465 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:35.207760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:35.208398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:35.226070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.229854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.230414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.231390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.232027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.232677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.704141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:35.705233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:35.705880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:35.706561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:35.707226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:35.758807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.759334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.760764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.761973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.762783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.763240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.784279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:35.790436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:35.798646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:35.802095 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4561cfa3-e51e-426e-b48c-2ea2ac64eec7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.600203 Aug 27 03:10:35.803451 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 438/885] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:35 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:35.810089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:35.811070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:35.817849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.818724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.819415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.820402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.821098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.823055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.838989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Going to run 2 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:35.843916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:35.940210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122408) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 03:10:35.981797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:35.997131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:36.073904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:36.083686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:36.101525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=094efd70-ba42-484c-bdf3-d92d44463aa5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:36.211494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:36.217597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:36.269215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:36.291884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:36.301404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:36.305277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:36.307698 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3c1d6bed-f6b8-4ef0-8d32-05a592729cd2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.502604 Aug 27 03:10:36.318375 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 439/886] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:35 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:36.319109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:36.343536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:36.347776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:36.373398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:36.396945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:36.398085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:36.401916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:36.403240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:36.404312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:36.425064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:36.497652 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-84876229-ed2b-4573-a4d4-8c970c9d7e2f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.639895 Aug 27 03:10:36.505146 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 448/887] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:34 2022] POST /compute/v2.1/servers => generated 32 bytes in 1649 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 03:10:36.516721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:36.519056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:36.557368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:36.560119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:36.565021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:36.566213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:36.566828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:36.569537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:36.867221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:36.883048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34a38960-61ef-4a30-af65-27b0299360c5 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 200 len: 1294 microversion: 2.1 time: 0.375145 Aug 27 03:10:36.887822 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 449/888] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:36 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 1294 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:36.912121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-60a45bdd-d75a-487a-8223-d4eaae359d2e req-62d3f729-4a91-460c-ab43-d688dfb6b696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782b01df-d140-43ab-a3c7-72da7fae9f0a", "name": "network-vif-deleted", "tag": "eda7639a-a67d-4718-a767-6b0da80ac50a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:36.966661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-60a45bdd-d75a-487a-8223-d4eaae359d2e req-62d3f729-4a91-460c-ab43-d688dfb6b696 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:36.968134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-60a45bdd-d75a-487a-8223-d4eaae359d2e req-62d3f729-4a91-460c-ab43-d688dfb6b696 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:36.969348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-60a45bdd-d75a-487a-8223-d4eaae359d2e req-62d3f729-4a91-460c-ab43-d688dfb6b696 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.000039 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-60a45bdd-d75a-487a-8223-d4eaae359d2e req-62d3f729-4a91-460c-ab43-d688dfb6b696 service nova] Creating event network-vif-deleted:eda7639a-a67d-4718-a767-6b0da80ac50a for instance 782b01df-d140-43ab-a3c7-72da7fae9f0a on n-h2-852086-5 Aug 27 03:10:37.006567 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-60a45bdd-d75a-487a-8223-d4eaae359d2e req-62d3f729-4a91-460c-ab43-d688dfb6b696 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116742 Aug 27 03:10:37.008177 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 450/889] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:37.016358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:37.022560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:37.023915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Searching by: {'deleted': False, 'project_id': '587c41ae3469462b8099222b2bb2a278'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:37.049539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.050837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.053181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.055845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.057492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.058537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.146151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:10:37.199708 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31c2a51e-9c5d-4dfd-a141-48d534ed37a7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.189627 Aug 27 03:10:37.208742 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 451/890] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:10:37 2022] GET /compute/v2.1/servers => generated 1662 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:37.208742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:37.208742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:37.216021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.216713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.217325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.218289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.219000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.219603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.644860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:37.663059 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c234fa40-0eb0-4033-a1df-13cc955edbfb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 1.342919 Aug 27 03:10:37.663663 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 440/891] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:36 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:37.672386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c2e0ac8-f53a-4bca-8fd0-276ce9f0c51b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:37.681274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c2e0ac8-f53a-4bca-8fd0-276ce9f0c51b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:37.828079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5c2e0ac8-f53a-4bca-8fd0-276ce9f0c51b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:37.835652 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c2e0ac8-f53a-4bca-8fd0-276ce9f0c51b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1218 microversion: 2.1 time: 0.170742 Aug 27 03:10:37.850953 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 441/892] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:37 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:37.869440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:37.872506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:37.885427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.885929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.886426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.887386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.888389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.889243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.332678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:38.364194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:38.365833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:38.367366 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-200e136b-910d-4c81-8be4-ed8ff8b9354c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.514954 Aug 27 03:10:38.377102 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 442/893] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:37 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:38.390756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8345d4bb-7430-4336-ac36-416d902f3c58 req-18268c65-0f56-48b3-95bd-7b5bd94f04b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cdac2b-b8ff-487a-9b33-de6c454b9c4a", "name": "network-vif-plugged", "status": "completed", "tag": "a9c175a8-47b9-4f77-83cc-a385824167d1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:38.427116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8345d4bb-7430-4336-ac36-416d902f3c58 req-18268c65-0f56-48b3-95bd-7b5bd94f04b2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.432741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8345d4bb-7430-4336-ac36-416d902f3c58 req-18268c65-0f56-48b3-95bd-7b5bd94f04b2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.441874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8345d4bb-7430-4336-ac36-416d902f3c58 req-18268c65-0f56-48b3-95bd-7b5bd94f04b2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.466135 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8345d4bb-7430-4336-ac36-416d902f3c58 req-18268c65-0f56-48b3-95bd-7b5bd94f04b2 service nova] Creating event network-vif-plugged:a9c175a8-47b9-4f77-83cc-a385824167d1 for instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a on n-h1-852086-5 Aug 27 03:10:38.487979 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8345d4bb-7430-4336-ac36-416d902f3c58 req-18268c65-0f56-48b3-95bd-7b5bd94f04b2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107203 Aug 27 03:10:38.489227 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 443/894] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:38.498761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:38.502098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: 782b01df-d140-43ab-a3c7-72da7fae9f0a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:38.524508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.525300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.526495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.528358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.530711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.531331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.565530 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] HTTP exception thrown: Instance 782b01df-d140-43ab-a3c7-72da7fae9f0a could not be found. Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Request method failure captured: Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a HTTP/1.1 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYrmM2yEH5Ht7OHzMDOEB2ovP9bhrECrzYEdb6eh8LuB_-DWCJ77CgPH3lwdMTXOFatwDespY3eCzguZ1kya9pYGTujHoOMLHh5HXiqUEmoqsYAu1aUWDxZWp05Vn-JpahM7Gb5DmnM1NueXlSMMT3je-9wmpNbRg-9iqCSjttCUXQI Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: fd9c7fa6872a425298d2b501e9121af3 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-LiveMigrationNegativeTest-1180790414 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fd9c7fa6872a425298d2b501e9121af3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fd9c7fa6872a425298d2b501e9121af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fd9c7fa6872a425298d2b501e9121af3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fd9c7fa6872a425298d2b501e9121af3"}]}] Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-LiveMigrationNegativeTest-1180790414 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: fd9c7fa6872a425298d2b501e9121af3 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1180790414 Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-LiveMigrationNegativeTest-1180790414-project Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: b7d0abe77aa743688dbae2f2e7064f1c Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-LiveMigrationNegativeTest-1180790414-project Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 782b01df-d140-43ab-a3c7-72da7fae9f0a could not be found. Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '782b01df-d140-43ab-a3c7-72da7fae9f0a'} Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782b01df-d140-43ab-a3c7-72da7fae9f0a could not be found. Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782b01df-d140-43ab-a3c7-72da7fae9f0a could not be found. Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:38.570633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:38.575417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:38.575417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:38.575417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:38.575417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:38.575417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:38.575417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782b01df-d140-43ab-a3c7-72da7fae9f0a could not be found. Aug 27 03:10:38.575417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:38.575936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:38.577201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Returning 404 to user: Instance 782b01df-d140-43ab-a3c7-72da7fae9f0a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:38.580696 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14980a9c-2ecd-470f-99bc-4459f311d6ef tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a" status: 404 len: 111 microversion: 2.1 time: 0.086810 Aug 27 03:10:38.581855 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 444/895] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:38 2022] GET /compute/v2.1/servers/782b01df-d140-43ab-a3c7-72da7fae9f0a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:38.591979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:38.594527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:38.600050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77d7dad1-ee0b-4946-9e39-f427c627e700 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 1.397045 Aug 27 03:10:38.622701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.624031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.624385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.625291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.627543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.628662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.633597 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 452/896] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:37 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:38.699434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:38.702287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:38.703277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:38.719228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.722836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.723596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.726945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.730999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.731761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.864433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:38.889182 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee2f7bee-bb54-4f88-80ee-4dc6bd4bf2e3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 204 len: 0 microversion: 2.1 time: 0.301736 Aug 27 03:10:38.893735 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 445/897] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:38 2022] DELETE /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:10:38.910863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:38.914684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:38.933049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.935267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.938216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.939415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.940292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.941415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.126436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.152872 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-401c8189-0703-4d09-8eeb-0bc2ce916f26 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1270 microversion: 2.1 time: 0.252694 Aug 27 03:10:39.159720 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 446/898] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:38 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1270 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:39.176868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:39.177791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:39.203939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.204527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.205254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.206406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.207685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.208226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.316634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.332669 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3234268d-5635-4468-8d48-c47bb9b21fad tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.639036 Aug 27 03:10:39.336417 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 453/899] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:38 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:39.408607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:39.410978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:39.422440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.423119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.424287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.425345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.426048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.426707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.521222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.537867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-785d0f2e-f734-40f5-ab3e-8fcae3050521 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1475 microversion: 2.1 time: 0.376024 Aug 27 03:10:39.571370 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 447/900] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:39 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1475 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:39.636299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:39.639205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:39.649508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.650680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.652014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.653336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.654419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.655281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.710485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.725659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.727501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.729743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b3c85d1-f3f2-4473-b6f4-138d22ce2933 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1568 microversion: 2.25 time: 0.332458 Aug 27 03:10:39.730336 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 454/901] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:39 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1568 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:39.735377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86188160-3408-4ca8-aef9-17dc8518d36a tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '.version_select at 0x7fe45c4e2ca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:39.739916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86188160-3408-4ca8-aef9-17dc8518d36a tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:39.741709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86188160-3408-4ca8-aef9-17dc8518d36a tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:39.742384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86188160-3408-4ca8-aef9-17dc8518d36a tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:39.763112 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86188160-3408-4ca8-aef9-17dc8518d36a tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.031507 Aug 27 03:10:39.778546 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 455/902] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:10:39 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:39.803627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8588a274-d42c-41ee-bb42-2601911968ee tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:39.817021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8588a274-d42c-41ee-bb42-2601911968ee tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018545 Aug 27 03:10:39.817990 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 456/903] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:10:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:39.838578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3f972ab-ff1f-4415-a12f-da23f26d3bdb tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-97365457", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:39.871395 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3f972ab-ff1f-4415-a12f-da23f26d3bdb tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.039340 Aug 27 03:10:39.871774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.879005 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 457/904] 10.222.0.69 () {60 vars in 1146 bytes} [Sat Aug 27 03:10:39 2022] POST /compute/v2.1/flavors => generated 497 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:39.891685 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf673c56-cab1-45c1-903a-5c69f94edd3d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.262746 Aug 27 03:10:39.892601 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 448/905] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:39 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:39.897966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ea438b6-8810-4dfc-b78b-d65610c598fc tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:39.909426 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ea438b6-8810-4dfc-b78b-d65610c598fc tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018055 Aug 27 03:10:39.910004 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 458/906] 10.222.0.69 () {58 vars in 1182 bytes} [Sat Aug 27 03:10:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:40.067940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-445119887", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:40.180879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:40.182565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:40.204832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:40.207442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.208213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.209154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.210474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.211203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.211895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.375766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:40.394967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4de159a8-f665-4bbf-9486-bd3f2c863564 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1270 microversion: 2.1 time: 0.221359 Aug 27 03:10:40.408082 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 459/907] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:40 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:40.408082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:40.408082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:40.427989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.428820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.429540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.433901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.434763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.435569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.684425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:40.697727 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91a2afff-7563-4fd5-81e9-b6561ae62aab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.300521 Aug 27 03:10:40.698762 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 460/908] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:40 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:40.733783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:40.737321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:40.755183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.755927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.756541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.757412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.758012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.758595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.951726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:40.953656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:40.954700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:40.955545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:40.957461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:40.986842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.989203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.990829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.992711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.994080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.996370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.032713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:41.036367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:41.048420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for user 3ad6820606064210a5a0e2fa2bfa4bb7 and project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:41.051507 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63c47477-eb22-4006-b58f-f8dd3b144763 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1475 microversion: 2.1 time: 0.343236 Aug 27 03:10:41.062892 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 461/909] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:40 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1475 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:41.076307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:41.082216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:41.099339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:41.099984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:41.126614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.129412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.130917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.137056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.139464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.142904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.157751 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91cb0f7e-7b00-41d0-b9f8-7edd18138c03 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.097230 Aug 27 03:10:41.159445 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 449/910] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:41.173567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:41.174408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:41.182740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.183602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.184616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.191922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.193978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.195208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.630097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:41.655775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:41.666363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:41.671183 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eaa36800-3d16-4b95-abb5-264a675a2d52 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1543 microversion: 2.25 time: 0.589839 Aug 27 03:10:41.673539 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 462/911] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:41 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1543 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:41.724838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7a9e71a7-6515-4a7f-937f-86774782abee req-06b75b5b-57f5-4d84-9ff5-b9efb3600f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982", "name": "network-vif-plugged", "status": "completed", "tag": "36227945-5d9d-4e96-9626-0e4cec52fea3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:41.733648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:41.745853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a9e71a7-6515-4a7f-937f-86774782abee req-06b75b5b-57f5-4d84-9ff5-b9efb3600f82 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.746848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a9e71a7-6515-4a7f-937f-86774782abee req-06b75b5b-57f5-4d84-9ff5-b9efb3600f82 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.747194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a9e71a7-6515-4a7f-937f-86774782abee req-06b75b5b-57f5-4d84-9ff5-b9efb3600f82 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.757729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:41.781937 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7a9e71a7-6515-4a7f-937f-86774782abee req-06b75b5b-57f5-4d84-9ff5-b9efb3600f82 service nova] Creating event network-vif-plugged:36227945-5d9d-4e96-9626-0e4cec52fea3 for instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 on n-h1-852086-5 Aug 27 03:10:41.795900 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b3e235f-f3dd-42c8-9870-c2ec4cfe02fd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.634847 Aug 27 03:10:41.802266 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7a9e71a7-6515-4a7f-937f-86774782abee req-06b75b5b-57f5-4d84-9ff5-b9efb3600f82 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105055 Aug 27 03:10:41.803212 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 463/912] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:41.811099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c45ce70-5726-4bee-8f7f-d047a0f32816 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:41.812051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c45ce70-5726-4bee-8f7f-d047a0f32816 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:41.817288 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 450/913] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:41 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:41.850190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:41.853262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:41.872258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.872912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.873360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.874092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.874575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.875000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.993983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c45ce70-5726-4bee-8f7f-d047a0f32816 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:42.005812 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c45ce70-5726-4bee-8f7f-d047a0f32816 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1278 microversion: 2.1 time: 0.201284 Aug 27 03:10:42.007140 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 464/914] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:41 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:42.014307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9bfeceff-2652-4b93-a202-aad6590da1ff tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '.version_select at 0x7fe45cfcdaf0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:42.018946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bfeceff-2652-4b93-a202-aad6590da1ff tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.019579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bfeceff-2652-4b93-a202-aad6590da1ff tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.020425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bfeceff-2652-4b93-a202-aad6590da1ff tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.034528 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9bfeceff-2652-4b93-a202-aad6590da1ff tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.024428 Aug 27 03:10:42.042783 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 465/915] 10.222.0.69 () {60 vars in 1184 bytes} [Sat Aug 27 03:10:42 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:42.066826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:42.071679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:42.073271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:42.084815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.088591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.094906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.098963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.102742 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34799e68-dbfe-45d9-905f-57a39728d562 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1270 microversion: 2.1 time: 0.284073 Aug 27 03:10:42.104905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.106672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.109483 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 451/916] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:41 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1270 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:42.132877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:42.136107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:42.178821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.180360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.180810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.199026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.200295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.206386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.603139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:42.623641 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b2e72502-ba93-484d-93ad-7fcf3d908166 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1315 microversion: 2.1 time: 0.578651 Aug 27 03:10:42.628298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 466/917] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:42 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:42.635410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:42.636131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:42.652063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.652511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.652938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.653690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.654149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.661093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.801276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:42.846610 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81946e78-6f97-4473-bdd4-516d52a6ac4a tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1304 microversion: 2.1 time: 0.216712 Aug 27 03:10:42.867869 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 467/918] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:42 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1304 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:42.883501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2adddb08-f9f9-46b0-9031-7805516bed1c req-8f170013-f334-4a1b-991a-61a33581d265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f651cdea-2174-4ec4-8e1e-e357a81d3b08", "name": "network-vif-deleted", "tag": "03fb416f-f10e-4fc5-bb78-7b7f20b5d114"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:42.897499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2adddb08-f9f9-46b0-9031-7805516bed1c req-8f170013-f334-4a1b-991a-61a33581d265 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.899982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2adddb08-f9f9-46b0-9031-7805516bed1c req-8f170013-f334-4a1b-991a-61a33581d265 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.901002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2adddb08-f9f9-46b0-9031-7805516bed1c req-8f170013-f334-4a1b-991a-61a33581d265 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.946603 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2adddb08-f9f9-46b0-9031-7805516bed1c req-8f170013-f334-4a1b-991a-61a33581d265 service nova] Creating event network-vif-deleted:03fb416f-f10e-4fc5-bb78-7b7f20b5d114 for instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 on n-h1-852086-5 Aug 27 03:10:42.962576 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2adddb08-f9f9-46b0-9031-7805516bed1c req-8f170013-f334-4a1b-991a-61a33581d265 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091125 Aug 27 03:10:42.964784 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 468/919] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:42.986363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:42.993020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:42.996706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:43.000382 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b67bdefb-d73e-4dfd-836e-78489e59d7eb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 2036 microversion: 2.25 time: 0.889262 Aug 27 03:10:43.001115 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 452/920] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:42 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 2036 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:43.008164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.010984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.012177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.025618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.031790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.033155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.050403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:43.051017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:43.063385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.067150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.068635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.072932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.073992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.074803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.299064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:43.311496 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d256310f-60b6-4aae-a10f-baddf2e8e4c7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1330 microversion: 2.1 time: 0.276531 Aug 27 03:10:43.317669 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 453/921] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:43 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1330 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:43.333221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16eb6b85-e688-48c9-b040-b8e70c21a720 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Action: 'create', calling method: .version_select at 0x7fe45cae80d0>, body: {"keypair": {"name": "tempest-keypair-1345394866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqcFycuXTyFfbORcH0gD+I524RpOKZV9jD0yD68hzJJKYREFlvkHtY4KFdj2RQygMRK6gHlaavHoL/xlqWQ6xLTi+03wV99FYv3N2k7G4tpacGgIADoG8hYxPB71lcJ8A=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:43.380471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-16eb6b85-e688-48c9-b040-b8e70c21a720 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for project 99adbc97973247998f0bfbbc486a410e. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:43.405532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-16eb6b85-e688-48c9-b040-b8e70c21a720 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for user 21a64079d45547ba80c22c309d216438 and project 99adbc97973247998f0bfbbc486a410e. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:43.468762 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16eb6b85-e688-48c9-b040-b8e70c21a720 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.149560 Aug 27 03:10:43.469724 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 454/922] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:10:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:10:43.481003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:43.481597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:43.501723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.502059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.502534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.503268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.503724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.504144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.540674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:43.550607 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-544b4015-0f65-4302-8ccd-042b948e15a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1314 microversion: 2.1 time: 0.583549 Aug 27 03:10:43.551193 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 469/923] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:42 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:43.662538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:43.664627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:43.680917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:43.683555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.684307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.684856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.686410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.686797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.687598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.721389 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce1340a5-33bd-41fb-b388-f639c52f9136 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1278 microversion: 2.1 time: 0.248592 Aug 27 03:10:43.726880 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 455/924] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:43 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:43.889402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:43.894792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:43.911548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.912585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.912585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.913217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.913682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.914114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.976995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.978147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.979680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.980331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lazy-loading 'fault' on Instance uuid f651cdea-2174-4ec4-8e1e-e357a81d3b08 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:44.038949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:44.099542 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59c4b84d-0e96-4171-be59-949ebc5829a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1503 microversion: 2.1 time: 0.438809 Aug 27 03:10:44.117043 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 470/925] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:43 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:44.133280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1206129246"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:44.134153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:44.146792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.147378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.148707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.149518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.150050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.158524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.182494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d0abe77aa743688dbae2f2e7064f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9c7fa6872a425298d2b501e9121af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:44.245630 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c139fabc-f45e-42a1-958a-80ef3142b2c3 tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 200 len: 1309 microversion: 2.1 time: 0.358476 Aug 27 03:10:44.249094 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 456/926] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:43 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:44.339282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:44.340293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:44.365381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.368547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.369649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.374206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.375456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.378627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.604998 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Adding security group fb0de87c-e495-445c-bda9-0359e71f42b5 to port a9c175a8-47b9-4f77-83cc-a385824167d1 Aug 27 03:10:44.667652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:44.692243 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4f30466-4861-4575-b53e-30be5abcd174 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1338 microversion: 2.1 time: 0.361584 Aug 27 03:10:44.693730 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 457/927] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:44 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1338 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:44.707899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:44.709671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:44.752909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.756554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.757227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.758612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.761319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.761972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.800039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:45.274869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:45.307029 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c261dd0b-3b40-47e8-9edb-a13f744d77d5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1464 microversion: 2.1 time: 0.607414 Aug 27 03:10:45.324664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 458/928] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:44 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1464 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:45.346816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:45.347689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:45.357192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.358083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.358798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.359802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.360685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.361328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.662329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:45.685051 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c62114af-cde4-48b9-9546-7334b2c4aa37 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1276 microversion: 2.1 time: 0.357516 Aug 27 03:10:45.703590 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 459/929] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:45 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1276 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:45.716038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:45.717529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] [instance: f651cdea-2174-4ec4-8e1e-e357a81d3b08] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:45.724898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.725730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.726470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.727930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.728717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.729791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.764011 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] HTTP exception thrown: Instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 could not be found. Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Request method failure captured: Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 HTTP/1.1 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYrmM2yEH5Ht7OHzMDOEB2ovP9bhrECrzYEdb6eh8LuB_-DWCJ77CgPH3lwdMTXOFatwDespY3eCzguZ1kya9pYGTujHoOMLHh5HXiqUEmoqsYAu1aUWDxZWp05Vn-JpahM7Gb5DmnM1NueXlSMMT3je-9wmpNbRg-9iqCSjttCUXQI Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: fd9c7fa6872a425298d2b501e9121af3 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-LiveMigrationNegativeTest-1180790414 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fd9c7fa6872a425298d2b501e9121af3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fd9c7fa6872a425298d2b501e9121af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fd9c7fa6872a425298d2b501e9121af3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fd9c7fa6872a425298d2b501e9121af3"}]}] Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-LiveMigrationNegativeTest-1180790414 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: fd9c7fa6872a425298d2b501e9121af3 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1180790414 Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-LiveMigrationNegativeTest-1180790414-project Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: b7d0abe77aa743688dbae2f2e7064f1c Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-LiveMigrationNegativeTest-1180790414-project Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 could not be found. Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f651cdea-2174-4ec4-8e1e-e357a81d3b08'} Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 could not be found. Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 could not be found. Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:45.766255 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.770132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:45.770132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:45.770132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:45.770132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:45.770132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:45.770132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 could not be found. Aug 27 03:10:45.770132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.772383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] Returning 404 to user: Instance f651cdea-2174-4ec4-8e1e-e357a81d3b08 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:45.773494 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7e87ebcd-137a-4d2b-b72e-d0ae232ce19e tempest-LiveMigrationNegativeTest-1180790414 tempest-LiveMigrationNegativeTest-1180790414-project] 10.222.0.69 "GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08" status: 404 len: 111 microversion: 2.1 time: 0.068916 Aug 27 03:10:45.774693 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 460/930] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:45 2022] GET /compute/v2.1/servers/f651cdea-2174-4ec4-8e1e-e357a81d3b08 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:46.047612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7bab5673-2f2b-4375-9d0b-382fec1079f0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a/action" status: 202 len: 0 microversion: 2.1 time: 1.915833 Aug 27 03:10:46.053564 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 471/931] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:44 2022] POST /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a/action => generated 0 bytes in 1921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:46.077412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-676f31ae-e095-4bbd-9136-4aebf6f177a0 req-4df527b2-cdcb-4c59-9c2a-8eb6def03366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094efd70-ba42-484c-bdf3-d92d44463aa5", "tag": "3538fc00-b7da-4311-8edd-a7b29893993a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:46.116033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-676f31ae-e095-4bbd-9136-4aebf6f177a0 req-4df527b2-cdcb-4c59-9c2a-8eb6def03366 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.117197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-676f31ae-e095-4bbd-9136-4aebf6f177a0 req-4df527b2-cdcb-4c59-9c2a-8eb6def03366 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.118763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-676f31ae-e095-4bbd-9136-4aebf6f177a0 req-4df527b2-cdcb-4c59-9c2a-8eb6def03366 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.186551 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-676f31ae-e095-4bbd-9136-4aebf6f177a0 req-4df527b2-cdcb-4c59-9c2a-8eb6def03366 service nova] Creating event network-changed:3538fc00-b7da-4311-8edd-a7b29893993a for instance 094efd70-ba42-484c-bdf3-d92d44463aa5 on n-h2-852086-5 Aug 27 03:10:46.205659 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-676f31ae-e095-4bbd-9136-4aebf6f177a0 req-4df527b2-cdcb-4c59-9c2a-8eb6def03366 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149005 Aug 27 03:10:46.206274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 472/932] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:46.238703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:46.241728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:46.271336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.278653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.279254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.280031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.280508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.280939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.359401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:46.387074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Searching by: {'deleted': False, 'project_id': '5b35a3a15ebb4e1f8c2ac185941e5fda'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:46.390493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:46.410288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.411021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.411676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.418787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.419558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.420194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.644259 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0d0529a-51cd-4a1e-a334-db947a35fe7a tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.864942 Aug 27 03:10:46.645737 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 461/933] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:10:45 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:46.652482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-726731045"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:46.654010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:46.669666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.679435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.680727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.683466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.685969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.686711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.700996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:46.710565 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bb4fb3f-a07f-4527-bbf2-37b0a95babf9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1336 microversion: 2.1 time: 0.500113 Aug 27 03:10:46.714293 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 473/934] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:46 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1336 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:46.723424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ed9190f8-0e79-450b-bdab-6a5c3ffb5fe6 req-92f56c08-84f3-4f9c-ae61-1c785330c4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cdac2b-b8ff-487a-9b33-de6c454b9c4a", "tag": "a9c175a8-47b9-4f77-83cc-a385824167d1"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:46.774669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ed9190f8-0e79-450b-bdab-6a5c3ffb5fe6 req-92f56c08-84f3-4f9c-ae61-1c785330c4c5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.776950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ed9190f8-0e79-450b-bdab-6a5c3ffb5fe6 req-92f56c08-84f3-4f9c-ae61-1c785330c4c5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.787393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ed9190f8-0e79-450b-bdab-6a5c3ffb5fe6 req-92f56c08-84f3-4f9c-ae61-1c785330c4c5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.821866 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ed9190f8-0e79-450b-bdab-6a5c3ffb5fe6 req-92f56c08-84f3-4f9c-ae61-1c785330c4c5 service nova] Creating event network-changed:a9c175a8-47b9-4f77-83cc-a385824167d1 for instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a on n-h1-852086-5 Aug 27 03:10:46.842383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ed9190f8-0e79-450b-bdab-6a5c3ffb5fe6 req-92f56c08-84f3-4f9c-ae61-1c785330c4c5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121781 Aug 27 03:10:46.846746 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 474/935] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:46.858313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:46.877230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Searching by: {'deleted': False} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:46.891487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.892202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.892868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.893810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.894868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.895761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:47.012315 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.network.security_group_api [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Adding security group 3313058f-3863-4c7c-a8ed-65da64230dc2 to port a9c175a8-47b9-4f77-83cc-a385824167d1 Aug 27 03:10:47.333754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Listed batch of 17 results from cell out of 1000 limit. Returned 17 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:10:47.566734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:47.566734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:47.573625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:48.494864 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-627af99e-bf34-4f42-9cf0-196defb04319 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a/action" status: 202 len: 0 microversion: 2.1 time: 1.845603 Aug 27 03:10:48.497133 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 462/936] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:46 2022] POST /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a/action => generated 0 bytes in 1850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:48.526664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:48.553146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:48.570136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:48.570659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:48.571102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:48.576972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:48.579504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:48.580074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:49.122214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:49.134740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ca0ab31-247b-4b2e-b252-e2845e530a2c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.634147 Aug 27 03:10:49.137215 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 463/937] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:48 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:49.617771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40544adf-cba0-406c-a8b5-f4c15a1dac51 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1244910238", "id": 804812852, "os-flavor-access:is_public": "False"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:49.679252 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40544adf-cba0-406c-a8b5-f4c15a1dac51 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.530869 Aug 27 03:10:49.680836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 464/938] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:49 2022] POST /compute/v2.1/flavors => generated 436 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:49.690396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:49.692268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:49.705072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.707798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.709004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:49.711781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.713594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.714865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:49.756967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8ccc8fa-4fa0-4a43-b269-b17f050087c0 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 27323 microversion: 2.1 time: 2.904402 Aug 27 03:10:49.788596 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 475/939] 10.222.0.69 () {58 vars in 1171 bytes} [Sat Aug 27 03:10:46 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 27323 bytes in 2941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:10:49.813660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:49.814970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:49.823143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.824022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.824670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:49.825691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.826395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.827178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.071391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:50.086846 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7277b2d9-ff59-406e-b6e0-46f8fb003988 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.402885 Aug 27 03:10:50.090889 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 465/940] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:49 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:50.099141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-891214d9-aeef-495c-8d50-090a739ab25d req-cd855efd-4709-4476-94b4-e18402ab2608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cdac2b-b8ff-487a-9b33-de6c454b9c4a", "tag": "a9c175a8-47b9-4f77-83cc-a385824167d1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:50.115541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-891214d9-aeef-495c-8d50-090a739ab25d req-cd855efd-4709-4476-94b4-e18402ab2608 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.116346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-891214d9-aeef-495c-8d50-090a739ab25d req-cd855efd-4709-4476-94b4-e18402ab2608 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.117030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-891214d9-aeef-495c-8d50-090a739ab25d req-cd855efd-4709-4476-94b4-e18402ab2608 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.136994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-891214d9-aeef-495c-8d50-090a739ab25d req-cd855efd-4709-4476-94b4-e18402ab2608 service nova] Creating event network-changed:a9c175a8-47b9-4f77-83cc-a385824167d1 for instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a on n-h1-852086-5 Aug 27 03:10:50.144141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-891214d9-aeef-495c-8d50-090a739ab25d req-cd855efd-4709-4476-94b4-e18402ab2608 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050755 Aug 27 03:10:50.145390 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 466/941] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:50.154622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-237ac389-216f-44ec-bc15-317b9a7d6c1b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:50.340804 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0485ba0-bd3c-4d44-8a81-18c21733fb58 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.547419 Aug 27 03:10:50.342404 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 476/942] 10.222.0.69 () {58 vars in 1293 bytes} [Sat Aug 27 03:10:49 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a/os-security-groups => generated 1157 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:50.355099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:50.362652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Searching by: {'deleted': False, 'project_id': '5b35a3a15ebb4e1f8c2ac185941e5fda'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:50.370546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.371545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.372131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.373023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.373825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.374425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.528377 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8886fb92-850f-49a7-a8cc-2eb62e3a9214 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?tenant_id=82ec502ce3cc43bb969abf2fa3637591" status: 200 len: 15 microversion: 2.1 time: 0.182821 Aug 27 03:10:50.529778 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 477/943] 10.222.0.69 () {58 vars in 1231 bytes} [Sat Aug 27 03:10:50 2022] GET /compute/v2.1/servers/detail?tenant_id=82ec502ce3cc43bb969abf2fa3637591 => generated 15 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:50.551784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1173587271", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "34528e57-9495-4744-8566-85d04ab8d770"}], "security_groups": [{"name": "tempest-securitygroup--874561933"}], "key_name": "tempest-keypair-1345394866", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:50.586682 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-237ac389-216f-44ec-bc15-317b9a7d6c1b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/804812852/action" status: 200 len: 96 microversion: 2.1 time: 0.439057 Aug 27 03:10:50.587380 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 467/944] 10.222.0.69 () {60 vars in 1197 bytes} [Sat Aug 27 03:10:50 2022] POST /compute/v2.1/flavors/804812852/action => generated 96 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:50.599078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:50.600122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:50.619541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.624313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.626027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.628323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.629258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.629866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.917653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] validate_networks() for [('34528e57-9495-4744-8566-85d04ab8d770', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:50.965301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:50.981773 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b9e14a2-71e6-4183-baa7-9a065c8fd609 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.391993 Aug 27 03:10:50.994607 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 468/945] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:50 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:50.994822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-61c2a803-15dc-4fd7-9d11-1b4cec7e178f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe45c30a1f0>, body: {"security_group": {"name": " tempest-securitygroup -214412007 ", "description": "tempest-description-388582417"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:51.330029 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-61c2a803-15dc-4fd7-9d11-1b4cec7e178f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.345867 Aug 27 03:10:51.332394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 469/946] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:10:50 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:51.342070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:51.356754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Searching by: {'tenant_id': '82ec502ce3cc43bb969abf2fa3637591', 'deleted': False} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:51.364091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:51.365462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:51.366587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:51.374918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:51.375764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:51.376406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:51.424942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:10:51.529041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:51.529619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:51.530345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:51.721677 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d8a6d44-c681-4e48-bbea-a4224e0dafbe tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=82ec502ce3cc43bb969abf2fa3637591" status: 200 len: 4826 microversion: 2.1 time: 0.387582 Aug 27 03:10:51.734702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 470/947] 10.222.0.69 () {58 vars in 1257 bytes} [Sat Aug 27 03:10:51 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=82ec502ce3cc43bb969abf2fa3637591 => generated 4826 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:51.750061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8243a9a9-1040-4fd6-bb67-fdeab11de103 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:52.173863 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-8243a9a9-1040-4fd6-bb67-fdeab11de103 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 6ebf002043fd41a49cd245a812bdce36 combination. Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8243a9a9-1040-4fd6-bb67-fdeab11de103 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Request method failure captured: Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/flavors/804812852/action HTTP/1.1 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 67 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYs1ZgW68m1T23UiHMbYlY-CYvkJC3E5MCOjMPfhezH72WtHAwwX5WTq0dwtH80qIA621zNEnDCySRfTbsq4voa-n2nSZWzjublWq1EDkZQ2Bhlx21s6QZU-VK4qg9YrEuVEEKHA2NKewaZFlKf26frxehzuaNCO3wlVocDNhHEWGXk Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: afd081ba76cb446a9ff6226c0d35c4d3 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/afd081ba76cb446a9ff6226c0d35c4d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/afd081ba76cb446a9ff6226c0d35c4d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_afd081ba76cb446a9ff6226c0d35c4d3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/afd081ba76cb446a9ff6226c0d35c4d3"}]}] Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: afd081ba76cb446a9ff6226c0d35c4d3 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: e3f7454198624b019e1cdba69c3ab651 Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: {"addTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: exception: Flavor access already exists for flavor 36 and project 6ebf002043fd41a49cd245a812bdce36 combination. Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '804812852', 'body': {'addTenantAccess': {'tenant': '6ebf002043fd41a49cd245a812bdce36'}}} Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result.read() Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-6ebf002043fd41a49cd245a812bdce36' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.179002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result.read() Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 03:10:52.184090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-6ebf002043fd41a49cd245a812bdce36' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 3, 10, 52, 168534), 'updated_at': None, 'flavor_id': 36, 'project_id': '6ebf002043fd41a49cd245a812bdce36'}] Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 6ebf002043fd41a49cd245a812bdce36 combination. Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 6ebf002043fd41a49cd245a812bdce36 combination. Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 6ebf002043fd41a49cd245a812bdce36 combination. Aug 27 03:10:52.194212 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:52.206187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8243a9a9-1040-4fd6-bb67-fdeab11de103 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 6ebf002043fd41a49cd245a812bdce36 combination. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:52.206187 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8243a9a9-1040-4fd6-bb67-fdeab11de103 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/804812852/action" status: 409 len: 152 microversion: 2.1 time: 0.467813 Aug 27 03:10:52.206187 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 471/948] 10.222.0.69 () {60 vars in 1197 bytes} [Sat Aug 27 03:10:51 2022] POST /compute/v2.1/flavors/804812852/action => generated 152 bytes in 469 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:10:52.222905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:52.223770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:52.234534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.235261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.235935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.236988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.237568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.238094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.248326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:52.249238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:52.250784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:52.251791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:52.253139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:52.272140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.272636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.273561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.274453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.275043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.275682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.300036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:52.306819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for user 21a64079d45547ba80c22c309d216438 and project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:52.331222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:52.335174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:52.438293 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ca41741-0db3-48ce-9091-000b877579e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.906480 Aug 27 03:10:52.440892 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 478/949] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:10:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:10:52.453170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c582f44-154b-40fa-94e4-ebb6bd5f2913 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c52e9d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:52.506209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:52.523895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3b666e2-15ee-4d57-825f-150b7ec76101 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.318319 Aug 27 03:10:52.525622 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 472/950] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:52 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:52.548621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:52.559971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Searching by: {'tenant_id': '5b35a3a15ebb4e1f8c2ac185941e5fda', 'deleted': False} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:52.572992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.574304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.575184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.576877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.577768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.578482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.632220 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-27e8b850-8a78-4744-b8c7-e51780c6c699 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5b35a3a15ebb4e1f8c2ac185941e5fda" status: 200 len: 15 microversion: 2.1 time: 0.103639 Aug 27 03:10:52.634058 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 473/951] 10.222.0.69 () {58 vars in 1257 bytes} [Sat Aug 27 03:10:52 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5b35a3a15ebb4e1f8c2ac185941e5fda => generated 15 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:52.651896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-11c059ba-45ce-4463-a638-a6fa742fa8fd req-3eb07a42-5215-4fdb-b923-91fa0a8f498b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61cb6ca-8b57-4408-b6a2-5e8e542ce81a", "tag": "7c4936ee-07ae-40cf-b35c-9ec273970636"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:52.671130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-11c059ba-45ce-4463-a638-a6fa742fa8fd req-3eb07a42-5215-4fdb-b923-91fa0a8f498b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.672230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-11c059ba-45ce-4463-a638-a6fa742fa8fd req-3eb07a42-5215-4fdb-b923-91fa0a8f498b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.673054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-11c059ba-45ce-4463-a638-a6fa742fa8fd req-3eb07a42-5215-4fdb-b923-91fa0a8f498b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.690846 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-11c059ba-45ce-4463-a638-a6fa742fa8fd req-3eb07a42-5215-4fdb-b923-91fa0a8f498b service nova] Creating event network-changed:7c4936ee-07ae-40cf-b35c-9ec273970636 for instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a on n-h2-852086-5 Aug 27 03:10:52.696527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-11c059ba-45ce-4463-a638-a6fa742fa8fd req-3eb07a42-5215-4fdb-b923-91fa0a8f498b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058725 Aug 27 03:10:52.698394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 474/952] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:52.706386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:52.707404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:52.716591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:52.719178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.720052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.720996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.722221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.722916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.723421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.822569 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c582f44-154b-40fa-94e4-ebb6bd5f2913 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf" status: 200 len: 222 microversion: 2.1 time: 0.378659 Aug 27 03:10:52.834254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 479/953] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:10:52 2022] GET /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf => generated 222 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:52.842442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5babfb42-3da2-4f93-8bcd-446f479f0086 req-e3bc864b-5ffc-4b9f-896f-ec2d2856fef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b5437b-bc51-497e-9dd8-f29576d43dab", "tag": "8e716cc4-c738-4bde-a49d-8f8e449c8da6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:52.861795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5babfb42-3da2-4f93-8bcd-446f479f0086 req-e3bc864b-5ffc-4b9f-896f-ec2d2856fef0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.862619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5babfb42-3da2-4f93-8bcd-446f479f0086 req-e3bc864b-5ffc-4b9f-896f-ec2d2856fef0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.863374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5babfb42-3da2-4f93-8bcd-446f479f0086 req-e3bc864b-5ffc-4b9f-896f-ec2d2856fef0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.877613 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5babfb42-3da2-4f93-8bcd-446f479f0086 req-e3bc864b-5ffc-4b9f-896f-ec2d2856fef0 service nova] Creating event network-changed:8e716cc4-c738-4bde-a49d-8f8e449c8da6 for instance 37b5437b-bc51-497e-9dd8-f29576d43dab on n-h1-852086-5 Aug 27 03:10:52.884849 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5babfb42-3da2-4f93-8bcd-446f479f0086 req-e3bc864b-5ffc-4b9f-896f-ec2d2856fef0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059261 Aug 27 03:10:52.886700 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 480/954] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:52.895253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00929c75-e450-41ef-bfcd-1f163c93f4b6 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:53.050397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:53.062062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82b1dc45-ba5c-427d-85a5-175d1c94107f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.360940 Aug 27 03:10:53.065959 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 475/955] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:52 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:53.075504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a68f25cb-9fa5-49cf-849c-d489f073f2a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:53.081590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a68f25cb-9fa5-49cf-849c-d489f073f2a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:53.194265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a68f25cb-9fa5-49cf-849c-d489f073f2a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:53.197830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=17 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:53.207109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a68f25cb-9fa5-49cf-849c-d489f073f2a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:53.209630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a68f25cb-9fa5-49cf-849c-d489f073f2a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:53.211980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a68f25cb-9fa5-49cf-849c-d489f073f2a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1286 microversion: 2.25 time: 0.141563 Aug 27 03:10:53.226191 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 476/956] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:53 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:53.235466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f394b576-e55e-4d30-afb1-85ff3ac22215 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:53.243161 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f394b576-e55e-4d30-afb1-85ff3ac22215 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015710 Aug 27 03:10:53.245263 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 477/957] 10.222.0.69 () {58 vars in 1189 bytes} [Sat Aug 27 03:10:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:53.251324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2cfd6e2e-7d00-4536-8c7d-ba85d8e6ff4b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c13e430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:53.396894 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00929c75-e450-41ef-bfcd-1f163c93f4b6 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/804812852/action" status: 200 len: 21 microversion: 2.1 time: 0.506915 Aug 27 03:10:53.398890 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 481/958] 10.222.0.69 () {60 vars in 1197 bytes} [Sat Aug 27 03:10:52 2022] POST /compute/v2.1/flavors/804812852/action => generated 21 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:53.405660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:53.409115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:53.420576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.421067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.421806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.423247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.424052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.424808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.544855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c36b103-1dcc-4bbc-8299-4a6aec6fdabd tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action" status: 202 len: 0 microversion: 2.1 time: 0.143985 Aug 27 03:10:53.551231 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 482/959] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:53 2022] POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:53.558828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cf31e96-6189-4d92-bcca-54fe83eefba7 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:53.585986 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8cf31e96-6189-4d92-bcca-54fe83eefba7 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/804812852" status: 202 len: 0 microversion: 2.1 time: 0.032202 Aug 27 03:10:53.587563 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 483/960] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:10:53 2022] DELETE /compute/v2.1/flavors/804812852 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:53.675857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1526903371", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": "none"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:53.743374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:53.744772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:53.746358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:53.747438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:53.747872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:53.759494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.760070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.760521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.761348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.761897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.762417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.796488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Getting quotas for project 1babffe9ddfd4a2aa16a795ebdae4964. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:53.817642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Getting quotas for user ded125b553aa433bb761689de9b7c8f1 and project 1babffe9ddfd4a2aa16a795ebdae4964. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:53.844686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:53.847319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:53.848915 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2cfd6e2e-7d00-4536-8c7d-ba85d8e6ff4b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf" status: 202 len: 0 microversion: 2.1 time: 0.600143 Aug 27 03:10:53.852292 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 478/961] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:10:53 2022] DELETE /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:53.860888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:53.863813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:53.904939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.906186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.907987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.909490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.910869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.911941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.928171 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f84eda71-a19d-46c4-9e4f-f6395597e5d6 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.339174 Aug 27 03:10:53.929703 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 484/962] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:10:53.939939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:53.957519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:53.961410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '82ec502ce3cc43bb969abf2fa3637591'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:53.985798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.987415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.990515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.991518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:53.992235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:53.994903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.188590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:10:54.226517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.250768 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00ce64ad-cb08-49df-973e-15546ba7e192 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.395853 Aug 27 03:10:54.253511 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 479/963] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:53 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:54.263329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7dcc856-f0ef-4b7e-b100-f6f135ded934 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:54.304123 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7dcc856-f0ef-4b7e-b100-f6f135ded934 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5478 microversion: 2.1 time: 0.048745 Aug 27 03:10:54.304645 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 480/964] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:10:54 2022] GET /compute/v2.1/flavors/detail => generated 5478 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:54.311299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e1df8bd-cbc4-4505-b512-d6be04b880d2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c5494c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:54.321328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc973018-6f87-4b04-a585-36872fa0a9b3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.390250 Aug 27 03:10:54.324690 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 485/965] 10.222.0.69 () {58 vars in 1150 bytes} [Sat Aug 27 03:10:53 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:54.333140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53b90e34-e207-4b63-ad2b-a3dcab2c2bd3 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:54.335966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53b90e34-e207-4b63-ad2b-a3dcab2c2bd3 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:54.339862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-2e1df8bd-cbc4-4505-b512-d6be04b880d2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:10:54.340481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-2e1df8bd-cbc4-4505-b512-d6be04b880d2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 7126f450-382e-429c-ac0d-dbbc1ec894bf not found {{(pid=122407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:10:54.341127 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2e1df8bd-cbc4-4505-b512-d6be04b880d2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:10:54.341127 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-97cae79d-3622-4bb2-a2cc-254c2eba27b7'] Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e1df8bd-cbc4-4505-b512-d6be04b880d2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf HTTP/1.1 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-97cae79d-3622-4bb2-a2cc-254c2eba27b7'] Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7126f450-382e-429c-ac0d-dbbc1ec894bf'} Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:10:54.355266 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97cae79d-3622-4bb2-a2cc-254c2eba27b7'] Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97cae79d-3622-4bb2-a2cc-254c2eba27b7'] Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97cae79d-3622-4bb2-a2cc-254c2eba27b7'] Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97cae79d-3622-4bb2-a2cc-254c2eba27b7'] Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e1df8bd-cbc4-4505-b512-d6be04b880d2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-97cae79d-3622-4bb2-a2cc-254c2eba27b7'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e1df8bd-cbc4-4505-b512-d6be04b880d2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf" status: 404 len: 194 microversion: 2.1 time: 0.051503 Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 481/966] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:10:54 2022] GET /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:54.366905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-82006b48-00f5-4cd4-a914-8240b72dc65b req-a8327edc-fce2-4a76-bf5a-2e3a3097ce15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094efd70-ba42-484c-bdf3-d92d44463aa5", "name": "network-vif-plugged", "status": "completed", "tag": "3538fc00-b7da-4311-8edd-a7b29893993a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:54.379735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-82006b48-00f5-4cd4-a914-8240b72dc65b req-a8327edc-fce2-4a76-bf5a-2e3a3097ce15 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.380732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-82006b48-00f5-4cd4-a914-8240b72dc65b req-a8327edc-fce2-4a76-bf5a-2e3a3097ce15 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.381389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-82006b48-00f5-4cd4-a914-8240b72dc65b req-a8327edc-fce2-4a76-bf5a-2e3a3097ce15 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.394251 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-82006b48-00f5-4cd4-a914-8240b72dc65b req-a8327edc-fce2-4a76-bf5a-2e3a3097ce15 service nova] Creating event network-vif-plugged:3538fc00-b7da-4311-8edd-a7b29893993a for instance 094efd70-ba42-484c-bdf3-d92d44463aa5 on n-h2-852086-5 Aug 27 03:10:54.399506 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-82006b48-00f5-4cd4-a914-8240b72dc65b req-a8327edc-fce2-4a76-bf5a-2e3a3097ce15 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039648 Aug 27 03:10:54.400717 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 482/967] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:54.407597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:54.408316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:54.415187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.416174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.416497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.417349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.417745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.418200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.479019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53b90e34-e207-4b63-ad2b-a3dcab2c2bd3 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.487973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53b90e34-e207-4b63-ad2b-a3dcab2c2bd3 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.489798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53b90e34-e207-4b63-ad2b-a3dcab2c2bd3 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.499165 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53b90e34-e207-4b63-ad2b-a3dcab2c2bd3 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "PUT /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1359 microversion: 2.75 time: 0.172430 Aug 27 03:10:54.500598 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 486/968] 10.222.0.69 () {62 vars in 1297 bytes} [Sat Aug 27 03:10:54 2022] PUT /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:54.513033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:54.514034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:54.522866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.523983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.524442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.525614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.526239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.526696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.638643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.659927 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e270f66b-db21-4beb-917a-12fd40c4e098 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.257466 Aug 27 03:10:54.660211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.662301 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 483/969] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:54 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:54.673009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:54.676696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.677266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:54.680007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:54.682761 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f337b4e-6c80-42ab-a7a5-797bc543b41a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1338 microversion: 2.25 time: 0.179790 Aug 27 03:10:54.686217 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 487/970] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:54 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1338 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:54.693001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.693907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.694618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.700189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-216ca15f-bb97-43a4-a20a-4cf3c14b527a tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1043799281", "id": 1859517204, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:54.700731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.702798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.705323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.713386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:54.746599 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-216ca15f-bb97-43a4-a20a-4cf3c14b527a tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.059748 Aug 27 03:10:54.755618 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 488/971] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:54 2022] POST /compute/v2.1/flavors => generated 438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:54.766517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b05803d4-2312-4c4e-869e-2347f8633423 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe45c0c8af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-79104897", "description": "tempest-description-2091595764"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:54.888407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b048fc9-f1ed-4916-a750-ad7bf5881d20 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action" status: 202 len: 0 microversion: 2.1 time: 0.223979 Aug 27 03:10:54.891468 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 484/972] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:54 2022] POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:54.899297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:54.900763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:54.910119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.910985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.911552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.914200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.915120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.917626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.111293 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b05803d4-2312-4c4e-869e-2347f8633423 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.354079 Aug 27 03:10:55.112706 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 489/973] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:10:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:55.131988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c92af42-c6be-44d1-bae2-18fb26aa731b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:55.167411 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4c92af42-c6be-44d1-bae2-18fb26aa731b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c92af42-c6be-44d1-bae2-18fb26aa731b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Request method failure captured: Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/flavors/1859517204/os-flavor-access HTTP/1.1 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYs1ZgW68m1T23UiHMbYlY-CYvkJC3E5MCOjMPfhezH72WtHAwwX5WTq0dwtH80qIA621zNEnDCySRfTbsq4voa-n2nSZWzjublWq1EDkZQ2Bhlx21s6QZU-VK4qg9YrEuVEEKHA2NKewaZFlKf26frxehzuaNCO3wlVocDNhHEWGXk Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: afd081ba76cb446a9ff6226c0d35c4d3 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/afd081ba76cb446a9ff6226c0d35c4d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/afd081ba76cb446a9ff6226c0d35c4d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_afd081ba76cb446a9ff6226c0d35c4d3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/afd081ba76cb446a9ff6226c0d35c4d3"}]}] Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: afd081ba76cb446a9ff6226c0d35c4d3 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: e3f7454198624b019e1cdba69c3ab651 Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: exception: Access list not available for public flavors. Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'flavor_id': '1859517204'} Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 27 03:10:55.170790 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:55.182092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c92af42-c6be-44d1-bae2-18fb26aa731b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:55.183377 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c92af42-c6be-44d1-bae2-18fb26aa731b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/1859517204/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.068770 Aug 27 03:10:55.184685 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 490/974] 10.222.0.69 () {58 vars in 1209 bytes} [Sat Aug 27 03:10:55 2022] GET /compute/v2.1/flavors/1859517204/os-flavor-access => generated 91 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:10:55.192038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:55.193129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:55.214296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.215529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.216834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.218783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.220134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.221207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.349764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:55.372024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:55.374065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:55.383462 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-27abafdc-ebf7-42e9-9765-8d8a5739fd81 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1355 microversion: 2.75 time: 0.489903 Aug 27 03:10:55.385381 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 485/975] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:54 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1355 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:55.394028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49706367-b06f-46d6-a0cb-501fc3b4d280 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe45c079310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-286906050", "description": "tempest-description-794617279"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:55.684426 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa64b8ac-a511-4f90-9754-df107c6937a4 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1614 microversion: 2.1 time: 0.498120 Aug 27 03:10:55.700038 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 491/976] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:55 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1614 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:55.705750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21718e98-991c-4831-950a-38e2bf74a9c7 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:55.773785 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21718e98-991c-4831-950a-38e2bf74a9c7 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1859517204" status: 202 len: 0 microversion: 2.1 time: 0.070060 Aug 27 03:10:55.775481 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 492/977] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:10:55 2022] DELETE /compute/v2.1/flavors/1859517204 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:55.793141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:55.793468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:55.800737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.801357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.801668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.802446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:55.802911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:55.803543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:55.967670 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49706367-b06f-46d6-a0cb-501fc3b4d280 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.580471 Aug 27 03:10:55.971063 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 486/978] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:10:55 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:55.987829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.003372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:56.015124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.016291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.016747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.018046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.018556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.018990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.036251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.038553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:56.048873 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33c13d94-c8ba-4f56-a5de-8397efd6e107 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.272023 Aug 27 03:10:56.062380 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 493/979] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:55 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:56.067191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.067805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:56.075461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.075967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.076427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.077173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.077629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.078276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.245256 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0abbe1ab-a276-4ca8-87d7-785d4bac278f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1614 microversion: 2.1 time: 0.181256 Aug 27 03:10:56.254679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 494/980] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1614 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:56.259302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.260313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:56.284748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.285479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.286038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.287115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.287819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.288507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.335159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.348918 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0bcc6e2c-1787-4659-93ea-b142227cbbea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.375420 Aug 27 03:10:56.351222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 487/981] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:55 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:56.365095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc0c80d3-acd8-4f6f-97df-ab93b47a2409 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.410362 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc0c80d3-acd8-4f6f-97df-ab93b47a2409 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5478 microversion: 2.1 time: 0.054751 Aug 27 03:10:56.412693 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 488/982] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/flavors/detail => generated 5478 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:56.425127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8a5e7e92-e011-4cec-9f02-d628cee85beb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe45c079160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-369495530", "description": "tempest-description-1127716842"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:56.429230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.443008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.444743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.447628 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9191ae8f-1ee1-4683-a4b0-4bac60588bcc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1344 microversion: 2.25 time: 0.198609 Aug 27 03:10:56.447970 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 495/983] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1344 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:56.455753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.467749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Searching by: {'host': 'n-h1-852086-5', 'deleted': False} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:56.474151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.474675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.475111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.476054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.476685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.477117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.595371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:10:56.672977 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-960c953d-1948-4ec2-9d06-809f1cd4fa7c tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers?host=n-h1-852086-5&all_tenants=1" status: 200 len: 3275 microversion: 2.1 time: 0.222913 Aug 27 03:10:56.683585 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 496/984] 10.222.0.69 () {58 vars in 1190 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/servers?host=n-h1-852086-5&all_tenants=1 => generated 3275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:56.689036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.690092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:56.698316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.698316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.698767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.699490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.700563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.701072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.839847 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8a5e7e92-e011-4cec-9f02-d628cee85beb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.425224 Aug 27 03:10:56.841758 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 489/985] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:10:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:56.848232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a51f8c6-87f4-4b28-a40b-9a8d843560da tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2117904382", "id": 1556476655, "os-flavor-access:is_public": "False"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:56.848742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.872227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.873952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.884858 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a51f8c6-87f4-4b28-a40b-9a8d843560da tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.041228 Aug 27 03:10:56.885891 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 490/986] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:56 2022] POST /compute/v2.1/flavors => generated 439 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:56.888157 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12651b29-02ff-4e9e-a095-381b96a59699 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1417 microversion: 2.75 time: 0.203367 Aug 27 03:10:56.889874 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 497/987] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1417 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:56.896811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-085ba4c0-712f-4717-9729-69f8a40e8f59 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c074ee0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.906724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:56.920392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:10:56.929799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.930868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.931876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.932743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.934279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.934658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.966756 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa7081cf-6494-4249-ae79-75b0b527c0aa tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.073607 Aug 27 03:10:56.967976 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 498/988] 10.222.0.69 () {58 vars in 1196 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:57.162606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d90e21c-3847-47fd-80d9-a0bf89cf329a tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:57.169010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d90e21c-3847-47fd-80d9-a0bf89cf329a tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '6182ad0f6b4044039c196eda339f6c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebf002043fd41a49cd245a812bdce36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d90e21c-3847-47fd-80d9-a0bf89cf329a tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Request method failure captured: Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/flavors/1556476655/action HTTP/1.1 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 67 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYs0TTuJXl5-8SeuB-CdAaU_dfisUYIQUHHTSsslBju_yhgcZB_dfBhdkl_UEugYR5sEQRDEIEDRXtXMoI973Rim3BvZ_5eNIWiNSHdi3jBIxvsPXtUsPJ5aXRt8j50_GtrO0RMEJuoHbIZ5iDwbltto3UQz98Fy-ht9RnbK9C1wrcc Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 6ebf002043fd41a49cd245a812bdce36 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1674548666 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6ebf002043fd41a49cd245a812bdce36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6ebf002043fd41a49cd245a812bdce36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6ebf002043fd41a49cd245a812bdce36", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6ebf002043fd41a49cd245a812bdce36"}]}] Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1674548666 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 6ebf002043fd41a49cd245a812bdce36 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1674548666 Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FlavorsAccessNegativeTestJSON-1674548666-project Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6182ad0f6b4044039c196eda339f6c1e Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1674548666-project Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: {"addTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1556476655', 'body': {'addTenantAccess': {'tenant': '6ebf002043fd41a49cd245a812bdce36'}}} Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:10:57.175941 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d90e21c-3847-47fd-80d9-a0bf89cf329a tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:57.182039 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d90e21c-3847-47fd-80d9-a0bf89cf329a tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] 10.222.0.69 "POST /compute/v2.1/flavors/1556476655/action" status: 403 len: 130 microversion: 2.1 time: 0.210638 Aug 27 03:10:57.183295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 499/989] 10.222.0.69 () {60 vars in 1200 bytes} [Sat Aug 27 03:10:56 2022] POST /compute/v2.1/flavors/1556476655/action => generated 130 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:57.189020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:57.193030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.204885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.205605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.206234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.207128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.207758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.208356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.213156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:57.264485 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-085ba4c0-712f-4717-9729-69f8a40e8f59 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.371213 Aug 27 03:10:57.267164 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 491/990] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:10:56 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:57.275377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.277822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.289738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.291611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.292111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.292895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.293364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.293788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.325791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-643ae7cb-a449-4056-a1f1-e317db2cbcf8 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action" status: 202 len: 0 microversion: 2.1 time: 0.140941 Aug 27 03:10:57.326996 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 500/991] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:57 2022] POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:57.332760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3e3b7724-837a-46a7-b8fd-2ec838718a99 req-a870ecbd-e8e0-4adb-b4a1-0c536b99017e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b5437b-bc51-497e-9dd8-f29576d43dab", "name": "network-vif-plugged", "status": "completed", "tag": "8e716cc4-c738-4bde-a49d-8f8e449c8da6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:57.343538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e3b7724-837a-46a7-b8fd-2ec838718a99 req-a870ecbd-e8e0-4adb-b4a1-0c536b99017e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.344430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e3b7724-837a-46a7-b8fd-2ec838718a99 req-a870ecbd-e8e0-4adb-b4a1-0c536b99017e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.345126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e3b7724-837a-46a7-b8fd-2ec838718a99 req-a870ecbd-e8e0-4adb-b4a1-0c536b99017e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.359070 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3e3b7724-837a-46a7-b8fd-2ec838718a99 req-a870ecbd-e8e0-4adb-b4a1-0c536b99017e service nova] Creating event network-vif-plugged:8e716cc4-c738-4bde-a49d-8f8e449c8da6 for instance 37b5437b-bc51-497e-9dd8-f29576d43dab on n-h1-852086-5 Aug 27 03:10:57.367161 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3e3b7724-837a-46a7-b8fd-2ec838718a99 req-a870ecbd-e8e0-4adb-b4a1-0c536b99017e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037874 Aug 27 03:10:57.367785 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 501/992] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:57.373529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5136058a-db24-4d9e-87f1-379069b152fd tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.393127 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5136058a-db24-4d9e-87f1-379069b152fd tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1556476655" status: 202 len: 0 microversion: 2.1 time: 0.024067 Aug 27 03:10:57.393710 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 502/993] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:10:57 2022] DELETE /compute/v2.1/flavors/1556476655 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:57.398695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b3828e0-3a58-4ffa-a9af-2bdabca1d710 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c045f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.499351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:57.509073 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0dfd859-4f76-4fd8-b24f-590c6e6f1296 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.239993 Aug 27 03:10:57.510259 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 492/994] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:57 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:57.515912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:57.518924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.533409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.534482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.535985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.537591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.539693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.540436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.644919 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b3828e0-3a58-4ffa-a9af-2bdabca1d710 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e" status: 202 len: 0 microversion: 2.1 time: 0.249232 Aug 27 03:10:57.646012 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 503/995] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:10:57 2022] DELETE /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:57.646998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:57.647886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:57.648744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:57.649494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:57.650240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:57.660450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.662204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.673983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.674950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.675935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.677200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.678069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.678958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.787714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.812237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.813630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.814687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.817286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.819151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.820102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.888146 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-863104f2-8eec-446a-873d-6c61617887de tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action" status: 202 len: 1067 microversion: 2.1 time: 0.376487 Aug 27 03:10:57.894214 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 493/996] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:57 2022] POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action => generated 1067 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:10:57.899163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc30f3bf-e3a8-4bb9-b836-c09c62eb3983 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.932315 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc30f3bf-e3a8-4bb9-b836-c09c62eb3983 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5478 microversion: 2.1 time: 0.035665 Aug 27 03:10:57.933749 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 494/997] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:10:57 2022] GET /compute/v2.1/flavors/detail => generated 5478 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:57.940411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.941440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.957474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:57.960051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.961202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.962278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.963810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.965740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.966691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.971276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cac55bbc-f41b-40d6-9c59-e8bda8f6043b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.318164 Aug 27 03:10:57.972286 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 504/998] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:57 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:57.988000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75855f24-dcab-497c-a75a-ea2c55243ebb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c091e50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:58.032699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-75855f24-dcab-497c-a75a-ea2c55243ebb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:10:58.042723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-75855f24-dcab-497c-a75a-ea2c55243ebb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 09193bcd-c072-4270-969a-96d638bb766e not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:10:58.043351 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-75855f24-dcab-497c-a75a-ea2c55243ebb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:10:58.043351 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-b7c4a63c-9d5a-4705-9bd2-ce13d4ebae8f'] Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75855f24-dcab-497c-a75a-ea2c55243ebb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e HTTP/1.1 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-b7c4a63c-9d5a-4705-9bd2-ce13d4ebae8f'] Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '09193bcd-c072-4270-969a-96d638bb766e'} Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:10:58.053260 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7c4a63c-9d5a-4705-9bd2-ce13d4ebae8f'] Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7c4a63c-9d5a-4705-9bd2-ce13d4ebae8f'] Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7c4a63c-9d5a-4705-9bd2-ce13d4ebae8f'] Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7c4a63c-9d5a-4705-9bd2-ce13d4ebae8f'] Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75855f24-dcab-497c-a75a-ea2c55243ebb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-b7c4a63c-9d5a-4705-9bd2-ce13d4ebae8f'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75855f24-dcab-497c-a75a-ea2c55243ebb tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e" status: 404 len: 194 microversion: 2.1 time: 0.078131 Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 505/999] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:10:57 2022] GET /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:58.069800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:58.080298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.083350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.083917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.085080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.088714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.095229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.335307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.357482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.361008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.363158 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5de2d336-ff42-42e1-8012-69f6708d4bfc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.427889 Aug 27 03:10:58.364333 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 495/1000] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:57 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:58.376349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:58.378391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:58.393138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.394558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.395576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.397086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.398152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.400695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.435007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.450593 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a08dfa0-272a-42dd-9753-ebf8081ed114 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.394579 Aug 27 03:10:58.451865 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 506/1001] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:58 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:58.457889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-206903d8-591f-4b3f-8adc-a13fbf19644c tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1009106639", "id": 1338866035, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:58.491688 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-206903d8-591f-4b3f-8adc-a13fbf19644c tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.038471 Aug 27 03:10:58.492645 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 507/1002] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:58 2022] POST /compute/v2.1/flavors => generated 439 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:58.498557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f5394ba-2a77-4648-bb5e-39a469c497de tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457e79ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:58.515702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.525849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.527746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.536796 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e67414f3-87de-45f1-a2fe-fee0d45e9b6e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1417 microversion: 2.75 time: 0.170070 Aug 27 03:10:58.538420 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 496/1003] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:58 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1417 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:58.555743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d277ca5f-80f9-42a0-9bde-72ce719cb1b3 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:58.697658 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d277ca5f-80f9-42a0-9bde-72ce719cb1b3 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1338866035/action" status: 200 len: 97 microversion: 2.1 time: 0.157033 Aug 27 03:10:58.706252 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 497/1004] 10.222.0.69 () {60 vars in 1200 bytes} [Sat Aug 27 03:10:58 2022] POST /compute/v2.1/flavors/1338866035/action => generated 97 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:58.706252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:58.707230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:58.714011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.714560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.714997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.715723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:58.716207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:58.716642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:58.891325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f5394ba-2a77-4648-bb5e-39a469c497de tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9" status: 202 len: 0 microversion: 2.1 time: 0.396141 Aug 27 03:10:58.895777 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 508/1005] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:10:58 2022] DELETE /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:58.904496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed13e10b-6ff5-4c11-a13f-a3bfc6d775c2 tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:58.908899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed13e10b-6ff5-4c11-a13f-a3bfc6d775c2 tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '6182ad0f6b4044039c196eda339f6c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebf002043fd41a49cd245a812bdce36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed13e10b-6ff5-4c11-a13f-a3bfc6d775c2 tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Request method failure captured: Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/flavors/1338866035/action HTTP/1.1 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 70 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYs0TTuJXl5-8SeuB-CdAaU_dfisUYIQUHHTSsslBju_yhgcZB_dfBhdkl_UEugYR5sEQRDEIEDRXtXMoI973Rim3BvZ_5eNIWiNSHdi3jBIxvsPXtUsPJ5aXRt8j50_GtrO0RMEJuoHbIZ5iDwbltto3UQz98Fy-ht9RnbK9C1wrcc Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 6ebf002043fd41a49cd245a812bdce36 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1674548666 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6ebf002043fd41a49cd245a812bdce36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6ebf002043fd41a49cd245a812bdce36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6ebf002043fd41a49cd245a812bdce36", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6ebf002043fd41a49cd245a812bdce36"}]}] Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1674548666 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 6ebf002043fd41a49cd245a812bdce36 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1674548666 Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FlavorsAccessNegativeTestJSON-1674548666-project Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6182ad0f6b4044039c196eda339f6c1e Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1674548666-project Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: {"removeTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1338866035', 'body': {'removeTenantAccess': {'tenant': '6ebf002043fd41a49cd245a812bdce36'}}} Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can( Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 03:10:58.910550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed13e10b-6ff5-4c11-a13f-a3bfc6d775c2 tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed13e10b-6ff5-4c11-a13f-a3bfc6d775c2 tempest-FlavorsAccessNegativeTestJSON-1674548666 tempest-FlavorsAccessNegativeTestJSON-1674548666-project] 10.222.0.69 "POST /compute/v2.1/flavors/1338866035/action" status: 403 len: 133 microversion: 2.1 time: 0.018018 Aug 27 03:10:58.917920 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 509/1006] 10.222.0.69 () {60 vars in 1200 bytes} [Sat Aug 27 03:10:58 2022] POST /compute/v2.1/flavors/1338866035/action => generated 133 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:58.923943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a63f76e-a7dc-4fac-825a-a7d42d1ac5d9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c0df5e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:58.971127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-9a63f76e-a7dc-4fac-825a-a7d42d1ac5d9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:10:58.972185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-9a63f76e-a7dc-4fac-825a-a7d42d1ac5d9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:10:58.973388 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9a63f76e-a7dc-4fac-825a-a7d42d1ac5d9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:10:58.973388 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-98b9656c-3102-4154-b4c0-7507b86cc535'] Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a63f76e-a7dc-4fac-825a-a7d42d1ac5d9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9 HTTP/1.1 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-98b9656c-3102-4154-b4c0-7507b86cc535'] Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '37b13b93-17ff-4dd4-85f5-15391fa009f9'} Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:10:58.979065 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b9656c-3102-4154-b4c0-7507b86cc535'] Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b9656c-3102-4154-b4c0-7507b86cc535'] Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b9656c-3102-4154-b4c0-7507b86cc535'] Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98b9656c-3102-4154-b4c0-7507b86cc535'] Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a63f76e-a7dc-4fac-825a-a7d42d1ac5d9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-98b9656c-3102-4154-b4c0-7507b86cc535'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:58.983454 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a63f76e-a7dc-4fac-825a-a7d42d1ac5d9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9" status: 404 len: 194 microversion: 2.1 time: 0.063396 Aug 27 03:10:58.991133 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 510/1007] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:10:58 2022] GET /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:59.000118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb81e882-bd62-4be5-af7e-74385d24f0ad tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6ebf002043fd41a49cd245a812bdce36"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:59.036105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.053213 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2519be38-e175-4fb9-9ccf-f24557732082 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.351897 Aug 27 03:10:59.058602 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 498/1008] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:58 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:59.072023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aecf085e-36f9-42b7-a5d3-729bd89ea30e tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c036160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.124232 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb81e882-bd62-4be5-af7e-74385d24f0ad tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/1338866035/action" status: 200 len: 21 microversion: 2.1 time: 0.133540 Aug 27 03:10:59.125871 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 511/1009] 10.222.0.69 () {60 vars in 1200 bytes} [Sat Aug 27 03:10:58 2022] POST /compute/v2.1/flavors/1338866035/action => generated 21 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:10:59.135653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.136549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.147101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.147799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.148431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.149421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.150887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.151566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.316082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.333118 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf5b672a-4dad-4314-8176-408e06319704 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.205069 Aug 27 03:10:59.334084 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 512/1010] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:59.344731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cae8f2b3-fc98-4403-aef1-64d0c2c4f2e8 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.383086 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cae8f2b3-fc98-4403-aef1-64d0c2c4f2e8 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1338866035" status: 202 len: 0 microversion: 2.1 time: 0.046701 Aug 27 03:10:59.386013 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 513/1011] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:10:59 2022] DELETE /compute/v2.1/flavors/1338866035 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:59.395780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a05f9452-de81-4c7a-b107-5135823d1884 req-45e05264-4d99-4d39-837c-579c79a70480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "607b043e-1bab-4c1d-8348-610a19b23bfa", "tag": "01d2411e-6250-4e8c-bc59-812d60bccff5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:59.417121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a05f9452-de81-4c7a-b107-5135823d1884 req-45e05264-4d99-4d39-837c-579c79a70480 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.417994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a05f9452-de81-4c7a-b107-5135823d1884 req-45e05264-4d99-4d39-837c-579c79a70480 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.418918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a05f9452-de81-4c7a-b107-5135823d1884 req-45e05264-4d99-4d39-837c-579c79a70480 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.443328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a05f9452-de81-4c7a-b107-5135823d1884 req-45e05264-4d99-4d39-837c-579c79a70480 service nova] Creating event network-changed:01d2411e-6250-4e8c-bc59-812d60bccff5 for instance 607b043e-1bab-4c1d-8348-610a19b23bfa on n-h1-852086-5 Aug 27 03:10:59.455257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a05f9452-de81-4c7a-b107-5135823d1884 req-45e05264-4d99-4d39-837c-579c79a70480 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065625 Aug 27 03:10:59.456242 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 514/1012] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:59.466020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cbe5e5e-fcde-47f6-9e5f-1be379aa6158 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.491374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5cbe5e5e-fcde-47f6-9e5f-1be379aa6158 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5478 microversion: 2.1 time: 0.033375 Aug 27 03:10:59.491984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 515/1013] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/flavors/detail => generated 5478 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:59.499105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.500809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.518494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.519294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.520684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.521963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.522660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.523454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.536875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aecf085e-36f9-42b7-a5d3-729bd89ea30e tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1" status: 202 len: 0 microversion: 2.1 time: 0.476712 Aug 27 03:10:59.537612 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 499/1014] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:10:59 2022] DELETE /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:59.546558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.547138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.566578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.567084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.567520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.568244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.570132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.570621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.730974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.744764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.747150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.749028 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68162724-3824-4610-8344-d2b978ccc04e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.255595 Aug 27 03:10:59.749905 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 516/1015] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:59.757688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87c2530d-6814-45e5-a354-744e9de6ac7e tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1055794780", "id": 990627141, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:59.781384 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87c2530d-6814-45e5-a354-744e9de6ac7e tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.029980 Aug 27 03:10:59.782461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 517/1016] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:59 2022] POST /compute/v2.1/flavors => generated 436 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:59.790595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-887a2d27-6bb8-446c-aad2-dc0086b3cce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c02dc10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.819033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-887a2d27-6bb8-446c-aad2-dc0086b3cce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:10:59.819772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-887a2d27-6bb8-446c-aad2-dc0086b3cce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:10:59.820436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-887a2d27-6bb8-446c-aad2-dc0086b3cce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:10:59.820436 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-822b29ab-0e24-4177-ad54-0ff3bec9c0e5'] Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-887a2d27-6bb8-446c-aad2-dc0086b3cce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1 HTTP/1.1 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-822b29ab-0e24-4177-ad54-0ff3bec9c0e5'] Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '21c63ceb-6d39-476d-acf5-d5e7484494b1'} Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:10:59.823958 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822b29ab-0e24-4177-ad54-0ff3bec9c0e5'] Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822b29ab-0e24-4177-ad54-0ff3bec9c0e5'] Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822b29ab-0e24-4177-ad54-0ff3bec9c0e5'] Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822b29ab-0e24-4177-ad54-0ff3bec9c0e5'] Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-887a2d27-6bb8-446c-aad2-dc0086b3cce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-822b29ab-0e24-4177-ad54-0ff3bec9c0e5'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-887a2d27-6bb8-446c-aad2-dc0086b3cce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1" status: 404 len: 194 microversion: 2.1 time: 0.042425 Aug 27 03:10:59.833173 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 518/1017] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:59.841679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.841679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.847832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.848490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.849017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.849862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.851140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.851358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.949271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.960424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.963653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:59.970540 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31bcaa3a-c850-499e-8b19-42770117507e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1438 microversion: 2.75 time: 0.141675 Aug 27 03:10:59.971130 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 519/1018] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:10:59.975996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b5ea8ac-2c3f-46dc-90c1-48c091c04b0b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e73b1db0c82c4fecb8c8fdac8d015220"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:00.064891 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1b5ea8ac-2c3f-46dc-90c1-48c091c04b0b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] HTTP exception thrown: Flavor access not found for 40 / e73b1db0c82c4fecb8c8fdac8d015220 combination. Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b5ea8ac-2c3f-46dc-90c1-48c091c04b0b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Request method failure captured: Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/flavors/990627141/action HTTP/1.1 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 70 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYs1ZgW68m1T23UiHMbYlY-CYvkJC3E5MCOjMPfhezH72WtHAwwX5WTq0dwtH80qIA621zNEnDCySRfTbsq4voa-n2nSZWzjublWq1EDkZQ2Bhlx21s6QZU-VK4qg9YrEuVEEKHA2NKewaZFlKf26frxehzuaNCO3wlVocDNhHEWGXk Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: afd081ba76cb446a9ff6226c0d35c4d3 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/afd081ba76cb446a9ff6226c0d35c4d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/afd081ba76cb446a9ff6226c0d35c4d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_afd081ba76cb446a9ff6226c0d35c4d3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/afd081ba76cb446a9ff6226c0d35c4d3"}]}] Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: afd081ba76cb446a9ff6226c0d35c4d3 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: e3f7454198624b019e1cdba69c3ab651 Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: {"removeTenantAccess": {"tenant": "e73b1db0c82c4fecb8c8fdac8d015220"}} Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: exception: Flavor access not found for 40 / e73b1db0c82c4fecb8c8fdac8d015220 combination. Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '990627141', 'body': {'removeTenantAccess': {'tenant': 'e73b1db0c82c4fecb8c8fdac8d015220'}}} Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / e73b1db0c82c4fecb8c8fdac8d015220 combination. Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:00.066993 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / e73b1db0c82c4fecb8c8fdac8d015220 combination. Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / e73b1db0c82c4fecb8c8fdac8d015220 combination. Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b5ea8ac-2c3f-46dc-90c1-48c091c04b0b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Returning 404 to user: Flavor access not found for 40 / e73b1db0c82c4fecb8c8fdac8d015220 combination. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b5ea8ac-2c3f-46dc-90c1-48c091c04b0b tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors/990627141/action" status: 404 len: 124 microversion: 2.1 time: 0.096375 Aug 27 03:11:00.073034 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 520/1019] 10.222.0.69 () {60 vars in 1197 bytes} [Sat Aug 27 03:10:59 2022] POST /compute/v2.1/flavors/990627141/action => generated 124 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:00.080749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21cc8354-6627-4595-9e31-dd107740b330 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457f1d160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:00.124025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:00.133343 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b956cf6c-9111-4281-9294-d91abb3ce5e7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.594069 Aug 27 03:11:00.133930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 500/1020] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:00.139196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:00.141965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:00.148221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.149033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.150046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.150963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.151654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.152521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.270938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:00.271521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:00.272082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:00.272694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:00.273407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:00.362485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:00.365812 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21cc8354-6627-4595-9e31-dd107740b330 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.294791 Aug 27 03:11:00.378321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.378580 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 521/1021] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:11:00 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:00.378702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.378702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.378702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.378702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.378702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.385323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:00.386355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:00.394911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.396606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.397617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.399273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.402028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.402946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.600875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:00.612729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:00.631784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:00.633728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:00.646248 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8db6a89b-a242-47bf-bde9-a1d1c1425e0f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.270246 Aug 27 03:11:00.647729 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 522/1022] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:00 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:00.653039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-471f736f-5614-49dc-8a3c-7d67a1ab2fcd tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:00.665233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-80a46e99-ae69-4794-99db-2ebf054e360f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "POST /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654/action" status: 202 len: 1495 microversion: 2.75 time: 0.530152 Aug 27 03:11:00.666738 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 501/1023] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:11:00 2022] POST /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654/action => generated 1495 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 03:11:00.675748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:00.678478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:00.695270 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-471f736f-5614-49dc-8a3c-7d67a1ab2fcd tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/990627141" status: 202 len: 0 microversion: 2.1 time: 0.046398 Aug 27 03:11:00.697134 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 523/1024] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:11:00 2022] DELETE /compute/v2.1/flavors/990627141 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:00.702494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.703335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.704667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.706114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:00.709086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:00.709086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:00.714813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4185a707-7ee7-49f6-b1dc-86101b7ed24d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe457e7e0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-710879835", "description": "tempest-description-852138115"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:00.972328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4185a707-7ee7-49f6-b1dc-86101b7ed24d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.273748 Aug 27 03:11:00.986504 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 524/1025] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:11:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:00.999030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fc4bf0f4-00c4-40d5-a87c-7926f032aa59 req-caab4e92-bc69-48a0-89c7-8ec29025726e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61cb6ca-8b57-4408-b6a2-5e8e542ce81a", "name": "network-vif-plugged", "status": "completed", "tag": "7c4936ee-07ae-40cf-b35c-9ec273970636"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:01.014437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fc4bf0f4-00c4-40d5-a87c-7926f032aa59 req-caab4e92-bc69-48a0-89c7-8ec29025726e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.015359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fc4bf0f4-00c4-40d5-a87c-7926f032aa59 req-caab4e92-bc69-48a0-89c7-8ec29025726e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.015359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fc4bf0f4-00c4-40d5-a87c-7926f032aa59 req-caab4e92-bc69-48a0-89c7-8ec29025726e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.030996 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fc4bf0f4-00c4-40d5-a87c-7926f032aa59 req-caab4e92-bc69-48a0-89c7-8ec29025726e service nova] Creating event network-vif-plugged:7c4936ee-07ae-40cf-b35c-9ec273970636 for instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a on n-h2-852086-5 Aug 27 03:11:01.037114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fc4bf0f4-00c4-40d5-a87c-7926f032aa59 req-caab4e92-bc69-48a0-89c7-8ec29025726e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047995 Aug 27 03:11:01.042420 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 525/1026] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:01.049730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:01.051154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:01.059136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.076498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.079955 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1657fed-4cf5-4eb3-a6ca-e5b45b100efb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1318 microversion: 2.1 time: 0.411610 Aug 27 03:11:01.080416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.081376 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 502/1027] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:00 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:01.081725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.082808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.086196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.086810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.091381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51479768-0be0-4c25-b888-b330ca253084 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:01.125085 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51479768-0be0-4c25-b888-b330ca253084 tempest-FlavorsAccessNegativeTestJSON-1056073982 tempest-FlavorsAccessNegativeTestJSON-1056073982-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5478 microversion: 2.1 time: 0.041065 Aug 27 03:11:01.126677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 503/1028] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:11:01 2022] GET /compute/v2.1/flavors/detail => generated 5478 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:01.136506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:01.138286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:01.156156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.158224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.159396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.160625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.161744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.162834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.276055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.300871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.302635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.309826 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1bb8f65-e1be-457c-8d01-372be0ec5207 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.265181 Aug 27 03:11:01.310836 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 526/1029] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:01 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:01.317913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb04b9ff-5fd4-43dd-a3d5-dfec200df45f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe457f1d310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-471993816", "description": "tempest-description-1981815254"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:01.572918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.589997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.593517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.595781 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b9c8259-215e-4cca-88d3-f14457cd02b1 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.467590 Aug 27 03:11:01.596735 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 504/1030] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:01 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:01.612956 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb04b9ff-5fd4-43dd-a3d5-dfec200df45f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.300246 Aug 27 03:11:01.614795 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 527/1031] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:11:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:01.615403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:01.616427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:01.637872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.638714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.639736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.641135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.642230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.643212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.675651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:01.677043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:01.684126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.684965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.685598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.686547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:01.687192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:01.687810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:01.935250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:01.948911 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5730b054-bea3-47ad-98a0-e540ec726bf0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.276591 Aug 27 03:11:01.949902 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 528/1032] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:01 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:01.972904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1189194849", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "d0d61aeb-6578-4809-8b65-8c47d7949dcd"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:02.025536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.038622 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c05e46ae-4699-458b-8234-30220a5e20bd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.440117 Aug 27 03:11:02.041266 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 505/1033] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:01 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:02.076365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] validate_networks() for [('d0d61aeb-6578-4809-8b65-8c47d7949dcd', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:02.125754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:02.127086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:02.136214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.137108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.137801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.139007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.139860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.141672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.397490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.408037 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f304dd4a-238b-41a4-a9e1-3985113d44eb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1467 microversion: 2.1 time: 0.290218 Aug 27 03:11:02.409003 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 506/1034] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:02 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1467 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:02.414120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:02.415070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:02.422563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.423492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.424045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.424783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.425248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.425673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.497126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.499714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:02.507360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.508832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.517542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2104d7b4-3269-4fed-b5ec-b2e9dc6ad1fa tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.107116 Aug 27 03:11:02.518197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 507/1035] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:02 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:02.522717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:02.523326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:02.532224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.533584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.534591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.536248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.537256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.538815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.593754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:02.722907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:02.723656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:02.725249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:02.725738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:02.726541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:02.732281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=14,nova_api:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:02.740792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=53 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:02.748698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.750196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.751225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.753826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.755143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.755840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.772147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.773916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=21 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:02.788837 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8edaa02a-0946-4afa-80b7-7a1182204251 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5" status: 200 len: 1468 microversion: 2.1 time: 0.269216 Aug 27 03:11:02.802990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Getting quotas for project 90ebbb9e792148aca468510c69c89d14. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:02.806477 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 508/1036] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:02 2022] GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5 => generated 1468 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:02.816212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Getting quotas for user 657d8e0c58fa4aa58c4e8e1b1bfa74d3 and project 90ebbb9e792148aca468510c69c89d14. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:02.817281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:02.820420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:02.832747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.833253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.833695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.834632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.835102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.835536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.848639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:02.853230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:02.924920 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc7e8944-6458-4a63-ae87-e9556e60d6bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970748 Aug 27 03:11:02.926272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 529/1037] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:02.932910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:02.939412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:02.940654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Searching by: {'reservation_id': 'r-6e2bbnn9', 'deleted': False, 'project_id': '587c41ae3469462b8099222b2bb2a278'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:11:02.952882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.953545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.954362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:02.957988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:02.959769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:02.961419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.103989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.126651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.131472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.134249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:11:03.135928 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04bd5bdc-a78c-4ba0-b2f9-518c0e7b9edb tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.325502 Aug 27 03:11:03.137994 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 509/1038] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:02 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:03.148171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e029fd82-a557-44c8-b4f8-c196541bc8ed tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.149954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e029fd82-a557-44c8-b4f8-c196541bc8ed tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:03.205519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:03.243331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e029fd82-a557-44c8-b4f8-c196541bc8ed tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.244305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.257201 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e029fd82-a557-44c8-b4f8-c196541bc8ed tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1216 microversion: 2.1 time: 0.116706 Aug 27 03:11:03.258471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.259446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.274230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.275278 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 510/1039] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:03.281302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.294968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:03.305323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.306227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.307009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.308275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.309092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.309838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.562495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.577689 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f205f270-f045-44df-890b-43e705439c75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1378 microversion: 2.1 time: 0.314082 Aug 27 03:11:03.578832 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 511/1040] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1378 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:03.583996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.584854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:03.592797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.593667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.594429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.595380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.596053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.596749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.644212 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b99ca168-d9ae-4c57-a0b7-275966a28bbb tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?reservation_id=r-6e2bbnn9" status: 200 len: 2928 microversion: 2.1 time: 0.715740 Aug 27 03:11:03.645906 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 530/1041] 10.222.0.69 () {58 vars in 1197 bytes} [Sat Aug 27 03:11:02 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6e2bbnn9 => generated 2928 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:03.661775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.665020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:03.687724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.688775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.689704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.692424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.693862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.694675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.833870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.850202 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b1ff05d7-f15f-4c22-8ec6-032280a35d65 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.269849 Aug 27 03:11:03.851645 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 512/1042] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:03.873903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ecfc2d84-cb0f-461f-be1e-8b57c14ae634 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.887588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.906074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.909605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.916769 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c504ced-b01c-4363-a355-8546f73fca76 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.268726 Aug 27 03:11:03.918516 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 531/1043] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:03.935267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.server_groups [None req-ecfc2d84-cb0f-461f-be1e-8b57c14ae634 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Querying cell c415b947-a476-436d-b81a-456a5f662c42(cell1) for 2 instances {{(pid=122407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 03:11:03.936949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfc2d84-cb0f-461f-be1e-8b57c14ae634 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.938261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfc2d84-cb0f-461f-be1e-8b57c14ae634 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.939273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfc2d84-cb0f-461f-be1e-8b57c14ae634 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.002904 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ecfc2d84-cb0f-461f-be1e-8b57c14ae634 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/fc4e2058-4f1f-46af-9394-dd13393d7437" status: 200 len: 271 microversion: 2.1 time: 0.149199 Aug 27 03:11:04.003743 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 513/1044] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/os-server-groups/fc4e2058-4f1f-46af-9394-dd13393d7437 => generated 271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:04.023062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.024243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.034426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.035305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.035973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.037176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.037886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.038511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.168910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.169951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.181889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.183248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.184023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.185415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.186491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.187498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.259287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93f04079-33f1-4cef-89ec-4bd7d31404ed tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1618 microversion: 2.1 time: 0.242638 Aug 27 03:11:04.261581 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 532/1045] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1618 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:04.300432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.301634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.323167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.324794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.326984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.328374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.329461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.330468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.439363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:04.457046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:04.460947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:04.463544 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17eb5f17-4b67-4844-b00c-e5852701b2ba tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.301824 Aug 27 03:11:04.478200 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 514/1046] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:11:04.478200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.478200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.480800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.481302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.481884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.482742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.483198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.484107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.486323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:04.499388 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb4c5d3c-1c7a-40a5-9e15-8357535c9dab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1268 microversion: 2.1 time: 0.210667 Aug 27 03:11:04.513833 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 533/1047] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1268 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:04.609617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.622963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.636764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.638195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.639391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.640868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.641628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.642299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.675230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:04.720510 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-383d50e4-af9d-45ce-9784-3407e1feca12 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5" status: 200 len: 1619 microversion: 2.1 time: 0.253706 Aug 27 03:11:04.727278 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 515/1048] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5 => generated 1619 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:04.892238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.894413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.916238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.921951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:04.922272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.922583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.923384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.924029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.924660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.936601 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac0f2e8d-bb40-4bf3-975f-e2556498ee47 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1528 microversion: 2.1 time: 0.333254 Aug 27 03:11:04.942230 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 534/1049] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1528 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:04.965276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.966178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.976869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.977440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.978195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:04.979132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:04.980212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:04.980794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.079625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:05.090836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:05.092322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:05.098035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58cad4e0-f002-4a21-9da5-f8a4261df61a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.140919 Aug 27 03:11:05.098642 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 535/1050] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:11:05.104254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.104880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.111661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.111970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.112616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.113336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.113796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.114238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.209325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:05.224123 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfb1ed99-7f08-4018-bcec-243f8272d726 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.340120 Aug 27 03:11:05.224727 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 516/1051] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:05.233530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-122455718", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:05.310081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:05.679341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:05.706035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac3512de-c5d1-49e7-9497-1961920a495b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1528 microversion: 2.1 time: 0.605790 Aug 27 03:11:05.707233 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 536/1052] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:05 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1528 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:05.714978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:05.716051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:05.717164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:05.717965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.718295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:05.718930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:05.721356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.731512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.732301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.733026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.734217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.735014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.736406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.737417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:05.755076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.755912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.756677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.757693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.758524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.762805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.788835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:05.795704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:05.811214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:05.813693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:05.914616 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bb44affa-1a62-4792-aaca-b704b01c0f60 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676101 Aug 27 03:11:05.928950 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 517/1053] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:05.951414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.952554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:05.964470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.965433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.967066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:05.968295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:05.969101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:05.970113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.117131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.131341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.133163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.136173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.146525 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81803e59-6a7e-4799-8c0a-aa37af9fc6cc tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.429006 Aug 27 03:11:06.147491 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 537/1054] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:05 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:06.153478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-880bb1d9-684f-41a6-a521-2bea500361bd tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:06.182541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7701a77-6b4b-43b8-976f-08ea9ddf68b6 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1274 microversion: 2.1 time: 0.241882 Aug 27 03:11:06.183767 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 518/1055] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:05 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:06.192553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3bca510-607a-4e6e-b384-8c26c386e606 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:06.194200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3bca510-607a-4e6e-b384-8c26c386e606 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:06.205644 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-880bb1d9-684f-41a6-a521-2bea500361bd tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a" status: 202 len: 0 microversion: 2.1 time: 0.056800 Aug 27 03:11:06.206538 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 538/1056] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:06 2022] DELETE /compute/v2.1/flavors/9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:06.225526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:06.225526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:06.233457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.234010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.234672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.235755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.236400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.237284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.354030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c3bca510-607a-4e6e-b384-8c26c386e606 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.375644 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3bca510-607a-4e6e-b384-8c26c386e606 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1216 microversion: 2.1 time: 0.189984 Aug 27 03:11:06.383397 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 519/1057] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:06 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:06.393771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8fd638c-e5c3-4712-acae-9b9918605b97 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:06.395264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.423317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.424905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.443085 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f361be5-e461-426a-ab1c-a5ac2bef5016 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.234986 Aug 27 03:11:06.445145 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 539/1058] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:06 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:06.454880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:06.456641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:06.467712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.468223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.468948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.471161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.473057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.474718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.486841 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a8fd638c-e5c3-4712-acae-9b9918605b97 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105865 Aug 27 03:11:06.489416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 520/1059] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:11:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:06.521886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:06.527225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:06.544458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.545638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.546870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.548279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.549693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.550660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.799773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.810494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Old instance type tempest-test_resize_flavor_-97365457, new instance type m1.heat {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:11:06.852059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:06.855145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:06.856118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:06.856855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:06.860275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:07.137888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.166080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-510a47de-5ea2-40b7-8086-5f8940de1624 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.718235 Aug 27 03:11:07.168856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 540/1060] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:06 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:07.199371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:07.201843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:07.232073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.234860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.237146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.239883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.240783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.248513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.310011 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b300066-508f-4405-8c81-6d6f98e19d65 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a/action" status: 202 len: 0 microversion: 2.1 time: 0.792030 Aug 27 03:11:07.318332 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 521/1061] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:06 2022] POST /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a/action => generated 0 bytes in 805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:07.345146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:07.348094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:07.373033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.373906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.380686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.382066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.382749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.383572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.543800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.574247 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9c588b5-ff69-45ab-ad3a-645d69d8bb39 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1274 microversion: 2.1 time: 0.249906 Aug 27 03:11:07.576994 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 522/1062] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:07 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1274 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:07.586963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:07.590672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:07.611366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.613842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.615508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.618876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.622110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.625982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.875577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.903004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.907818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:07.911888 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0121310-03b5-43ab-88b4-2405eeb59f9f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.730311 Aug 27 03:11:07.916544 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 541/1063] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:07 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:07.944866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:07.946770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:07.977215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.981170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.982183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.984490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.986858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.994339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.234905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:08.262923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:08.270400 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a27f84e8-0ef4-493d-9027-7548033f03f9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1537 microversion: 2.1 time: 0.689879 Aug 27 03:11:08.273916 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 523/1064] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:07 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1537 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:08.285670 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3901cb7a-a072-4e7a-9128-cf29f95277e1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1268 microversion: 2.1 time: 0.366622 Aug 27 03:11:08.293867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:08.295505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:08.303081 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 542/1065] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:07 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1268 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:08.313788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.314954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.315613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.317437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.318202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.318865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.326702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:08.327367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:08.372814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.373578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.375911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.382749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.383741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.392240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.506836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:08.553938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:08.564413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:08.589340 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9368a61b-7a03-45f0-905f-695deb443687 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.313408 Aug 27 03:11:08.603230 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 524/1066] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:08 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:08.620632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:08.621582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:08.639248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.639870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.641055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.644831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:08.645914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:08.646024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.989556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.001449 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e28da49-ff04-4ec8-b86c-bcd9c88ea7f5 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.696149 Aug 27 03:11:09.002427 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 543/1067] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:08 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:09.009306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:09.023124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:09.044065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.045454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.048701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.050327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.064360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.064928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.109303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.124880 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-faca09a4-b993-46b3-a594-d6d1a788a678 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.510896 Aug 27 03:11:09.126678 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 525/1068] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:08 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:09.324647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:09.329458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:09.349903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.356072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.357420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.361715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.362956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.364078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.820463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.829328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.840888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.843973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.848058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2da580d7-4cc2-403e-89f2-743b6d96ec62 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.843801 Aug 27 03:11:09.850424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 544/1069] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:09 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:09.859879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:09.861494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:09.864431 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11d36504-ef8e-4e5f-9441-457a4ce87bac tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1537 microversion: 2.1 time: 0.562432 Aug 27 03:11:09.865614 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 526/1070] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:09 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1537 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:09.871651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:09.872265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:09.879384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.883283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.884377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.885469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.886061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.886698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.887849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.888698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.889146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.890041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.890556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.890985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.913006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:10.095741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.115770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.118789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.125366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.126047 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c39c439d-197e-4a6c-80e1-1eb152e51e28 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.259072 Aug 27 03:11:10.127068 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 527/1071] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:09 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:10.138559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:10.138559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:10.145991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.149122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.153960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.154901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.155532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.156298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.183832 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e0e10ae-3eb1-4e01-aee8-04ffaf066456 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1274 microversion: 2.1 time: 0.326964 Aug 27 03:11:10.188833 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 545/1072] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:09 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1274 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:10.222391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:10.224770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:10.235781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.236631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.238209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.239487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.240396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.241420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.613827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.628541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4ae0a21-e22a-4ae0-8c6e-c06dc0deb21b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.500078 Aug 27 03:11:10.630335 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 528/1073] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:10 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:10.640447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:10.662383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-113f7bc4-4b9d-4b28-90bf-8c091e6c596a req-cb515b37-54f8-49b0-9ac5-8d607751263a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f", "tag": "0ac125f0-0cb6-4e61-9884-8abc6154284a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:10.663516 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9390a8b9-25dc-462a-82d6-2f13162347a5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.472356 Aug 27 03:11:10.665252 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 546/1074] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:10 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:10.682975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-113f7bc4-4b9d-4b28-90bf-8c091e6c596a req-cb515b37-54f8-49b0-9ac5-8d607751263a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.684888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-113f7bc4-4b9d-4b28-90bf-8c091e6c596a req-cb515b37-54f8-49b0-9ac5-8d607751263a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.686012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-113f7bc4-4b9d-4b28-90bf-8c091e6c596a req-cb515b37-54f8-49b0-9ac5-8d607751263a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.705345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-113f7bc4-4b9d-4b28-90bf-8c091e6c596a req-cb515b37-54f8-49b0-9ac5-8d607751263a service nova] Creating event network-changed:0ac125f0-0cb6-4e61-9884-8abc6154284a for instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f on n-h2-852086-5 Aug 27 03:11:10.713005 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-113f7bc4-4b9d-4b28-90bf-8c091e6c596a req-cb515b37-54f8-49b0-9ac5-8d607751263a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079212 Aug 27 03:11:10.714325 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 529/1075] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:10.882537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:10.883947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:10.901909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.902645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.903019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.903750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.904218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.904651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.919298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:10.921483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:10.942252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.943564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.945378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:10.947908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:10.949237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:10.950426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.432995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:11.451337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:11.462832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:11.465290 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d72f0f2c-90cb-4544-ba1b-d775a64118a5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.589816 Aug 27 03:11:11.470702 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 547/1076] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:10 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:11.489229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:11.490714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:11.520221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.523039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.524141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.555338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.559171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.562502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.994588 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-546bfa40-b7c3-454f-99e7-045064384295 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1811 microversion: 2.1 time: 0.518500 Aug 27 03:11:11.997065 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 548/1077] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:11 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1811 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:12.007082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:12.009012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:12.020441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.021595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.022584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.024014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.025416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.026434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.128780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:12.143101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:12.146639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:12.160107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1165525f-bbc4-45ed-b903-c208c28aa096 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.160983 Aug 27 03:11:12.161464 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 549/1078] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:11 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:12.183799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:12.184429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:12.191212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.191920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.192344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.193942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.193942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.193942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.375617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:12.395998 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e739ffe4-9dc4-4d23-8eee-a24a21169734 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1537 microversion: 2.1 time: 1.488441 Aug 27 03:11:12.412860 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 530/1079] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:10 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1537 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:12.428033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e25e951e-e217-45ad-8e0d-671aff0c7af9 req-0f636ece-a18e-46e6-82c9-b8366b2f92da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607b043e-1bab-4c1d-8348-610a19b23bfa", "name": "network-vif-plugged", "status": "completed", "tag": "01d2411e-6250-4e8c-bc59-812d60bccff5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:12.459384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e25e951e-e217-45ad-8e0d-671aff0c7af9 req-0f636ece-a18e-46e6-82c9-b8366b2f92da service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.463593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e25e951e-e217-45ad-8e0d-671aff0c7af9 req-0f636ece-a18e-46e6-82c9-b8366b2f92da service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.464330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e25e951e-e217-45ad-8e0d-671aff0c7af9 req-0f636ece-a18e-46e6-82c9-b8366b2f92da service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.516007 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e25e951e-e217-45ad-8e0d-671aff0c7af9 req-0f636ece-a18e-46e6-82c9-b8366b2f92da service nova] Creating event network-vif-plugged:01d2411e-6250-4e8c-bc59-812d60bccff5 for instance 607b043e-1bab-4c1d-8348-610a19b23bfa on n-h1-852086-5 Aug 27 03:11:12.538443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:12.544935 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e25e951e-e217-45ad-8e0d-671aff0c7af9 req-0f636ece-a18e-46e6-82c9-b8366b2f92da service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130028 Aug 27 03:11:12.549794 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 531/1080] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:12.569796 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c78bad2-16b9-4b0d-9c8a-a81b67488d12 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.387894 Aug 27 03:11:12.572233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:12.573121 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 550/1081] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:12 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:12.584572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:12.601423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:12.602049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:12.611442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.614797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.615476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.619130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.620102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.622234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.627925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.632454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.633344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.638287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.642727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.645537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.969367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:12.970790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:12.982749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e154ec05-1401-4a76-a8a2-238f3e2abd02 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.427974 Aug 27 03:11:12.984176 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a99f0d6-5f86-4232-8f8d-05e94054f19b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.408800 Aug 27 03:11:12.994879 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 532/1082] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:12 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:12.995192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 551/1083] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:12 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:12.995919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.006906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.007358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.009556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:13.010834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.020291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:13.021483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.021483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.021483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.021483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.029252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.031090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.033031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.033953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.039253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.042263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.060186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:13.111677 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19db524d-7d89-4884-ae9b-1a9ed127754f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.124964 Aug 27 03:11:13.121791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 533/1084] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:11:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:13.206771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.210404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:13.232806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.233415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.234055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.235007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.239847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.240161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=7 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:13.241268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.426109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.474693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.478454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.487298 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44930a25-ed13-47f2-b07a-2c54cecb2875 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.497417 Aug 27 03:11:13.495275 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 552/1085] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:12 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:13.514382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.517903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.519132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:13.531249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.533542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.550629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.551442 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-af6b36b5-96fc-4aa4-a4f4-1746d2ca79ec tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.352644 Aug 27 03:11:13.551584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.552268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.553131 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 534/1086] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:13 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:13.560665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.566613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.567698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.604984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:13.605916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:13.623193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.624940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.625746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.627356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.628269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.629177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.982570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.997019 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ee29054-5ca9-4a77-953e-a2ee760816bb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1537 microversion: 2.1 time: 0.499964 Aug 27 03:11:14.011669 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 553/1087] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:13 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1537 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:14.024755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:14.026134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:14.035776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.036283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.037080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.039359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.040217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.041869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.148851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:14.185215 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9221ffc-9a58-4640-97aa-d360a63a319c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.575854 Aug 27 03:11:14.186433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 535/1088] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:13 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:14.204183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:14.205112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:14.222795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.223787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.224688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.225962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.228915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.229973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.411035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:14.436167 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ecc8802-3fe6-4181-81d0-b4e618e10721 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.422749 Aug 27 03:11:14.450391 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 554/1089] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:14 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:14.519217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:14.519841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:14.551044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.551044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.551044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.552344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.553184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.553971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.641135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:14.671218 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-23d8abad-34d4-43db-9284-2eb921c8b535 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.480317 Aug 27 03:11:14.687278 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 536/1090] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:14 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:14.694692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:14.705229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:14.719241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.731396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.732515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.734543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.735849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.736631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.017122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.075904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.084641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.109375 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-05cc536d-3142-4fd8-b397-f43e342e3a1b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.419876 Aug 27 03:11:15.111921 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 537/1091] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:14 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:15.122881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.124443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.136844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.138134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.140328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.141961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.143097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.144173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.198939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.222217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.231125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.239178 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7419cf43-be36-4cc1-a5f9-7b7cfe767428 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1411 microversion: 2.25 time: 0.721637 Aug 27 03:11:15.241584 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 555/1092] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:14 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1411 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:15.294780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.297701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.326623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.327947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.331223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.332782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.337777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.340048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.534706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.553296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9375500a-06e6-45ad-a841-4606a37f206c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1537 microversion: 2.1 time: 0.439281 Aug 27 03:11:15.557131 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 538/1093] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1537 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:15.569569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5898026b-0d76-4ba4-a741-1c7a85acc6dd req-ddc379fc-710e-4dcc-b743-c7670a369afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace45f85-bd05-40de-8cf7-4e0b9e366c12", "tag": "31c116f1-58c6-46b3-94fe-8a1e3bc2dd0c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:15.605843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5898026b-0d76-4ba4-a741-1c7a85acc6dd req-ddc379fc-710e-4dcc-b743-c7670a369afc service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.606547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5898026b-0d76-4ba4-a741-1c7a85acc6dd req-ddc379fc-710e-4dcc-b743-c7670a369afc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.606990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5898026b-0d76-4ba4-a741-1c7a85acc6dd req-ddc379fc-710e-4dcc-b743-c7670a369afc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.640246 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5898026b-0d76-4ba4-a741-1c7a85acc6dd req-ddc379fc-710e-4dcc-b743-c7670a369afc service nova] Creating event network-changed:31c116f1-58c6-46b3-94fe-8a1e3bc2dd0c for instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 on n-h1-852086-5 Aug 27 03:11:15.653819 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5898026b-0d76-4ba4-a741-1c7a85acc6dd req-ddc379fc-710e-4dcc-b743-c7670a369afc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095298 Aug 27 03:11:15.654788 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 539/1094] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:15.664574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.672744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.691365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.692071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.692875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.693797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.694479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.695606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.837681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:15.861493 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ba8affd-cb63-430c-91bc-ddb2e8d83d7f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.615816 Aug 27 03:11:15.862238 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 556/1095] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:15.877745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.879194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.896974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.897638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.900114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.901425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.904534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.905185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.029635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.049461 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d3e4c030-1f9c-4049-bf16-e1ddb35438b7 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.393622 Aug 27 03:11:16.066988 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 540/1096] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:16.150560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:16.151503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:16.160260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.161154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.161818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.162808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.163443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.164031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.216995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.249977 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93f00d92-13e6-4ff8-8f00-4dc98b2e2d43 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1471 microversion: 2.1 time: 0.386205 Aug 27 03:11:16.251046 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 557/1097] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:16.268712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:16.269565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:16.280597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.281158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.282058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.283369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.284186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.285326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.296008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.312253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.316694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.327737 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17f50196-3457-46b4-9129-a0558c649b87 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.183275 Aug 27 03:11:16.332135 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 541/1098] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:16 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:16.598596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:16.600118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:16.606947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:16.614567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.639759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.640792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.641728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.644107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.645463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.646645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.648681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.663702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.669462 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6317869-09b4-49e6-b927-8bf71ef0b36e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1607 microversion: 2.25 time: 0.405407 Aug 27 03:11:16.670505 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 558/1099] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:16 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1607 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:11:16.704146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:16.704980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:16.714463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.715270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.716177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.719770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.721084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.721935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.004496 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3b21070-063e-4dcc-91a5-82339692a0a8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.305641 Aug 27 03:11:17.005478 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 559/1100] 10.222.0.69 () {60 vars in 1316 bytes} [Sat Aug 27 03:11:16 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-interface => generated 284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:11:17.027887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:17.041050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:17.043793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:17.066949 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46da709d-a73b-4b59-8bd3-94f4dfcfde6f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.473279 Aug 27 03:11:17.069985 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 542/1101] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:16 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:17.081591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.092833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:17.095946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.096238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:17.096733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.104748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.105672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.106574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.129243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.130905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.137508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.139811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.144843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.146013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.719227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:17.733052 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f30fdbfd-ff5b-4bde-868a-dcf1f8b8d144 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.725981 Aug 27 03:11:17.734082 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 560/1102] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:17 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:17.753590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:17.754634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:17.763712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.764553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.764999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.765927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.766477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.767087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.915026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:17.930180 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4299ae18-b8ec-4b1b-a6b0-8d4408ce8a4f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.849163 Aug 27 03:11:17.941847 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 543/1103] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:17 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:17.974332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:17.975684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:17.981941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:17.988849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.990208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.991810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.993022 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2cd93f9b-2e7e-4a9b-8e60-e32af1106579 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1477 microversion: 2.1 time: 0.257512 Aug 27 03:11:17.993657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.994873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.995659 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 561/1104] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:17 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:17.996708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.018800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fc2367f-158c-4626-94fa-f95129632642", "device": "/dev/xvdb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:18.031342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:18.043935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.044759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.045506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.046775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.047805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.048800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.231206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.241731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.244507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.259596 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bb89485f-8beb-40e8-9ce8-469f4704af6d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.315902 Aug 27 03:11:18.260420 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 544/1105] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:17 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:18.288540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:18.290822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:18.306279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.308250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.309058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.310698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.311573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.312369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.842066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.861127 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16c33044-1969-41f2-847f-2ecfca9c1cdf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.598186 Aug 27 03:11:18.861759 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 545/1106] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:18 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:18.866756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:18.867656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:18.875672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.876519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.877445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.878294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.878954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.879680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.906330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:19.368600 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19b8f37a-736b-4ee0-b286-88e26047e377 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "POST /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.367847 Aug 27 03:11:19.381569 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 562/1107] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:11:17 2022] POST /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 194 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:19.397659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:19.400711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:19.417171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.418617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.419880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.421082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.422795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.425475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.733323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:19.742660 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c53a856e-60cd-4a3d-bdca-4f32ae2ee5c0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.357052 Aug 27 03:11:19.744995 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 563/1108] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:19 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:19.753635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:19.755344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:19.765245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.766202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.767059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.768378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.769398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.770575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.905696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:19.922382 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9014ae54-fe4b-428e-ab54-a7edfc4c59f5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 1.058937 Aug 27 03:11:19.923805 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 546/1109] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:18 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:19.932666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:19.933581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:19.940368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.941172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.941954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.942911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.943531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.944645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.034421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.091857 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0a6f1a4-e460-4feb-b144-aee36805af78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1477 microversion: 2.1 time: 0.337214 Aug 27 03:11:20.091857 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 564/1110] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:19 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:20.119543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:20.120617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:20.133262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.134977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.135921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.137089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.138122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.141360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.153870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.177428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.185309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.196769 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e159535-8c2a-4eef-b391-110b4324584e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.270454 Aug 27 03:11:20.199345 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 547/1111] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:19 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:20.470094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:20.485563 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e1561e3-8e9f-4fae-b81d-cdffa7b9fb7a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.394970 Aug 27 03:11:20.487010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 565/1112] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:20 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:20.768122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:20.769126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:20.778359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.779528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.780323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.784158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.785493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.786548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.966777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:20.977684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:20.992030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:20.995279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.999933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.006088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.007236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.007960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.009200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.338865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.348262 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e5405fb-e75e-4169-b4a9-f02daf9529d4 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.391052 Aug 27 03:11:21.364503 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 566/1113] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:20 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:21.371221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:21.371868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:21.380597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.381265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.381912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.384861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.385754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.386689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.536979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.556067 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-baae99b8-7e80-454e-a15b-52904dc34a7d tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.789341 Aug 27 03:11:21.574214 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 548/1114] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:20 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:21.587958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:21.591852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:21.614245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.618049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.618049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.620668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.622003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.625149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.733361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.736480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:21.746111 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a5c159e-dbe4-41d7-89c6-7de729a51e74 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1477 microversion: 2.1 time: 0.380261 Aug 27 03:11:21.746979 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 567/1115] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:21 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:21.760863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:21.762024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:21.773902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.775998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.776619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.778150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.779093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.780238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.825914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.845381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.846902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.857253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:21.877645 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-066918f7-98c6-4dbe-a14a-c3b2ab99e1c7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.304333 Aug 27 03:11:21.879808 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 549/1116] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:21 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:21.892793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5e80bda0-5ed8-44f3-99e9-acd6477d2fac req-35ebb530-430c-4382-9675-e053635c2f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd3b4a0-b115-4688-af4f-27f15a0eaea0", "name": "network-vif-unplugged", "status": "completed", "tag": "a94fdd64-5583-4e14-bd48-74552e561a6b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:21.937425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5e80bda0-5ed8-44f3-99e9-acd6477d2fac req-35ebb530-430c-4382-9675-e053635c2f40 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.942141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5e80bda0-5ed8-44f3-99e9-acd6477d2fac req-35ebb530-430c-4382-9675-e053635c2f40 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.943434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5e80bda0-5ed8-44f3-99e9-acd6477d2fac req-35ebb530-430c-4382-9675-e053635c2f40 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.988943 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5e80bda0-5ed8-44f3-99e9-acd6477d2fac req-35ebb530-430c-4382-9675-e053635c2f40 service nova] Creating event network-vif-unplugged:a94fdd64-5583-4e14-bd48-74552e561a6b for instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 on n-h1-852086-5 Aug 27 03:11:22.005926 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5e80bda0-5ed8-44f3-99e9-acd6477d2fac req-35ebb530-430c-4382-9675-e053635c2f40 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124106 Aug 27 03:11:22.012663 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 550/1117] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:22.019110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d02377ab-2655-4c10-b97e-924d9763bfa6 req-b56dfac3-6855-4587-a75d-f2be6cc4f63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "607b043e-1bab-4c1d-8348-610a19b23bfa", "tag": "01d2411e-6250-4e8c-bc59-812d60bccff5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:22.067119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d02377ab-2655-4c10-b97e-924d9763bfa6 req-b56dfac3-6855-4587-a75d-f2be6cc4f63f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.067774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d02377ab-2655-4c10-b97e-924d9763bfa6 req-b56dfac3-6855-4587-a75d-f2be6cc4f63f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.068692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d02377ab-2655-4c10-b97e-924d9763bfa6 req-b56dfac3-6855-4587-a75d-f2be6cc4f63f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.111896 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d02377ab-2655-4c10-b97e-924d9763bfa6 req-b56dfac3-6855-4587-a75d-f2be6cc4f63f service nova] Creating event network-changed:01d2411e-6250-4e8c-bc59-812d60bccff5 for instance 607b043e-1bab-4c1d-8348-610a19b23bfa on n-h1-852086-5 Aug 27 03:11:22.128059 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d02377ab-2655-4c10-b97e-924d9763bfa6 req-b56dfac3-6855-4587-a75d-f2be6cc4f63f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113014 Aug 27 03:11:22.131382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 551/1118] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:22.195360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:22.211334 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-510f8c50-f5b6-45ea-8d54-4a8cfe4777de tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.463191 Aug 27 03:11:22.222192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 568/1119] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:21 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:22.373957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:22.374689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:22.388575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.402228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.403187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.404742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.409076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.409647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.595455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:22.596454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:22.608524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.613881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.614612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.615646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.616339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.616949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:23.035822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:23.249495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:23.283093 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7febbbdd-1e55-408b-8c68-edd980ecc442 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.913498 Aug 27 03:11:23.304027 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 552/1120] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:22 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:23.338576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:23.338576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:23.350505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:23.351181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:23.351821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:23.353891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:23.361605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:23.369627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:23.835033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:23.853750 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb17616f-bb1b-44ad-a3de-f41339d4bc06 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 1.261289 Aug 27 03:11:23.870200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 569/1121] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:22 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:23.886237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:23.886237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:23.894774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:23.895384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:23.896478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:23.897348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:23.898063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:23.899221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.169901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:24.213955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:24.219702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:24.237879 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7cdf3aa-c96b-44bc-b207-8a4d9e710f84 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.378393 Aug 27 03:11:24.242054 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 570/1122] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:23 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:24.250596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:24.258327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:24.275304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.276182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.279184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.280095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:24.280637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.281317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.287924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.300055 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9372848f-59a6-4480-9750-f2374c657869 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1477 microversion: 2.1 time: 0.994426 Aug 27 03:11:24.301426 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 553/1123] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:23 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1477 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:24.307192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-10677a39-fbb3-4ba9-a84c-7571875b0e06 req-6987155d-dfe1-4abb-b437-281a45d79ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f", "name": "network-vif-plugged", "status": "completed", "tag": "0ac125f0-0cb6-4e61-9884-8abc6154284a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:24.331893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-10677a39-fbb3-4ba9-a84c-7571875b0e06 req-6987155d-dfe1-4abb-b437-281a45d79ba5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.334848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-10677a39-fbb3-4ba9-a84c-7571875b0e06 req-6987155d-dfe1-4abb-b437-281a45d79ba5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.335795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-10677a39-fbb3-4ba9-a84c-7571875b0e06 req-6987155d-dfe1-4abb-b437-281a45d79ba5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.381608 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-10677a39-fbb3-4ba9-a84c-7571875b0e06 req-6987155d-dfe1-4abb-b437-281a45d79ba5 service nova] Creating event network-vif-plugged:0ac125f0-0cb6-4e61-9884-8abc6154284a for instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f on n-h2-852086-5 Aug 27 03:11:24.399468 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-10677a39-fbb3-4ba9-a84c-7571875b0e06 req-6987155d-dfe1-4abb-b437-281a45d79ba5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095525 Aug 27 03:11:24.400814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 554/1124] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:24.409038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:24.410042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:24.418136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.419361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.420278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.421363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.422294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.422935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.707998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:24.717970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91818edc-0c1b-4dc4-9da9-2c48979c92ca tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.473430 Aug 27 03:11:24.724895 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 571/1125] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:24 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:24.896878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:24.897787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:24.904012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.904803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.905246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.905969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.906887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.907495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.127120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.143917 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc69a51b-fc66-44ba-b24c-ec0c068e463f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.248411 Aug 27 03:11:25.143917 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 572/1126] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:24 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:25.162593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.180420 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7fbfdeb8-ec8a-40d4-8c82-2f13678d1a98 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.776919 Aug 27 03:11:25.182632 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 555/1127] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:24 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:25.290659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:25.291523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:25.300804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.301301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.301746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.302538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.302976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.303400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.349248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:25.351375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:25.364816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.365669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.366793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.368503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.369276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.370024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.415955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.433023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.435332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.445493 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97fb7ae4-e6c4-430b-96ca-8dda88eb2057 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.161031 Aug 27 03:11:25.450630 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 573/1128] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:25 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:25.637354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.654334 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bfa8017e-43ee-49ef-95fd-86d097eea398 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1477 microversion: 2.1 time: 0.312390 Aug 27 03:11:25.655775 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 556/1129] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:25 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:25.755348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:25.756079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:25.763225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.763866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.764544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.765481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.766379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.767111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.071874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.092587 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a2191fa-9bb6-4e04-96b8-d71b5af1ff45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.343605 Aug 27 03:11:26.107861 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 574/1130] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:25 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:26.162916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:26.163734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.178495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.179843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.179843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.180706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.181322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.181887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.220390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:26.221873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.264606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.265655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.265655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.266493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.267646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.273748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.575635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.589286 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-569f097a-eef7-4791-8aac-b9a7c5a6bc0c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1316 microversion: 2.1 time: 0.430185 Aug 27 03:11:26.595364 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 557/1131] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:26 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:26.609408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-96568086-8f7e-42b6-a923-e083c54c9c11 req-57a19fae-ebde-4b39-8f88-b53cd3480880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd3b4a0-b115-4688-af4f-27f15a0eaea0", "name": "network-vif-plugged", "status": "completed", "tag": "a94fdd64-5583-4e14-bd48-74552e561a6b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:26.629018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96568086-8f7e-42b6-a923-e083c54c9c11 req-57a19fae-ebde-4b39-8f88-b53cd3480880 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.629870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96568086-8f7e-42b6-a923-e083c54c9c11 req-57a19fae-ebde-4b39-8f88-b53cd3480880 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.630568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96568086-8f7e-42b6-a923-e083c54c9c11 req-57a19fae-ebde-4b39-8f88-b53cd3480880 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.645697 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-96568086-8f7e-42b6-a923-e083c54c9c11 req-57a19fae-ebde-4b39-8f88-b53cd3480880 service nova] Creating event network-vif-plugged:a94fdd64-5583-4e14-bd48-74552e561a6b for instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 on n-h1-852086-5 Aug 27 03:11:26.654530 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-96568086-8f7e-42b6-a923-e083c54c9c11 req-57a19fae-ebde-4b39-8f88-b53cd3480880 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056771 Aug 27 03:11:26.655861 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 558/1132] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:26.670020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:26.671454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.682320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.683152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.683790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.685027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.685662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.686604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.806339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.837076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.850916 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69dd9e35-4d0c-43d8-bba3-61661b8a80de tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.623977 Aug 27 03:11:26.852272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 575/1133] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:26 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:26.857517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.860088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.860360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:26.873983 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e5aebe3-80f1-4f3b-a051-9778733ce8ff tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.204845 Aug 27 03:11:26.875251 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 559/1134] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:26 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:26.875412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.896205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.896529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.896872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.897729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.898294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.898800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.118704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.119778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.133272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.135663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.136517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.139285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.140794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.141597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.261521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:27.280879 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3def7035-58c3-424f-be7d-dbda51ec49a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1477 microversion: 2.1 time: 0.426956 Aug 27 03:11:27.302730 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 576/1135] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:26 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:27.381686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:27.398699 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-288f2aaf-d876-4f6b-a098-91d949488009 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.284320 Aug 27 03:11:27.401837 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 560/1136] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:27.612477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.613167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.624149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.624681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.625123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.625871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.626358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.626786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.883747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.884880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.906916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.920184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.920638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.926686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.929233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.934373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.940171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:27.948572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c51f4c2-47ae-405a-a94e-0eccfcb239ef tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1503 microversion: 2.1 time: 0.340214 Aug 27 03:11:27.949170 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 577/1137] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:27.978459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.979619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.998206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.998914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.999547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.000458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.001077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.003860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.161191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.177468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.179137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.195835 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86374129-644e-4a2b-bc28-60cdb5777c75 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.245480 Aug 27 03:11:28.197056 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 578/1138] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:28.202272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-710879835"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:28.215210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:28.234623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.237718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.239084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.241280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.244009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.245368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.252027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.280728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-068f18bb-dfef-411b-b993-2bd82d7412c1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.399704 Aug 27 03:11:28.282338 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 561/1139] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:28.317606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:28.319090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:28.329758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.330723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.331507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.332967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.333989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.334966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.711988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.723540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49b1e093-64f2-4483-bf9a-bf3c9d5c8f68 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1477 microversion: 2.1 time: 0.412320 Aug 27 03:11:28.724508 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 562/1140] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:28 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1477 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:28.731046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:28.732063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:28.770054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.781037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.787541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.789131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.790819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.791526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.814367 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Adding security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea to port 0ac125f0-0cb6-4e61-9884-8abc6154284a Aug 27 03:11:29.053513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.075201 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df29d93d-bded-46cd-9822-1743f54cd1d9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.348820 Aug 27 03:11:29.077113 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 563/1141] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:28 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:29.084937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8b71c093-d6a9-4c48-be86-824734437c95 req-2c90ed38-a523-4c6e-a7d1-1199f0c2f429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace45f85-bd05-40de-8cf7-4e0b9e366c12", "name": "network-vif-plugged", "status": "completed", "tag": "31c116f1-58c6-46b3-94fe-8a1e3bc2dd0c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:29.108205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b71c093-d6a9-4c48-be86-824734437c95 req-2c90ed38-a523-4c6e-a7d1-1199f0c2f429 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.108719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b71c093-d6a9-4c48-be86-824734437c95 req-2c90ed38-a523-4c6e-a7d1-1199f0c2f429 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.109149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b71c093-d6a9-4c48-be86-824734437c95 req-2c90ed38-a523-4c6e-a7d1-1199f0c2f429 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.129851 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8b71c093-d6a9-4c48-be86-824734437c95 req-2c90ed38-a523-4c6e-a7d1-1199f0c2f429 service nova] Creating event network-vif-plugged:31c116f1-58c6-46b3-94fe-8a1e3bc2dd0c for instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 on n-h1-852086-5 Aug 27 03:11:29.136892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8b71c093-d6a9-4c48-be86-824734437c95 req-2c90ed38-a523-4c6e-a7d1-1199f0c2f429 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056766 Aug 27 03:11:29.142603 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 564/1142] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:29.229712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.231793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:29.243563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.245450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.246688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.247694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.248349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.251321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.463247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.477442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.490603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.511117 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9065658-7270-4811-a5f1-474a1c80dca7 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.287227 Aug 27 03:11:29.513359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 565/1143] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:29 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:29.522618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.523668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:29.548505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.549707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.550850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.552306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.553123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.553856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.586788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:29.814253 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7ee66f0-3d40-4c6c-b07b-8a868bb1c0e0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f/action" status: 202 len: 0 microversion: 2.1 time: 1.611431 Aug 27 03:11:29.815856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 579/1144] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:28 2022] POST /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f/action => generated 0 bytes in 1618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:29.817152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.826730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.828980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:29.837994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-77ea334b-fcb8-4aa3-b1fd-3b682624af1c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1316 microversion: 2.1 time: 0.319886 Aug 27 03:11:29.839021 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 566/1145] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:29 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:29.844490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0cb67cda-214f-4bfc-8a75-870f342940a4 req-8bb76ede-ec3e-4e51-b3c6-80e27f34795d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f", "tag": "0ac125f0-0cb6-4e61-9884-8abc6154284a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:29.860389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0cb67cda-214f-4bfc-8a75-870f342940a4 req-8bb76ede-ec3e-4e51-b3c6-80e27f34795d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.861983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.862427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0cb67cda-214f-4bfc-8a75-870f342940a4 req-8bb76ede-ec3e-4e51-b3c6-80e27f34795d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.863114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.863553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0cb67cda-214f-4bfc-8a75-870f342940a4 req-8bb76ede-ec3e-4e51-b3c6-80e27f34795d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.864516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.868261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.869617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.871138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.890457 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0cb67cda-214f-4bfc-8a75-870f342940a4 req-8bb76ede-ec3e-4e51-b3c6-80e27f34795d service nova] Creating event network-changed:0ac125f0-0cb6-4e61-9884-8abc6154284a for instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f on n-h2-852086-5 Aug 27 03:11:29.896885 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0cb67cda-214f-4bfc-8a75-870f342940a4 req-8bb76ede-ec3e-4e51-b3c6-80e27f34795d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056286 Aug 27 03:11:29.898607 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 567/1146] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:29.905851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a517de11-c30a-447b-b255-c0557266bda5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c0360d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.107011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-a517de11-c30a-447b-b255-c0557266bda5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use.", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:30.109214 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a517de11-c30a-447b-b255-c0557266bda5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use. Aug 27 03:11:30.109214 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-3c6f98eb-1eea-4a5c-a483-4523e12894b7'] Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a517de11-c30a-447b-b255-c0557266bda5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea HTTP/1.1 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: exception: Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use. Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-3c6f98eb-1eea-4a5c-a483-4523e12894b7'] Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '2a148b19-854e-4c7a-af3d-551b2a4a8aea'} Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:30.111955 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use. Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c6f98eb-1eea-4a5c-a483-4523e12894b7'] Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use. Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c6f98eb-1eea-4a5c-a483-4523e12894b7'] Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use. Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c6f98eb-1eea-4a5c-a483-4523e12894b7'] Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use. Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c6f98eb-1eea-4a5c-a483-4523e12894b7'] Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a517de11-c30a-447b-b255-c0557266bda5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 400 to user: Security Group 2a148b19-854e-4c7a-af3d-551b2a4a8aea in use. Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-3c6f98eb-1eea-4a5c-a483-4523e12894b7'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a517de11-c30a-447b-b255-c0557266bda5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea" status: 400 len: 185 microversion: 2.1 time: 0.213132 Aug 27 03:11:30.117105 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 568/1147] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:29 2022] DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea => generated 185 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:11:30.123873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.123873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.142482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.143764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.144425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.145675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.146401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.147096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.191013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:30.204058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f49285d8-dbb2-41cd-b568-8568d1c58f6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1463 microversion: 2.1 time: 0.385511 Aug 27 03:11:30.219937 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 580/1148] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:29 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1463 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:30.219937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:30.219937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.235883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.236390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.237043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.238207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.238834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.239425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.456806 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a087f35c-a405-4f8a-b23c-459d7655f454 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f/action" status: 202 len: 0 microversion: 2.1 time: 0.250117 Aug 27 03:11:30.458079 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 581/1149] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:30 2022] POST /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:30.500807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:30.516083 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed12f54e-6355-45e1-99ae-ae66b8b7cda8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.396330 Aug 27 03:11:30.518973 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 569/1150] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:30 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:30.530815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.532962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.566638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.567606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.568212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.569157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.569779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.570469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.782848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1775211150", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "a7de571c-7240-46e9-a460-1d7d0ba06cf7"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:30.870118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] validate_networks() for [('a7de571c-7240-46e9-a460-1d7d0ba06cf7', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:30.902270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:30.918073 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-871c1e71-5274-40b2-8412-516dff2fc39f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1463 microversion: 2.1 time: 0.396231 Aug 27 03:11:30.918807 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 570/1151] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:30 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1463 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:30.924484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.925405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.934933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.935800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.937028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.938004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.938929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.939653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.233702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.263009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b85920b-f78a-42ad-a2a8-f316c85b5101 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1573 microversion: 2.1 time: 0.337990 Aug 27 03:11:31.265474 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 571/1152] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:30 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1573 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:31.287132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:31.292797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:31.318692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.319651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.320453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.321829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.322782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.323553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.429436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.447962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.449448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.455643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40a62614-cabb-499e-aa1d-42dffe4b00bb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.188337 Aug 27 03:11:31.456249 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 572/1153] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:31 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:31.461090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:31.463567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:31.476320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.477637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.478112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.478899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.479362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.479781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.700829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:31.709687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2258fe91-676a-4539-9271-cbbf0e7c3b43 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1466 microversion: 2.1 time: 0.252349 Aug 27 03:11:31.718647 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 573/1154] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:31 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1466 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:31.727898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:31.733639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:31.744909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.745655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.746475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.747560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.748301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.749336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.878416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:31.879166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:31.879967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:31.881491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:31.881491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:31.991618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.002768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.003680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.004379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.005685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.006789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.007757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.036152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:32.036793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:32.037182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:32.037596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:32.038024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:32.052577 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83fb9072-0782-40e3-97ec-b575dac61209 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action" status: 202 len: 1067 microversion: 2.1 time: 0.331095 Aug 27 03:11:32.054384 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 574/1155] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:31 2022] POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action => generated 1067 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:11:32.056245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.056840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.057271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.058026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.063389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.063892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.065375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.066705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.083988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.089535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.090270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.091473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.092143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.092959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.132123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Getting quotas for project f0a64cd2b6e940c7becf20937d70ee06. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:32.159754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Getting quotas for user 6fae47399cdb424c8840aa4481cc96c4 and project f0a64cd2b6e940c7becf20937d70ee06. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:32.183288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:32.191236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:32.300403 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abfde1be-6bcf-45ab-8467-ec3f956fe03e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.840359 Aug 27 03:11:32.301493 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 582/1156] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:32.309550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.311253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.328427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.329903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.331041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.333313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.334821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.336120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.422296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.443815 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a8e4707-410f-48b3-8733-5930f2978635 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.385022 Aug 27 03:11:32.446578 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 575/1157] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:32.451547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.452162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.459882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.461835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.462652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.463902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.464716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.465454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.739833 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1a380f3-fec3-44ac-ac92-88efee378e98 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1617 microversion: 2.1 time: 0.436300 Aug 27 03:11:32.754649 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 583/1158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1617 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:32.793032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.793858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.802719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.825401 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6c7f6d13-05cb-4ece-964b-f5fe8addcb64 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.377500 Aug 27 03:11:32.827202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.827901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.828510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.829387 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 576/1159] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:32.830361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.834521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.835251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.857716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c098b7b0-9757-435e-9306-8a83e40b92d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.859112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c098b7b0-9757-435e-9306-8a83e40b92d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.905003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:33.065648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c098b7b0-9757-435e-9306-8a83e40b92d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.090389 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c098b7b0-9757-435e-9306-8a83e40b92d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1216 microversion: 2.1 time: 0.256414 Aug 27 03:11:33.093506 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 577/1160] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:33.103847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.104999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.122619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.123453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.124268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.125386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.126029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.126495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.206301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.230615 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6e66411-d52b-436c-b9d6-aa554c1631e9 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1573 microversion: 2.1 time: 0.473473 Aug 27 03:11:33.233380 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 584/1161] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1573 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:33.241466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-447207306", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:33.300284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.338687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.353850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.359655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:33.363582 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c9ffc53-37b7-4cab-947d-7c8341b4536d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.267289 Aug 27 03:11:33.366218 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 578/1162] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:33.481670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.484228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.496354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.497660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.498782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.500318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.502840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.504199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.733113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.744940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:33.745820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:33.747296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:33.747296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:33.747644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:33.760617 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc339b21-18b5-4438-86cf-eff7cfabecb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.279270 Aug 27 03:11:33.776911 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 579/1163] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:33.793975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.801887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.804213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.805743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.806261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.806763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.851722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:33.865391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:33.874397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.875495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.888491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.889390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.890188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.891526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.892002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:33.892378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.893156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.894359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:33.960735 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8614769a-e243-407b-bd54-c767b035a9ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724162 Aug 27 03:11:33.962237 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 585/1164] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:33.980024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b22e1db1-bccb-436e-9943-67e47d806f74 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.980661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b22e1db1-bccb-436e-9943-67e47d806f74 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.078811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b22e1db1-bccb-436e-9943-67e47d806f74 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.090945 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b22e1db1-bccb-436e-9943-67e47d806f74 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1216 microversion: 2.1 time: 0.120933 Aug 27 03:11:34.091719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 586/1165] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1216 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:34.130371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:34.131373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.142487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.143278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.143759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.144497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.144957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.145386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.230855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.288934 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4c6a6e0-79cb-4254-ad27-a950c6894bb1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.419998 Aug 27 03:11:34.291730 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 580/1166] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:34.324383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:34.325519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.334755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.335362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.336075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.337609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.338542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.339091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.339251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.384305 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-304fb88e-76bf-4f00-b3d3-538159d420cd tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1268 microversion: 2.1 time: 0.260079 Aug 27 03:11:34.385635 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 587/1167] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:34 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1268 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:34.397389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:34.406869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.424770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.425276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.425895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.428583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.430606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.431057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.602367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.617957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.619810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.625904 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc7d3972-9af2-492d-ac9d-72669a181500 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.235418 Aug 27 03:11:34.626819 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 588/1168] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:34 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:34.662264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.680968 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-283f76e2-3e66-4bbc-882e-45b65e41530f tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1571 microversion: 2.1 time: 0.373060 Aug 27 03:11:34.681996 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 581/1169] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:34 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1571 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:34.703904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-471993816"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:34.705492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.716132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.716643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.717080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.718144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.719112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.719786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.793831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:34.795158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.807106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.807619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.808219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.811038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.812108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.812804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.047765 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Adding security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 to port 0ac125f0-0cb6-4e61-9884-8abc6154284a Aug 27 03:11:35.099012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.114338 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7620cd0b-120c-4696-8d8f-4ff7f34c9ab7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.328394 Aug 27 03:11:35.115977 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 582/1170] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:34 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:35.130039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:35.131494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:35.143778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.145626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.146554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.148411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.149865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.150848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.251591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.254355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:35.268533 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-681ece64-a973-40fa-9908-201ebbca1f30 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1220 microversion: 2.1 time: 0.149966 Aug 27 03:11:35.270615 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 583/1171] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:35 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1220 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:35.322607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:35.323494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:35.338638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.339435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.340097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.341163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.341733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.342324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.626267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.641441 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4ac399ec-cd6c-4d3b-8b7c-05f643dccb57 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.323252 Aug 27 03:11:35.642934 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 584/1172] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:35 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:35.652149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:35.653242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:35.670212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.671152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.671859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.673071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.673915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.674808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.769647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.786015 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58e07ea6-2c3a-4729-b84b-21b23bfbd9d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1274 microversion: 2.1 time: 0.141364 Aug 27 03:11:35.798940 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 585/1173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:35 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:35.817394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:35.818466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:35.819560 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a18f7984-fe4c-423c-9c68-f36c788ca5e4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f/action" status: 202 len: 0 microversion: 2.1 time: 1.119861 Aug 27 03:11:35.826220 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 589/1174] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:34 2022] POST /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f/action => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:11:35.831681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5b067fc-ae4e-47a6-9ef3-1b14e01064ab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c725430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:35.844062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.845041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.845640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.846625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.847082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.847533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.940566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.957998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.960629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.968585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-625f79a6-9713-4768-9fed-e5cce6246b3c tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.168061 Aug 27 03:11:35.969700 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 586/1175] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:35 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:35.977076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d5048d7a-81e2-4275-83c5-a1a6d04a1217 req-3b254362-e0fc-4640-83f7-87dac12a3a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f", "tag": "0ac125f0-0cb6-4e61-9884-8abc6154284a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:35.994011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5048d7a-81e2-4275-83c5-a1a6d04a1217 req-3b254362-e0fc-4640-83f7-87dac12a3a84 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.994645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5048d7a-81e2-4275-83c5-a1a6d04a1217 req-3b254362-e0fc-4640-83f7-87dac12a3a84 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.995167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5048d7a-81e2-4275-83c5-a1a6d04a1217 req-3b254362-e0fc-4640-83f7-87dac12a3a84 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.009449 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d5048d7a-81e2-4275-83c5-a1a6d04a1217 req-3b254362-e0fc-4640-83f7-87dac12a3a84 service nova] Creating event network-changed:0ac125f0-0cb6-4e61-9884-8abc6154284a for instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f on n-h2-852086-5 Aug 27 03:11:36.014725 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d5048d7a-81e2-4275-83c5-a1a6d04a1217 req-3b254362-e0fc-4640-83f7-87dac12a3a84 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043470 Aug 27 03:11:36.015794 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 587/1176] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:36.141725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.142637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.150379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.151184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.151629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.152358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.152817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.153245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.187396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-b5b067fc-ae4e-47a6-9ef3-1b14e01064ab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use.", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:36.188104 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-b5b067fc-ae4e-47a6-9ef3-1b14e01064ab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use. Aug 27 03:11:36.188104 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3781a947-ebb7-4965-b53b-52f4e21ae1d5'] Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5b067fc-ae4e-47a6-9ef3-1b14e01064ab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 HTTP/1.1 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: exception: Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use. Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3781a947-ebb7-4965-b53b-52f4e21ae1d5'] Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4'} Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:36.190110 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use. Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3781a947-ebb7-4965-b53b-52f4e21ae1d5'] Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use. Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3781a947-ebb7-4965-b53b-52f4e21ae1d5'] Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use. Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3781a947-ebb7-4965-b53b-52f4e21ae1d5'] Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use. Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3781a947-ebb7-4965-b53b-52f4e21ae1d5'] Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5b067fc-ae4e-47a6-9ef3-1b14e01064ab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 400 to user: Security Group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 in use. Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3781a947-ebb7-4965-b53b-52f4e21ae1d5'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5b067fc-ae4e-47a6-9ef3-1b14e01064ab tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4" status: 400 len: 185 microversion: 2.1 time: 0.364180 Aug 27 03:11:36.201866 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 590/1177] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:35 2022] DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 => generated 185 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:11:36.210375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.210375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.230774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.231706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.232731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.233728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.234662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.236828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.279350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:36.432533 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7883d27c-2463-4ed6-9152-d60a502c762a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 204 len: 0 microversion: 2.1 time: 0.234190 Aug 27 03:11:36.434092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 591/1178] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:36 2022] DELETE /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:36.450803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.452922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.469610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.470237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.470764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.471862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.472652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.473386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.581891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:36.591493 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7e54a68-57d4-471e-b455-221f2d95e3ba tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.454165 Aug 27 03:11:36.594885 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 588/1179] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:36 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:36.601507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.602807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.609592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.610755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.619557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.623194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.623690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.624131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.715086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:36.733318 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f1a27e2-bf81-4136-a160-373b75bad6c0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1220 microversion: 2.1 time: 0.291503 Aug 27 03:11:36.737757 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 592/1180] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:36 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1220 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:36.750651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.751706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.761765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.762551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.763216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.764247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.764987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.766034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.921302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:36.937867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-732282ef-7330-40bd-a3a6-c01518892d45 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1645 microversion: 2.1 time: 0.340488 Aug 27 03:11:36.938649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 589/1181] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:36 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1645 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:36.967978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.969590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.985002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.986555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.987873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.989272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.990560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.994686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.046658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.062952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75257ccf-85ab-44ae-ba9c-f6883bea31dc tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.322263 Aug 27 03:11:37.064470 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 593/1182] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:36 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:37.074591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.076330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.097232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.102955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.103543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.104321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.104807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.105242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.277346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.292523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.302041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c600ae7d-e917-4f6b-bf5f-7b93b8b806c9 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.349295 Aug 27 03:11:37.303220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.307631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.315946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:37.317116 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 590/1183] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:36 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:37.319307 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64fa36f0-7e9f-499a-9bf4-8589f4f9feee tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.252923 Aug 27 03:11:37.320582 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 594/1184] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:37.624886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.626290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.637720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.637720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.637720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.638018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.638509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.639140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.759628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.760855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.769888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.770578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.771159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.772073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.772685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.773143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.848370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.862086 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84957ccc-9388-4718-89d5-cf63e7bc7bb6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.245139 Aug 27 03:11:37.862898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 591/1185] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:37.866871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.871202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.872611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.880832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:37.886636 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-221c65d5-f1dd-4c95-be39-7dbecea8bbc1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1268 microversion: 2.1 time: 0.131668 Aug 27 03:11:37.888140 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 595/1186] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1268 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:37.888559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.889124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.889922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.890744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.891218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.891649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.975716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.976428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.984269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.985519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.986357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.987736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.988583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.989448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.087128 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8cefcb54-ebd9-47d7-961b-c4b68299cdc0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1857 microversion: 2.1 time: 0.222630 Aug 27 03:11:38.087880 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 592/1187] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1857 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:38.101070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:38.102254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:38.110969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.111453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.111880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.112583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.113187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.113623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.219586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:38.231225 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-451ccd27-6164-41fc-86f6-c01776743c44 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1645 microversion: 2.1 time: 0.261302 Aug 27 03:11:38.232473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 596/1188] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1645 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:38.240208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852086-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:38.243909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:38.259032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.271574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.272061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.272940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.273318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.274242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.277647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:38.289701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8a4c346e-254e-47c9-ae6c-561245e91261 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.196296 Aug 27 03:11:38.290258 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 593/1189] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:38 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:38.305447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lazy-loading 'flavor' on Instance uuid 3433e1f2-f285-4966-92cb-9379c704c79f {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:38.325391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:38.325728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Going to try to live migrate instance to n-h2-852086-5 {{(pid=122408) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:11:38.326649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:38.335738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.336802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.337260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.338410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.338983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.339717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.762218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:38.779258 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-258a1712-2bfd-41aa-85a1-0ebf396409e5 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.459272 Aug 27 03:11:38.796637 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 594/1190] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:38 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:38.803076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:38.806450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:38.819336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.820245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.821454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.822459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.823141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.823780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.998988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:39.014152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:39.016954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:39.029646 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f55b561c-a4ce-4282-9866-59fe0317a493 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.230901 Aug 27 03:11:39.031384 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 595/1191] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:38 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:39.051147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:39.052263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:39.062466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.063257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.063695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.064436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.064895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.065391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.411057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:39.421620 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e38bdb1d-635e-42a3-9d9c-cfffbb648a2f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.387837 Aug 27 03:11:39.422222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 596/1192] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:39 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:39.428136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:39.429147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:39.436824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.437331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.437962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.438819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.439478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.440167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.581268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:39.603833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c671f3f-9ced-4660-ace4-4885cf46da23 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1274 microversion: 2.1 time: 0.180140 Aug 27 03:11:39.606422 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 597/1193] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:39 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:39.621835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:39.626104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:39.637904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.640030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.640822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.642512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.643326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.644153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.096970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.107820 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3af5fa14-bc4c-4271-90fe-3db6c97fe17a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1645 microversion: 2.1 time: 0.492276 Aug 27 03:11:40.124087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 598/1194] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:39 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1645 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:40.130624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:40.131475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:40.140558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.141119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.141654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.142724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.143583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.143583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.437739 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f80109ac-015d-4dad-8f5f-6aa2823c6fd7 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/action" status: 202 len: 0 microversion: 2.1 time: 2.203620 Aug 27 03:11:40.442030 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 597/1195] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:38 2022] POST /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/action => generated 0 bytes in 2209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:40.449612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:40.458884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:40.468510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.468949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.469394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.470205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.473646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.474106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.514058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.528828 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-363f7057-4d01-4938-abc6-fbd7b0ea0523 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.403241 Aug 27 03:11:40.529637 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 599/1196] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:40 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:40.540773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-a5f0cc6d-a726-4172-bd16-760d0b5cd30c req-5a712e04-9e38-4d08-88d0-eb6235c3fa99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d", "tag": "a4b10926-60c9-41ff-9ebd-173e391ee8f3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:40.561510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a5f0cc6d-a726-4172-bd16-760d0b5cd30c req-5a712e04-9e38-4d08-88d0-eb6235c3fa99 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.561997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a5f0cc6d-a726-4172-bd16-760d0b5cd30c req-5a712e04-9e38-4d08-88d0-eb6235c3fa99 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.573311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a5f0cc6d-a726-4172-bd16-760d0b5cd30c req-5a712e04-9e38-4d08-88d0-eb6235c3fa99 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.599740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-a5f0cc6d-a726-4172-bd16-760d0b5cd30c req-5a712e04-9e38-4d08-88d0-eb6235c3fa99 service nova] Creating event network-changed:a4b10926-60c9-41ff-9ebd-173e391ee8f3 for instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d on n-h2-852086-5 Aug 27 03:11:40.617745 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-a5f0cc6d-a726-4172-bd16-760d0b5cd30c req-5a712e04-9e38-4d08-88d0-eb6235c3fa99 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085712 Aug 27 03:11:40.619630 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 600/1197] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:40.654100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:40.657852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:40.701384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.702222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.703119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.707247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.708563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.711974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.886606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.890784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:40.903523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.906012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.915710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19b6eadf-001c-484e-b794-2e0a02d836cb tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.293815 Aug 27 03:11:40.916617 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 601/1198] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:40 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:40.932750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:40.933721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:40.952282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.953061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.953854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.954844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.955567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.956163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.980762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.994184 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-638765d0-20f9-4f84-bacf-4b5e7917e13e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.550454 Aug 27 03:11:40.996856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 598/1199] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:40 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.004181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.005016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.016500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.018755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.019836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.020918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.021607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.022194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.227359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.249663 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-774849cd-75a6-47b6-92ba-f8c6bab6dc92 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.251039 Aug 27 03:11:41.252033 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 599/1200] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:40 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.260484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.261988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.281019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.282130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.282775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.283808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.284267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.284697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.307709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:41.490834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.500828 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0e7277b-246b-4f5a-9058-2b4683fb04a0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.246963 Aug 27 03:11:41.513285 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 600/1201] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.515587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.526307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.526670 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-08aa37b5-fdfb-47f2-9dc0-01b5695e89cc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.605493 Aug 27 03:11:41.527473 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 602/1202] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:40 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.529261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.546922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.547728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.548397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.549338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.552273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.552758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.572618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.574194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.582581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.583364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.583948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.584943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.585680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.586688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.600371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.601222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.602027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.603127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lazy-loading 'fault' on Instance uuid bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:41.658924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.670709 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e0abb31-c8da-41c4-ae05-d980b1ef7ea0 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1306 microversion: 2.1 time: 0.154810 Aug 27 03:11:41.671202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 601/1203] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.831327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.840169 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc58f3ed-562b-4244-8f31-ad52cb8379e8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.278826 Aug 27 03:11:41.840767 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 603/1204] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.945372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.946763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.956155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.956674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.957112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.957849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.958346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.958779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.029416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.030609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:42.045864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.047237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.053093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.055708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.056474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.059053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.063789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.081011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.083884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.095051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6bbcd95-987e-4ea9-8cfc-322b5f23bda8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.155813 Aug 27 03:11:42.098060 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 602/1205] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:11:42.277257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.277257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:42.284403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.284963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.285419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.286150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.286690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.287144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.323748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.336304 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-86938e1d-7e58-49f9-a717-8fbdb90ccb6f tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.315223 Aug 27 03:11:42.351393 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 604/1206] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:42.359611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-26914321-7590-455b-8bc1-5be1872701fd req-27cdb6f6-e540-46b9-a9a3-f8427cbf37e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e182fe3-82a1-4e42-95d9-133561ee07ee", "tag": "36718263-a977-43df-bd28-e84294163a51"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:42.373779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26914321-7590-455b-8bc1-5be1872701fd req-27cdb6f6-e540-46b9-a9a3-f8427cbf37e7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.375056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26914321-7590-455b-8bc1-5be1872701fd req-27cdb6f6-e540-46b9-a9a3-f8427cbf37e7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.376070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26914321-7590-455b-8bc1-5be1872701fd req-27cdb6f6-e540-46b9-a9a3-f8427cbf37e7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.390504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-26914321-7590-455b-8bc1-5be1872701fd req-27cdb6f6-e540-46b9-a9a3-f8427cbf37e7 service nova] Creating event network-changed:36718263-a977-43df-bd28-e84294163a51 for instance 7e182fe3-82a1-4e42-95d9-133561ee07ee on n-h1-852086-5 Aug 27 03:11:42.403786 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-26914321-7590-455b-8bc1-5be1872701fd req-27cdb6f6-e540-46b9-a9a3-f8427cbf37e7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049256 Aug 27 03:11:42.406739 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 605/1207] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:42.529150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.530750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:42.542534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.545778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.546713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.548323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.549445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.550495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.837436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.849290 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c615f4f2-6eb4-41bc-b8fc-662d8e1625c8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.324108 Aug 27 03:11:42.854483 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 606/1208] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:42.859753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.860604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:42.868656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.869472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.869911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.870686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.871144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.871574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.958414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.984390 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-296a7275-5c65-4e8d-a8a6-08cffa84b0d7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.712598 Aug 27 03:11:42.998337 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 603/1209] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:43.011787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:43.013592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:43.035554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.036344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.036949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.037830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.038588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.039430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.084868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.085728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.086564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.088105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lazy-loading 'fault' on Instance uuid bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:43.089634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:43.164082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.171336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.175291 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee7440d3-08c7-4e1f-a302-0f35d1cfb318 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 200 len: 1306 microversion: 2.1 time: 0.174156 Aug 27 03:11:43.177270 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 604/1210] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:43.185583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-75ade9f3-a2e5-4d46-a5cc-64a01300836c req-009201b8-de90-4bab-941e-6063dab29ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f", "name": "network-vif-deleted", "tag": "0ac125f0-0cb6-4e61-9884-8abc6154284a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:43.197166 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30661cf9-79c8-4e7e-a547-6cadef5337d0 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.341084 Aug 27 03:11:43.198034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 607/1211] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:43.198257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75ade9f3-a2e5-4d46-a5cc-64a01300836c req-009201b8-de90-4bab-941e-6063dab29ba8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.198875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75ade9f3-a2e5-4d46-a5cc-64a01300836c req-009201b8-de90-4bab-941e-6063dab29ba8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.199309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75ade9f3-a2e5-4d46-a5cc-64a01300836c req-009201b8-de90-4bab-941e-6063dab29ba8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.203727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:43.204331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:43.211304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-75ade9f3-a2e5-4d46-a5cc-64a01300836c req-009201b8-de90-4bab-941e-6063dab29ba8 service nova] Creating event network-vif-deleted:0ac125f0-0cb6-4e61-9884-8abc6154284a for instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f on n-h2-852086-5 Aug 27 03:11:43.213231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.213765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.215711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.216460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.217122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.217788 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-75ade9f3-a2e5-4d46-a5cc-64a01300836c req-009201b8-de90-4bab-941e-6063dab29ba8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038719 Aug 27 03:11:43.217947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.218448 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 605/1212] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:43.224008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:43.225258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:43.237600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.238813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.239592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.240824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.241840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.243360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.385067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.394261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.398000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.402646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.403878 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fae64d5e-a38a-4ec1-a654-c67084343ade tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.203689 Aug 27 03:11:43.406186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 608/1213] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:43 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:43.409992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:43.410797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:43.418390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.419135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.419717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.420536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.421176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.421745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.421989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3bfc11a-a00d-469f-8f4c-06430d5a914b tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.201698 Aug 27 03:11:43.423984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 606/1214] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:43 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:43.595453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.604755 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38ce0368-b482-4ec4-88d8-c878dc974194 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.198778 Aug 27 03:11:43.605343 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 609/1215] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:43 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:43.877446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:43.878987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:43.884035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:43.890806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.891216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.892358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.892554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.892972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.893413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.012945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.014042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.026129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.027168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.028348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.029766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.031905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.032683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.079571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.085350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:44.096236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8de4632b-d912-4839-9534-2daee948ecf0 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.225870 Aug 27 03:11:44.097351 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 607/1216] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:43 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:44.202699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.203053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.203909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.222846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.223938 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a80b24af-b384-4f42-8f45-e26432206eef tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.220211 Aug 27 03:11:44.224982 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 610/1217] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:44.225974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.232483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.233093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.236856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.237598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.238210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.238709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.250204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.255922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.257209 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f HTTP/1.1 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f'} Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:44.260057 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:44.270786 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed34e62f-92d4-4639-b1fd-35921229102a tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 404 len: 111 microversion: 2.1 time: 0.064425 Aug 27 03:11:44.273366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.273797 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 608/1218] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:44.274006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.274006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.274006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.274588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-608fd3e5-77a1-4862-88a5-ab532b582de5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457e7e0d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.478079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.487866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5ad06a3-611b-4316-89f9-4f3625453215 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.259482 Aug 27 03:11:44.488313 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 611/1219] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:44.495494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.496270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.505527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.509057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.509057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.509057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.509057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.509646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.568974 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-608fd3e5-77a1-4862-88a5-ab532b582de5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea" status: 202 len: 0 microversion: 2.1 time: 0.301005 Aug 27 03:11:44.580308 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 609/1220] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:44 2022] DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:44.589588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.591083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.599970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.600854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.601672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.602826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.603526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.604163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.687139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.697354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.699074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.705378 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46604456-6945-4a21-9d69-b300ff515519 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.123795 Aug 27 03:11:44.708293 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 610/1221] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:44.713738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85aad08c-2bed-4536-82e8-8d7febb44687 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c845a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.790995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.802785 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-25bfdcdf-f09a-403d-90e6-0de73d90df5c tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.312562 Aug 27 03:11:44.813912 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 612/1222] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:44.828855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.829608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.839010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.839714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.840310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.841330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.841889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.842540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.033199 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85aad08c-2bed-4536-82e8-8d7febb44687 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4" status: 202 len: 0 microversion: 2.1 time: 0.324505 Aug 27 03:11:45.034877 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 611/1223] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:44 2022] DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:45.053905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5de8536-36a5-4cab-af0e-b913b6d44b86 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'create', calling method: .version_select at 0x7fe45c7fc670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-896203340", "description": "tempest-description-699116079"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:45.236453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:45.272226 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34e5f7b4-a72f-4203-b7e0-706569839c2a tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.441611 Aug 27 03:11:45.286431 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 613/1224] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:45.291168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:45.292231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:45.318080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.319027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.319793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.322700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.323565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.324334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.347006 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5de8536-36a5-4cab-af0e-b913b6d44b86 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.300452 Aug 27 03:11:45.348240 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 612/1225] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:11:45 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:45.365108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:45.366345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:45.385042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.385886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.386670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.388094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.388866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.390004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.600915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:45.623116 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc86e3f5-4e76-4e40-999e-02d49a42cf4a tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.272646 Aug 27 03:11:45.625792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:45.635194 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 613/1226] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:45.641992 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b7cd06e-e5e2-4472-94bf-3ada24691660 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.366409 Aug 27 03:11:45.642935 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 614/1227] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:45.648376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:45.649778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec24d695-883a-4773-9bbd-05eb05fc4ee3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Action: 'update', calling method: .version_select at 0x7fe45c845160>, body: {"security_group": {"name": "tempest-sg-hth-117274910", "description": "tempest-description-hth-1370513963"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:45.655788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:45.667989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.669586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.670222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.671328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.671957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.672944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.884861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:45.894054 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-796e461b-4bec-4dbc-b0cf-d792ce65bda5 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.249907 Aug 27 03:11:45.906730 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 615/1228] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:45.917737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:45.919118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:45.929186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.930652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.931223 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec24d695-883a-4773-9bbd-05eb05fc4ee3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "PUT /compute/v2.1/os-security-groups/8ca9fc53-083b-4e04-8675-e83a3c5a5515" status: 200 len: 217 microversion: 2.1 time: 0.291961 Aug 27 03:11:45.931429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.932674 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 614/1229] 10.222.0.69 () {60 vars in 1290 bytes} [Sat Aug 27 03:11:45 2022] PUT /compute/v2.1/os-security-groups/8ca9fc53-083b-4e04-8675-e83a3c5a5515 => generated 217 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:45.940736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ba689a46-a3e8-41b3-a1ef-62aa9da8deb1 req-9940ccfb-ec8a-41b1-9fdc-c78bf2f8fc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d", "name": "network-vif-plugged", "status": "completed", "tag": "a4b10926-60c9-41ff-9ebd-173e391ee8f3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:45.941594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.942152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.942670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.953916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ba689a46-a3e8-41b3-a1ef-62aa9da8deb1 req-9940ccfb-ec8a-41b1-9fdc-c78bf2f8fc8f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.954792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ba689a46-a3e8-41b3-a1ef-62aa9da8deb1 req-9940ccfb-ec8a-41b1-9fdc-c78bf2f8fc8f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.955451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ba689a46-a3e8-41b3-a1ef-62aa9da8deb1 req-9940ccfb-ec8a-41b1-9fdc-c78bf2f8fc8f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.980126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ba689a46-a3e8-41b3-a1ef-62aa9da8deb1 req-9940ccfb-ec8a-41b1-9fdc-c78bf2f8fc8f service nova] Creating event network-vif-plugged:a4b10926-60c9-41ff-9ebd-173e391ee8f3 for instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d on n-h2-852086-5 Aug 27 03:11:45.993043 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ba689a46-a3e8-41b3-a1ef-62aa9da8deb1 req-9940ccfb-ec8a-41b1-9fdc-c78bf2f8fc8f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057177 Aug 27 03:11:45.994455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 615/1230] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:46.001177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.002276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.009408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.010285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.011039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.012084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.012792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.013496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.018020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.032950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.034816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.041877 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90a6b791-2a8a-45bc-a4bd-123ecd53233a tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.132826 Aug 27 03:11:46.047102 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 616/1231] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:46.052594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-96c8ee04-6b1f-442b-bad6-1b36d3aac6db tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457e03a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.127927 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-96c8ee04-6b1f-442b-bad6-1b36d3aac6db tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/8ca9fc53-083b-4e04-8675-e83a3c5a5515" status: 200 len: 217 microversion: 2.1 time: 0.079350 Aug 27 03:11:46.128782 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 617/1232] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/os-security-groups/8ca9fc53-083b-4e04-8675-e83a3c5a5515 => generated 217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:46.143062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e047a6c-be9e-496e-a67e-ac29dd3be787 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457f9c8b0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.262209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.275767 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71456f2b-c0f0-44ba-b822-0aa47c89ad91 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.279773 Aug 27 03:11:46.277004 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 616/1233] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:46.297219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.297960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.307242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.307823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.308312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.309077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.309552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.309990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.470539 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e047a6c-be9e-496e-a67e-ac29dd3be787 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/8ca9fc53-083b-4e04-8675-e83a3c5a5515" status: 202 len: 0 microversion: 2.1 time: 0.331284 Aug 27 03:11:46.479156 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 618/1234] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:46 2022] DELETE /compute/v2.1/os-security-groups/8ca9fc53-083b-4e04-8675-e83a3c5a5515 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:46.485711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.486685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.508641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.511026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.511861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.512929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.514790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.515605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.566282 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.567126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f HTTP/1.1 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f'} Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:46.569598 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:46.578051 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-171bdde1-c25e-4be2-bc3c-0f2987614b8b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 404 len: 111 microversion: 2.1 time: 0.095309 Aug 27 03:11:46.579844 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09971c37-1393-47db-8d06-7e230fe35b66 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.285120 Aug 27 03:11:46.584003 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 619/1235] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:46 2022] DELETE /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:46.587850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.588485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.592545 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 617/1236] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:46.596620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.597114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.597553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.598381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.599069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.599765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.629352 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f HTTP/1.1 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f'} Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.632581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Instance bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2919aee3-b1d1-42ef-80a9-a1ffddc274af tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f" status: 404 len: 111 microversion: 2.1 time: 0.051845 Aug 27 03:11:46.639486 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 620/1237] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/bfbbeb4f-cff4-4ef5-b46a-2ad7f8334e7f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:46.650291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5fde0f4-4c66-4e38-96ee-29da0c04731b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c630ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.670266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.671212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.679986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.680498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.680935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.681322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-e5fde0f4-4c66-4e38-96ee-29da0c04731b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:46.681660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.682117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.682253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-e5fde0f4-4c66-4e38-96ee-29da0c04731b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:11:46.682637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.682997 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e5fde0f4-4c66-4e38-96ee-29da0c04731b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist Aug 27 03:11:46.682997 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-90842000-27c0-4bc2-9f2e-6df882bed934'] Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5fde0f4-4c66-4e38-96ee-29da0c04731b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 HTTP/1.1 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-90842000-27c0-4bc2-9f2e-6df882bed934'] Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4'} Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:46.685324 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90842000-27c0-4bc2-9f2e-6df882bed934'] Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90842000-27c0-4bc2-9f2e-6df882bed934'] Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90842000-27c0-4bc2-9f2e-6df882bed934'] Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90842000-27c0-4bc2-9f2e-6df882bed934'] Aug 27 03:11:46.689548 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.693796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5fde0f4-4c66-4e38-96ee-29da0c04731b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 does not exist Aug 27 03:11:46.693796 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-90842000-27c0-4bc2-9f2e-6df882bed934'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:46.694403 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5fde0f4-4c66-4e38-96ee-29da0c04731b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4" status: 404 len: 194 microversion: 2.1 time: 0.052298 Aug 27 03:11:46.696073 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 618/1238] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:46 2022] DELETE /compute/v2.1/os-security-groups/45d7c3ed-39b5-431e-b7fa-0ed8ad2581b4 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:46.700969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.701835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.709995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.710701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.712262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.713298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.714076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.714963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.877130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.890739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f578ef93-e5e4-49a8-a25c-063a7c197023 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.225267 Aug 27 03:11:46.891920 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 621/1239] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:46.896940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-702ea7fd-a95c-4f96-99d4-3e6954a0bba5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457e5bb80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.927181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-702ea7fd-a95c-4f96-99d4-3e6954a0bba5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:46.931416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-702ea7fd-a95c-4f96-99d4-3e6954a0bba5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea not found {{(pid=122407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:11:46.932323 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-702ea7fd-a95c-4f96-99d4-3e6954a0bba5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist Aug 27 03:11:46.932323 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-8e5dad2c-6298-44ea-9b1f-268a44230442'] Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-702ea7fd-a95c-4f96-99d4-3e6954a0bba5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea HTTP/1.1 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-8e5dad2c-6298-44ea-9b1f-268a44230442'] Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '2a148b19-854e-4c7a-af3d-551b2a4a8aea'} Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:46.937350 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5dad2c-6298-44ea-9b1f-268a44230442'] Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5dad2c-6298-44ea-9b1f-268a44230442'] Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5dad2c-6298-44ea-9b1f-268a44230442'] Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e5dad2c-6298-44ea-9b1f-268a44230442'] Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-702ea7fd-a95c-4f96-99d4-3e6954a0bba5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 2a148b19-854e-4c7a-af3d-551b2a4a8aea does not exist Aug 27 03:11:46.943587 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-8e5dad2c-6298-44ea-9b1f-268a44230442'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:46.955155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.955388 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-702ea7fd-a95c-4f96-99d4-3e6954a0bba5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea" status: 404 len: 194 microversion: 2.1 time: 0.045279 Aug 27 03:11:46.955388 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 622/1240] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:46 2022] DELETE /compute/v2.1/os-security-groups/2a148b19-854e-4c7a-af3d-551b2a4a8aea => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:46.955784 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dee1f0b9-785a-4748-892f-e4b1b2f461f7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.252641 Aug 27 03:11:46.955784 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 619/1241] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:46.955784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c97527a2-05d8-4260-a7bf-172fb015dcd4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c845160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.965270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.965889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.974282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.974811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.975230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.975941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.976905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.977356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.996448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-c97527a2-05d8-4260-a7bf-172fb015dcd4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:46.997480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-c97527a2-05d8-4260-a7bf-172fb015dcd4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:11:46.998571 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c97527a2-05d8-4260-a7bf-172fb015dcd4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:11:46.998571 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-9cda305f-11ac-4a6f-9e3f-fe84d2e4be09'] Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c97527a2-05d8-4260-a7bf-172fb015dcd4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1 HTTP/1.1 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-9cda305f-11ac-4a6f-9e3f-fe84d2e4be09'] Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '21c63ceb-6d39-476d-acf5-d5e7484494b1'} Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:47.002593 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cda305f-11ac-4a6f-9e3f-fe84d2e4be09'] Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cda305f-11ac-4a6f-9e3f-fe84d2e4be09'] Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cda305f-11ac-4a6f-9e3f-fe84d2e4be09'] Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cda305f-11ac-4a6f-9e3f-fe84d2e4be09'] Aug 27 03:11:47.008731 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.018061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:47.018271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c97527a2-05d8-4260-a7bf-172fb015dcd4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 21c63ceb-6d39-476d-acf5-d5e7484494b1 does not exist Aug 27 03:11:47.018271 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-9cda305f-11ac-4a6f-9e3f-fe84d2e4be09'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:47.018271 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c97527a2-05d8-4260-a7bf-172fb015dcd4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1" status: 404 len: 194 microversion: 2.1 time: 0.053614 Aug 27 03:11:47.018271 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 620/1242] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:46 2022] DELETE /compute/v2.1/os-security-groups/21c63ceb-6d39-476d-acf5-d5e7484494b1 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:47.025727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f905ad24-b4a4-415c-83ab-41e98bfdaa1c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c0df670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.072005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-f905ad24-b4a4-415c-83ab-41e98bfdaa1c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:47.073072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-f905ad24-b4a4-415c-83ab-41e98bfdaa1c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:11:47.073973 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f905ad24-b4a4-415c-83ab-41e98bfdaa1c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:11:47.073973 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-6181dd5d-524c-4b29-9c4b-d0936e3b0d22'] Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f905ad24-b4a4-415c-83ab-41e98bfdaa1c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9 HTTP/1.1 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-6181dd5d-524c-4b29-9c4b-d0936e3b0d22'] Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '37b13b93-17ff-4dd4-85f5-15391fa009f9'} Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:47.079618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6181dd5d-524c-4b29-9c4b-d0936e3b0d22'] Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6181dd5d-524c-4b29-9c4b-d0936e3b0d22'] Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6181dd5d-524c-4b29-9c4b-d0936e3b0d22'] Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6181dd5d-524c-4b29-9c4b-d0936e3b0d22'] Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f905ad24-b4a4-415c-83ab-41e98bfdaa1c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 37b13b93-17ff-4dd4-85f5-15391fa009f9 does not exist Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-6181dd5d-524c-4b29-9c4b-d0936e3b0d22'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:47.083513 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f905ad24-b4a4-415c-83ab-41e98bfdaa1c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9" status: 404 len: 194 microversion: 2.1 time: 0.064761 Aug 27 03:11:47.090378 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 621/1243] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:47 2022] DELETE /compute/v2.1/os-security-groups/37b13b93-17ff-4dd4-85f5-15391fa009f9 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:47.093796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.094963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.107849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.109077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.110093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.111593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.112786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.113592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.197416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.204568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.206899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.208472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.214622 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-52b9a80e-f269-47f3-bc59-5d045635676d tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.128542 Aug 27 03:11:47.215205 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 622/1244] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:47.219442 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f7ba6e2-50dc-4dba-9319-38cb7de2050d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.271832 Aug 27 03:11:47.220253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-489adc1f-398e-4434-8314-27d737e403a4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457f1dd30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.228403 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 623/1245] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:47.245883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-489adc1f-398e-4434-8314-27d737e403a4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:47.246534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-489adc1f-398e-4434-8314-27d737e403a4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 09193bcd-c072-4270-969a-96d638bb766e not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:11:47.247059 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-489adc1f-398e-4434-8314-27d737e403a4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:11:47.247059 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3c59a2e4-4c21-4a0a-b375-eb6d0ef97913'] Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-489adc1f-398e-4434-8314-27d737e403a4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e HTTP/1.1 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3c59a2e4-4c21-4a0a-b375-eb6d0ef97913'] Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '09193bcd-c072-4270-969a-96d638bb766e'} Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:47.248884 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c59a2e4-4c21-4a0a-b375-eb6d0ef97913'] Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c59a2e4-4c21-4a0a-b375-eb6d0ef97913'] Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c59a2e4-4c21-4a0a-b375-eb6d0ef97913'] Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c59a2e4-4c21-4a0a-b375-eb6d0ef97913'] Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-489adc1f-398e-4434-8314-27d737e403a4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 09193bcd-c072-4270-969a-96d638bb766e does not exist Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3c59a2e4-4c21-4a0a-b375-eb6d0ef97913'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-489adc1f-398e-4434-8314-27d737e403a4 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e" status: 404 len: 194 microversion: 2.1 time: 0.034084 Aug 27 03:11:47.257716 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 623/1246] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:47 2022] DELETE /compute/v2.1/os-security-groups/09193bcd-c072-4270-969a-96d638bb766e => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:47.265341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a32ab77-2c56-4509-af8e-6a9f836adbde tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe45c0795e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.290938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-3a32ab77-2c56-4509-af8e-6a9f836adbde tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:11:47.291675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-3a32ab77-2c56-4509-af8e-6a9f836adbde tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Neutron security group 7126f450-382e-429c-ac0d-dbbc1ec894bf not found {{(pid=122407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:11:47.292496 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3a32ab77-2c56-4509-af8e-6a9f836adbde tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:11:47.292496 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-25c06bda-cac0-41b2-9996-19405a6da395'] Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a32ab77-2c56-4509-af8e-6a9f836adbde tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf HTTP/1.1 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-25c06bda-cac0-41b2-9996-19405a6da395'] Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7126f450-382e-429c-ac0d-dbbc1ec894bf'} Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:11:47.295673 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c06bda-cac0-41b2-9996-19405a6da395'] Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c06bda-cac0-41b2-9996-19405a6da395'] Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c06bda-cac0-41b2-9996-19405a6da395'] Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25c06bda-cac0-41b2-9996-19405a6da395'] Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a32ab77-2c56-4509-af8e-6a9f836adbde tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Security group 7126f450-382e-429c-ac0d-dbbc1ec894bf does not exist Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-25c06bda-cac0-41b2-9996-19405a6da395'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:47.301792 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a32ab77-2c56-4509-af8e-6a9f836adbde tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf" status: 404 len: 194 microversion: 2.1 time: 0.042076 Aug 27 03:11:47.307818 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 624/1247] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:47 2022] DELETE /compute/v2.1/os-security-groups/7126f450-382e-429c-ac0d-dbbc1ec894bf => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:47.310627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.311246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.313473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.313988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.319059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.319563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.320098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.322254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.323047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.323245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.323405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.323559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.323691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.323691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.325118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.325118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.356168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:47.488606 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-78caf40c-a873-4fe3-85e0-c9c59c6120e8 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 204 len: 0 microversion: 2.1 time: 0.178540 Aug 27 03:11:47.490459 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 625/1248] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:47 2022] DELETE /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:47.505227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.507261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.519712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.520429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.521488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.522671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.524525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.525624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.526672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.538421 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70e83918-12fd-4d1b-b683-6a744195f1d9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.231608 Aug 27 03:11:47.544775 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 624/1249] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:47.608095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.609931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.619820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.620641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.621283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.622438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.623122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.623678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.780194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.793880 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0c43666-abe9-4790-b027-dfbe9825fd64 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1646 microversion: 2.1 time: 0.297880 Aug 27 03:11:47.795455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 626/1250] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1646 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:47.821953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.833061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21447775-ef3c-4859-9350-02b588277a03 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1316 microversion: 2.1 time: 0.232284 Aug 27 03:11:47.833643 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 625/1251] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:47.913469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.914714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.925846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.927388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.927553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.928379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.928948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.929505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.989694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.990635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.998938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.999693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.000376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.001327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.001822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.002432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.019583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:48.094378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:48.105360 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c40ca11b-159d-4946-9c58-4690954beaff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.196064 Aug 27 03:11:48.118578 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 627/1252] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:48.152050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:48.160369 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b97a599e-ca4e-4163-9a2a-823f37be8a13 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.180288 Aug 27 03:11:48.160948 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 626/1253] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:48.240650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:48.241297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:48.248354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.248891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.249341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.250051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.250654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.251086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.254561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:48.255338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:48.262815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.263535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.264083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.264893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.265452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.265984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.327412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:48.338586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:48.340327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:48.345770 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7021030-9f1a-4693-811a-d66fe484077e tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.109120 Aug 27 03:11:48.358882 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 628/1254] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:48 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:48.440631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:48.452869 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02dc9d20-61ee-4e39-86e1-c6e5d050c6b7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.203189 Aug 27 03:11:48.454268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 627/1255] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:48 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:48.576384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:48.577745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:48.591524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.592044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.592487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.593219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.593678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.594106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.654250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e801ec8a-3933-4c14-a7fe-e04374cdfccc req-d6342d0d-89cd-435b-b16f-456349b3d761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e182fe3-82a1-4e42-95d9-133561ee07ee", "name": "network-vif-plugged", "status": "completed", "tag": "36718263-a977-43df-bd28-e84294163a51"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:48.670282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e801ec8a-3933-4c14-a7fe-e04374cdfccc req-d6342d0d-89cd-435b-b16f-456349b3d761 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.671394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e801ec8a-3933-4c14-a7fe-e04374cdfccc req-d6342d0d-89cd-435b-b16f-456349b3d761 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.672217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e801ec8a-3933-4c14-a7fe-e04374cdfccc req-d6342d0d-89cd-435b-b16f-456349b3d761 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.691711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e801ec8a-3933-4c14-a7fe-e04374cdfccc req-d6342d0d-89cd-435b-b16f-456349b3d761 service nova] Creating event network-vif-plugged:36718263-a977-43df-bd28-e84294163a51 for instance 7e182fe3-82a1-4e42-95d9-133561ee07ee on n-h1-852086-5 Aug 27 03:11:48.699032 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e801ec8a-3933-4c14-a7fe-e04374cdfccc req-d6342d0d-89cd-435b-b16f-456349b3d761 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050927 Aug 27 03:11:48.700369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 628/1256] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:48.747732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:48.755627 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-de5245d5-d99f-44f8-80df-57e4970fc5b0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.183529 Aug 27 03:11:48.756100 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 629/1257] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:48 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:48.824503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:48.825406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:48.831603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.832092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.832533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.833243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.833701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.834247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.857331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:48.857983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:48.864015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.864501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.865120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.865991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.866477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.866942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.029620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.038569 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70432cd8-33cf-44eb-ad8d-82da92b7db49 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1646 microversion: 2.1 time: 0.220725 Aug 27 03:11:49.049257 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 629/1258] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:48 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1646 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:49.051720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.061387 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a7fa3f27-96c0-4bbf-97cc-19c978302370 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1505 microversion: 2.1 time: 0.207083 Aug 27 03:11:49.061387 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 630/1259] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:48 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:49.090814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.091353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.098694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.099197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.099636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.100348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.100813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.101407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.132272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.135258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.143063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.143699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.144526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.145363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.145925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.146451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:49.146635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.242143 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd338634-be8e-459d-881c-6613d5c86a92 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 204 len: 0 microversion: 2.1 time: 0.154836 Aug 27 03:11:49.243141 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 630/1260] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:49 2022] DELETE /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:49.248916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.249957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.256463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.256967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.257401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.258595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.258825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.259416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.332285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.353174 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0753cb15-bd33-44e0-abef-195a91a2db88 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.226749 Aug 27 03:11:49.366195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 631/1261] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:49 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:49.366195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.366195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.372607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.373085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.373701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.374487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.374940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.375362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.448800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.462281 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30205205-ddce-4319-854d-e0332539a355 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.216087 Aug 27 03:11:49.463019 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 631/1262] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:49 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:49.468808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.469475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.476105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.476678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.477507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.477923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.478431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.478869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.563783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.569512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.574287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.576380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.588720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-817bfd1b-f385-4436-bf65-22297932fcfc tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1511 microversion: 2.1 time: 0.232203 Aug 27 03:11:49.594430 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 632/1263] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:49 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:49.594617 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-517efc12-34da-4af2-b556-bd2c52944745 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1447 microversion: 2.75 time: 0.126910 Aug 27 03:11:49.594617 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 632/1264] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:49 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:49.609140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.610074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.617896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.618574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.619022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.619983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.621493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.621493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.777748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.780091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.785040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.788254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.788803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.789936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.790913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.791381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.791814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.795817 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b924b7b9-2ca8-4e1c-a3ea-a362ccb96fc8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.205137 Aug 27 03:11:49.796950 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 633/1265] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:49 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:49.994460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.015568 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa67b6e8-6f0d-4995-a1f8-c68c9c910e66 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.242165 Aug 27 03:11:50.020473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 633/1266] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:49 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:50.061083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.062613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.071992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.072772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.073551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.075254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.076783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.077533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.357130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.366493 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a282622-5b83-4666-8cc2-42f1877ab67b tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1646 microversion: 2.1 time: 0.309140 Aug 27 03:11:50.368451 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 634/1267] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1646 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:50.385658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.387623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.395251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.396001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.396437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.397156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.397619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.398040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.490390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.491407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.501108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.501973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.503653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.504596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.505331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.506018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.590474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.601110 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35fcf434-3bd0-46e3-98ce-89aa24f090a4 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.222405 Aug 27 03:11:50.604694 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 634/1268] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:50.616102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.616877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.623691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.624233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.624909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.625784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.626475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.626919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.676883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.688750 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-66b40c34-6c92-448b-860c-342c316bc7a2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.204327 Aug 27 03:11:50.689452 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 635/1269] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:50.702407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.703600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.717539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.718757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.719551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.720410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.720994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.721483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.802895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.809241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.813312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.813566 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-756759f6-916a-4a69-a731-9acbbf8aa24e tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1511 microversion: 2.1 time: 0.200731 Aug 27 03:11:50.814565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.815083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 635/1270] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:50.821116 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e32e0e4-3075-44a9-8db3-eef135fc50c8 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1453 microversion: 2.75 time: 0.129436 Aug 27 03:11:50.821808 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 636/1271] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:50.822696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.823330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.829618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.830216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.831537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.831537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.831859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.832277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.998297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:51.006736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-668db7ef-a492-4e9c-a301-7f3ad1705f41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.190380 Aug 27 03:11:51.007518 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 636/1272] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:51.051444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.052500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.060389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.060977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.061502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.062494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.063024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.063525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.218938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:51.227803 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a31dab97-f14f-4355-9e59-d27ea49eb9a9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.180277 Aug 27 03:11:51.228422 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 637/1273] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:51.392313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.392948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.400323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.400816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.401252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.402194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.402808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.403460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.629150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.630779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.637810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:51.645577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.646630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.648069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.649928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.650832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.651697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.700540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:51.709270 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd01ff28-7fe4-460f-b0b2-422d2c9c0ce3 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1646 microversion: 2.1 time: 0.320909 Aug 27 03:11:51.710358 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 637/1274] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1646 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:51.716828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9273c77d-8e5e-4517-8a56-884f66271d5e req-bd5ba566-5317-42e6-84a9-612ca708c3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d", "name": "network-vif-deleted", "tag": "a4b10926-60c9-41ff-9ebd-173e391ee8f3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:51.730427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9273c77d-8e5e-4517-8a56-884f66271d5e req-bd5ba566-5317-42e6-84a9-612ca708c3a4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.731073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9273c77d-8e5e-4517-8a56-884f66271d5e req-bd5ba566-5317-42e6-84a9-612ca708c3a4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.732678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9273c77d-8e5e-4517-8a56-884f66271d5e req-bd5ba566-5317-42e6-84a9-612ca708c3a4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.744229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9273c77d-8e5e-4517-8a56-884f66271d5e req-bd5ba566-5317-42e6-84a9-612ca708c3a4 service nova] Creating event network-vif-deleted:a4b10926-60c9-41ff-9ebd-173e391ee8f3 for instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d on n-h2-852086-5 Aug 27 03:11:51.752382 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9273c77d-8e5e-4517-8a56-884f66271d5e req-bd5ba566-5317-42e6-84a9-612ca708c3a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039488 Aug 27 03:11:51.754304 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 638/1275] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:51.761756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.762501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.772683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.774665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.774665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.775399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.775910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.776439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.848858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:51.860177 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4e1aac7-5e10-409f-9b16-1a6be3815434 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.238509 Aug 27 03:11:51.861173 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 638/1276] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:51.866227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.867173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.874004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.874687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.875243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.876099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.876877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.877592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.907098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:51.962092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:51.977085 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b34e34d-6207-4c76-9f7a-c12f74c54598 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.220073 Aug 27 03:11:51.978109 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 639/1277] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:51.980432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:51.987271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.989611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.997647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.998436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.999033 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46a0e680-eb54-4d72-a4bd-d354e336db06 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1469 microversion: 2.1 time: 0.135502 Aug 27 03:11:51.999239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.999804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.000976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.001162 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 639/1278] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1469 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:52.001580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.029560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:52.030305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:52.037253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.037961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.038503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.039714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.040370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.040863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.088708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.105331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.107128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.109418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:52.116203 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6fc582d-c21e-4989-bd70-f6488ee628a9 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1453 microversion: 2.75 time: 0.136821 Aug 27 03:11:52.117774 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 640/1279] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:52.252160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:52.252897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:52.259889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.260628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.261088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.261832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.262329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.262765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.310579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.330927 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20fc77c0-69c2-4532-bb44-5df7a6cd9112 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.305817 Aug 27 03:11:52.336204 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 640/1280] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:52 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:52.424796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.436661 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15c24df5-5fcf-4053-a527-ee9145b4b3fe tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.189317 Aug 27 03:11:52.437476 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 641/1281] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:52 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:52.599040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-67a81e84-0675-4cab-89e5-1e3e30edd0f1 req-b3551569-b63a-40cc-b325-d5599929e260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cdac2b-b8ff-487a-9b33-de6c454b9c4a", "name": "network-vif-deleted", "tag": "a9c175a8-47b9-4f77-83cc-a385824167d1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:52.618653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-67a81e84-0675-4cab-89e5-1e3e30edd0f1 req-b3551569-b63a-40cc-b325-d5599929e260 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.620163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-67a81e84-0675-4cab-89e5-1e3e30edd0f1 req-b3551569-b63a-40cc-b325-d5599929e260 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.621377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-67a81e84-0675-4cab-89e5-1e3e30edd0f1 req-b3551569-b63a-40cc-b325-d5599929e260 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.641144 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-67a81e84-0675-4cab-89e5-1e3e30edd0f1 req-b3551569-b63a-40cc-b325-d5599929e260 service nova] Creating event network-vif-deleted:a9c175a8-47b9-4f77-83cc-a385824167d1 for instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a on n-h1-852086-5 Aug 27 03:11:52.650435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-67a81e84-0675-4cab-89e5-1e3e30edd0f1 req-b3551569-b63a-40cc-b325-d5599929e260 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060046 Aug 27 03:11:52.651082 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 641/1282] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:52.743388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:52.744100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:52.751959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.752497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.753381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.753665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.754122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.754566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.792109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.792596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.793029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.793477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lazy-loading 'fault' on Instance uuid f1cdac2b-b8ff-487a-9b33-de6c454b9c4a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:52.795376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:52.840742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.850072 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-84a13628-e52d-4829-be21-79e05c65a8bd tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1305 microversion: 2.1 time: 0.111225 Aug 27 03:11:52.850686 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 642/1283] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:52 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:52.884831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:52.885500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:52.893325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.893850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.894322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.895041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.895500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.895926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.004162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.005626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.016473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.017104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.017555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.018437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.019062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.019506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.067901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.077438 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6acf5edd-bf23-49ef-8c8a-fe509d4c64e0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.196970 Aug 27 03:11:53.079007 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 642/1284] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:52 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:53.082969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.083669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.091865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.092654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.093081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.093787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.094286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.094707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.186538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.195666 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fd6fa597-d0cc-4cdb-a07f-896a27a49d8d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1301 microversion: 2.1 time: 0.115791 Aug 27 03:11:53.196709 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 643/1285] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:53 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1301 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:53.202080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.202745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.210242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.211306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.211784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.212640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.213130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.213548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.223843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.233586 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a3bddb5-d2d0-4077-8fc6-da1ad764e225 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1316 microversion: 2.1 time: 0.239068 Aug 27 03:11:53.234193 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 643/1286] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:52 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:53.293377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.301754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.303219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.308588 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c38197e5-bd26-4683-b99f-ad662c2ba1ab tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1453 microversion: 2.75 time: 0.110553 Aug 27 03:11:53.309166 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 644/1287] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:53 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:53.354787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.356140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.364386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.365451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.366222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.367050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.367892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.368414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.459253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.460022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.466903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.467261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.467593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.468356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.468761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.469193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.570686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.581603 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21aa0fdd-0467-4553-830d-d40d48f3e90d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1542 microversion: 2.1 time: 0.232238 Aug 27 03:11:53.582654 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 644/1288] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:53 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1542 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:53.683050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.694573 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a7cd3ca6-8acb-473a-87af-2ce5114aa5da tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.238817 Aug 27 03:11:53.708957 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 645/1289] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:53 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:53.872803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.873531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.883809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.884325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.884781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.885644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.885971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.886457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.927140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.927140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.927140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.927140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lazy-loading 'fault' on Instance uuid f1cdac2b-b8ff-487a-9b33-de6c454b9c4a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:53.999364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.015894 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3af207d2-20a1-4c40-b13c-1f7fcacde30c tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1305 microversion: 2.1 time: 0.146932 Aug 27 03:11:54.017260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 645/1290] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:53 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1305 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:54.101506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.102127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.110046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.110750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.111177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.112045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.112759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.113177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.221544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.222787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.233275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.234357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.235011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.236395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.236905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.237349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.275299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.275984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.276985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.277544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lazy-loading 'fault' on Instance uuid 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:54.332463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.343423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fae47399cdb424c8840aa4481cc96c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a64cd2b6e940c7becf20937d70ee06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.344516 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33ace98c-30d4-41cf-bb2a-a85920adb926 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.247879 Aug 27 03:11:54.345072 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 646/1291] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:54.351348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.352402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.355716 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24bf3435-33e6-4d73-b5cb-eca1184313be tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 200 len: 1306 microversion: 2.1 time: 0.141324 Aug 27 03:11:54.356867 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 646/1292] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 1306 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:54.364405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.365820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.371067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.371703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.372284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.373661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.374206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.374632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.377044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.377777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.378524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.379462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.380043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.380579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.453085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.464149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.465699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.472257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce671176-8822-403f-a705-8bf35fba566f tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1453 microversion: 2.75 time: 0.113800 Aug 27 03:11:54.472864 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 647/1293] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:54.561615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.592897 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e9e188d-3add-4bc4-adc2-6bc76de786bd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1465 microversion: 2.1 time: 0.245929 Aug 27 03:11:54.599050 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 647/1294] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1465 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:54.614462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.615778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.619778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.620406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.635787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.636089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.636674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.636944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.637201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.637494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.637995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.638756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.639035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.639168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.639414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.639566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.844960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-279c3429-c409-4290-ab39-d90b3fe1e765 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1616 microversion: 2.1 time: 0.229454 Aug 27 03:11:54.845648 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 648/1295] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1616 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:54.850353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.851758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.858440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.858934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.859544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.860431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.860883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.861471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.892611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:54.932625 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0505e682-703b-4788-8bde-e19cb2bf7cbc tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1541 microversion: 2.1 time: 0.324398 Aug 27 03:11:54.935010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 648/1296] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1541 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:55.022709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-980803854", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:55.096911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:55.123937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.132847 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d93ee4c0-d6f8-4bc4-b876-945db26b8358 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.285722 Aug 27 03:11:55.134015 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 649/1297] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:55.139712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:55.140813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.148617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.150249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.150637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.151489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.151968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.152834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.200882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.201438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.201885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.202381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lazy-loading 'fault' on Instance uuid f1cdac2b-b8ff-487a-9b33-de6c454b9c4a {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:55.253600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '657d8e0c58fa4aa58c4e8e1b1bfa74d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ebbb9e792148aca468510c69c89d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.264157 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3559a74e-85b0-44dc-9e03-f2c90f76d9ca tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 200 len: 1305 microversion: 2.1 time: 0.128851 Aug 27 03:11:55.264920 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 650/1298] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:55 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:55.373292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:55.374462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.385687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.386205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.386889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.387629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.388144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.388568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.428587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:55.429017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:55.429604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:55.430119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:55.430805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:55.442309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.442814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.443260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.444005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.444468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.445628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.467998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:55.477367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Getting quotas for user 8803ca2433cb474392f803e913c5d783 and project 587c41ae3469462b8099222b2bb2a278. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:55.501451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:55.501451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:55.551775 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62a7e416-c1a0-45e0-96ac-705ca9972406 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532951 Aug 27 03:11:55.559302 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 649/1299] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:11:55.564638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:55.565269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.572961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.573270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.573702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.574464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.574928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.575364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.607028 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] HTTP exception thrown: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Request method failure captured: Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d HTTP/1.1 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYthkgywSgdODsjl3y4X4JNkQDAsouYUNPidb_6bY7KSJbfU0MSm2dduc3u2h6YltVgiFXBQ-hi0VwloqGkBWHvLccGd2TAYM5aB2GIKrPebnQPCrsU5DqGBT-daxDTWtVR46bv-Rd8MKf1KYelD945F1hFSbGifTEuCpZDTKzZPodg Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f0a64cd2b6e940c7becf20937d70ee06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}] Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6fae47399cdb424c8840aa4481cc96c4 Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d'} Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.612135 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Returning 404 to user: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:55.616704 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09775ba6-e15d-4ebf-a170-7467b61e8959 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 404 len: 111 microversion: 2.1 time: 0.053785 Aug 27 03:11:55.618618 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 650/1300] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:55 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:55.624341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.628475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:55.629810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.638419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.638937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.639411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.640137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.640613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.641046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.643252 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-52e85499-9c97-4848-a5bd-47235bf41c95 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.276062 Aug 27 03:11:55.646220 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 651/1301] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:55 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:55.651930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8968905-f7ed-4a9f-a5fb-01a7313b81f8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:55.652543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8968905-f7ed-4a9f-a5fb-01a7313b81f8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.733328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c8968905-f7ed-4a9f-a5fb-01a7313b81f8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.744146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.746133 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8968905-f7ed-4a9f-a5fb-01a7313b81f8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1216 microversion: 2.1 time: 0.100901 Aug 27 03:11:55.747666 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 652/1302] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:55 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:55.753363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1052504762", "metadata": {"image_type": "test"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:55.756166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.762142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.763270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.763761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.764194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.764905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.765629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.766832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.767271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.776790 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-040bd911-46a7-45e2-9f49-144e9d832ab4 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1438 microversion: 2.75 time: 0.152926 Aug 27 03:11:55.778122 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 651/1303] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:55 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1438 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:55.792827 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] HTTP exception thrown: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Request method failure captured: Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d/action HTTP/1.1 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 112 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYthkgywSgdODsjl3y4X4JNkQDAsouYUNPidb_6bY7KSJbfU0MSm2dduc3u2h6YltVgiFXBQ-hi0VwloqGkBWHvLccGd2TAYM5aB2GIKrPebnQPCrsU5DqGBT-daxDTWtVR46bv-Rd8MKf1KYelD945F1hFSbGifTEuCpZDTKzZPodg Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f0a64cd2b6e940c7becf20937d70ee06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}] Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6fae47399cdb424c8840aa4481cc96c4 Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1052504762", "metadata": {"image_type": "test"}}} Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1052504762', 'metadata': {'image_type': 'test'}}}} Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 03:11:55.796559 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Returning 404 to user: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87f6c4f1-2104-496f-84e7-8a4582d4b246 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "POST /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d/action" status: 404 len: 111 microversion: 2.1 time: 0.050044 Aug 27 03:11:55.804811 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 653/1304] 10.222.0.69 () {60 vars in 1279 bytes} [Sat Aug 27 03:11:55 2022] POST /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:55.821991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e44ba20-f87c-454f-af58-cc7a9c441f4d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-647589404", "metadata": {"image_type": "test"}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:55.826871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e44ba20-f87c-454f-af58-cc7a9c441f4d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Failed to fetch instance by id tempest-invalid-1617956267 {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:11:55.827414 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6e44ba20-f87c-454f-af58-cc7a9c441f4d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] HTTP exception thrown: Instance tempest-invalid-1617956267 could not be found. Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e44ba20-f87c-454f-af58-cc7a9c441f4d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Request method failure captured: Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/tempest-invalid-1617956267/action HTTP/1.1 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 111 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYthkgywSgdODsjl3y4X4JNkQDAsouYUNPidb_6bY7KSJbfU0MSm2dduc3u2h6YltVgiFXBQ-hi0VwloqGkBWHvLccGd2TAYM5aB2GIKrPebnQPCrsU5DqGBT-daxDTWtVR46bv-Rd8MKf1KYelD945F1hFSbGifTEuCpZDTKzZPodg Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f0a64cd2b6e940c7becf20937d70ee06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}] Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6fae47399cdb424c8840aa4481cc96c4 Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-647589404", "metadata": {"image_type": "test"}}} Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance tempest-invalid-1617956267 could not be found. Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'tempest-invalid-1617956267', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-647589404', 'metadata': {'image_type': 'test'}}}} Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1617956267 could not be found. Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:55.830648 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1617956267 could not be found. Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1617956267 could not be found. Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e44ba20-f87c-454f-af58-cc7a9c441f4d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Returning 404 to user: Instance tempest-invalid-1617956267 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e44ba20-f87c-454f-af58-cc7a9c441f4d tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "POST /compute/v2.1/servers/tempest-invalid-1617956267/action" status: 404 len: 101 microversion: 2.1 time: 0.018941 Aug 27 03:11:55.839699 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 652/1305] 10.222.0.69 () {60 vars in 1249 bytes} [Sat Aug 27 03:11:55 2022] POST /compute/v2.1/servers/tempest-invalid-1617956267/action => generated 101 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:55.857223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53a78dda-9fe5-4c50-b913-64e4991924d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2049788825"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:55.859926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53a78dda-9fe5-4c50-b913-64e4991924d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:11:55.860464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-53a78dda-9fe5-4c50-b913-64e4991924d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53a78dda-9fe5-4c50-b913-64e4991924d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Request method failure captured: Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 57 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYthkgywSgdODsjl3y4X4JNkQDAsouYUNPidb_6bY7KSJbfU0MSm2dduc3u2h6YltVgiFXBQ-hi0VwloqGkBWHvLccGd2TAYM5aB2GIKrPebnQPCrsU5DqGBT-daxDTWtVR46bv-Rd8MKf1KYelD945F1hFSbGifTEuCpZDTKzZPodg Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f0a64cd2b6e940c7becf20937d70ee06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}] Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6fae47399cdb424c8840aa4481cc96c4 Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: {"createImage": {"name": "tempest-test-snap-2049788825"}} Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2049788825'}}} Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.862208 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53a78dda-9fe5-4c50-b913-64e4991924d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53a78dda-9fe5-4c50-b913-64e4991924d3 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.019577 Aug 27 03:11:55.873229 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 653/1306] 10.222.0.69 () {60 vars in 1275 bytes} [Sat Aug 27 03:11:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:55.896115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05836b9f-7f46-4704-a67c-779caae1abad tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1562430284"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:55.899477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05836b9f-7f46-4704-a67c-779caae1abad tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:11:55.900196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-05836b9f-7f46-4704-a67c-779caae1abad tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05836b9f-7f46-4704-a67c-779caae1abad tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Request method failure captured: Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 57 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYthkgywSgdODsjl3y4X4JNkQDAsouYUNPidb_6bY7KSJbfU0MSm2dduc3u2h6YltVgiFXBQ-hi0VwloqGkBWHvLccGd2TAYM5aB2GIKrPebnQPCrsU5DqGBT-daxDTWtVR46bv-Rd8MKf1KYelD945F1hFSbGifTEuCpZDTKzZPodg Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f0a64cd2b6e940c7becf20937d70ee06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}] Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6fae47399cdb424c8840aa4481cc96c4 Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: {"createImage": {"name": "tempest-test-snap-1562430284"}} Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1562430284'}}} Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.901744 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05836b9f-7f46-4704-a67c-779caae1abad tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05836b9f-7f46-4704-a67c-779caae1abad tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019312 Aug 27 03:11:55.912535 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 654/1307] 10.222.0.69 () {60 vars in 1281 bytes} [Sat Aug 27 03:11:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:55.920745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:55.921256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.931310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.932043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.932452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.934223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.934444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.935075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.960232 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] HTTP exception thrown: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Request method failure captured: Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d HTTP/1.1 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYthkgywSgdODsjl3y4X4JNkQDAsouYUNPidb_6bY7KSJbfU0MSm2dduc3u2h6YltVgiFXBQ-hi0VwloqGkBWHvLccGd2TAYM5aB2GIKrPebnQPCrsU5DqGBT-daxDTWtVR46bv-Rd8MKf1KYelD945F1hFSbGifTEuCpZDTKzZPodg Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f0a64cd2b6e940c7becf20937d70ee06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}] Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6fae47399cdb424c8840aa4481cc96c4 Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d'} Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:55.963377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Returning 404 to user: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a940d116-351b-4467-9732-c3f84f2b2e41 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 404 len: 111 microversion: 2.1 time: 0.054234 Aug 27 03:11:55.969175 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 655/1308] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:55 2022] DELETE /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:55.974459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:55.975689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:55.984478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.985021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.985638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.986459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.987003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.987447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.026193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:56.032733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.040722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.041382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.041823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.042578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.043031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.043459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.155366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:56.155801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:56.156355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:56.157084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:56.157704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:56.179309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:56.189304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95e1e7ce-ad37-4867-b382-b9e3aebcb240 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1473 microversion: 2.1 time: 0.221981 Aug 27 03:11:56.190410 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 656/1309] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:55 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:56.196041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.196671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] [instance: 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.203749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.204665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.205649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.207093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.208032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.208988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.229544 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] HTTP exception thrown: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Request method failure captured: Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d HTTP/1.1 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYthkgywSgdODsjl3y4X4JNkQDAsouYUNPidb_6bY7KSJbfU0MSm2dduc3u2h6YltVgiFXBQ-hi0VwloqGkBWHvLccGd2TAYM5aB2GIKrPebnQPCrsU5DqGBT-daxDTWtVR46bv-Rd8MKf1KYelD945F1hFSbGifTEuCpZDTKzZPodg Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f0a64cd2b6e940c7becf20937d70ee06", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f0a64cd2b6e940c7becf20937d70ee06"}]}] Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f0a64cd2b6e940c7becf20937d70ee06 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1290413185 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6fae47399cdb424c8840aa4481cc96c4 Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1290413185-project Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d'} Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:56.231796 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] Returning 404 to user: Instance 6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a5f4cf4-00c0-4686-b8e9-8ebb1eba9b68 tempest-ImagesNegativeTestJSON-1290413185 tempest-ImagesNegativeTestJSON-1290413185-project] 10.222.0.69 "GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d" status: 404 len: 111 microversion: 2.1 time: 0.041711 Aug 27 03:11:56.239172 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 657/1310] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:56 2022] GET /compute/v2.1/servers/6f9704cb-ac6f-4bc7-a9d6-af2f91a8ee4d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:56.249640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.252690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.262640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.263635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.266444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.277305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.278377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.278956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.279453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.281030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.284158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.285171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.287891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.289632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.291606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.530129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:56.559468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:56.574303 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ffb875c2-d27a-4526-b2cc-9e9078c5a7d7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.337660 Aug 27 03:11:56.574942 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8efa36ac-737c-48cc-93a8-2c71f8775425 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654/action" status: 202 len: 1942 microversion: 2.75 time: 0.758416 Aug 27 03:11:56.581539 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 654/1311] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:11:55 2022] POST /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654/action => generated 1942 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 03:11:56.590491 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 658/1312] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:56 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:56.593539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.595659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] [instance: f1cdac2b-b8ff-487a-9b33-de6c454b9c4a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.606961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.607568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.608112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.609084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.609784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.610565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.619138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.620093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.628186 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] HTTP exception thrown: Instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a could not be found. Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Request method failure captured: Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a HTTP/1.1 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYsRvDWiR1l5WHkxTDrXVp0Afn1fKmWRzLl9x0IAwapeszC9ibVxU1Q3MSFS6_sMOKjwejf0GLEDkVDcfBwm5Pl0EVbYz6E7arUpFg2dXUm2GeLZTzViA3Cnm3YKOJgbLMbwK8Tqhp-6qqMIuIRxRgUkxvw3XsPUY9Uv_1bWlDwB6d0 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90ebbb9e792148aca468510c69c89d14", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90ebbb9e792148aca468510c69c89d14"}]}] Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 90ebbb9e792148aca468510c69c89d14 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-468264836 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 657d8e0c58fa4aa58c4e8e1b1bfa74d3 Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsTestJSON-468264836-project Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a could not be found. Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f1cdac2b-b8ff-487a-9b33-de6c454b9c4a'} Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a could not be found. Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a could not be found. Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:56.629969 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a could not be found. Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Returning 404 to user: Instance f1cdac2b-b8ff-487a-9b33-de6c454b9c4a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b7e48c5-68a4-4017-b878-927de8dc32c5 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a" status: 404 len: 111 microversion: 2.1 time: 0.054238 Aug 27 03:11:56.636453 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 655/1313] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:56 2022] GET /compute/v2.1/servers/f1cdac2b-b8ff-487a-9b33-de6c454b9c4a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:56.641432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.642399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.643248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.645151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.645402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8cee35a3-4df6-4316-ab0a-0c001f422127 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457e12a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.645893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.647094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.839743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:56.881724 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6163b47a-5a6b-46b3-bfc9-2787bca8789f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.268139 Aug 27 03:11:56.884718 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 659/1314] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:56 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:56.888970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.889699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.906132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.906973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.907518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.908267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.908738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.909183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.118751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:57.133020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b5b31a0-e1f1-4982-9815-aaee48cf3300 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.248067 Aug 27 03:11:57.133631 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 660/1315] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:56 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:57.142046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:57.142994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:57.152395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.153000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.153779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.155334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.155870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.156331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.277842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:57.291021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09b9a9c9-378b-4275-84ce-0ae7ee22bdea tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1220 microversion: 2.1 time: 0.156006 Aug 27 03:11:57.291623 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 661/1316] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:57 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1220 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:57.298667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:57.299819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:57.312552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.313417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.314187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.315113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.315753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.316507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.529278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:57.543522 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b59a7f7c-3634-402a-83bd-a4aeb862e666 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1473 microversion: 2.1 time: 0.250412 Aug 27 03:11:57.549538 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 662/1317] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:57 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:57.569604 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8cee35a3-4df6-4316-ab0a-0c001f422127 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/3313058f-3863-4c7c-a8ed-65da64230dc2" status: 202 len: 0 microversion: 2.1 time: 0.930687 Aug 27 03:11:57.572336 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 656/1318] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:56 2022] DELETE /compute/v2.1/os-security-groups/3313058f-3863-4c7c-a8ed-65da64230dc2 => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:57.581728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-358f3f8c-bdb0-4143-912b-db694078e8f2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] Calling method '.version_select at 0x7fe457d1f550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:57.603500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:57.607607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:57.629854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.631149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.631667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.634442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.635701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.636995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.691502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:57.932680 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-358f3f8c-bdb0-4143-912b-db694078e8f2 tempest-SecurityGroupsTestJSON-468264836 tempest-SecurityGroupsTestJSON-468264836-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/fb0de87c-e495-445c-bda9-0359e71f42b5" status: 202 len: 0 microversion: 2.1 time: 0.351233 Aug 27 03:11:57.936357 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 663/1319] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:11:57 2022] DELETE /compute/v2.1/os-security-groups/fb0de87c-e495-445c-bda9-0359e71f42b5 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:11:57.956804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:57.958743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:57.977759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.983322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.985162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.986923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.988130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.989353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.999537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:58.042184 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9a43d477-7994-4e0c-bedf-693c440cdd78 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.446048 Aug 27 03:11:58.044363 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 657/1320] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:57 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:58.163592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.166676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.177851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:58.200387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.203954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.209457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.211739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:58.213559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.215652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.219576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.265391 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7b3e993-bbb7-40db-aa3b-31bdfeb320b2 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.325291 Aug 27 03:11:58.266008 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 664/1321] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:57 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:58.322184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.323310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.340906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.344185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.344185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.344185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.345782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.345935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.494281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:58.508652 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5dc6d84f-8677-4a85-875c-ef9a1ca0c1c2 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1220 microversion: 2.1 time: 0.194792 Aug 27 03:11:58.515413 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 665/1322] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1220 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:58.575883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.576859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.583409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.584002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.584509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.585299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.586808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.587331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.759125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:58.784791 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9b8b653-fb79-4af0-9fd7-e69f387b9d35 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.630287 Aug 27 03:11:58.785411 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 658/1323] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:59.081455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.084061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.094884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.096247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.097308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.099363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.100506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.102217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.186274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:59.196227 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d74fbc6-960b-44b3-a57f-510921784f52 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1470 microversion: 2.1 time: 0.625737 Aug 27 03:11:59.197215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 666/1324] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:59.235587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:59.236594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.258206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.259239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.260028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.261104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.261785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.262568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.346042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.347058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.347711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.349080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.349679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.350573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.393358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for project 82d80176cbd24a32922fe33269a9ae59. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:59.401943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for user 3ad6820606064210a5a0e2fa2bfa4bb7 and project 82d80176cbd24a32922fe33269a9ae59. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:59.433156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:59.446934 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24f96038-51b2-4fe5-89ae-c4799eaab5a0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.373842 Aug 27 03:11:59.449033 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 659/1325] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:59.457648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.459009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.468948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.470031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.470868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.472298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.473210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.473876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.635443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5419e22-64f0-46fd-b116-74f3f4288a1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a/action" status: 202 len: 0 microversion: 2.1 time: 0.404795 Aug 27 03:11:59.637162 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 667/1326] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:59 2022] POST /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:11:59.648411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.649486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.661939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.662777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.663745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.665718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.666193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.666650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.774008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:59.784697 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c830649f-2247-48e4-8b00-5c5a9ef6265e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1212 microversion: 2.1 time: 0.145348 Aug 27 03:11:59.786343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 668/1327] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1212 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:59.792826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.793458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.812711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.813540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.814461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.815385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.815884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.816489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.891219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:59.924092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-096b76d8-5a56-45d1-8af8-66e4b4962bbe tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.473119 Aug 27 03:11:59.925456 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 660/1328] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:11:59.932668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.934211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.945211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.946037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.946740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.947970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.948772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.949537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:00.083015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:00.093214 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2922b69-9262-46db-a3ef-eb476b0789d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1469 microversion: 2.1 time: 0.305034 Aug 27 03:12:00.099345 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 669/1329] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1469 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:00.370975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:00.380051 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f4a3e04-15ec-495d-87c7-9771568831fd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.452974 Aug 27 03:12:00.381530 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 661/1330] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:00.495082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:00.496340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:00.521130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:00.535956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:00.535956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:00.535956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:00.535956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:00.541010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:00.806020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-340e32d3-21b9-44c1-9433-329a6bf7869d req-b9005392-176f-47b0-9578-1baaa94aac7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61cb6ca-8b57-4408-b6a2-5e8e542ce81a", "name": "network-vif-plugged", "status": "completed", "tag": "7c4936ee-07ae-40cf-b35c-9ec273970636"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:00.825671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-340e32d3-21b9-44c1-9433-329a6bf7869d req-b9005392-176f-47b0-9578-1baaa94aac7a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:00.826336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-340e32d3-21b9-44c1-9433-329a6bf7869d req-b9005392-176f-47b0-9578-1baaa94aac7a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:00.827352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-340e32d3-21b9-44c1-9433-329a6bf7869d req-b9005392-176f-47b0-9578-1baaa94aac7a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:00.854990 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-340e32d3-21b9-44c1-9433-329a6bf7869d req-b9005392-176f-47b0-9578-1baaa94aac7a service nova] Creating event network-vif-plugged:7c4936ee-07ae-40cf-b35c-9ec273970636 for instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a on n-h2-852086-5 Aug 27 03:12:00.864753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-340e32d3-21b9-44c1-9433-329a6bf7869d req-b9005392-176f-47b0-9578-1baaa94aac7a service nova] Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:12:00.885625 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-340e32d3-21b9-44c1-9433-329a6bf7869d req-b9005392-176f-47b0-9578-1baaa94aac7a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097263 Aug 27 03:12:00.887548 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 662/1331] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:00.894976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:00.898487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:00.911544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:00.912425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:00.915228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:00.916348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:00.917537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:00.922308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.098908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:01.112497 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a70dbc22-f597-45d9-a47d-1a8508aa2e1f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1268 microversion: 2.1 time: 0.222984 Aug 27 03:12:01.114579 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 663/1332] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:00 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1268 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:01.123927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:01.124995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:01.136305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.136862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.137277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.138149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.138544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.138954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.180598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:01.189509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df8e80ac-6447-458d-b9ea-1a9ae382ef71 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.710320 Aug 27 03:12:01.190417 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 670/1333] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:00 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:01.197673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:01.198450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:01.211120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.212063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.212800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.213865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.214529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.214974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.254422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:01.290401 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17bcf1c5-7a16-41d7-8896-695c1af3ac55 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.173844 Aug 27 03:12:01.298212 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 664/1334] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:01 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:01.403667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:01.404503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:01.412667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.415253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.415938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.416744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.417215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.417641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.652724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:01.668390 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dd6888f7-7c09-48ca-9034-f68b31e926cf tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.268936 Aug 27 03:12:01.669746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 665/1335] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:01 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:01.941657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-03fbd04e-3640-4912-b105-33cf9a73d3d5 req-83b68005-9fdc-4421-bfac-57eb2f1f96d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3433e1f2-f285-4966-92cb-9379c704c79f", "name": "network-vif-unplugged", "status": "completed", "tag": "9ebee722-b0c2-440d-bedb-e10ee3451871"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:01.970096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-03fbd04e-3640-4912-b105-33cf9a73d3d5 req-83b68005-9fdc-4421-bfac-57eb2f1f96d5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.970956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-03fbd04e-3640-4912-b105-33cf9a73d3d5 req-83b68005-9fdc-4421-bfac-57eb2f1f96d5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.971707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-03fbd04e-3640-4912-b105-33cf9a73d3d5 req-83b68005-9fdc-4421-bfac-57eb2f1f96d5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.999289 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-03fbd04e-3640-4912-b105-33cf9a73d3d5 req-83b68005-9fdc-4421-bfac-57eb2f1f96d5 service nova] Creating event network-vif-unplugged:9ebee722-b0c2-440d-bedb-e10ee3451871 for instance 3433e1f2-f285-4966-92cb-9379c704c79f on n-h1-852086-5 Aug 27 03:12:02.016904 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-03fbd04e-3640-4912-b105-33cf9a73d3d5 req-83b68005-9fdc-4421-bfac-57eb2f1f96d5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082016 Aug 27 03:12:02.020235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 666/1336] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:02.139250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:02.140432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:02.149127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.150107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.150888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.152050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.152955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.153744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.161257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:02.178529 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8f539d3-4251-44c8-ad11-12141b14c60f tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1469 microversion: 2.1 time: 0.986497 Aug 27 03:12:02.188501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 671/1337] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:01 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1469 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:02.215245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:02.216960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:02.221789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:02.237742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.238632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.239335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.240347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.242661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.243717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.292477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:02.311872 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e5dec321-cb54-496b-b09a-0b3fae440a11 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1274 microversion: 2.1 time: 0.176972 Aug 27 03:12:02.316178 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 667/1338] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:02 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:02.339396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:02.341392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:02.364868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.366104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.368097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.369593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.370703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.371637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.555711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:02.597140 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9a055e95-4936-4691-917b-38643c9130fc tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.269675 Aug 27 03:12:02.601946 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 668/1339] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:02 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:02.705958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:02.707259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:02.715687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.720898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:02.726101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.731402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.732765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.733687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.736819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.741080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4fa46069-d6b5-4334-b07f-dc85fe416c0e tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.527044 Aug 27 03:12:02.743475 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 672/1340] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:02 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:03.220791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:03.223342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:03.236893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.238350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.239588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.241300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.243177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.244303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.553077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:03.571234 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6a764e9-3ba7-4981-b21d-bb3c83c602ec tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1469 microversion: 2.1 time: 0.357579 Aug 27 03:12:03.593457 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 673/1341] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:03 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:03.595343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:03.595967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:03.605979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.606527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.606976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.607704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.608300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.608739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.686351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:03.703234 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02529f7d-32d4-4bf8-a904-8fdc95cf0707 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 1.000917 Aug 27 03:12:03.718559 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 669/1342] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:02 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:03.724089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:03.724702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:03.734325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.735150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.735879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.736833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.737505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.738192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.861316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:03.871475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bde719cd-82cf-450a-ab9b-5553d52a2fcf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1274 microversion: 2.1 time: 0.280293 Aug 27 03:12:03.887106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 674/1343] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:03 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1274 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:03.893110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:03.894124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:03.902274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.903137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.903816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.904771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.905822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.907166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.956447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:03.985285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62285e5a-d8ff-41b0-86d1-c32e8a3ac6cb tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.271117 Aug 27 03:12:03.986918 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 670/1344] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:03 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:04.459085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7644b12b-cb91-4e50-b6f8-b0dcbc3e347d req-85f68c24-371e-409c-afce-aae9e699e0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3433e1f2-f285-4966-92cb-9379c704c79f", "tag": "9ebee722-b0c2-440d-bedb-e10ee3451871"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:04.491076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7644b12b-cb91-4e50-b6f8-b0dcbc3e347d req-85f68c24-371e-409c-afce-aae9e699e0fe service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.493100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7644b12b-cb91-4e50-b6f8-b0dcbc3e347d req-85f68c24-371e-409c-afce-aae9e699e0fe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.493943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7644b12b-cb91-4e50-b6f8-b0dcbc3e347d req-85f68c24-371e-409c-afce-aae9e699e0fe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.523836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7644b12b-cb91-4e50-b6f8-b0dcbc3e347d req-85f68c24-371e-409c-afce-aae9e699e0fe service nova] Creating event network-changed:9ebee722-b0c2-440d-bedb-e10ee3451871 for instance 3433e1f2-f285-4966-92cb-9379c704c79f on n-h1-852086-5 Aug 27 03:12:04.554385 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7644b12b-cb91-4e50-b6f8-b0dcbc3e347d req-85f68c24-371e-409c-afce-aae9e699e0fe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104439 Aug 27 03:12:04.558112 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 671/1345] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:04.610417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:04.627173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:04.628138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:04.631429 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebce30d6-eddf-4abc-8e08-dce11ffdc74d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.741948 Aug 27 03:12:04.636314 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 675/1346] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:03 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:04.648932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.650272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.651288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.653118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.655497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.657779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.746202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:04.748090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:04.765542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.771552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.772802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.787580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.788167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.788691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:05.452703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:05.475504 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2d08092-dbb3-423c-ae66-b6d42c06ce55 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.746247 Aug 27 03:12:05.501372 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 676/1347] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:04 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:05.503392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:05.516659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:05.517310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:05.539507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:05.540440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:05.541213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:05.542248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:05.548019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:05.548890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:05.740262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:05.792262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:05.807139 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2da67c86-b329-4ae9-870a-f399edf7de41 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1469 microversion: 2.1 time: 1.202536 Aug 27 03:12:05.807809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 672/1348] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:04 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1469 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:05.829195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:05.833445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:05.852724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:05.855154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:05.857661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:05.859538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:05.862111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:05.863095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.096378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:06.129236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13b398b7-e985-4e34-b74b-8683a82a91e5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.626333 Aug 27 03:12:06.133894 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 677/1349] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:05 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:06.165367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:06.165734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:06.170541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:06.171811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:06.193010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46290644-c897-44ae-8508-1c916802658c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.381738 Aug 27 03:12:06.194050 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 673/1350] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:05 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:06.202570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.202570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.202570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.205095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.206015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.206596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.219432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:06.501470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:06.524411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:06.527731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:06.533549 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72cc0f88-7d21-4f7f-a07a-d979d014ee17 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.389591 Aug 27 03:12:06.542102 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 678/1351] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:06 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:06.553135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.554477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.555475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.556974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.558095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.559170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.845479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:06.846211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:06.865265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.867482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.871939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.873297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.878581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.886289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.178653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:07.189286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:07.199928 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fec65eae-cdbf-470b-91d4-b64cee6eb9a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1469 microversion: 2.1 time: 0.358680 Aug 27 03:12:07.210686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1292ffef-b30f-429d-b25a-6d060f316709 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.693711 Aug 27 03:12:07.211498 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 679/1352] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:06 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1469 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:07.211934 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 674/1353] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:06 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:07.222186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:07.222858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:07.230088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.231021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.232433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.233475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.234257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.234948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.247439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:07.248390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:07.263525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.266345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.267090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.269377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.270102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.270618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.593950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:07.601435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:07.631009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff7f4c2b-3555-4b2d-855a-6e1ae45f5e0c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.393232 Aug 27 03:12:07.632247 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b66126ab-20f4-4bca-8f3c-720000ce0676 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.418618 Aug 27 03:12:07.646313 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 680/1354] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:07 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:07.646674 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 675/1355] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:07 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:07.648763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:07.649810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:07.671979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.672878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.673663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.687263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.688092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.688844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.017907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:08.030494 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93b7aeb3-cad9-49f5-a196-b79046037518 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.395314 Aug 27 03:12:08.036225 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 681/1356] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:07 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:08.225289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:08.227950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:08.236576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.237454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.238202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.239373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.240085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.240760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.248532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:08.249992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:08.264984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.266060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.266910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.270243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.272173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.274530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.697154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:08.707873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6ecde14-c11f-4116-9cbd-4c3c19a95c3d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1535 microversion: 2.1 time: 0.486855 Aug 27 03:12:08.709219 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 676/1357] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:08 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1535 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:08.716416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f0398c85-5e11-4427-b65f-f5d2f0b31ebc req-5ef97808-f030-408a-af48-d2ef98f34f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f60d27e-6741-43fb-bbaa-822e5a49bf30", "tag": "fc480075-3074-4484-8fa4-f91ac49445ff"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:08.728213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:08.733242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f0398c85-5e11-4427-b65f-f5d2f0b31ebc req-5ef97808-f030-408a-af48-d2ef98f34f94 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.733903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f0398c85-5e11-4427-b65f-f5d2f0b31ebc req-5ef97808-f030-408a-af48-d2ef98f34f94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.734376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f0398c85-5e11-4427-b65f-f5d2f0b31ebc req-5ef97808-f030-408a-af48-d2ef98f34f94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.749815 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f0398c85-5e11-4427-b65f-f5d2f0b31ebc req-5ef97808-f030-408a-af48-d2ef98f34f94 service nova] Creating event network-changed:fc480075-3074-4484-8fa4-f91ac49445ff for instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 on n-h2-852086-5 Aug 27 03:12:08.758500 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f0398c85-5e11-4427-b65f-f5d2f0b31ebc req-5ef97808-f030-408a-af48-d2ef98f34f94 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045636 Aug 27 03:12:08.761932 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 677/1358] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:08.768773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:08.769990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:08.780222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.781190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.782271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.784513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.785383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.786200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.897057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:08.919720 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c91d9d8-f0b8-4fcc-88e8-df4d43ecd9a0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.680337 Aug 27 03:12:08.936255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:08.938248 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 682/1359] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:08 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:08.956139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:08.958108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:08.959001 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-077a8f53-6e3e-49da-9ae2-72dd38722bf5 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.194880 Aug 27 03:12:08.960457 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 678/1360] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:08 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:08.972313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.973431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.974044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:08.975073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.976315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:08.977192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.072610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:09.076022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:09.088440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:09.089315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.090395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.092002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:09.093109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.094408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.369724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:09.823356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:09.836056 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e5e0853d-2cc9-4835-8d7a-bbf56eafcedd tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.779103 Aug 27 03:12:09.837585 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 679/1361] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:09 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:09.852100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:09.855301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:09.864708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:09.865891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.867424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.868869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:09.869414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.869918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.921820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:09.940575 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d07c417-676d-4d68-a732-9687ba37f668 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 1.000167 Aug 27 03:12:09.941504 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 683/1362] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:08 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:09.951953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:09.952778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:09.976779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:09.977754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.978646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.979889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:09.980585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.981450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:10.235036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:10.246622 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-778010e9-182b-44e7-bd6c-62557533963e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.298519 Aug 27 03:12:10.259022 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 684/1363] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:09 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:10.269526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:10.270413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:10.280871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:10.282603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:10.283728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:10.284669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:10.285248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:10.285880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:10.442994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:10.466415 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed41a1b7-df0e-4303-8363-23679a69042b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.205542 Aug 27 03:12:10.481648 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 685/1364] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:10 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:10.488371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6f543869-9d79-44e0-8e56-cc7c6ac85f9d req-3b88bb93-2650-4068-8200-133502e8b1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61cb6ca-8b57-4408-b6a2-5e8e542ce81a", "name": "network-vif-unplugged", "status": "completed", "tag": "7c4936ee-07ae-40cf-b35c-9ec273970636"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:10.506564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f543869-9d79-44e0-8e56-cc7c6ac85f9d req-3b88bb93-2650-4068-8200-133502e8b1a6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:10.507974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f543869-9d79-44e0-8e56-cc7c6ac85f9d req-3b88bb93-2650-4068-8200-133502e8b1a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:10.508797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f543869-9d79-44e0-8e56-cc7c6ac85f9d req-3b88bb93-2650-4068-8200-133502e8b1a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:10.533172 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6f543869-9d79-44e0-8e56-cc7c6ac85f9d req-3b88bb93-2650-4068-8200-133502e8b1a6 service nova] Creating event network-vif-unplugged:7c4936ee-07ae-40cf-b35c-9ec273970636 for instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a on n-h2-852086-5 Aug 27 03:12:10.543526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-6f543869-9d79-44e0-8e56-cc7c6ac85f9d req-3b88bb93-2650-4068-8200-133502e8b1a6 service nova] Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:12:10.555573 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6f543869-9d79-44e0-8e56-cc7c6ac85f9d req-3b88bb93-2650-4068-8200-133502e8b1a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071321 Aug 27 03:12:10.557323 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 686/1365] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:10.559616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:10.574824 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-88c6c79b-2f1e-4c0e-b9ee-0e59dfc98245 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1535 microversion: 2.1 time: 0.734953 Aug 27 03:12:10.575880 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 680/1366] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:09 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1535 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:10.878390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:10.879719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:10.890932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:10.891759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:10.892205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:10.893204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:10.894039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:10.894544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.000396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:11.002739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:11.016050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.017251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.017995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.019704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.020615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.021564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.120119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:11.142693 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9b6f214-1e76-4ab2-96a4-597ed9106dc8 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.270053 Aug 27 03:12:11.146114 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 687/1367] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:10 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:11.277726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:11.281896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:11.302900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.303713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.305791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.307065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.308031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.308480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.450336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:11.459318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e464853f-78af-4663-ba71-213b1826ba33 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.473657 Aug 27 03:12:11.463010 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 681/1368] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:10 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:11.502380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:11.503589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:11.523525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.525614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.548747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.549658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.550251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.550711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.753117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:11.763665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:11.778958 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a115d6a-1104-4236-8287-fbbf7f71d2d8 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.507167 Aug 27 03:12:11.780429 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 688/1369] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:11 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:11.791818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:11.793328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:11.802956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.804797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.805976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.807518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.808596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.809448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.834327 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-717abb3f-b231-4249-8253-3b540d11820e tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.337218 Aug 27 03:12:11.839898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 682/1370] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:11 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:12.173204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:12.175253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:12.208603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.220664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.223480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.226773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.228274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:12.244198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.245061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b03a760-2fee-44d2-b5d0-8b9e6838e2f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1535 microversion: 2.1 time: 0.463085 Aug 27 03:12:12.245826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.259232 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 689/1371] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:11 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1535 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:12.495940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:12.496873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:12.527934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.528848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.529653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.530737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.534560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.542588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.884095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:12.919458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d908bf77-cdad-42d5-82a9-a178a0d8f5be tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.745607 Aug 27 03:12:12.935534 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 683/1372] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:12 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:12.940639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:12.941272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:12.965576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.966753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.967220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.969237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.971694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.973341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.098096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:13.107860 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eaa97bdf-2a7a-4212-b4ea-48ed888bcbca tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.624040 Aug 27 03:12:13.109939 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 690/1373] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:12 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:13.123407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:13.128648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:13.143517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.146915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.148146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.152609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.153294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.158482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.307915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:13.323795 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6430802-1bfd-4b37-9738-892f811fe174 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.385805 Aug 27 03:12:13.324772 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 684/1374] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:12 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:13.342603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:13.343628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:13.351496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:13.353908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.355406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.358756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.359631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.360121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.360554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.395874 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7fc4cf99-57c0-4498-90a3-09caa00b596b tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.284522 Aug 27 03:12:13.396972 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 691/1375] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:13 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:13.720776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:13.750784 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e10eb465-e169-4186-8a1a-388a5ce96805 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1535 microversion: 2.1 time: 0.421847 Aug 27 03:12:13.752196 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 685/1376] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:13 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1535 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:13.943717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:13.947068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:13.959441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.960881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.961957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.963178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.964269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.965326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.136554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:14.148284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:14.165816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.166448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.173128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.174201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.174749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.175716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.465580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:14.487425 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e46c277-c806-4e80-9df7-1f81fd452822 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1472 microversion: 2.1 time: 0.548755 Aug 27 03:12:14.488695 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 692/1377] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:13 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:14.505822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:14.508237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:14.517487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.518710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.519387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.520340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.520982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.521827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.662195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:14.683182 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d297e149-98d1-41f1-924a-4b1314503683 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.551827 Aug 27 03:12:14.687434 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 686/1378] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:14 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:14.705589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:14.707226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:14.721104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.722098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.724827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.727439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.728251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.731653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.205464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:15.236395 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e5d8297-dc28-40a5-b5dd-cab68cf3321d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.745580 Aug 27 03:12:15.259238 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 693/1379] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:14 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:15.291494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:15.293077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:15.320556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.321060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.321698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.326473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.326972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.327420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.402417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:15.408589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:15.464925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d2c0b25-4aa6-4fd7-9d59-1e80e05b27d9 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.771074 Aug 27 03:12:15.479662 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 687/1380] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:14 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:15.510449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:15.511738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:15.535208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.547432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.548836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.550367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.551433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.552469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.219763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:16.239866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59cb689e-cc21-47c1-b2de-76bcf4070b9b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1478 microversion: 2.1 time: 0.732806 Aug 27 03:12:16.261904 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 688/1381] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:15 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1478 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:16.274326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:16.281100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:16.304865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.309344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.310906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.314583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.338968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.339795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.568659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:16.606209 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-101f6589-9331-4aa8-80cb-752f93063493 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1528 microversion: 2.1 time: 1.345008 Aug 27 03:12:16.636221 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 694/1382] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:15 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1528 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:16.665782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:16.672036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:16.704307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.714050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.714738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.716003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.716786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.717391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.239716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 607b043e-1bab-4c1d-8348-610a19b23bfa {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:17.278469 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2d7280f-db74-4b57-932c-81229e68b4b5 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 2344 microversion: 2.25 time: 0.640450 Aug 27 03:12:17.284428 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 695/1383] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:16 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 2344 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:17.306212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:17.307191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:17.313907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.314732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.315734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.316686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.317345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.317954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.500387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:17.538713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:17.548152 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7bf3ed28-0d90-4acb-a82c-58d5db592646 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 1.283365 Aug 27 03:12:17.552827 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 689/1384] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:16 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:17.567579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:17.568776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:17.588336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.589301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.591509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.593591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.597453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.598081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.178695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:18.192559 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01e0dc5d-60f4-4301-821c-ada2c2da0e99 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.908810 Aug 27 03:12:18.196673 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 696/1385] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:17 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:18.211886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:18.212969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:18.229012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.234582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.236663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.237636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.243599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.244314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.398984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:18.442314 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9cc498f-cba6-45cb-bf14-736603990ead tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.887213 Aug 27 03:12:18.459348 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 690/1386] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:17 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:18.468519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:18.470278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:18.479588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.480361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.481104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.482115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.482966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.483686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.160016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:19.184761 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-af8c63d6-9d70-40c6-a5b5-184f1352db62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1478 microversion: 2.1 time: 0.722920 Aug 27 03:12:19.186217 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 691/1387] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:18 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1478 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:19.192290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:19.197043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.197883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.198567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.200179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.200862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.201545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.236854 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6dbe4f3f-56f4-4519-978e-5d58953f0fa6 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049121 Aug 27 03:12:19.257149 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 692/1388] 10.222.0.69 () {60 vars in 1217 bytes} [Sat Aug 27 03:12:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:12:19.264616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5063db24-47e8-428a-9b2c-79898cbbd061 req-4303c470-36aa-40f5-b557-3bba0121d8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61cb6ca-8b57-4408-b6a2-5e8e542ce81a", "name": "network-vif-plugged", "status": "completed", "tag": "7c4936ee-07ae-40cf-b35c-9ec273970636"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:19.298307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:19.310814 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f1316b7-1450-4cb6-ad2b-f20e16b22a91 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1528 microversion: 2.1 time: 1.110662 Aug 27 03:12:19.311719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 697/1389] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:18 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1528 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:19.316856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5063db24-47e8-428a-9b2c-79898cbbd061 req-4303c470-36aa-40f5-b557-3bba0121d8ce service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.322968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5063db24-47e8-428a-9b2c-79898cbbd061 req-4303c470-36aa-40f5-b557-3bba0121d8ce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.323820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5063db24-47e8-428a-9b2c-79898cbbd061 req-4303c470-36aa-40f5-b557-3bba0121d8ce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.330422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:19.332698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:19.347938 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5063db24-47e8-428a-9b2c-79898cbbd061 req-4303c470-36aa-40f5-b557-3bba0121d8ce service nova] Creating event network-vif-plugged:7c4936ee-07ae-40cf-b35c-9ec273970636 for instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a on n-h2-852086-5 Aug 27 03:12:19.349875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.351394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.352049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.353251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.361813 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5063db24-47e8-428a-9b2c-79898cbbd061 req-4303c470-36aa-40f5-b557-3bba0121d8ce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102594 Aug 27 03:12:19.365653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.366671 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 693/1390] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:19.367506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.397346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:19.411288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:19.431185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.433157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.434023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.442241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.443096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.443763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.069612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:20.111947 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0fc75e70-a798-4f50-b1aa-c8aaa7048c33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.731776 Aug 27 03:12:20.119396 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 694/1391] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:19 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:20.136143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59b5fedd-b2e2-4a1a-9072-e364635385e9 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:20.168377 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-59b5fedd-b2e2-4a1a-9072-e364635385e9 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] HTTP exception thrown: Flavor 9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a could not be found. Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59b5fedd-b2e2-4a1a-9072-e364635385e9 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Request method failure captured: Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/flavors/9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a HTTP/1.1 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqEx6FJcik7ZJ-Mrf6_WbdfX1aABFz6cqhajl9e8GbRLPBYskAuRqBEkixFJ_v1c86fyEbPq_5AuZEoysARnaUFoJF20IV9zulgDA1zS6crYV2oCAiOwMWP8yHdrHGt3NVnV-bDn6qhDNUi7Qne-FE9FIbRqEIvNN__R043_5Yjgfo Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9cdf9335d2fe4a71ba5399d5341e7320 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MigrationsAdminTest-300938204 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9cdf9335d2fe4a71ba5399d5341e7320"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9cdf9335d2fe4a71ba5399d5341e7320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9cdf9335d2fe4a71ba5399d5341e7320", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9cdf9335d2fe4a71ba5399d5341e7320"}]}] Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MigrationsAdminTest-300938204 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9cdf9335d2fe4a71ba5399d5341e7320 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MigrationsAdminTest-300938204 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MigrationsAdminTest-300938204-project-admin Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ef5cbd20c90c4e7ab72e0b54c68ed1a0 Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MigrationsAdminTest-300938204-project-admin Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: exception: Flavor 9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a could not be found. Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a'} Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a could not be found. Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a could not be found. Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:20.173227 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a could not be found. Aug 27 03:12:20.178466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:20.179523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59b5fedd-b2e2-4a1a-9072-e364635385e9 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Returning 404 to user: Flavor 9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:20.180441 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59b5fedd-b2e2-4a1a-9072-e364635385e9 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a" status: 404 len: 109 microversion: 2.1 time: 0.059984 Aug 27 03:12:20.181206 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 695/1392] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:20 2022] DELETE /compute/v2.1/flavors/9dccf6c9-a1c3-4ff4-a416-ec13fbc7697a => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:20.189669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:20.190733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:20.225409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.226328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.227076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.228341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.237427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:20.245956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.246773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.267031 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29ae08cd-a057-4ebc-8fc2-3135a18ccb83 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.943478 Aug 27 03:12:20.280685 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 698/1393] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:19 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:20.301418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:20.302808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:20.323248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.323746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.324191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.324921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:20.335828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:20.336881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.485906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:20.523459 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-afccedee-65f0-453f-b098-528e16f92ea7 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.337288 Aug 27 03:12:20.524049 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 696/1394] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:20 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:20.537459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1149379908", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:20.610268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:12:20.753450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:20.766511 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f21b96e9-6ba2-4463-ae6a-8807693db84f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1478 microversion: 2.1 time: 0.476551 Aug 27 03:12:20.768423 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 699/1395] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:20 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1478 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:21.144213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:21.145056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:21.166314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.168538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.169059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.170813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.171294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.173979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.567953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:21.591120 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfef0043-687e-4248-9c44-dfa09d785473 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.451751 Aug 27 03:12:21.595714 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 700/1396] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:21 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:21.620125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:21.632379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:21.684742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.685282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.686800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.689553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.693094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.694738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.942300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:12:21.942881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:12:21.943293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:12:21.943732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:12:21.944787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:12:21.985160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.985776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.986818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.987901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.988963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.989674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.015192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:12:22.023134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Getting quotas for user 3ad6820606064210a5a0e2fa2bfa4bb7 and project 82d80176cbd24a32922fe33269a9ae59. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:12:22.046051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:12:22.049246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:12:22.124299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:22.138380 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39a212ec-42cc-4ccb-b248-bc7abc60a740 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.539822 Aug 27 03:12:22.141564 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8740cbf8-df17-4dfa-a17b-a19abc721e48 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616370 Aug 27 03:12:22.143027 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 697/1397] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:12:22.151494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:22.152461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:22.164506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.165277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.165919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.167555 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 701/1398] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:21 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:22.168254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.169234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.169907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.200621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:22.203240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:22.255028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.255972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.257334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.258334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.259086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.259608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.377979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:22.457838 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a6ad2ac-97db-4c73-b864-ba276a2e091c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.313154 Aug 27 03:12:22.460809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 698/1399] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:22 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:22.478369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-33451c35-d57a-4665-858b-4e49b543bfca req-a261c5e9-7021-42f1-aab2-8c065fc0e797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd3b4a0-b115-4688-af4f-27f15a0eaea0", "name": "network-vif-unplugged", "status": "completed", "tag": "a94fdd64-5583-4e14-bd48-74552e561a6b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:22.508863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-33451c35-d57a-4665-858b-4e49b543bfca req-a261c5e9-7021-42f1-aab2-8c065fc0e797 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.509377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-33451c35-d57a-4665-858b-4e49b543bfca req-a261c5e9-7021-42f1-aab2-8c065fc0e797 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.509840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-33451c35-d57a-4665-858b-4e49b543bfca req-a261c5e9-7021-42f1-aab2-8c065fc0e797 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.549248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-33451c35-d57a-4665-858b-4e49b543bfca req-a261c5e9-7021-42f1-aab2-8c065fc0e797 service nova] Creating event network-vif-unplugged:a94fdd64-5583-4e14-bd48-74552e561a6b for instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 on n-h1-852086-5 Aug 27 03:12:22.565214 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-33451c35-d57a-4665-858b-4e49b543bfca req-a261c5e9-7021-42f1-aab2-8c065fc0e797 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102416 Aug 27 03:12:22.569260 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 699/1400] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:22.584002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd44aba3-a541-4357-8071-2ebef554ff37 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:22.585111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bd44aba3-a541-4357-8071-2ebef554ff37 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:22.814739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bd44aba3-a541-4357-8071-2ebef554ff37 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:22.832966 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd44aba3-a541-4357-8071-2ebef554ff37 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1213 microversion: 2.1 time: 0.257394 Aug 27 03:12:22.834823 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 700/1401] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:22 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1213 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:22.857740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a059d73-ee8d-45bf-a172-1f8430ff52d5", "device": "/dev/xvdb"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:22.867961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:22.888475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.888976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.889419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.890148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.890630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.902512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.187359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:23.213286 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d4d35b4-f3f8-43a2-ad51-310b5a265168 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1478 microversion: 2.1 time: 1.028589 Aug 27 03:12:23.218426 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 702/1402] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:22 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1478 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:23.245163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:23.247802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:23.276859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.278831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.280120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.285750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.291728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.293736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.646217 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e5dee306-4ee8-4223-bcd3-dd4572d30150 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "POST /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.807432 Aug 27 03:12:23.654359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 701/1403] 10.222.0.69 () {62 vars in 1364 bytes} [Sat Aug 27 03:12:22 2022] POST /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:12:23.899513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2068373613", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "795686d4-8fb6-4361-8b06-7d0eab3e904b"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:24.046377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] validate_networks() for [('795686d4-8fb6-4361-8b06-7d0eab3e904b', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:12:24.080132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:24.093688 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62bba656-9a28-40e9-9657-f75d8ca67538 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 0.871027 Aug 27 03:12:24.111430 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 703/1404] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:23 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:24.124749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:24.129196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:24.142951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.145091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.157407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.159081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.159778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.161454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.666471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:24.678696 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3367bca0-2efd-4d36-b21c-a200db6dd68c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.565615 Aug 27 03:12:24.695578 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 704/1405] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:24 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:24.703156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:24.703781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:24.718729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.719238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.719685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.720422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:24.720881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:24.737925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.937367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:24.980813 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c471a355-509b-47e1-a96e-43c3ce5cc3ed tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.284080 Aug 27 03:12:24.981550 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 705/1406] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:24 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:24.993377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:24.998568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.015835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.018889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.022570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.023769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.024420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.025049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.159400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:25.172124 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5dbad7e1-a7df-49fd-b143-f4e47ea75a71 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1265 microversion: 2.1 time: 0.189155 Aug 27 03:12:25.175197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:12:25.176597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:12:25.177317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:12:25.177954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:12:25.180207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:12:25.187695 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 706/1407] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:24 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:25.195706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.196191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.196943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.197111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.197752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.198850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.199971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.200744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.208839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.209780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.210539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.211498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.212213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.212796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.231363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for project 3372b4747f714009ad9a04a488019e78. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:12:25.242089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for user 7268918710454b128eaa3621f708efb9 and project 3372b4747f714009ad9a04a488019e78. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:12:25.262737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:12:25.267318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:12:25.348001 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6a4bf08c-17c3-4333-8c88-9cff7b1f8273 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689370 Aug 27 03:12:25.358524 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 702/1408] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:12:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:12:25.469776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b7f5996-b582-4663-8038-94cfad81dc3f tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Calling method '.version_select at 0x7fe45c2f6160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.500367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-2b7f5996-b582-4663-8038-94cfad81dc3f tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:12:25.503331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-2b7f5996-b582-4663-8038-94cfad81dc3f tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Neutron security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 not found {{(pid=122407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:12:25.503950 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2b7f5996-b582-4663-8038-94cfad81dc3f tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] HTTP exception thrown: Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist Aug 27 03:12:25.503950 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-a2968f0a-5836-4094-a1c0-f82281e33268'] Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b7f5996-b582-4663-8038-94cfad81dc3f tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Request method failure captured: Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-security-groups/57b9aef6-bce5-4667-9db7-01dfeb7590c7 HTTP/1.1 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuY6Z-klVJ9yj8ithOHxSBp4y-qTSa-jo6HvjmWT79q3fynzyb2QBwnJZ3JJtlf2NtZd0tDPm-uvpOnPZi1aIWrxTPAhkBaR3ey8-YHB-ybVyqkPKFEN0SkrHtthtCChXol-t_3n5JV53U70gyHxxrlruwoBBlP02NPOzqJJDxFJO4 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_404308cae7e64890b7aa91817d04a8e2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}] Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 4f0bffa8672e46fc9da07671873a4751 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-a2968f0a-5836-4094-a1c0-f82281e33268'] Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '57b9aef6-bce5-4667-9db7-01dfeb7590c7'} Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:12:25.506239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2968f0a-5836-4094-a1c0-f82281e33268'] Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2968f0a-5836-4094-a1c0-f82281e33268'] Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2968f0a-5836-4094-a1c0-f82281e33268'] Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2968f0a-5836-4094-a1c0-f82281e33268'] Aug 27 03:12:25.511100 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:25.517359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b7f5996-b582-4663-8038-94cfad81dc3f tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Returning 404 to user: Security group 57b9aef6-bce5-4667-9db7-01dfeb7590c7 does not exist Aug 27 03:12:25.517359 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-a2968f0a-5836-4094-a1c0-f82281e33268'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:25.518286 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b7f5996-b582-4663-8038-94cfad81dc3f tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/57b9aef6-bce5-4667-9db7-01dfeb7590c7" status: 404 len: 194 microversion: 2.1 time: 0.158780 Aug 27 03:12:25.518871 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 703/1409] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:12:25 2022] DELETE /compute/v2.1/os-security-groups/57b9aef6-bce5-4667-9db7-01dfeb7590c7 => generated 194 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:25.543953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c2a2b0b1-53da-4868-a5e9-70265a9056cb req-8dba69ff-ac2e-4cf6-b555-a731084fc47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f60d27e-6741-43fb-bbaa-822e5a49bf30", "name": "network-vif-plugged", "status": "completed", "tag": "fc480075-3074-4484-8fa4-f91ac49445ff"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:25.571410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c2a2b0b1-53da-4868-a5e9-70265a9056cb req-8dba69ff-ac2e-4cf6-b555-a731084fc47d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.575786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c2a2b0b1-53da-4868-a5e9-70265a9056cb req-8dba69ff-ac2e-4cf6-b555-a731084fc47d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.576335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c2a2b0b1-53da-4868-a5e9-70265a9056cb req-8dba69ff-ac2e-4cf6-b555-a731084fc47d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.595025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:25.597020 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c2a2b0b1-53da-4868-a5e9-70265a9056cb req-8dba69ff-ac2e-4cf6-b555-a731084fc47d service nova] Creating event network-vif-plugged:fc480075-3074-4484-8fa4-f91ac49445ff for instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 on n-h2-852086-5 Aug 27 03:12:25.617039 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c2a2b0b1-53da-4868-a5e9-70265a9056cb req-8dba69ff-ac2e-4cf6-b555-a731084fc47d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091894 Aug 27 03:12:25.618012 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 704/1410] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:25.618461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6bd05428-2446-4734-a421-4b48e456da6d tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1478 microversion: 2.1 time: 0.425794 Aug 27 03:12:25.623741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.628579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.635117 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 707/1411] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:25 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1478 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:25.677586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.678887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.679541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.682108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.683104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.687027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.697172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9d0ae49-6702-4266-b146-c13870b3f76e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.701721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9d0ae49-6702-4266-b146-c13870b3f76e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.857942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9d0ae49-6702-4266-b146-c13870b3f76e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:25.865474 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9d0ae49-6702-4266-b146-c13870b3f76e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1225 microversion: 2.1 time: 0.229149 Aug 27 03:12:25.866412 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 708/1412] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:25 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1225 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:25.870857 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7545d6f0-4857-4ffa-83a3-a8488dd141a1 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003674 Aug 27 03:12:25.888719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 709/1413] 10.222.0.69 () {58 vars in 1164 bytes} [Sat Aug 27 03:12:25 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:12:25.902520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.903148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.943889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.949794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.950630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.954627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.963500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.966848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:26.448782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:26.465265 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af163116-e220-4e2a-98ef-c6a900c7c88e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.573680 Aug 27 03:12:26.493815 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 710/1414] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:25 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:26.515541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afff6ab3-5a24-4950-9a4e-9a53695f646b tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Calling method '.version_select at 0x7fe4603c3b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:27.164904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:27.176579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afff6ab3-5a24-4950-9a4e-9a53695f646b tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.679561 Aug 27 03:12:27.186683 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 711/1415] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:12:26 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:27.191653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:27.192539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:27.195138 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-791b8f29-4f67-47a8-95aa-41952f515e12 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1716 microversion: 2.1 time: 1.575445 Aug 27 03:12:27.201807 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 705/1416] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:25 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1716 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:27.220236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.220756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.221213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.221981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.222408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:27.222562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.222895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.223708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:27.230818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:27.260491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.266536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.271191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.273069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.274033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.275087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.420278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:27.452134 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c14e5f5f-754b-4dfb-882f-26fa56dbf5ab tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.264137 Aug 27 03:12:27.453751 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 712/1417] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:27 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:27.461079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:27.463239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:27.476548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.477814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.478834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.480290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.481737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.482875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.494205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:27.662217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:27.707030 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9cc16e06-27ba-43a7-b38f-b033417ee0a4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1271 microversion: 2.1 time: 0.500939 Aug 27 03:12:27.710320 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 706/1418] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:27 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1271 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:27.733840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:27.734730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:27.750065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.750792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.751341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.752988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.753742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.754560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.785446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:27.804212 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff6496f6-de0e-4235-a01e-48cbbe55a17b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1478 microversion: 2.1 time: 0.346042 Aug 27 03:12:27.806128 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 713/1419] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:27 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1478 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:27.814585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fefb8913-d845-4c5e-bb2a-99222303717a tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Calling method '.version_select at 0x7fe4603c7c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.069449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.087113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92d084d2-c78d-4b3e-bd7b-65e8103bf674 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1277 microversion: 2.1 time: 0.375261 Aug 27 03:12:28.106840 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 707/1420] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:27 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1277 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:28.113252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.114207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:28.121773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-fefb8913-d845-4c5e-bb2a-99222303717a tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:12:28.122991 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fefb8913-d845-4c5e-bb2a-99222303717a tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 27 03:12:28.122991 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-e025fb84-f6ab-4ea4-84d2-14d726b26b60'] Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fefb8913-d845-4c5e-bb2a-99222303717a tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Request method failure captured: Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-groups/755efcc0-0e1b-4db0-aba1-ee414e0312ea HTTP/1.1 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuY6Z-klVJ9yj8ithOHxSBp4y-qTSa-jo6HvjmWT79q3fynzyb2QBwnJZ3JJtlf2NtZd0tDPm-uvpOnPZi1aIWrxTPAhkBaR3ey8-YHB-ybVyqkPKFEN0SkrHtthtCChXol-t_3n5JV53U70gyHxxrlruwoBBlP02NPOzqJJDxFJO4 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_404308cae7e64890b7aa91817d04a8e2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}] Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 4f0bffa8672e46fc9da07671873a4751 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: exception: Insufficient rights for removing default security group. Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-e025fb84-f6ab-4ea4-84d2-14d726b26b60'] Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '755efcc0-0e1b-4db0-aba1-ee414e0312ea'} Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:12:28.130940 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e025fb84-f6ab-4ea4-84d2-14d726b26b60'] Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e025fb84-f6ab-4ea4-84d2-14d726b26b60'] Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e025fb84-f6ab-4ea4-84d2-14d726b26b60'] Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e025fb84-f6ab-4ea4-84d2-14d726b26b60'] Aug 27 03:12:28.136862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.139525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.139525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.139525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.139525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.139525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.139525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.142188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fefb8913-d845-4c5e-bb2a-99222303717a tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 27 03:12:28.142188 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-e025fb84-f6ab-4ea4-84d2-14d726b26b60'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:28.142188 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fefb8913-d845-4c5e-bb2a-99222303717a tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/755efcc0-0e1b-4db0-aba1-ee414e0312ea" status: 400 len: 182 microversion: 2.1 time: 0.334057 Aug 27 03:12:28.146664 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 714/1421] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:12:27 2022] DELETE /compute/v2.1/os-security-groups/755efcc0-0e1b-4db0-aba1-ee414e0312ea => generated 182 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:12:28.160963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-53cca0f8-0fe4-41e7-bd8b-4e7119885637 req-c1162e4d-088b-46eb-98c7-6442a2ee0278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd3b4a0-b115-4688-af4f-27f15a0eaea0", "name": "network-vif-plugged", "status": "completed", "tag": "a94fdd64-5583-4e14-bd48-74552e561a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:28.175296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-53cca0f8-0fe4-41e7-bd8b-4e7119885637 req-c1162e4d-088b-46eb-98c7-6442a2ee0278 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.175788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-53cca0f8-0fe4-41e7-bd8b-4e7119885637 req-c1162e4d-088b-46eb-98c7-6442a2ee0278 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.176231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-53cca0f8-0fe4-41e7-bd8b-4e7119885637 req-c1162e4d-088b-46eb-98c7-6442a2ee0278 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.201538 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-53cca0f8-0fe4-41e7-bd8b-4e7119885637 req-c1162e4d-088b-46eb-98c7-6442a2ee0278 service nova] Creating event network-vif-plugged:a94fdd64-5583-4e14-bd48-74552e561a6b for instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 on n-h1-852086-5 Aug 27 03:12:28.211999 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-53cca0f8-0fe4-41e7-bd8b-4e7119885637 req-c1162e4d-088b-46eb-98c7-6442a2ee0278 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062699 Aug 27 03:12:28.236500 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 715/1422] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:28.247920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd8a0f9e-e550-4629-af54-0c6ee9d565ad tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Calling method '.version_select at 0x7fe460381ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.275977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-cd8a0f9e-e550-4629-af54-0c6ee9d565ad tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:12:28.276816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-cd8a0f9e-e550-4629-af54-0c6ee9d565ad tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Neutron security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:12:28.277686 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cd8a0f9e-e550-4629-af54-0c6ee9d565ad tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] HTTP exception thrown: Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist Aug 27 03:12:28.277686 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3e4fdd2c-8d30-4e51-bbe8-dc806b242a8c'] Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd8a0f9e-e550-4629-af54-0c6ee9d565ad tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Request method failure captured: Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-security-groups/29e08c16-bb4c-4b97-845d-77a0bec94b9a HTTP/1.1 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuY6Z-klVJ9yj8ithOHxSBp4y-qTSa-jo6HvjmWT79q3fynzyb2QBwnJZ3JJtlf2NtZd0tDPm-uvpOnPZi1aIWrxTPAhkBaR3ey8-YHB-ybVyqkPKFEN0SkrHtthtCChXol-t_3n5JV53U70gyHxxrlruwoBBlP02NPOzqJJDxFJO4 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_404308cae7e64890b7aa91817d04a8e2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}] Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 4f0bffa8672e46fc9da07671873a4751 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3e4fdd2c-8d30-4e51-bbe8-dc806b242a8c'] Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '29e08c16-bb4c-4b97-845d-77a0bec94b9a'} Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:12:28.280304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4fdd2c-8d30-4e51-bbe8-dc806b242a8c'] Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4fdd2c-8d30-4e51-bbe8-dc806b242a8c'] Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4fdd2c-8d30-4e51-bbe8-dc806b242a8c'] Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e4fdd2c-8d30-4e51-bbe8-dc806b242a8c'] Aug 27 03:12:28.285145 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.290501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd8a0f9e-e550-4629-af54-0c6ee9d565ad tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Returning 404 to user: Security group 29e08c16-bb4c-4b97-845d-77a0bec94b9a does not exist Aug 27 03:12:28.290501 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-3e4fdd2c-8d30-4e51-bbe8-dc806b242a8c'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:28.291812 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd8a0f9e-e550-4629-af54-0c6ee9d565ad tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/29e08c16-bb4c-4b97-845d-77a0bec94b9a" status: 404 len: 194 microversion: 2.1 time: 0.053028 Aug 27 03:12:28.293195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 716/1423] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:12:28 2022] GET /compute/v2.1/os-security-groups/29e08c16-bb4c-4b97-845d-77a0bec94b9a => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:28.334103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.339313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:28.357279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.357807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.359399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.360451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.367202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.368127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.551479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.567109 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0862681-c832-4646-8ff6-b022090b8ef7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1316 microversion: 2.1 time: 0.458823 Aug 27 03:12:28.589338 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 708/1424] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:28 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:28.612303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e9536ad-7e4c-47a1-b18e-3a847f9cfbb0 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Action: 'update', calling method: .version_select at 0x7fe457f9c0d0>, body: {"security_group": {"name": "tempest-sg-2065394327", "description": "tempest-description-2018448256"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:28.695286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-3e9536ad-7e4c-47a1-b18e-3a847f9cfbb0 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:12:28.696553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-3e9536ad-7e4c-47a1-b18e-3a847f9cfbb0 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Neutron security group bb79ce80-0e41-4428-9960-68003a3dd4eb not found {{(pid=122407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:12:28.697513 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3e9536ad-7e4c-47a1-b18e-3a847f9cfbb0 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] HTTP exception thrown: Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist Aug 27 03:12:28.697513 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-70280d81-f7ec-465b-aea0-7ca1f7367cae'] Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e9536ad-7e4c-47a1-b18e-3a847f9cfbb0 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Request method failure captured: Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/os-security-groups/bb79ce80-0e41-4428-9960-68003a3dd4eb HTTP/1.1 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 102 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuY6Z-klVJ9yj8ithOHxSBp4y-qTSa-jo6HvjmWT79q3fynzyb2QBwnJZ3JJtlf2NtZd0tDPm-uvpOnPZi1aIWrxTPAhkBaR3ey8-YHB-ybVyqkPKFEN0SkrHtthtCChXol-t_3n5JV53U70gyHxxrlruwoBBlP02NPOzqJJDxFJO4 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_404308cae7e64890b7aa91817d04a8e2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/404308cae7e64890b7aa91817d04a8e2"}]}] Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 404308cae7e64890b7aa91817d04a8e2 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 4f0bffa8672e46fc9da07671873a4751 Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1538806494-project Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: {"security_group": {"name": "tempest-sg-2065394327", "description": "tempest-description-2018448256"}} Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-70280d81-f7ec-465b-aea0-7ca1f7367cae'] Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'bb79ce80-0e41-4428-9960-68003a3dd4eb', 'body': {'security_group': {'name': 'tempest-sg-2065394327', 'description': 'tempest-description-2018448256'}}} Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:12:28.699975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70280d81-f7ec-465b-aea0-7ca1f7367cae'] Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70280d81-f7ec-465b-aea0-7ca1f7367cae'] Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70280d81-f7ec-465b-aea0-7ca1f7367cae'] Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70280d81-f7ec-465b-aea0-7ca1f7367cae'] Aug 27 03:12:28.704901 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:28.708646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e9536ad-7e4c-47a1-b18e-3a847f9cfbb0 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] Returning 404 to user: Security group bb79ce80-0e41-4428-9960-68003a3dd4eb does not exist Aug 27 03:12:28.708646 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-70280d81-f7ec-465b-aea0-7ca1f7367cae'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:28.710942 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e9536ad-7e4c-47a1-b18e-3a847f9cfbb0 tempest-SecurityGroupsNegativeTestJSON-1538806494 tempest-SecurityGroupsNegativeTestJSON-1538806494-project] 10.222.0.69 "PUT /compute/v2.1/os-security-groups/bb79ce80-0e41-4428-9960-68003a3dd4eb" status: 404 len: 194 microversion: 2.1 time: 0.119466 Aug 27 03:12:28.717356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 709/1425] 10.222.0.69 () {60 vars in 1290 bytes} [Sat Aug 27 03:12:28 2022] PUT /compute/v2.1/os-security-groups/bb79ce80-0e41-4428-9960-68003a3dd4eb => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:28.722802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.723602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:28.741743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.742904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.743692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.744872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:28.746889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:28.748338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.938104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.977538 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-070ace6e-40d6-40b7-982d-59178f861e33 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1706 microversion: 2.1 time: 0.682959 Aug 27 03:12:28.983318 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 717/1426] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:28 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1706 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:28.994942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:28.995572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:29.034122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.035104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.035805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.036966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.037723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.042992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.141021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:29.276843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7aeb9d07-3f20-40ce-ba73-d33bc66d0231 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.557230 Aug 27 03:12:29.302397 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 710/1427] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:28 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:29.321075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.322348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:29.341801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.342604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.343323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.344517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.345311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.354492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.593479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:29.614286 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa3adb32-8262-41fa-b3a1-d360cbf38f60 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.629502 Aug 27 03:12:29.628640 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 718/1428] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:28 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:29.635748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e311f8e7-07e5-4a9a-a34b-3bf32c9d00e4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '.version_select at 0x7fe460379550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.641177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f8e7-07e5-4a9a-a34b-3bf32c9d00e4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.642005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f8e7-07e5-4a9a-a34b-3bf32c9d00e4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.642694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f8e7-07e5-4a9a-a34b-3bf32c9d00e4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.673390 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e311f8e7-07e5-4a9a-a34b-3bf32c9d00e4 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 3112 microversion: 2.1 time: 0.042947 Aug 27 03:12:29.684772 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 719/1429] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/os-migrations => generated 3112 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:29.691955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.692573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:29.713847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.714372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.720306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.726564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.727264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.728964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.854706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:29.874479 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d6b261a3-683c-49b2-abae-5b4c390f51e5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1277 microversion: 2.1 time: 0.185115 Aug 27 03:12:29.876120 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 720/1430] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:29.887439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.888095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:29.902443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.903169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.903749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.904615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.905232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.905843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.918342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:29.922003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:29.936431 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bac66bd5-1747-4896-b502-97ce122d3128 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1478 microversion: 2.1 time: 0.631527 Aug 27 03:12:29.966779 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 711/1431] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1478 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:29.985651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.987280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:30.005757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.008566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.009007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.011644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.013685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.015376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.265587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:30.284789 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5ecda88-2c30-4557-b688-b70d06351f15 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1465 microversion: 2.1 time: 0.407430 Aug 27 03:12:30.288236 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 721/1432] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1465 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:30.321762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:30.322781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:30.358827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:30.363910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.378413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.378983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.380117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.385033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.385557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.968218 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b30738a0-60ca-4832-908d-4716d7f0d600 tempest-ServersOnMultiNodesTest-969580070 tempest-ServersOnMultiNodesTest-969580070-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1616 microversion: 2.1 time: 0.650606 Aug 27 03:12:30.992505 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 722/1433] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:30 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1616 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:31.027284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:31.028346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:31.050326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.051086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.052189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.053751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.054888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.055674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.236345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:31.282990 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60276da5-462c-4ecc-91e2-7e776f109a60 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.288553 Aug 27 03:12:31.284254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 723/1434] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:30 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:31.292746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:31.293580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:31.306092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.307551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.308696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.311603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.313018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.314329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.471428 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-da243b63-f07c-44b5-81c0-d7a2e14c088e tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1857 microversion: 2.1 time: 1.503108 Aug 27 03:12:31.496013 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 712/1435] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1857 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:31.510619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:31.513594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:31.552565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.553444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.554232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.555531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.555997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.556433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.741430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:31.763625 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2aee981e-704f-4589-99a1-099a7a9f8c83 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1283 microversion: 2.1 time: 0.265939 Aug 27 03:12:31.765865 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 713/1436] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:31 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1283 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:31.770811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:31.780463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:31.795127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.795872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.796587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.797468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.798078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.798684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.091337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:32.126760 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00fe913a-dbb4-4e62-943a-789d3329aa0e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.839728 Aug 27 03:12:32.162428 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 724/1437] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:31 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:32.177573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:32.182376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:32.194483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.195534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.196322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.197780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.198748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.199519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.287453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:32.325809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:32.354299 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-01ae0dbd-727d-42ee-99d4-e7ec4e0890b4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1463 microversion: 2.1 time: 0.585942 Aug 27 03:12:32.370190 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 714/1438] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:31 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1463 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:32.377425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:32.380873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:32.421109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.422941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.423940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.427278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.429191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.430309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.569414 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38a3c6c5-502f-4bd2-bd8c-42ce81eac5ba tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 204 len: 0 microversion: 2.1 time: 0.404548 Aug 27 03:12:32.572637 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 725/1439] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:32 2022] DELETE /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:32.587115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:32.591171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:32.609039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.609930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.612622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.614640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.618949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.619686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.015875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3740773e-74af-420b-8d24-26cc13a9d505 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1857 microversion: 2.1 time: 0.652093 Aug 27 03:12:33.016617 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 715/1440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:32 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1857 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:33.030406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:33.033902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:33.077941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.078633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.078955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.079669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.080125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.080554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.121044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:33.158433 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0e1d7d8-c539-4784-b20a-1d95507f31cf tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.583299 Aug 27 03:12:33.163723 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 726/1441] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:32 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:33.172531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:33.173776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:33.187076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.187729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.188272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.195606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.197657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.202135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.321223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39e67c96-ccc2-467c-bcd7-fbb5b5156466 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action" status: 202 len: 0 microversion: 2.1 time: 0.301556 Aug 27 03:12:33.328902 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 716/1442] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:12:33 2022] POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:12:33.336128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-239ce1fb-4e3a-4813-843e-53cc25e48ccd req-70dceb76-336c-42a4-ad5e-4dba1340d871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:33.355707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-239ce1fb-4e3a-4813-843e-53cc25e48ccd req-70dceb76-336c-42a4-ad5e-4dba1340d871 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.357051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-239ce1fb-4e3a-4813-843e-53cc25e48ccd req-70dceb76-336c-42a4-ad5e-4dba1340d871 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.358093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-239ce1fb-4e3a-4813-843e-53cc25e48ccd req-70dceb76-336c-42a4-ad5e-4dba1340d871 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.388847 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-239ce1fb-4e3a-4813-843e-53cc25e48ccd req-70dceb76-336c-42a4-ad5e-4dba1340d871 service nova] Creating event network-changed:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h1-852086-5 Aug 27 03:12:33.400023 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-239ce1fb-4e3a-4813-843e-53cc25e48ccd req-70dceb76-336c-42a4-ad5e-4dba1340d871 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068843 Aug 27 03:12:33.401924 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 717/1443] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:33.415573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:33.417704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:33.435564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.436957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.438072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.441280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.442515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.444907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.716718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:33.732856 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42666939-281d-45b9-8bf1-868ee8463ddf tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1471 microversion: 2.1 time: 0.567544 Aug 27 03:12:33.734155 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 727/1444] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:33 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1471 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:33.739072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:33.739937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:33.759220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.760860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.761908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.764230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:33.765892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:33.766963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:33.981765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:33.994985 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50cf1d04-2af8-4910-af44-512e608a238a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.589638 Aug 27 03:12:34.008208 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 718/1445] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:33 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:34.044504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:34.045240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:34.058892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.059386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.059828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.060566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.061027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.061452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.452539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lazy-loading 'services' on Instance uuid 3433e1f2-f285-4966-92cb-9379c704c79f {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:34.655611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:34.686634 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0bb369a7-b2cb-4b0a-8b51-280b686114c0 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments/3fc2367f-158c-4626-94fa-f95129632642" status: 202 len: 0 microversion: 2.1 time: 0.656720 Aug 27 03:12:34.687637 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 719/1446] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:12:34 2022] DELETE /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments/3fc2367f-158c-4626-94fa-f95129632642 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:12:34.690495 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab4296be-e6c6-4927-a2fc-a52da2e0ead9 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.954920 Aug 27 03:12:34.696269 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 728/1447] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:33 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:34.700700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:34.703331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:34.705069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:34.708928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:34.723382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.724288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.725811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.727502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.728125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.728393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.728959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.729874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.731326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.732873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.733887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.735157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.852735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.853618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.854787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.855510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lazy-loading 'fault' on Instance uuid acd3b4a0-b115-4688-af4f-27f15a0eaea0 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:34.968937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:35.010664 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bda91180-640a-48d1-96dd-87a2083186a8 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.311327 Aug 27 03:12:35.027761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 729/1448] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:34 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:35.043520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1965db24-2cea-4091-b741-62afcdc99f42 req-f981e963-34af-4395-b15d-66dbee02ba5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2487156-8dfd-40a2-ac84-3bd6325a4c45", "tag": "0e3bcf8b-0218-4f3b-9efe-366fb5a71f67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:35.056584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1965db24-2cea-4091-b741-62afcdc99f42 req-f981e963-34af-4395-b15d-66dbee02ba5c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.057481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1965db24-2cea-4091-b741-62afcdc99f42 req-f981e963-34af-4395-b15d-66dbee02ba5c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.058109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1965db24-2cea-4091-b741-62afcdc99f42 req-f981e963-34af-4395-b15d-66dbee02ba5c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.072954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1965db24-2cea-4091-b741-62afcdc99f42 req-f981e963-34af-4395-b15d-66dbee02ba5c service nova] Creating event network-changed:0e3bcf8b-0218-4f3b-9efe-366fb5a71f67 for instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 on n-h2-852086-5 Aug 27 03:12:35.078611 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1965db24-2cea-4091-b741-62afcdc99f42 req-f981e963-34af-4395-b15d-66dbee02ba5c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049419 Aug 27 03:12:35.079817 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 730/1449] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:35.087942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:35.090364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.096874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.097360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.097791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.098528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.099161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.099744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.103528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:35.144886 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb159f78-4c92-4e61-a42c-3222efa95c27 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063634 Aug 27 03:12:35.145776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 731/1450] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:35 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:35.155442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:35.156365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.163875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.164744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.165363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.166309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.167140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.167725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.214404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:35.253731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=14 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:35.343426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:35.357236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75dae3bd-7139-4b2b-8c96-f088aa98ede6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1471 microversion: 2.1 time: 0.209953 Aug 27 03:12:35.358834 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 732/1451] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:35 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:35.366203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:35.366988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.367909 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f310757c-d4f8-4465-855f-fb9a4dde3d9f tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1597 microversion: 2.1 time: 0.678829 Aug 27 03:12:35.373899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.374769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.375455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.376396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.377073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.377740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.384927 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 720/1452] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:34 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1597 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:35.393391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:35.396653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.405689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.406212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.406921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.407753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.408218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.408645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.523708 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4287d1a-34fa-46c5-85ae-f0678ed86ee7 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action" status: 202 len: 0 microversion: 2.1 time: 0.134871 Aug 27 03:12:35.524686 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 721/1453] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:12:35 2022] POST /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:12:35.534506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:35.535475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.546764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.547958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.548976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.551529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.552547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.553478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.635511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:35.649126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ca13f3c-74fe-494c-a86a-f4e77c3ae5ba tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.288473 Aug 27 03:12:35.651566 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 733/1454] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:35 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:35.719088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:35.719088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.740161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.741991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.743148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.744566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.745574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.746601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.864471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:36.257383 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fb4ceca-ddb3-4a60-9588-e9b01031d022 tempest-ServersAdminTestJSON-53013708 tempest-ServersAdminTestJSON-53013708-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1614 microversion: 2.1 time: 0.726123 Aug 27 03:12:36.270639 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 722/1455] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:35 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1614 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:36.284174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:36.291124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:36.311394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.314040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.314715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.316669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.319922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.320784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.546098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:36.597692 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24fc427c-6f86-4096-b73e-78152b514145 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.324929 Aug 27 03:12:36.602631 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 723/1456] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:36 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:36.623627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:36.627865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:36.630513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:36.645572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28574484-9036-412e-b2f5-55b202e68f9e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.932041 Aug 27 03:12:36.652165 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 734/1457] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:35 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:36.658249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:36.658477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.659234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.660029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.661295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.662115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.663795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.664215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:36.680760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.681155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.681597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.689686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.690219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.690756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.758928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:36.780981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:36.801160 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f5002fb7-79f0-4b50-8f88-64cbb3c22a20 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196592 Aug 27 03:12:36.816901 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 724/1458] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:36 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:36.845777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:36.847126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:36.876813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.878770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.880416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.881996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.884236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.888623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.062482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2facad75-b9a3-4c34-a66b-53991e47a7f1 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 204 len: 0 microversion: 2.1 time: 0.408431 Aug 27 03:12:37.063902 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 735/1459] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:36 2022] DELETE /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:37.076566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.077573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:37.112119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.113528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.114969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.127498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.128291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.129966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.268642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:37.283709 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f6da3d6-28ea-44c9-8842-804b97619f41 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1429 microversion: 2.1 time: 0.464907 Aug 27 03:12:37.284849 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 725/1460] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:36 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1429 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:37.303208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.304489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:37.322405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.323240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.324050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.325925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.327073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.327826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.588307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:37.610555 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91908ddb-5def-4406-bc35-3ff421353da3 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1470 microversion: 2.1 time: 0.323812 Aug 27 03:12:37.627108 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 726/1461] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:37 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1470 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:37.748903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f7fb7422-93f0-4479-82e7-5e6ed46bcd40 req-bea7078f-3482-46f1-a179-ec32ddeb9bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f60d27e-6741-43fb-bbaa-822e5a49bf30", "name": "network-vif-deleted", "tag": "fc480075-3074-4484-8fa4-f91ac49445ff"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:37.752612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:37.765733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f7fb7422-93f0-4479-82e7-5e6ed46bcd40 req-bea7078f-3482-46f1-a179-ec32ddeb9bda service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.765998 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9bb7504-7e6a-4e78-9ffc-2798b4c3dfa1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.699742 Aug 27 03:12:37.766690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f7fb7422-93f0-4479-82e7-5e6ed46bcd40 req-bea7078f-3482-46f1-a179-ec32ddeb9bda service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.767343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f7fb7422-93f0-4479-82e7-5e6ed46bcd40 req-bea7078f-3482-46f1-a179-ec32ddeb9bda service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.768408 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 736/1462] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:37 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:37.783219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.786500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:37.808765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.809516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.809700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.810453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.811440 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f7fb7422-93f0-4479-82e7-5e6ed46bcd40 req-bea7078f-3482-46f1-a179-ec32ddeb9bda service nova] Creating event network-vif-deleted:fc480075-3074-4484-8fa4-f91ac49445ff for instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 on n-h2-852086-5 Aug 27 03:12:37.814761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.817385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.819648 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f7fb7422-93f0-4479-82e7-5e6ed46bcd40 req-bea7078f-3482-46f1-a179-ec32ddeb9bda service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188555 Aug 27 03:12:37.824271 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 727/1463] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:37.838802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.839790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:37.849347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.851117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.851877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:37.852874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:37.853905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:37.854862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.111605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:38.185301 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff7199e1-4be7-4fed-803e-10321ae9b08f tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.414477 Aug 27 03:12:38.202323 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 737/1464] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:37 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:38.206755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:38.211881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:38.239447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.245817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.246579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.256572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.257683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.258555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.367023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:38.391882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6de4864a-3c14-40e2-b4f4-bfe0c3209d75 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.565527 Aug 27 03:12:38.393049 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 728/1465] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:37 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:38.416314 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c32ec4c2-0ec8-4bcc-9bc9-c66e9911500f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222433 Aug 27 03:12:38.423842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:38.428589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:38.428904 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 738/1466] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:38 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:38.460450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.461180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.461961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.467685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.468678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.474225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.552772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.554052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.554857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.555648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lazy-loading 'fault' on Instance uuid 6f60d27e-6741-43fb-bbaa-822e5a49bf30 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:38.651650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:38.659113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:38.660139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:38.677593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.678996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.680049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.681417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.684679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.685909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.690332 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae6c39d4-2269-4087-abe8-9c3fc39a6b49 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1306 microversion: 2.1 time: 0.278336 Aug 27 03:12:38.710763 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 729/1467] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:38 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1306 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:38.797547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:38.799030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:38.812256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.813566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.814855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.816428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.817518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.819612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.969727 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:12:38.970385 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 03:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 (ip 10.222.0.69) !!! Aug 27 03:12:39.031242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:39.051114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-638f754a-6273-4511-b0ba-c0d30cdfaaa7 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1470 microversion: 2.1 time: 0.414917 Aug 27 03:12:39.063614 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 739/1468] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:38 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1470 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:39.219296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:39.220549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:39.232430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.233095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.233751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.234643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.235483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.237241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.380298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:39.396089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:39.396379 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a25e1323-f894-49cd-9afb-1f8bdcc50736 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.604089 Aug 27 03:12:39.411149 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 730/1469] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:38 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:39.425267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:39.426035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:39.451567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.452066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.456417 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3863b76-b0d3-4a72-9241-b4a16ae2ad46 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1929 microversion: 2.75 time: 0.240736 Aug 27 03:12:39.459952 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 740/1470] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:39 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1929 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:39.460858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.467866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.476950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.477959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.524502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:39.537429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:39.580925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.581948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.582739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.583877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.585131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.585788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.780051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ffd0aa50-f344-4d13-8216-c4a49b203c3c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.317296 Aug 27 03:12:39.785679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 741/1471] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:39 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:39.806342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:39.807898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:39.830526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.831302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.831999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.844195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.845449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.846648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.965372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:39.984308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.987437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.993177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.997858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lazy-loading 'fault' on Instance uuid 6f60d27e-6741-43fb-bbaa-822e5a49bf30 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:40.000802 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-86ce9d11-08cd-4044-883e-e9f13c3dcc28 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.581870 Aug 27 03:12:40.021257 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 731/1472] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:39 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:40.090614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:40.092001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:40.097616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:40.101008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.103056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.103542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.106634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.107792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.108628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.112914 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49b32b2e-7162-4557-b678-d7f98dd55a82 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 200 len: 1306 microversion: 2.1 time: 0.324030 Aug 27 03:12:40.133728 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 742/1473] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:39 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 1306 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:40.421702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:40.423754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:40.457956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.458973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.460449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.461895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.462535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.463883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.624165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:40.634851 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4241d611-1f0a-40b5-8396-627bd5276044 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1470 microversion: 2.1 time: 0.550892 Aug 27 03:12:40.637406 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 732/1474] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:40 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1470 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:40.653796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:40.657980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:40.683225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.684013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.684712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.690679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.691691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.692335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.828306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:40.850374 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64d4b0f0-c70a-4faa-9a86-5df370592297 tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1935 microversion: 2.75 time: 0.210472 Aug 27 03:12:40.851613 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 733/1475] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:40 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1935 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:40.857409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:40.861552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:40.870336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.871298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.872180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.873174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.874095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.874758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.913579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f7755166-c9ae-4b71-a697-e616c55bcc32 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060342 Aug 27 03:12:40.914687 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 734/1476] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:40 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:40.921162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:40.937827 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c77c2da5-da9b-4dc0-89b6-4d16e0f4b5d6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.522776 Aug 27 03:12:40.939050 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 743/1477] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:40 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:41.036438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:41.038241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:41.045577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.046463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.047264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.048213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.049020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.049612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.146024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:41.148125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 6f60d27e-6741-43fb-bbaa-822e5a49bf30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:41.173411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.175679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.176605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.179609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.181260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.182296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.211848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 could not be found. Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 HTTP/1.1 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 could not be found. Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6f60d27e-6741-43fb-bbaa-822e5a49bf30'} Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 could not be found. Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 could not be found. Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:41.214186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 could not be found. Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:41.220384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance 6f60d27e-6741-43fb-bbaa-822e5a49bf30 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:41.224387 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bf1a6af-370d-461b-b792-030c76819020 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30" status: 404 len: 111 microversion: 2.1 time: 0.079240 Aug 27 03:12:41.227920 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 744/1478] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:41 2022] GET /compute/v2.1/servers/6f60d27e-6741-43fb-bbaa-822e5a49bf30 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:12:41.235985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:41.236881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:41.249657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.250074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.251753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.255512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.257073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.257739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.294313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:41.301688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:41.496890 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bcdc0afe-cccc-4a6a-b715-1411b853198c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 204 len: 0 microversion: 2.1 time: 0.263329 Aug 27 03:12:41.503519 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 745/1479] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:41 2022] DELETE /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:41.516267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:41.517844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:41.533153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.534378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.535287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.536808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.538236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.540251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.603122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:41.626579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2810f2c-236f-46e7-aa96-ee7e614946fe tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.592767 Aug 27 03:12:41.633148 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 735/1480] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:41 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:41.672320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:41.676663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:41.695998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.696633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.697169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.698106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:41.698946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:41.700875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.004651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:42.026505 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68147347-c403-4e5a-9a47-95db38d52224 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1471 microversion: 2.1 time: 0.509887 Aug 27 03:12:42.043150 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 746/1481] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:41 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:42.050838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.055535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:42.075891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.076718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.077355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.078346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.079006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.079609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.102844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:42.117826 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-722590a0-2737-44b8-856d-6268f2271c62 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1470 microversion: 2.1 time: 0.450487 Aug 27 03:12:42.119791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 736/1482] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:41 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1470 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:42.151195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.154085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:42.172366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.173198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.179370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.180537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.181297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.182150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.267434 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee830d24-ac86-4b8b-8525-232409c88754 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133545 Aug 27 03:12:42.268767 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 737/1483] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:42.274828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.275739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:42.277196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:42.285277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.287744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.289527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.290114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.291072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.291885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.323054 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-51181f3b-cc11-4239-8fdc-4d023766709c tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1935 microversion: 2.75 time: 0.278301 Aug 27 03:12:42.338062 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 747/1484] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1935 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:42.357119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.357656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:42.375343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.375874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.376334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.380814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.381922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.382425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.619823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:42.633140 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d001f8e-d163-4215-991e-52d1364f5dbd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.362960 Aug 27 03:12:42.634198 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 738/1485] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:42.640267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-af3ddfeb-0f41-40ad-a702-c9b99991b46d req-87908f2c-ac6a-4231-bde0-e3ee2360281d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "name": "network-vif-plugged", "status": "completed", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:42.660494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-af3ddfeb-0f41-40ad-a702-c9b99991b46d req-87908f2c-ac6a-4231-bde0-e3ee2360281d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.661110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-af3ddfeb-0f41-40ad-a702-c9b99991b46d req-87908f2c-ac6a-4231-bde0-e3ee2360281d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.661573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-af3ddfeb-0f41-40ad-a702-c9b99991b46d req-87908f2c-ac6a-4231-bde0-e3ee2360281d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.735819 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-af3ddfeb-0f41-40ad-a702-c9b99991b46d req-87908f2c-ac6a-4231-bde0-e3ee2360281d service nova] Creating event network-vif-plugged:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h1-852086-5 Aug 27 03:12:42.754717 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-af3ddfeb-0f41-40ad-a702-c9b99991b46d req-87908f2c-ac6a-4231-bde0-e3ee2360281d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118986 Aug 27 03:12:42.757122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 739/1486] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:42.768399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.769487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:42.803349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.806080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.807638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.812301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.838745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.839916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.876422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 607b043e-1bab-4c1d-8348-610a19b23bfa {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:42.926328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65aaf049-48a2-4984-a150-fa406223e505 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 2422 microversion: 2.25 time: 0.586337 Aug 27 03:12:42.933627 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 748/1487] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 2422 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:42.951576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5c35e488-d051-4735-9a93-a246fda7facd req-8055716a-086f-4bb3-a141-89e4546edac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982", "name": "network-vif-deleted", "tag": "36227945-5d9d-4e96-9626-0e4cec52fea3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:42.974337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5c35e488-d051-4735-9a93-a246fda7facd req-8055716a-086f-4bb3-a141-89e4546edac6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.976189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5c35e488-d051-4735-9a93-a246fda7facd req-8055716a-086f-4bb3-a141-89e4546edac6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.977289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5c35e488-d051-4735-9a93-a246fda7facd req-8055716a-086f-4bb3-a141-89e4546edac6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.999956 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5c35e488-d051-4735-9a93-a246fda7facd req-8055716a-086f-4bb3-a141-89e4546edac6 service nova] Creating event network-vif-deleted:36227945-5d9d-4e96-9626-0e4cec52fea3 for instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 on n-h1-852086-5 Aug 27 03:12:43.008342 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5c35e488-d051-4735-9a93-a246fda7facd req-8055716a-086f-4bb3-a141-89e4546edac6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072567 Aug 27 03:12:43.009748 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 749/1488] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:43.019159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852086-5", "block_migration": "auto"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:43.024924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:43.039734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.040999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.041824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.043044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.043882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.044646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.081381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'flavor' on Instance uuid 607b043e-1bab-4c1d-8348-610a19b23bfa {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:43.108692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Going to try to live migrate instance to n-h2-852086-5 {{(pid=122408) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:12:43.622820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:43.638058 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5dfce4da-8a4e-4be6-b316-1709752ef76c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.876620 Aug 27 03:12:43.647678 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 740/1489] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:43.658012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:43.658701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:43.666506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.667941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.668781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.669806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.670475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.671094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.082556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.101883 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aa353e90-2c35-4dcf-a70c-fb4de341c361 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1471 microversion: 2.1 time: 0.448695 Aug 27 03:12:44.104902 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 741/1490] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:43 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:44.123892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.124757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.133436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.133978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.134453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.152858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.155244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.155244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.168577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:44.228096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.228096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.228542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.229002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lazy-loading 'fault' on Instance uuid 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:44.280868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.291572 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-148a8d9a-8d15-45bd-8a99-09af99ece8e0 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1304 microversion: 2.1 time: 0.185149 Aug 27 03:12:44.292776 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 742/1491] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:44.298105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.300660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.308017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.309292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.309878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.310976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.311588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.312166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.370498 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5612953c-d150-49b2-893d-010c6e28d119 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075721 Aug 27 03:12:44.371875 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 743/1492] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:12:44.381433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.382799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.395040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.395764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.397621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.398797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.399455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.400080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.518044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:44.560749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f51aaee-251b-4763-8740-6c33580ac5de tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1935 microversion: 2.75 time: 0.186940 Aug 27 03:12:44.561670 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 744/1493] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1935 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:44.578390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.579200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.589974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.591275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.592640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.595203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.596639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.598904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.881991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.919930 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0682111-863b-4886-8108-171a4f9ac051 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.352262 Aug 27 03:12:44.923370 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 745/1494] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:44.940421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.942225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.951399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.970763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.971621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.973570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.974440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.976229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.636722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:45.663007 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df3d8c64-43a3-46e8-8313-5aebada43324 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1313 microversion: 2.1 time: 0.737557 Aug 27 03:12:45.682123 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 746/1495] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1313 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:45.691096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c7b38733-37d2-440e-ab93-18cd34825bad req-de610d4d-09ab-48d4-b300-35a997eae6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e182fe3-82a1-4e42-95d9-133561ee07ee", "name": "network-vif-deleted", "tag": "36718263-a977-43df-bd28-e84294163a51"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:45.711328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7b38733-37d2-440e-ab93-18cd34825bad req-de610d4d-09ab-48d4-b300-35a997eae6fa service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.713148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7b38733-37d2-440e-ab93-18cd34825bad req-de610d4d-09ab-48d4-b300-35a997eae6fa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.713800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7b38733-37d2-440e-ab93-18cd34825bad req-de610d4d-09ab-48d4-b300-35a997eae6fa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.773086 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c7b38733-37d2-440e-ab93-18cd34825bad req-de610d4d-09ab-48d4-b300-35a997eae6fa service nova] Creating event network-vif-deleted:36718263-a977-43df-bd28-e84294163a51 for instance 7e182fe3-82a1-4e42-95d9-133561ee07ee on n-h1-852086-5 Aug 27 03:12:45.801411 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c7b38733-37d2-440e-ab93-18cd34825bad req-de610d4d-09ab-48d4-b300-35a997eae6fa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117136 Aug 27 03:12:45.807222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 747/1496] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:45.822334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:45.823277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:45.841941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.843280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.843280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.843803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.844269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.844698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.004755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.005666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.006577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.007428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lazy-loading 'fault' on Instance uuid 7e182fe3-82a1-4e42-95d9-133561ee07ee {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:46.172680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:46.192567 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9cf33ef-50f8-4969-ae75-bc96a52b8e7c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 200 len: 1306 microversion: 2.1 time: 0.383523 Aug 27 03:12:46.197840 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 748/1497] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:45 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 1306 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:46.209057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:46.210565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:46.252872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:46.292436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.293004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.293458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.300136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.311349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.312118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.402853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.403677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.404557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.405199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lazy-loading 'fault' on Instance uuid 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:46.522522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:46.543966 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c1e474de-bee0-48c6-8627-631534257cb4 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 200 len: 1304 microversion: 2.1 time: 0.343361 Aug 27 03:12:46.544555 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 749/1498] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:46 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 1304 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:46.551505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:46.552285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:46.565642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.566929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.567941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.569672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.571028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.572074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.837664 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d0c5551-c0f3-4d62-a640-c8e44c04d407 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/action" status: 202 len: 0 microversion: 2.25 time: 3.826069 Aug 27 03:12:46.838675 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 750/1499] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:12:43 2022] POST /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/action => generated 0 bytes in 3828 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:46.844919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:46.846332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:46.855892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.856832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.857495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.858505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.859302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.860034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.176089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.197064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] Lazy-loading 'services' on Instance uuid bd5c45f5-5ee3-405c-b162-acceaabcb654 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:47.207670 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1cb72f3a-c48d-4273-9f83-815c72359457 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.367770 Aug 27 03:12:47.227374 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 751/1500] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:46 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:47.252560 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-adfc10a3-949e-470e-ab7d-46f01b2228ea tempest-ServersAdmin275Test-959696848 tempest-ServersAdmin275Test-959696848-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1920 microversion: 2.75 time: 0.705801 Aug 27 03:12:47.254035 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 750/1501] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:46 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1920 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:47.277518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:47.286491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:47.307031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:47.308002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:47.311782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.314012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.322669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.323876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.324094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.324370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.324690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.325385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.327016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.328628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.329742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.330848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.715988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.760391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.762386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.765538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3016afe1-77a2-41ba-ba80-f9629d3e85dd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.495722 Aug 27 03:12:47.768245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 751/1502] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:47 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:47.779070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:47.781854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 7e182fe3-82a1-4e42-95d9-133561ee07ee] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:47.802058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.803391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.804018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.804759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.805225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.805656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.850948 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance 7e182fe3-82a1-4e42-95d9-133561ee07ee could not be found. Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee HTTP/1.1 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7e182fe3-82a1-4e42-95d9-133561ee07ee could not be found. Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7e182fe3-82a1-4e42-95d9-133561ee07ee'} Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e182fe3-82a1-4e42-95d9-133561ee07ee could not be found. Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e182fe3-82a1-4e42-95d9-133561ee07ee could not be found. Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:47.858124 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e182fe3-82a1-4e42-95d9-133561ee07ee could not be found. Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance 7e182fe3-82a1-4e42-95d9-133561ee07ee could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:47.864321 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-12c69b04-399a-45d1-b838-c2b990cfe56c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee" status: 404 len: 111 microversion: 2.1 time: 0.091372 Aug 27 03:12:47.868343 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 752/1503] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:47 2022] GET /compute/v2.1/servers/7e182fe3-82a1-4e42-95d9-133561ee07ee => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:47.883825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:47.887454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:47.907581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.909234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.910366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.913417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.914633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.915837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.933234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.955772 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29502883-1f21-46d9-9186-33a05946de62 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1462 microversion: 2.1 time: 0.726032 Aug 27 03:12:47.957492 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 752/1504] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:47 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1462 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:47.967139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:47.968808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:47.980935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.982337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.983447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.985800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.987590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.988706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.049763 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] HTTP exception thrown: Instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 could not be found. Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Request method failure captured: Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 HTTP/1.1 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYr2348S2yMZt4mmygvV1VdWt0xjSnBQY11qAgme-XzijCncfxU1E2N6iVT-MJVHldVfovzMTqhDUXgDp7t71bIGSiZJdl11B7JR7jnWGRBUZEPqbmjvblapx3xshBX4RArRQ_bEOs_73cTIVG7C2YWCsZT51eQzkow8nRHX99YSB_g Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 82ec502ce3cc43bb969abf2fa3637591 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminTestJSON-464158226 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/82ec502ce3cc43bb969abf2fa3637591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82ec502ce3cc43bb969abf2fa3637591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_82ec502ce3cc43bb969abf2fa3637591", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82ec502ce3cc43bb969abf2fa3637591"}]}] Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminTestJSON-464158226 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 82ec502ce3cc43bb969abf2fa3637591 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminTestJSON-464158226 Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersAdminTestJSON-464158226-project Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 1150c8244e514ef098f87f12f04f964b Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminTestJSON-464158226-project Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 could not be found. Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982'} Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 could not be found. Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 could not be found. Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:48.059816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 could not be found. Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Returning 404 to user: Instance 9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:48.067026 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0b4a9f0-86e2-4fd0-863d-1233566b2a6b tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982" status: 404 len: 111 microversion: 2.1 time: 0.101991 Aug 27 03:12:48.069000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:48.076018 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 753/1505] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:47 2022] GET /compute/v2.1/servers/9e1e71e3-bfa2-40fc-96e2-39cbd2a4e982 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:48.080776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.081289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:48.101232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.101739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.102201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.103804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.105430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.106125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.201574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:48.300337 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bac9dbf0-dbc9-4349-9256-1b7c4d674634 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 204 len: 0 microversion: 2.75 time: 0.430148 Aug 27 03:12:48.322626 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 753/1506] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:12:47 2022] DELETE /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:12:48.333364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.334717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:48.356491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.356995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.357433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.358201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.358666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.359088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.396829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:48.437781 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57d781a3-ba01-44a2-90e0-2f6207564c06 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 204 len: 0 microversion: 2.1 time: 0.360581 Aug 27 03:12:48.444807 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 754/1507] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:48 2022] DELETE /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:48.451228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.452138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:48.462993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.464400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.465032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.465928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.466588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.468827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.554279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:48.750012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66a8592e-5704-4822-b163-e598d5d27dea tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "DELETE /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 204 len: 0 microversion: 2.1 time: 0.301686 Aug 27 03:12:48.751267 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 755/1508] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:48 2022] DELETE /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:48.760076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.761883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:48.771344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.772889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.773976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.775320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.776149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.776871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.817967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:48.976817 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-22c6dd44-1758-4137-8a4c-8c1c8ebfb72b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1613 microversion: 2.1 time: 0.652640 Aug 27 03:12:48.977543 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 754/1509] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:48 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1613 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:48.994669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.998233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.023048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.028213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.029090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.031150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.033146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.034777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.120300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.131376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c78872d-5e9d-47dd-8c5b-e482a8bd6be3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.377778 Aug 27 03:12:49.142716 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 756/1510] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:48 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:49.155002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:49.158310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.160864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.177235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.182812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.183821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.185078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.196452 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f7451b0-8a53-4d52-a5c3-7d1168243491 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1444 microversion: 2.75 time: 0.212286 Aug 27 03:12:49.197683 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 755/1511] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:48 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1444 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:49.215961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.217170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.217343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.217768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.218815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:49.219909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.231164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.233161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.236379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.239508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.242901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.245523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.530458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.534092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:49.549290 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e6990025-da08-4ad8-a8d8-f474a14eb6a2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1469 microversion: 2.1 time: 0.350153 Aug 27 03:12:49.560820 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 756/1512] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:49 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:49.575775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.581224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:49.581224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.596606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.597656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.599248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.612702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.614921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.617817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.618060 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d572e993-2b02-4049-a067-8cf218d0519c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1472 microversion: 2.1 time: 0.472872 Aug 27 03:12:49.618910 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 757/1513] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:49 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:49.628658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:49.634997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.647438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.649918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.665658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.666535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.667079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.667584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.725371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ef5cbd20c90c4e7ab72e0b54c68ed1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdf9335d2fe4a71ba5399d5341e7320', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.726444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] flavor_id is None. Assuming migration. {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:12:49.726444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:12:50.125332 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5466164f-833e-4001-a337-e206bd3c591b tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5/action" status: 202 len: 0 microversion: 2.1 time: 0.503539 Aug 27 03:12:50.127724 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 758/1514] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:12:49 2022] POST /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:12:50.373058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.405658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-919a6371-64be-40e3-8d6f-6c10d1b72255 req-dc60b188-b947-42fc-aa5f-4dcf4a4a27b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2487156-8dfd-40a2-ac84-3bd6325a4c45", "name": "network-vif-plugged", "status": "completed", "tag": "0e3bcf8b-0218-4f3b-9efe-366fb5a71f67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:50.417900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.423901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-919a6371-64be-40e3-8d6f-6c10d1b72255 req-dc60b188-b947-42fc-aa5f-4dcf4a4a27b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.424724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-919a6371-64be-40e3-8d6f-6c10d1b72255 req-dc60b188-b947-42fc-aa5f-4dcf4a4a27b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.425436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-919a6371-64be-40e3-8d6f-6c10d1b72255 req-dc60b188-b947-42fc-aa5f-4dcf4a4a27b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.441852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.444653 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-96e0f8e0-81bf-413b-a9df-b56022d92e21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.881466 Aug 27 03:12:50.453843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-919a6371-64be-40e3-8d6f-6c10d1b72255 req-dc60b188-b947-42fc-aa5f-4dcf4a4a27b8 service nova] Creating event network-vif-plugged:0e3bcf8b-0218-4f3b-9efe-366fb5a71f67 for instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 on n-h2-852086-5 Aug 27 03:12:50.469667 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-919a6371-64be-40e3-8d6f-6c10d1b72255 req-dc60b188-b947-42fc-aa5f-4dcf4a4a27b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335258 Aug 27 03:12:50.470460 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 757/1515] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:49 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:50.474106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 759/1516] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:50.514025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:50.517914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:50.546692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.547791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.548363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.549672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.550488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.562045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.768453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:50.769239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:50.785585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.785585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.785585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.786898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.787985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.788478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.284759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:51.326854 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f93214fc-aae1-4449-a964-5f860e2e756d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.848247 Aug 27 03:12:51.343320 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 760/1517] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:50 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:51.353161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:51.354940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:51.368148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.369468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.370522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.372086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.373185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.374288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.599877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:51.609339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:51.615508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ded125b553aa433bb761689de9b7c8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1babffe9ddfd4a2aa16a795ebdae4964', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:51.630428 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d618c11d-3f84-472b-948b-299545d80614 tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 200 len: 1444 microversion: 2.75 time: 0.284981 Aug 27 03:12:51.633240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:51.643162 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 761/1518] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:51 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 1444 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:51.652629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:51.653384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:51.664278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d41c7f7-7206-4975-a047-c0d551defceb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1471 microversion: 2.1 time: 1.192184 Aug 27 03:12:51.675405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.675907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.676342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.677061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.678198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.678633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.679708 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 758/1519] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:50 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1471 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:51.691992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:51.693011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:51.722788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.727322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.729055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.730426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.731670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.732244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.333204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.351427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca3b126f-30ef-470a-a07e-ae277a1d663e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1472 microversion: 2.1 time: 0.668224 Aug 27 03:12:52.386199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 759/1520] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:51 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1472 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:52.429538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:52.429980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.430916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:52.450723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.451414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.454920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.457461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.460171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.460708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.463384 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e72785d-4bd5-4764-86ba-94ac153cbc86 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1469 microversion: 2.1 time: 0.818308 Aug 27 03:12:52.467676 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 762/1521] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:51 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1469 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:52.478139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:52.479931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:52.493536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.494849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.496081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.497772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.498835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.499974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.959443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.977458 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-033c5e15-cc60-41b4-82f5-72625f46b028 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1325 microversion: 2.1 time: 0.506872 Aug 27 03:12:52.995604 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 763/1522] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:52 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1325 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:53.014973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4982633f-3ee3-41b7-8f18-53e9e2938e1d req-3e1cb8e3-b07a-46ce-a3c9-65296a896b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b6f613-7f60-4e14-8283-4617c9b0f283", "name": "network-vif-deleted", "tag": "a09097d9-1bf0-429e-ad65-3ea59a299e7e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:53.034966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4982633f-3ee3-41b7-8f18-53e9e2938e1d req-3e1cb8e3-b07a-46ce-a3c9-65296a896b2b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.035752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4982633f-3ee3-41b7-8f18-53e9e2938e1d req-3e1cb8e3-b07a-46ce-a3c9-65296a896b2b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.036463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4982633f-3ee3-41b7-8f18-53e9e2938e1d req-3e1cb8e3-b07a-46ce-a3c9-65296a896b2b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.060344 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4982633f-3ee3-41b7-8f18-53e9e2938e1d req-3e1cb8e3-b07a-46ce-a3c9-65296a896b2b service nova] Creating event network-vif-deleted:a09097d9-1bf0-429e-ad65-3ea59a299e7e for instance 53b6f613-7f60-4e14-8283-4617c9b0f283 on n-h2-852086-5 Aug 27 03:12:53.078002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4982633f-3ee3-41b7-8f18-53e9e2938e1d req-3e1cb8e3-b07a-46ce-a3c9-65296a896b2b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072767 Aug 27 03:12:53.084926 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 764/1523] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:53.095513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.096725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.124925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.126214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.128735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.133344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.134610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.137634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.449104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.472638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.484390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.494201 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-184ae0ea-6839-48f1-bbf7-87d3cd7877c7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 1.093834 Aug 27 03:12:53.513680 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 760/1524] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:52 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:53.534414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.542650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] [instance: bd5c45f5-5ee3-405c-b162-acceaabcb654] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.565060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.567554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.568705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.570319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.571460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.572940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.596494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.607176 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] HTTP exception thrown: Instance bd5c45f5-5ee3-405c-b162-acceaabcb654 could not be found. Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Request method failure captured: Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 HTTP/1.1 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYs7ffk63S1vEt9f57H44JoV_b05OVTwtuUj1qUlOR1Sq2merY7NB9MAS5-RZqh0oirtBMlNpsCNM9jAEbwQSfcWoP3hT4Cja7gMbSaovH98bncY4ssM6AcguYDfA-QcQfVmPt1rqcn7Dj0SdJAP31ACKQru3khmyGxR3_HbkUVQc0M Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.75 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1babffe9ddfd4a2aa16a795ebdae4964 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdmin275Test-1724205711 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1babffe9ddfd4a2aa16a795ebdae4964"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1babffe9ddfd4a2aa16a795ebdae4964"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1babffe9ddfd4a2aa16a795ebdae4964", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1babffe9ddfd4a2aa16a795ebdae4964"}]}] Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdmin275Test-1724205711 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1babffe9ddfd4a2aa16a795ebdae4964 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdmin275Test-1724205711 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdmin275Test-1724205711-project Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ded125b553aa433bb761689de9b7c8f1 Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdmin275Test-1724205711-project Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance bd5c45f5-5ee3-405c-b162-acceaabcb654 could not be found. Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'bd5c45f5-5ee3-405c-b162-acceaabcb654'} Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5c45f5-5ee3-405c-b162-acceaabcb654 could not be found. Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5c45f5-5ee3-405c-b162-acceaabcb654 could not be found. Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:53.612277 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:53.624327 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:53.624327 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:53.624327 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:53.624327 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:53.624327 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:53.624327 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5c45f5-5ee3-405c-b162-acceaabcb654 could not be found. Aug 27 03:12:53.624327 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:53.627624 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6fb927f-83d0-4800-b8a6-0148041ae0ea tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1471 microversion: 2.1 time: 0.528308 Aug 27 03:12:53.630443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] Returning 404 to user: Instance bd5c45f5-5ee3-405c-b162-acceaabcb654 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:53.632485 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f39d47d-25fc-4a0d-aa09-bfae760857ef tempest-ServersAdmin275Test-1724205711 tempest-ServersAdmin275Test-1724205711-project] 10.222.0.69 "GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654" status: 404 len: 111 microversion: 2.75 time: 0.116482 Aug 27 03:12:53.633765 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 761/1525] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/bd5c45f5-5ee3-405c-b162-acceaabcb654 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:12:53.636586 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 765/1526] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1471 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:53.658804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.659767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.667112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.670545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.705361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.705878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.710055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.711669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.712169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.717021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.732331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.732829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.733264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.733998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.746031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.749717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.894109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.895011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.895570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.896777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lazy-loading 'fault' on Instance uuid 53b6f613-7f60-4e14-8283-4617c9b0f283 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:54.095359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:54.106700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:54.124025 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6ddb766-0bdb-49de-b9ee-b843f16d44c9 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1304 microversion: 2.1 time: 0.479007 Aug 27 03:12:54.141322 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 766/1527] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1304 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:54.151676 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f6add19-27ac-420e-ba48-2098684cb7b6 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 200 len: 1430 microversion: 2.1 time: 0.514597 Aug 27 03:12:54.157165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 762/1528] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 1430 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:54.165066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:54.165768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:54.182260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6edd8cbc-ca2e-437b-b67a-1e7bd5cd7b57 req-9ebede74-12ae-4833-8d19-e126cb71877b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace45f85-bd05-40de-8cf7-4e0b9e366c12", "name": "network-vif-deleted", "tag": "31c116f1-58c6-46b3-94fe-8a1e3bc2dd0c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:54.201023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.202770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.205103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.206811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.208125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.209601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.236750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6edd8cbc-ca2e-437b-b67a-1e7bd5cd7b57 req-9ebede74-12ae-4833-8d19-e126cb71877b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.249249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6edd8cbc-ca2e-437b-b67a-1e7bd5cd7b57 req-9ebede74-12ae-4833-8d19-e126cb71877b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.250040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6edd8cbc-ca2e-437b-b67a-1e7bd5cd7b57 req-9ebede74-12ae-4833-8d19-e126cb71877b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.300066 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6edd8cbc-ca2e-437b-b67a-1e7bd5cd7b57 req-9ebede74-12ae-4833-8d19-e126cb71877b service nova] Creating event network-vif-deleted:31c116f1-58c6-46b3-94fe-8a1e3bc2dd0c for instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 on n-h1-852086-5 Aug 27 03:12:54.326120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6edd8cbc-ca2e-437b-b67a-1e7bd5cd7b57 req-9ebede74-12ae-4833-8d19-e126cb71877b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164716 Aug 27 03:12:54.326913 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 763/1529] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:54.523419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:54.524235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:54.550821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.551284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.551837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.555358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.557865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.563580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.646782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:54.656236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bd716b7-e7dd-4469-94ab-9c40ceb137c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 0.510227 Aug 27 03:12:54.683531 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 767/1530] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:54 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:54.697842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:54.702817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:54.723981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.725547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.726765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.733551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.738197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.748153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.089770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.127683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.129379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.143663 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5e17f5af-372d-4b4f-bcc1-2ab6b2e69244 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.625198 Aug 27 03:12:55.150981 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 764/1531] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:54 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:12:55.171829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:55.172952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:55.192544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.195107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.195941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.196769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.198276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.201493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.204482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.209796 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64716fe1-6678-464e-a072-80e931c87f1e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1471 microversion: 2.1 time: 0.524057 Aug 27 03:12:55.213753 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 768/1532] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:54 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:55.225068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:55.232121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:55.265148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.270297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.270901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.271788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.273545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.276932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.488806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.489908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.493265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.494109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lazy-loading 'fault' on Instance uuid 53b6f613-7f60-4e14-8283-4617c9b0f283 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:55.727392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.774961 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7f1bfd9-01d0-468a-a8a1-ec1ca04b65d6 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 200 len: 1304 microversion: 2.1 time: 0.548418 Aug 27 03:12:55.776390 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 769/1533] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:55 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 1304 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:55.803915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:55.805000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: ace45f85-bd05-40de-8cf7-4e0b9e366c12] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:55.823963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.824385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.824830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.825583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.826029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.826487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.863557 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 could not be found. Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 HTTP/1.1 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 could not be found. Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ace45f85-bd05-40de-8cf7-4e0b9e366c12'} Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 could not be found. Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 could not be found. Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:55.865776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 could not be found. Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance ace45f85-bd05-40de-8cf7-4e0b9e366c12 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afa88514-8ee9-46fb-a362-e8ddbe8e8a8a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12" status: 404 len: 111 microversion: 2.1 time: 0.088908 Aug 27 03:12:55.870550 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 770/1534] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:55 2022] GET /compute/v2.1/servers/ace45f85-bd05-40de-8cf7-4e0b9e366c12 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:55.878003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:55.878452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:55.893703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.896089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.896617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.897391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.897867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.898343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.973653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:56.045373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:56.212257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a24282f3-58ba-436b-9ee7-75fb061f35dd tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5" status: 204 len: 0 microversion: 2.1 time: 0.338474 Aug 27 03:12:56.222621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 771/1535] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:55 2022] DELETE /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:12:56.230580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:56.231486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:56.253250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.256263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.257592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.259391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.264337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.265054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.611613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.654407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9750ad6f-37b2-4076-8b74-84c9939356c8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 1.501847 Aug 27 03:12:56.665689 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 765/1536] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:55 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:56.696312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:56.697109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:56.725828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.726397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.726888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.733217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.734334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.734943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.735407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.753032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.756150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.758117 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c7562fc-81f6-4ce3-b9d5-d8c9f7d92111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.533531 Aug 27 03:12:56.762859 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 772/1537] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:56 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:56.786062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:56.789359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:56.822413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.828496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.829219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:56.830225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.836235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.853585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.859067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.145928 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c65783ff-ac63-4141-8563-83bdeb398ce7 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 204 len: 0 microversion: 2.1 time: 0.469429 Aug 27 03:12:57.146624 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 766/1538] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:56 2022] DELETE /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:57.158252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3642fb3-4cf4-44fc-878a-c017f43805ca tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-79666020", "metadata": {"": ""}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3642fb3-4cf4-44fc-878a-c017f43805ca tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action HTTP/1.1 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 105 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-79666020", "metadata": {"": ""}}} Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f2487156-8dfd-40a2-ac84-3bd6325a4c45', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-79666020', 'metadata': {'': ''}}}} Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'': ''} Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:12:57.164656 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3642fb3-4cf4-44fc-878a-c017f43805ca tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3642fb3-4cf4-44fc-878a-c017f43805ca tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action" status: 400 len: 170 microversion: 2.1 time: 0.015885 Aug 27 03:12:57.174390 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 767/1539] 10.222.0.69 () {60 vars in 1279 bytes} [Sat Aug 27 03:12:57 2022] POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action => generated 170 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:12:57.178411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.178745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: 53b6f613-7f60-4e14-8283-4617c9b0f283] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:57.191403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.191945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.192394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.193563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.194090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.194551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.231311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] HTTP exception thrown: Instance 53b6f613-7f60-4e14-8283-4617c9b0f283 could not be found. Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Request method failure captured: Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 HTTP/1.1 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYr2348S2yMZt4mmygvV1VdWt0xjSnBQY11qAgme-XzijCncfxU1E2N6iVT-MJVHldVfovzMTqhDUXgDp7t71bIGSiZJdl11B7JR7jnWGRBUZEPqbmjvblapx3xshBX4RArRQ_bEOs_73cTIVG7C2YWCsZT51eQzkow8nRHX99YSB_g Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 82ec502ce3cc43bb969abf2fa3637591 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdminTestJSON-464158226 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/82ec502ce3cc43bb969abf2fa3637591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82ec502ce3cc43bb969abf2fa3637591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_82ec502ce3cc43bb969abf2fa3637591", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82ec502ce3cc43bb969abf2fa3637591"}]}] Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdminTestJSON-464158226 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 82ec502ce3cc43bb969abf2fa3637591 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdminTestJSON-464158226 Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdminTestJSON-464158226-project Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 1150c8244e514ef098f87f12f04f964b Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdminTestJSON-464158226-project Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 53b6f613-7f60-4e14-8283-4617c9b0f283 could not be found. Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '53b6f613-7f60-4e14-8283-4617c9b0f283'} Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b6f613-7f60-4e14-8283-4617c9b0f283 could not be found. Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b6f613-7f60-4e14-8283-4617c9b0f283 could not be found. Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:57.233005 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b6f613-7f60-4e14-8283-4617c9b0f283 could not be found. Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Returning 404 to user: Instance 53b6f613-7f60-4e14-8283-4617c9b0f283 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59ff5d1c-286a-4768-8ae0-dfef16fd816f tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283" status: 404 len: 111 microversion: 2.1 time: 0.065297 Aug 27 03:12:57.242720 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 768/1540] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:57 2022] GET /compute/v2.1/servers/53b6f613-7f60-4e14-8283-4617c9b0f283 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:57.245945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.246598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:57.253749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.254381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.254833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.255859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.256349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.257056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.563171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:57.589915 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35aa340f-ab09-45c8-9e62-38390a2af9c4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1471 microversion: 2.1 time: 0.824028 Aug 27 03:12:57.595607 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 773/1541] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:56 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1471 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:57.625214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.626932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:57.659273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.660075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.660849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.662607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.663365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.664142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.766942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:57.804687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f85cc19-27c4-4b10-8766-ecd1c7429358 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5" status: 200 len: 1474 microversion: 2.1 time: 0.567676 Aug 27 03:12:57.814774 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 769/1542] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:57 2022] GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5 => generated 1474 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:57.847619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.849908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:57.879274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.880510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.881512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.885903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.887436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.888462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.968577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:58.260943 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b0b0fcf2-9011-4446-94c3-7f0f2972b588 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "DELETE /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 204 len: 0 microversion: 2.1 time: 0.444084 Aug 27 03:12:58.272523 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 770/1543] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:57 2022] DELETE /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:58.290955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.318761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:58.320873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:58.328042 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9720a5d-d934-46f3-90d3-a22e94143656 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 0.729554 Aug 27 03:12:58.332294 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 774/1544] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:57 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:58.354835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.355871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:58.357631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.360229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.363469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.365652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.366846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.367268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:58.441715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.449607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.452038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.453750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.455739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.456936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.939955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.977314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.983201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:58.988411 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a7d3fb1f-8088-4ebf-a85b-e1545a7293c3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.713345 Aug 27 03:12:58.993532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 771/1545] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:12:58 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:12:59.014632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:59.016921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:59.041319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.042938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.043966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.045497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.046543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.047162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.760610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:59.774304 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-927941ee-1070-4845-8004-e32d81c1c021 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 0.778998 Aug 27 03:12:59.786341 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 772/1546] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:58 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:59.805782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:59.806913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:59.830060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:59.848420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.854652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.860656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.863164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.864568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.866554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.870473 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d1e6bae-c396-4bcd-92b4-911fe2ee43e2 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1469 microversion: 2.1 time: 1.530355 Aug 27 03:12:59.871553 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 775/1547] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:58 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1469 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:59.896454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:59.922315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:59.930584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:59.960004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.961095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.963888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.966898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.973198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.978503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:00.149355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:00.167341 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4862ab69-36c1-4dca-b43a-c4c421599271 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5" status: 200 len: 1432 microversion: 2.1 time: 0.283453 Aug 27 03:13:00.170501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 776/1548] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:59 2022] GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5 => generated 1432 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:00.181109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fed9f891-4679-4b72-a9ef-fee4de13f99a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2041413347", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fed9f891-4679-4b72-a9ef-fee4de13f99a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action HTTP/1.1 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 619 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2041413347", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'f2487156-8dfd-40a2-ac84-3bd6325a4c45', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2041413347', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:13:00.191274 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:13:00.194538 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:00.201483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fed9f891-4679-4b72-a9ef-fee4de13f99a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:00.202728 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fed9f891-4679-4b72-a9ef-fee4de13f99a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action" status: 400 len: 938 microversion: 2.1 time: 0.030512 Aug 27 03:13:00.203242 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 777/1549] 10.222.0.69 () {60 vars in 1279 bytes} [Sat Aug 27 03:13:00 2022] POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action => generated 938 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:13:00.208547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:00.209647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:00.251472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:00.254248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:00.254724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:00.255546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:00.256213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:00.256990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.081993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.113895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.116103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.117367 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-498cf9a4-9dfc-4838-9d99-8d8edf466052 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.912902 Aug 27 03:13:01.142906 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 778/1550] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:00 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:01.168739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:01.184961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:01.227354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:01.234629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:01.238928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.242812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:01.244361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:01.245127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.643035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:01.664723 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4383b851-34bd-4d93-af04-89a059cce023 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1471 microversion: 2.1 time: 1.876625 Aug 27 03:13:01.665651 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 773/1551] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:59 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1471 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:02.142659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:02.155376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6841a7d2-444a-4cb3-ac0d-8bcb6e8e9184 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 1.010349 Aug 27 03:13:02.177227 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 779/1552] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:01 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:02.188986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:02.189852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:02.201299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.202023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.202677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.203721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.205385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.206514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.390196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e87b125d-95b3-4325-9c60-d90d390c1be3 req-d68cd3f3-16db-49d4-b5b5-801966aea1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094efd70-ba42-484c-bdf3-d92d44463aa5", "name": "network-vif-deleted", "tag": "3538fc00-b7da-4311-8edd-a7b29893993a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:02.436661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e87b125d-95b3-4325-9c60-d90d390c1be3 req-d68cd3f3-16db-49d4-b5b5-801966aea1d6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.437153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e87b125d-95b3-4325-9c60-d90d390c1be3 req-d68cd3f3-16db-49d4-b5b5-801966aea1d6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.437587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e87b125d-95b3-4325-9c60-d90d390c1be3 req-d68cd3f3-16db-49d4-b5b5-801966aea1d6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.506645 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e87b125d-95b3-4325-9c60-d90d390c1be3 req-d68cd3f3-16db-49d4-b5b5-801966aea1d6 service nova] Creating event network-vif-deleted:3538fc00-b7da-4311-8edd-a7b29893993a for instance 094efd70-ba42-484c-bdf3-d92d44463aa5 on n-h2-852086-5 Aug 27 03:13:02.543210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e87b125d-95b3-4325-9c60-d90d390c1be3 req-d68cd3f3-16db-49d4-b5b5-801966aea1d6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.875020 Aug 27 03:13:02.550840 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 774/1553] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:02.569337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:02.570126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 094efd70-ba42-484c-bdf3-d92d44463aa5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:02.609205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.610036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.618017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.619402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.620290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.621077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.721526 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance 094efd70-ba42-484c-bdf3-d92d44463aa5 could not be found. Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5 HTTP/1.1 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 094efd70-ba42-484c-bdf3-d92d44463aa5 could not be found. Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '094efd70-ba42-484c-bdf3-d92d44463aa5'} Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094efd70-ba42-484c-bdf3-d92d44463aa5 could not be found. Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094efd70-ba42-484c-bdf3-d92d44463aa5 could not be found. Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:02.724466 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094efd70-ba42-484c-bdf3-d92d44463aa5 could not be found. Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:02.728615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance 094efd70-ba42-484c-bdf3-d92d44463aa5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:02.742039 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba5b7f4f-8c0d-437f-a9d1-0cf1695dd87e tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5" status: 404 len: 111 microversion: 2.1 time: 0.186571 Aug 27 03:13:02.746747 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 775/1554] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:02 2022] GET /compute/v2.1/servers/094efd70-ba42-484c-bdf3-d92d44463aa5 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:02.806683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:02.843640 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c332fa44-0d1e-45da-a3d3-8e4500466817 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1469 microversion: 2.1 time: 0.664621 Aug 27 03:13:02.850881 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 780/1555] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:02 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1469 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:02.893742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:02.900571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:02.930993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.933730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.942271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.945012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.951394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.954364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.683629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:03.709961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:03.722726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:03.727580 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20fca41c-9df4-4030-890e-527c7916e602 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.870027 Aug 27 03:13:03.730287 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 781/1556] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:02 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:03.736985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:03.738061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:03.775121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.777724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.780289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.787724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.789497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.796749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.813723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8652ce67-45fc-44cc-a09c-bb3c16cedf1d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Action: 'create', calling method: .version_select at 0x7fe457cca430>, body: {"keypair": {"name": "tempest-keypair-1939888622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWBh1KSSN8qnyOMeHu26o4mIZ7jedRV9D045NuZKAR3a9VsmWLKym3MxC2mq7jWiCaJ7kdfceg5dpOsTjYw72RJrnTAiUiuRbQZYSgbhZRbaelypPsViiQArf+EEGhXwQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:03.843014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8652ce67-45fc-44cc-a09c-bb3c16cedf1d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Getting quotas for project 169bb4af498e4606b896ea4d711b9d12. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:03.852306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8652ce67-45fc-44cc-a09c-bb3c16cedf1d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Getting quotas for user c093521eb52f431eaac1c2ab229092ef and project 169bb4af498e4606b896ea4d711b9d12. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:03.929484 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8652ce67-45fc-44cc-a09c-bb3c16cedf1d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.178538 Aug 27 03:13:03.951077 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 776/1557] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:13:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:03.957636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:03.959338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:03.993544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.993544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.001729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.028616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.029730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.030475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.125330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.141518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a005a69a-bc94-42a5-81a9-12f6f19ec1c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 0.409110 Aug 27 03:13:04.143382 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 782/1558] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:03 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:04.150983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:04.152198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:04.178577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.180042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.182085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.185527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.191750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.195393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.331191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.331684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.332120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.339947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lazy-loading 'fault' on Instance uuid 37b5437b-bc51-497e-9dd8-f29576d43dab {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:04.419264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.432519 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26b28047-4c83-4909-b22f-208193099ab1 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 200 len: 1308 microversion: 2.1 time: 0.287691 Aug 27 03:13:04.433319 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 783/1559] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:04 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:04.457940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3d54018e-8a4c-4a33-9c16-55c6696c73f9 req-d277dd3e-f7a8-4969-8e87-26ac33237328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd3b4a0-b115-4688-af4f-27f15a0eaea0", "name": "network-vif-deleted", "tag": "a94fdd64-5583-4e14-bd48-74552e561a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:04.487937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d54018e-8a4c-4a33-9c16-55c6696c73f9 req-d277dd3e-f7a8-4969-8e87-26ac33237328 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.489400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d54018e-8a4c-4a33-9c16-55c6696c73f9 req-d277dd3e-f7a8-4969-8e87-26ac33237328 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.490142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d54018e-8a4c-4a33-9c16-55c6696c73f9 req-d277dd3e-f7a8-4969-8e87-26ac33237328 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.525648 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3d54018e-8a4c-4a33-9c16-55c6696c73f9 req-d277dd3e-f7a8-4969-8e87-26ac33237328 service nova] Creating event network-vif-deleted:a94fdd64-5583-4e14-bd48-74552e561a6b for instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 on n-h1-852086-5 Aug 27 03:13:04.532990 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3d54018e-8a4c-4a33-9c16-55c6696c73f9 req-d277dd3e-f7a8-4969-8e87-26ac33237328 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092560 Aug 27 03:13:04.533598 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 784/1560] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:04.600770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.622024 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32b9a20d-aee0-4b35-8d8b-60f1661e7ec2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 0.668511 Aug 27 03:13:04.624481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:04.625133 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 777/1561] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:03 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:04.636115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.637252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.637898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.638936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.639632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.640280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.653965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:04.654621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:04.672920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.676810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.677091 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23943577-65b1-4cf9-98ed-1415776ad6e7 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.141817 Aug 27 03:13:04.677900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.686075 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 785/1562] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:13:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:04.688121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.688894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.700953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.705400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8568332f-68a0-4349-ad9f-f70d9ab57072 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8568332f-68a0-4349-ad9f-f70d9ab57072 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action HTTP/1.1 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 285 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'f2487156-8dfd-40a2-ac84-3bd6325a4c45', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:04.716300 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:13:04.719841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:04.724190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8568332f-68a0-4349-ad9f-f70d9ab57072 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:04.741309 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8568332f-68a0-4349-ad9f-f70d9ab57072 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action" status: 400 len: 619 microversion: 2.1 time: 0.045246 Aug 27 03:13:04.748183 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 786/1563] 10.222.0.69 () {60 vars in 1279 bytes} [Sat Aug 27 03:13:04 2022] POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action => generated 619 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:13:04.759244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-68d14e3a-13e4-4aa0-ba5a-d3029bed391e req-20f764e3-9c4f-45dd-8772-7cc4b81aea80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b5437b-bc51-497e-9dd8-f29576d43dab", "name": "network-vif-deleted", "tag": "8e716cc4-c738-4bde-a49d-8f8e449c8da6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:04.783976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-68d14e3a-13e4-4aa0-ba5a-d3029bed391e req-20f764e3-9c4f-45dd-8772-7cc4b81aea80 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.784870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.785307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-68d14e3a-13e4-4aa0-ba5a-d3029bed391e req-20f764e3-9c4f-45dd-8772-7cc4b81aea80 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.785459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.785789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.786270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lazy-loading 'fault' on Instance uuid acd3b4a0-b115-4688-af4f-27f15a0eaea0 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:04.786617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-68d14e3a-13e4-4aa0-ba5a-d3029bed391e req-20f764e3-9c4f-45dd-8772-7cc4b81aea80 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.801919 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-68d14e3a-13e4-4aa0-ba5a-d3029bed391e req-20f764e3-9c4f-45dd-8772-7cc4b81aea80 service nova] Creating event network-vif-deleted:8e716cc4-c738-4bde-a49d-8f8e449c8da6 for instance 37b5437b-bc51-497e-9dd8-f29576d43dab on n-h1-852086-5 Aug 27 03:13:04.817574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-68d14e3a-13e4-4aa0-ba5a-d3029bed391e req-20f764e3-9c4f-45dd-8772-7cc4b81aea80 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067482 Aug 27 03:13:04.819823 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 787/1564] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:04.835848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:04.837738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1150c8244e514ef098f87f12f04f964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec502ce3cc43bb969abf2fa3637591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.848231 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8bf9a53e-a446-4ad7-810d-35e9359bc319 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 200 len: 1304 microversion: 2.1 time: 0.204730 Aug 27 03:13:04.851945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.852823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.854715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.856809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.857641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.858700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.862670 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 778/1565] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:04 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:04.869747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:04.870755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:04.878448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.879294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.881261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.882993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.883824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.884532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.957940 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-667faa9e-647d-43d5-a372-a865d6d4b755 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=n-d-852086-5" status: 200 len: 578 microversion: 2.1 time: 0.136283 Aug 27 03:13:04.974686 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 788/1566] 10.222.0.69 () {58 vars in 1172 bytes} [Sat Aug 27 03:13:04 2022] GET /compute/v2.1/os-services?host=n-d-852086-5 => generated 578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:04.982611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:04.983575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:04.995884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.996409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.997309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.998286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.998779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.999211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.227287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.244312 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6fd595dd-b67c-4e98-a7ac-05a531282cb7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 0.380043 Aug 27 03:13:05.246360 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 779/1567] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:04 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:05.272394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.282986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.283650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.286105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.288641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.289486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.290902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.301684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.315861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.327393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.328620 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecf0a5bf-68d7-4c3b-91a4-47e99ce54765 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.352541 Aug 27 03:13:05.329192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 789/1568] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:04 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:05.334040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.334469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:05.348217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.348584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.348772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.350476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.350598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.350950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.356692 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2302ed30-48a8-4d91-aa2f-15761b650322 tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.108339 Aug 27 03:13:05.357893 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 780/1569] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:05.371323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.377387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.377884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.380938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.386919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.387447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.387902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.412253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:05.440810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37a5843c-4c97-44d3-8bfb-12600442ba1e tempest-ServicesAdminTestJSON-984563715 tempest-ServicesAdminTestJSON-984563715-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.073125 Aug 27 03:13:05.442284 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 781/1570] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:05.463809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.472740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 37b5437b-bc51-497e-9dd8-f29576d43dab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:05.489259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.493883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.494741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.496811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.497464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.499380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.530694 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance 37b5437b-bc51-497e-9dd8-f29576d43dab could not be found. Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab HTTP/1.1 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 37b5437b-bc51-497e-9dd8-f29576d43dab could not be found. Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '37b5437b-bc51-497e-9dd8-f29576d43dab'} Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b5437b-bc51-497e-9dd8-f29576d43dab could not be found. Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b5437b-bc51-497e-9dd8-f29576d43dab could not be found. Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:05.534604 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:05.539556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:05.539556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:05.539556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:05.539556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:05.539556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:05.539556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b5437b-bc51-497e-9dd8-f29576d43dab could not be found. Aug 27 03:13:05.539556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:05.552644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance 37b5437b-bc51-497e-9dd8-f29576d43dab could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:05.554967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4343193d-39f7-4c43-9e9f-512c88abd74d tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab" status: 404 len: 111 microversion: 2.1 time: 0.095405 Aug 27 03:13:05.559808 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 782/1571] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/servers/37b5437b-bc51-497e-9dd8-f29576d43dab => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:05.568799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b79c664-8bce-4545-9bf1-539866154a70 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.635882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:05.639238 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b79c664-8bce-4545-9bf1-539866154a70 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/fc4e2058-4f1f-46af-9394-dd13393d7437" status: 204 len: 0 microversion: 2.1 time: 0.074671 Aug 27 03:13:05.640301 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 783/1572] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:13:05 2022] DELETE /compute/v2.1/os-server-groups/fc4e2058-4f1f-46af-9394-dd13393d7437 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:05.645266 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8cc0556-3657-43a5-ab85-938e6c8fe530 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 0.315016 Aug 27 03:13:05.652644 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 790/1573] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:05.658324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.660545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:05.676924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.678409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.679475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.680715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.681539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.682452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.689992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.691716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:05.718004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:05.735783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.736823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.737438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.739284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.741078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.741700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.780621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:05.785519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:06.015600 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25124dc5-2022-4e17-97e5-0e8622d91655 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 204 len: 0 microversion: 2.1 time: 0.349407 Aug 27 03:13:06.017097 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 791/1574] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:05 2022] DELETE /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:06.028223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1861563662"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:06.033610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.042642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.043268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.044015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.044973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.054304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.055041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.172421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:06.187999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0102541f-2adc-4482-a863-56beafca65da tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 0.537933 Aug 27 03:13:06.188808 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 784/1575] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:06.213517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:06.221394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] [instance: acd3b4a0-b115-4688-af4f-27f15a0eaea0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.266975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.271471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.272899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.278383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.283786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.286190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.351895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] HTTP exception thrown: Instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 could not be found. Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Request method failure captured: Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 HTTP/1.1 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYr2348S2yMZt4mmygvV1VdWt0xjSnBQY11qAgme-XzijCncfxU1E2N6iVT-MJVHldVfovzMTqhDUXgDp7t71bIGSiZJdl11B7JR7jnWGRBUZEPqbmjvblapx3xshBX4RArRQ_bEOs_73cTIVG7C2YWCsZT51eQzkow8nRHX99YSB_g Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 82ec502ce3cc43bb969abf2fa3637591 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdminTestJSON-464158226 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/82ec502ce3cc43bb969abf2fa3637591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82ec502ce3cc43bb969abf2fa3637591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_82ec502ce3cc43bb969abf2fa3637591", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82ec502ce3cc43bb969abf2fa3637591"}]}] Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdminTestJSON-464158226 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 82ec502ce3cc43bb969abf2fa3637591 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdminTestJSON-464158226 Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdminTestJSON-464158226-project Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 1150c8244e514ef098f87f12f04f964b Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdminTestJSON-464158226-project Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 could not be found. Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'acd3b4a0-b115-4688-af4f-27f15a0eaea0'} Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 could not be found. Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 could not be found. Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:06.355184 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 could not be found. Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] Returning 404 to user: Instance acd3b4a0-b115-4688-af4f-27f15a0eaea0 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:06.368779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-75190a7b-9f7e-42d2-a339-618c8e25a327 tempest-ServersAdminTestJSON-464158226 tempest-ServersAdminTestJSON-464158226-project] 10.222.0.69 "GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0" status: 404 len: 111 microversion: 2.1 time: 0.175863 Aug 27 03:13:06.378798 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 785/1576] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:06 2022] GET /compute/v2.1/servers/acd3b4a0-b115-4688-af4f-27f15a0eaea0 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:06.389332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:06.390214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.404745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.406336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.407966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.409671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.412553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.418223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.491861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:06.612306 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5d719674-d491-4a3f-a107-8930a35fb1b5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action" status: 202 len: 0 microversion: 2.1 time: 0.590747 Aug 27 03:13:06.616492 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 792/1577] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:13:06 2022] POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:13:06.628138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:06.633628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.658693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.659261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.659769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.660673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.661368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.661813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.713112 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-63425cd2-e82c-4177-a4c0-fda92d92988f tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 204 len: 0 microversion: 2.1 time: 0.331198 Aug 27 03:13:06.716686 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 786/1578] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:06 2022] DELETE /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:06.736150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-646991024"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:06.757891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.774998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.776733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.778216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.781181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.783295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.788431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.861872 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Cannot 'createImage' instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 while it is in task_state image_snapshot_pending Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action HTTP/1.1 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 84 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-646991024"}} Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: exception: Cannot 'createImage' instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 while it is in task_state image_snapshot_pending Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f2487156-8dfd-40a2-ac84-3bd6325a4c45', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-646991024'}}} Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:13:06.869966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 while it is in task_state image_snapshot_pending Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 while it is in task_state image_snapshot_pending Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 409 to user: Cannot 'createImage' instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 while it is in task_state image_snapshot_pending {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:06.885408 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e5ea499-7a91-4027-b699-6624bac9ce38 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action" status: 409 len: 167 microversion: 2.1 time: 0.159057 Aug 27 03:13:06.890206 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 787/1579] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:13:06 2022] POST /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45/action => generated 167 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:13:06.899684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:06.901120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:06.922399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.923358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.924225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.925602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.926860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.928339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.232777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:07.261228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:07.265515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:07.269120 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77876b20-29ce-4dd0-bc60-6a298590057c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.650927 Aug 27 03:13:07.288281 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 793/1580] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:06 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:07.304856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d31a7cd4-c929-4efc-862a-20893e8174a3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '.version_select at 0x7fe460306040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:07.565212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:07.585244 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c892424a-afbe-46a8-8e6a-a4273c14e92b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 200 len: 1473 microversion: 2.1 time: 0.692274 Aug 27 03:13:07.587713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 788/1581] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:06 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 1473 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:07.633046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:07.634214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:07.642684 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d31a7cd4-c929-4efc-862a-20893e8174a3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/images/50ba80b2-b5de-4617-b592-e09203648b80" status: 204 len: 0 microversion: 2.1 time: 0.352827 Aug 27 03:13:07.643726 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 794/1582] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:07 2022] DELETE /compute/v2.1/images/50ba80b2-b5de-4617-b592-e09203648b80 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:07.656415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:07.662097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:07.662384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.662826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.663271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.664007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.664478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.664910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.676639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.677184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.677634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.678429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.679211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.679666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.023929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.032392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.035831 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b15dd13d-a89e-4f18-bac7-d9524a167062 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1541 microversion: 2.1 time: 0.384551 Aug 27 03:13:08.038214 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 795/1583] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:07 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1541 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:08.045339 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfa170f7-e38f-405f-ae3f-ef65280c0594 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 0.454778 Aug 27 03:13:08.047054 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 789/1584] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:07 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:08.303788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:08.305274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:08.340977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.343698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.345700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.350290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.351768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.352896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.622039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:08.625231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:08.641757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.642546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.643439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.645513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.646492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.648025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.806290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.822774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.824335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.826420 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6099e2cd-3b4a-4216-8a72-ee2dcfe26a51 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.529692 Aug 27 03:13:08.827677 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 796/1585] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:08 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:08.953019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.963592 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-29a0c5a7-ec7d-4a9f-8a44-3f6f596c1999 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 200 len: 1473 microversion: 2.1 time: 0.353419 Aug 27 03:13:08.968444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 790/1586] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:08 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:09.071038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:09.071771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:09.081738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:09.082581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:09.086202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.086957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.088794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.090830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.091351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.091786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.096954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.097686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.099846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.100749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.101932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.103179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.365624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:09.378558 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b7ab19b-8df7-47d9-a290-6c1cfea2dafc tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1541 microversion: 2.1 time: 0.312936 Aug 27 03:13:09.379483 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 797/1587] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:09 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1541 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:09.386536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1008676118", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "655a672b-ef82-4899-9c13-394c711ba155"}], "security_groups": [{"name": "tempest-securitygroup--1418540007"}], "key_name": "tempest-keypair-1939888622", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:09.406134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:09.423338 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3aed2c3-338a-4221-8698-39285c1dc5b1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 0.345505 Aug 27 03:13:09.424309 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 791/1588] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:09 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:09.547913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] validate_networks() for [('655a672b-ef82-4899-9c13-394c711ba155', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:13:09.864176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:09.866373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:09.874245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.875046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.875686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:09.876424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:09.877051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:09.877634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.081708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:10.095294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:10.097253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:10.099370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a05ac6b9-315a-44ef-817c-0cc037b62748 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.238548 Aug 27 03:13:10.114201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 792/1589] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:09 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:10.139508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:10.143541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:10.180105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.180747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.181463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.182570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.183711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.187882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.642883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:10.648607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:10.677375 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b48f96c2-977b-4a18-8bf1-7e430e47b59c tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 200 len: 1473 microversion: 2.1 time: 0.570691 Aug 27 03:13:10.681503 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 793/1590] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:10 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 1473 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:10.720947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:10.722773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:10.741007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.743213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.744647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.748109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.750295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.751716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.260436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Getting quotas for project 169bb4af498e4606b896ea4d711b9d12. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:11.296474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Getting quotas for user c093521eb52f431eaac1c2ab229092ef and project 169bb4af498e4606b896ea4d711b9d12. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:11.360538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:13:11.360966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:13:11.361443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:13:11.361854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:13:11.365841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:13:11.430995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.431441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.432813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.433605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.442008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.443137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.521605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Getting quotas for project 169bb4af498e4606b896ea4d711b9d12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:11.544919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Getting quotas for user c093521eb52f431eaac1c2ab229092ef and project 169bb4af498e4606b896ea4d711b9d12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:11.590876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:13:11.598329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:13:11.746052 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e588282-e5f0-40d7-b5ce-ad8487af95f8 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.364112 Aug 27 03:13:11.757810 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 798/1591] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:13:09 2022] POST /compute/v2.1/servers => generated 407 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:13:11.767687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:11.775523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:11.788930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.791760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.794123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.798052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.799091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.799778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.573916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:12.642127 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3044c9bf-6cba-4c4b-823d-7bef1a4dfe9d tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1533 microversion: 2.1 time: 1.953860 Aug 27 03:13:12.666390 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 794/1592] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:10 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1533 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:12.688636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:12.692241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:12.728594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.730916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.733616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.735632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.742700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.747420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.411639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:13.428238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3dbaafa-9114-4c35-95ac-2dcde7d70364 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 1.667210 Aug 27 03:13:13.444871 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 799/1593] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:11 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:13.450786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:13.459196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:13.497423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.499033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.499616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.503304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.503887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.505992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.662992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:13.676580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:13.691269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:13.693871 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-678e005c-b9bd-4b25-8b0c-89fd51f61bfa tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 1.021806 Aug 27 03:13:13.709244 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 795/1594] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:12 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:13.716912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:13.720108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:13.744127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.759882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.764610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.765996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.768451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.769142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.772876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.773759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.785208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.786283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lazy-loading 'fault' on Instance uuid 65bc4962-c5bb-4892-9540-3e657d0b2a54 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:13.922613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:13.979167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:14.026805 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdb0b1aa-b270-4622-8f4b-759d2ceeda88 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 200 len: 1308 microversion: 2.1 time: 0.580642 Aug 27 03:13:14.034686 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 800/1595] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:13 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 1308 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:14.059557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3e7b67ab-58b0-4300-9c1e-3cb4630b75b5 req-6aa2f813-5974-48a6-9f77-ec56d66586b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496e039-42a3-469e-b6c9-8b6539bcff34", "name": "network-vif-deleted", "tag": "48335665-e640-480f-bd82-a959289c828f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:14.064586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:14.099369 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e28cd428-fbde-477c-bfec-24e6b338fbc6 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1274 microversion: 2.1 time: 0.392478 Aug 27 03:13:14.101142 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 796/1596] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:13 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1274 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:14.111815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e12d2f51-98f4-49e7-9704-0c17a5d70d6f req-2bbf6a91-ef67-4b76-b057-35c1bf379a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65bc4962-c5bb-4892-9540-3e657d0b2a54", "name": "network-vif-deleted", "tag": "4215d1f8-9911-4f91-8d07-2d6aa16d23e7"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:14.119589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e7b67ab-58b0-4300-9c1e-3cb4630b75b5 req-6aa2f813-5974-48a6-9f77-ec56d66586b1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.123230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e7b67ab-58b0-4300-9c1e-3cb4630b75b5 req-6aa2f813-5974-48a6-9f77-ec56d66586b1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.124650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3e7b67ab-58b0-4300-9c1e-3cb4630b75b5 req-6aa2f813-5974-48a6-9f77-ec56d66586b1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.185232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e12d2f51-98f4-49e7-9704-0c17a5d70d6f req-2bbf6a91-ef67-4b76-b057-35c1bf379a3b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.185982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e12d2f51-98f4-49e7-9704-0c17a5d70d6f req-2bbf6a91-ef67-4b76-b057-35c1bf379a3b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.186709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e12d2f51-98f4-49e7-9704-0c17a5d70d6f req-2bbf6a91-ef67-4b76-b057-35c1bf379a3b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.189739 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3e7b67ab-58b0-4300-9c1e-3cb4630b75b5 req-6aa2f813-5974-48a6-9f77-ec56d66586b1 service nova] Creating event network-vif-deleted:48335665-e640-480f-bd82-a959289c828f for instance 1496e039-42a3-469e-b6c9-8b6539bcff34 on n-h2-852086-5 Aug 27 03:13:14.204899 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3e7b67ab-58b0-4300-9c1e-3cb4630b75b5 req-6aa2f813-5974-48a6-9f77-ec56d66586b1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165730 Aug 27 03:13:14.213501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 801/1597] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:14.236897 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e12d2f51-98f4-49e7-9704-0c17a5d70d6f req-2bbf6a91-ef67-4b76-b057-35c1bf379a3b service nova] Creating event network-vif-deleted:4215d1f8-9911-4f91-8d07-2d6aa16d23e7 for instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 on n-h2-852086-5 Aug 27 03:13:14.262469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:14.274610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:14.284639 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e12d2f51-98f4-49e7-9704-0c17a5d70d6f req-2bbf6a91-ef67-4b76-b057-35c1bf379a3b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180126 Aug 27 03:13:14.292513 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 797/1598] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:14.318986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.329265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.345717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.347930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:14.361636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:14.374895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.668611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-8602197", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:14.840236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:13:15.106035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:15.116680 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73dbebfb-814e-4df0-b5e9-3a498e4d5d94 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1539 microversion: 2.1 time: 0.898714 Aug 27 03:13:15.130961 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 802/1599] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:14 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1539 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:15.148191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:15.156841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:15.173123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.174022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.174762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.175834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.178269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.179069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.404170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:15.447342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:13:15.448741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:13:15.449916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:13:15.453197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:13:15.454308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:13:15.519200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.521305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.523553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.572579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.573534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.579958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.672040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Getting quotas for project 1cf788bbf414414d9a169a637f0e6cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:15.692029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Getting quotas for user ebee10484abe4e07a03835a0472c42ef and project 1cf788bbf414414d9a169a637f0e6cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:15.731121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:13:15.737125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:13:15.846917 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-720a6199-c771-454f-b255-12a297cee181 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552156 Aug 27 03:13:15.849953 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 798/1600] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:13:15.863353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:15.865750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:15.880643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.881435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.882439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.883391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.884033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.884637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.152672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.168654 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-890d89e6-8e4c-4b25-b5c7-fc384f84f69b tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 1.035836 Aug 27 03:13:16.169287 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 803/1601] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:15 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:16.185533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:16.186078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 65bc4962-c5bb-4892-9540-3e657d0b2a54] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:16.217695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.218250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.218706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.221246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.221649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.222092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.257171 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 could not be found. Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 HTTP/1.1 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 could not be found. Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '65bc4962-c5bb-4892-9540-3e657d0b2a54'} Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 could not be found. Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 could not be found. Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:16.258907 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 could not be found. Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance 65bc4962-c5bb-4892-9540-3e657d0b2a54 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:16.263421 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e2f0ce2-f294-4de0-b753-56a62e7652ed tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54" status: 404 len: 111 microversion: 2.1 time: 0.088006 Aug 27 03:13:16.271237 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 804/1602] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:16 2022] GET /compute/v2.1/servers/65bc4962-c5bb-4892-9540-3e657d0b2a54 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:16.284015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:16.295222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:16.304362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.304870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.305314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.306038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.306529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.306960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.523373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.538523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.541873 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5c5f6b0-1314-41c9-ac11-5c73121a8f3f tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1328 microversion: 2.1 time: 0.267152 Aug 27 03:13:16.543375 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 805/1603] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:16 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1328 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:16.553626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d7db1b0-9a13-4768-a1c5-72f70b93586a tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:16.555743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d7db1b0-9a13-4768-a1c5-72f70b93586a tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:16.598914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.602094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.610131 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-61d1800c-6802-4339-beb7-c8429ce32cbd tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.756306 Aug 27 03:13:16.613923 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 799/1604] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:15 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:16.650688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:16.651818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:16.665304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.678405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.680829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.683223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.683979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.690451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.704745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d7db1b0-9a13-4768-a1c5-72f70b93586a tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.717812 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d7db1b0-9a13-4768-a1c5-72f70b93586a tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1211 microversion: 2.1 time: 0.170400 Aug 27 03:13:16.720155 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 806/1605] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:16 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:16.736330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:16.743076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: 1496e039-42a3-469e-b6c9-8b6539bcff34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:16.767243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.772619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.773155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.776236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.777280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.780451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.817165 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance 1496e039-42a3-469e-b6c9-8b6539bcff34 could not be found. Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 HTTP/1.1 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 1496e039-42a3-469e-b6c9-8b6539bcff34 could not be found. Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1496e039-42a3-469e-b6c9-8b6539bcff34'} Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1496e039-42a3-469e-b6c9-8b6539bcff34 could not be found. Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1496e039-42a3-469e-b6c9-8b6539bcff34 could not be found. Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:16.824143 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.832349 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:16.832349 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:16.832349 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:16.832349 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:16.832349 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:16.832349 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1496e039-42a3-469e-b6c9-8b6539bcff34 could not be found. Aug 27 03:13:16.832349 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:16.838483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance 1496e039-42a3-469e-b6c9-8b6539bcff34 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:16.840079 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3d1cc6f-7a2b-426b-9545-32171bfec69b tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34" status: 404 len: 111 microversion: 2.1 time: 0.118575 Aug 27 03:13:16.841529 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 807/1606] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:16 2022] GET /compute/v2.1/servers/1496e039-42a3-469e-b6c9-8b6539bcff34 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:16.858369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e8712457-0812-4b5f-a697-a666c0ea0bba req-255926c8-a5ce-4ef7-bcbb-5ba6db4ee165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607b043e-1bab-4c1d-8348-610a19b23bfa", "name": "network-vif-unplugged", "status": "completed", "tag": "01d2411e-6250-4e8c-bc59-812d60bccff5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:16.877779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e8712457-0812-4b5f-a697-a666c0ea0bba req-255926c8-a5ce-4ef7-bcbb-5ba6db4ee165 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.878636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e8712457-0812-4b5f-a697-a666c0ea0bba req-255926c8-a5ce-4ef7-bcbb-5ba6db4ee165 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.879231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e8712457-0812-4b5f-a697-a666c0ea0bba req-255926c8-a5ce-4ef7-bcbb-5ba6db4ee165 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.925813 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e8712457-0812-4b5f-a697-a666c0ea0bba req-255926c8-a5ce-4ef7-bcbb-5ba6db4ee165 service nova] Creating event network-vif-unplugged:01d2411e-6250-4e8c-bc59-812d60bccff5 for instance 607b043e-1bab-4c1d-8348-610a19b23bfa on n-h1-852086-5 Aug 27 03:13:16.940511 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e8712457-0812-4b5f-a697-a666c0ea0bba req-255926c8-a5ce-4ef7-bcbb-5ba6db4ee165 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092858 Aug 27 03:13:16.948219 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 808/1607] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:16.957321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c4d3dfd-8015-4679-ab8c-a37f78d530bc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:17.010810 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c4d3dfd-8015-4679-ab8c-a37f78d530bc tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/a44222a2-5c52-4d8c-a3fc-2cd318d4cca8" status: 204 len: 0 microversion: 2.1 time: 0.060106 Aug 27 03:13:17.013551 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 809/1608] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:13:16 2022] DELETE /compute/v2.1/os-server-groups/a44222a2-5c52-4d8c-a3fc-2cd318d4cca8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:17.038064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:17.039077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:17.062920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.063465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.079140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.084992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.086470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.088848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.143209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:17.176064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:17.371601 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c240f3b-67a0-4fb2-8272-28678a177a1a tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 204 len: 0 microversion: 2.1 time: 0.353519 Aug 27 03:13:17.372537 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 810/1609] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:17 2022] DELETE /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:17.385613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:17.385613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:17.397498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.400043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.401205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.404862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.404862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.406210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.743455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:17.766578 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d500b77b-e3e8-46ba-a74c-b692dd354097 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 0.392164 Aug 27 03:13:17.768405 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 811/1610] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:17 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:17.776886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:17.778415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:17.797973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.798511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.798957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.799748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.800218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.800655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.856654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:17.875113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc03ef73-0676-4a56-ac85-0855d7958520 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1521 microversion: 2.1 time: 1.259198 Aug 27 03:13:17.876036 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 800/1611] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:16 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1521 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:17.882530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:17.883452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:17.904110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.905165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.905795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.907014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.907659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.908315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.129248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:18.147424 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-881fe1a1-ad39-4146-9c3f-2cdaf0bda45a tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1328 microversion: 2.1 time: 0.269804 Aug 27 03:13:18.148141 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 801/1612] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:17 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1328 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:18.169604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:18.173565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:18.196055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.196969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.197713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.199015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.199821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.200551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.223095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:18.245952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d94cd159-3d6b-4ec3-b4b0-68601f9df912 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1472 microversion: 2.1 time: 0.475406 Aug 27 03:13:18.260776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 812/1613] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:17 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:18.288027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:18.289065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:18.311752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.312569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.313375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.314598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.315366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.316106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.446546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:18.461794 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d7c2d36-bd6d-4064-a2ad-300cbf1ffe52 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1207 microversion: 2.1 time: 0.199068 Aug 27 03:13:18.463023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 813/1614] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:18 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1207 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:18.468437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:18.468944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:18.477581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.477955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.478539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.479239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.479709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.480343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.541911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:18.806555 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a986f36-3f75-4960-ad2a-eb2745315c3f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 204 len: 0 microversion: 2.1 time: 0.337658 Aug 27 03:13:18.813010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 814/1615] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:18 2022] DELETE /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:18.822058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:18.822954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:18.830879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.831509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.833073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.834342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:18.834891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:18.835533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.187753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.201099 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-198ea6c2-7cdf-40d9-85d7-ef2f59fbf002 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 0.385234 Aug 27 03:13:19.202262 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 815/1616] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:18 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:19.211526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:19.212308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:19.222802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:19.227085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.228290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.228693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.229998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.230915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.231680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.494315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.510577 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f6dab97-bca3-4eda-b32f-f9b0750098af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1527 microversion: 2.1 time: 0.306239 Aug 27 03:13:19.512134 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 816/1617] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:19 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1527 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:19.529046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0277ec6b-1dae-4a20-bda7-68081633047c req-a59100ab-3a2c-414f-879e-53806a94a8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "607b043e-1bab-4c1d-8348-610a19b23bfa", "tag": "01d2411e-6250-4e8c-bc59-812d60bccff5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:19.553667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0277ec6b-1dae-4a20-bda7-68081633047c req-a59100ab-3a2c-414f-879e-53806a94a8bb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.554585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0277ec6b-1dae-4a20-bda7-68081633047c req-a59100ab-3a2c-414f-879e-53806a94a8bb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.555390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0277ec6b-1dae-4a20-bda7-68081633047c req-a59100ab-3a2c-414f-879e-53806a94a8bb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.581261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0277ec6b-1dae-4a20-bda7-68081633047c req-a59100ab-3a2c-414f-879e-53806a94a8bb service nova] Creating event network-changed:01d2411e-6250-4e8c-bc59-812d60bccff5 for instance 607b043e-1bab-4c1d-8348-610a19b23bfa on n-h1-852086-5 Aug 27 03:13:19.590894 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0277ec6b-1dae-4a20-bda7-68081633047c req-a59100ab-3a2c-414f-879e-53806a94a8bb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074381 Aug 27 03:13:19.592145 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 817/1618] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:19.601895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:19.603690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:19.617026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.618265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.619320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.620969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.622118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.623191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.733462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.745444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.746971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.748836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab38b84d-cf85-4832-b95c-1f51be053766 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 1.585004 Aug 27 03:13:19.750016 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 802/1619] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:18 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:19.756054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:19.757072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:19.764009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.764931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.765651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.767000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.767763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.768454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.775109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.784325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6057e9f-09d9-4b5c-9e70-069201f21527 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1328 microversion: 2.1 time: 0.190555 Aug 27 03:13:19.785317 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 818/1620] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:19 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1328 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:19.790478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:19.791123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:19.797804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.798350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.798808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.799565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.800038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.800476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.921865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.935264 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b56b4ccc-6af4-48e8-8c5a-fdbffc3b3cb3 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1207 microversion: 2.1 time: 0.148556 Aug 27 03:13:19.947780 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 819/1621] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:19 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1207 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:20.235028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:20.235701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:20.243817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.244379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.244839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:20.245588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.246057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.246514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:20.450139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:20.469770 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e7acc76-baf5-4502-af20-b662b6eb7af8 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1472 microversion: 2.1 time: 0.717579 Aug 27 03:13:20.471246 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 803/1622] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:19 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1472 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:20.549594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:20.557219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:20.569677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.571662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.584460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:20.587635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.591217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.592289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:20.907632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:20.937819 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9719127-3f29-4d34-bbcb-8c1f1ee1527e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1476 microversion: 2.1 time: 0.707092 Aug 27 03:13:20.940691 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 820/1623] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:20 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1476 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:20.953464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:20.954382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:20.976135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.977048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.977720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:20.978891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.979619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.980267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:21.484431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:21.559280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:21.569260 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-240572a0-999d-48c4-81b5-93a883db9c84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1527 microversion: 2.1 time: 1.025718 Aug 27 03:13:21.584831 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 804/1624] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:20 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1527 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:21.607789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:21.608706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:21.628193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:21.628983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:21.631631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:21.632708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:21.635068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:21.636099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:22.085292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:22.130502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:22.136512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:22.146854 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ec6acb2-44c1-42a8-b6a2-41c966842b55 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 1.197859 Aug 27 03:13:22.152533 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 821/1625] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:20 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:22.164697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:22.166723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:22.180819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:22.182226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:22.183403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:22.185356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:22.186779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:22.187862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:22.412903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:22.427809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7874c5b8-b8e9-4562-9b73-e62f808d2005 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.839661 Aug 27 03:13:22.429850 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 805/1626] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:21 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:22.487868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:22.488632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:22.527134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:22.527905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:22.528499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:22.532094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:22.532802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:22.533411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:22.737099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:22.806596 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18f02288-14eb-4c1b-a96c-e53e493a4b13 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1207 microversion: 2.1 time: 0.651721 Aug 27 03:13:22.807640 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 822/1627] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:22 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1207 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:22.838004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:22.839837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:22.875562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:22.878068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:22.880265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:22.881958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:22.883530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:22.885094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:23.411298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:23.425251 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68fb3161-70de-4113-9353-8240283c7766 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1475 microversion: 2.1 time: 0.611053 Aug 27 03:13:23.425769 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 823/1628] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:22 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1475 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:23.444289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:23.445829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:23.459612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:23.460251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:23.460808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:23.461555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:23.471447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:23.471979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:23.609996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:23.632765 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35cc95c5-6219-43ae-8804-d6d329452a61 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1472 microversion: 2.1 time: 1.187466 Aug 27 03:13:23.639162 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 806/1629] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:22 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1472 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:23.646791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:23.647882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:23.661192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:23.662076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:23.662949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:23.679573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:23.689656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:23.690341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:24.216144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:24.244218 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7253112a-c3ac-4297-801e-67f32873d339 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1527 microversion: 2.1 time: 0.817282 Aug 27 03:13:24.251792 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 824/1630] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:23 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1527 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:24.257990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:24.262706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:24.275821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:24.276467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:24.277225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:24.279074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:24.280473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:24.281197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:24.312126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:24.768966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:24.783669 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5583e3e-0a44-4942-aa78-1dd61b94d4b2 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.530377 Aug 27 03:13:24.794901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 825/1631] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:24 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:24.807078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:24.809633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:24.828956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:24.829779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:24.830433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:24.831388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:24.832053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:24.832703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.017639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:25.044162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:25.046635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:25.049097 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bdc50e27-e353-4b67-9548-bf494a591dee tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 1.407265 Aug 27 03:13:25.051014 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 807/1632] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:23 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:25.058711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:25.060148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:25.090482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.091461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.093656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.095356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.101712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.102483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.185185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:25.203693 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a7f55fd-62b6-41cb-b276-c9a324bb8950 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1271 microversion: 2.1 time: 0.407409 Aug 27 03:13:25.213879 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 826/1633] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:24 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1271 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:25.244022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-08fe5cb8-4e7d-4bed-9b8b-09ea792334f5 req-f66191ed-62da-4377-9a52-090a42518b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "name": "network-vif-unplugged", "status": "completed", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:25.277584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-08fe5cb8-4e7d-4bed-9b8b-09ea792334f5 req-f66191ed-62da-4377-9a52-090a42518b83 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.286945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-08fe5cb8-4e7d-4bed-9b8b-09ea792334f5 req-f66191ed-62da-4377-9a52-090a42518b83 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.288173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-08fe5cb8-4e7d-4bed-9b8b-09ea792334f5 req-f66191ed-62da-4377-9a52-090a42518b83 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.312616 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-08fe5cb8-4e7d-4bed-9b8b-09ea792334f5 req-f66191ed-62da-4377-9a52-090a42518b83 service nova] Creating event network-vif-unplugged:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h2-852086-5 Aug 27 03:13:25.324851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-08fe5cb8-4e7d-4bed-9b8b-09ea792334f5 req-f66191ed-62da-4377-9a52-090a42518b83 service nova] Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:13:25.360883 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-08fe5cb8-4e7d-4bed-9b8b-09ea792334f5 req-f66191ed-62da-4377-9a52-090a42518b83 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144326 Aug 27 03:13:25.363023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 827/1634] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:25.382625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:25.384195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:25.391536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.392038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.392480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.393336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.393845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.394271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.635119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:25.693031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:25.705621 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5774e5d-d07c-4d7a-ae3e-78c4943f88d4 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1475 microversion: 2.1 time: 0.652617 Aug 27 03:13:25.718660 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 808/1635] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:25 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1475 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:25.722448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:25.723257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:25.724421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:25.741407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:25.751849 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-896f2aad-6ffd-43d3-98c1-05b6747abfb5 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1430 microversion: 2.1 time: 0.386635 Aug 27 03:13:25.754188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.754818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.755449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.756184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.763112 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 828/1636] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:25 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1430 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:25.763668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.764164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.809159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:25.809783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:25.828622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.829127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.829568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.830352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.830818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.831250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.921459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:25.922025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:25.933752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:25.934337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lazy-loading 'fault' on Instance uuid f2487156-8dfd-40a2-ac84-3bd6325a4c45 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:26.110859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:26.141454 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a3ba03eb-49ff-4b2f-a9e4-22dda5a89bb8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 200 len: 1315 microversion: 2.1 time: 0.428385 Aug 27 03:13:26.142363 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 809/1637] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:25 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:26.164920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b7a51032-f907-4d38-b9b8-5449864ef844 req-c85f276c-45ac-43f0-9aed-69fe6ed73534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9", "name": "network-vif-deleted", "tag": "0eecd510-c530-4560-b0bd-4b7338ca22be"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:26.202369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b7a51032-f907-4d38-b9b8-5449864ef844 req-c85f276c-45ac-43f0-9aed-69fe6ed73534 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:26.202892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b7a51032-f907-4d38-b9b8-5449864ef844 req-c85f276c-45ac-43f0-9aed-69fe6ed73534 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:26.203337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b7a51032-f907-4d38-b9b8-5449864ef844 req-c85f276c-45ac-43f0-9aed-69fe6ed73534 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:26.246343 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b7a51032-f907-4d38-b9b8-5449864ef844 req-c85f276c-45ac-43f0-9aed-69fe6ed73534 service nova] Creating event network-vif-deleted:0eecd510-c530-4560-b0bd-4b7338ca22be for instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 on n-h2-852086-5 Aug 27 03:13:26.264690 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b7a51032-f907-4d38-b9b8-5449864ef844 req-c85f276c-45ac-43f0-9aed-69fe6ed73534 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120315 Aug 27 03:13:26.269566 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 810/1638] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:26.294770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:26.295746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:26.313208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:26.316066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:26.321350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:26.322451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:26.323296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:26.323906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:26.559661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:26.574566 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7dffe6c-244f-48b4-81a1-cc22500c3f91 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.769176 Aug 27 03:13:26.581571 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 829/1639] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:25 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:26.617757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:26.618511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:26.629865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:26.632394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:26.635675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:26.641078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:26.642039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:26.642724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:26.720871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:27.051218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:27.079221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:27.087276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cd907ae-7154-45df-88e7-9799ea88251b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1269 microversion: 2.1 time: 0.480463 Aug 27 03:13:27.113762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:27.115376 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 830/1640] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:26 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1269 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:27.120293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:27.124113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f87ed445-3228-4a3c-b71c-17e0ff52155d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.849581 Aug 27 03:13:27.124942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:27.126122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 811/1641] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:26 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:27.126893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:27.141240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:27.146908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.148081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:27.155943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.157599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.160281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.165861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.167106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.174202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.178835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.183210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.186875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.189688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.191204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.252254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:27.291740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.292475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.293131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.293754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lazy-loading 'fault' on Instance uuid a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:27.378649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8803ca2433cb474392f803e913c5d783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587c41ae3469462b8099222b2bb2a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:27.397413 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e54c2bc9-506e-4f9e-b78f-b2b35c884f84 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 200 len: 1307 microversion: 2.1 time: 0.262258 Aug 27 03:13:27.409528 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 812/1642] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:27 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:27.445879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:27.446598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:27.463471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.464000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.464518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.466690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.467236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.467683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.492282 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 HTTP/1.1 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f2487156-8dfd-40a2-ac84-3bd6325a4c45'} Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:27.494661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:27.499186 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-71427dfa-f4c8-4852-bf45-181a1056a383 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 404 len: 111 microversion: 2.1 time: 0.083720 Aug 27 03:13:27.504964 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 813/1643] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:27 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:27.517589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0555aa49-4138-4a64-9dc3-f755bdd271d0 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'create', calling method: .version_select at 0x7fe457cae040>, body: {"keypair": {"name": "tempest-keypair-1082375641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1iVyp77D1Sz2ZEQGQ5Mrcw2BBDg68Tbdde14qYfaRZ55HAE+O4Bboxapl9a/hZENBLxDrR1dOx7rOAa7VBsxME+Tp9TRwZ6k+ZfWW2cBbQ4MWCbtvMcfS0l0xLXJ0Wgg=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:27.527290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:27.532970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:27.544988 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65968a2b-4e51-4ea9-90f0-39ae66fb5fa7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1475 microversion: 2.1 time: 0.428097 Aug 27 03:13:27.545519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0555aa49-4138-4a64-9dc3-f755bdd271d0 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for project 3372b4747f714009ad9a04a488019e78. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:27.554234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0555aa49-4138-4a64-9dc3-f755bdd271d0 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for user 7268918710454b128eaa3621f708efb9 and project 3372b4747f714009ad9a04a488019e78. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:27.554703 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 831/1644] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:27 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1475 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:27.606671 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0555aa49-4138-4a64-9dc3-f755bdd271d0 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099775 Aug 27 03:13:27.607617 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 814/1645] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:13:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:27.613301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:27.614101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:27.620460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.621084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.621528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.622275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.622729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.623153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.678260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2487156-8dfd-40a2-ac84-3bd6325a4c45", "name": "network-vif-deleted", "tag": "0e3bcf8b-0218-4f3b-9efe-366fb5a71f67"}, {"name": "network-changed", "server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:27.691817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:27.692347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:27.693533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:27.709365 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] Creating event network-vif-deleted:0e3bcf8b-0218-4f3b-9efe-366fb5a71f67 for instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 on n-h2-852086-5 Aug 27 03:13:27.711424 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] Creating event network-changed:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h2-852086-5 Aug 27 03:13:27.725997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:13:27.748391 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-43a18feb-d806-4c86-9fba-fc0697968240 req-da172530-8013-40cb-be40-3100a0a9c74c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076651 Aug 27 03:13:27.767165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 815/1646] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:13:28.109668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:28.110755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:28.117727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.118427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.118719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.119511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.120048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.120793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.216283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:28.233615 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3de5b502-cebd-40aa-9037-2f29db42927b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.624500 Aug 27 03:13:28.235747 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 832/1647] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:27 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:28.245842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:28.247186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:28.259296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.259824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.261534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.262655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.263179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.263793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.348356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:28.365071 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d507ed3-6c25-4654-afee-db14a5bbb3ac tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1269 microversion: 2.1 time: 0.258075 Aug 27 03:13:28.369275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 816/1648] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:28 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1269 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:28.377952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c36d6c1e-3fc0-45de-8a03-0d255dfe5e54 req-41fcae94-a69b-488a-b7df-b8502f2dec9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f233cfb6-a746-4919-b6cf-a694f07cfeba", "tag": "23046e60-7876-4073-85a0-4b1a400b8657"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:28.402554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c36d6c1e-3fc0-45de-8a03-0d255dfe5e54 req-41fcae94-a69b-488a-b7df-b8502f2dec9d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.403041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c36d6c1e-3fc0-45de-8a03-0d255dfe5e54 req-41fcae94-a69b-488a-b7df-b8502f2dec9d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.406098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c36d6c1e-3fc0-45de-8a03-0d255dfe5e54 req-41fcae94-a69b-488a-b7df-b8502f2dec9d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.424934 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c36d6c1e-3fc0-45de-8a03-0d255dfe5e54 req-41fcae94-a69b-488a-b7df-b8502f2dec9d service nova] Creating event network-changed:23046e60-7876-4073-85a0-4b1a400b8657 for instance f233cfb6-a746-4919-b6cf-a694f07cfeba on n-h1-852086-5 Aug 27 03:13:28.434334 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c36d6c1e-3fc0-45de-8a03-0d255dfe5e54 req-41fcae94-a69b-488a-b7df-b8502f2dec9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063077 Aug 27 03:13:28.435402 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 817/1649] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:28.440803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-292920103", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb"}], "block_device_mapping_v2": [{"uuid": "81dca977-6803-423c-98ac-33ba49823121", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:28.511648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:28.523429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:28.524902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] validate_networks() for [('1f0a9ea8-9454-40e0-bd04-2dfba3c49fcb', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:13:28.534731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:28.537299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0637765f-fded-452d-9f6a-78d663cee6d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.299261 Aug 27 03:13:28.538793 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 833/1650] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:28 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:28.543786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:28.549434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] [instance: a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:28.566304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.566790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.567244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.570744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.571205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.571635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.598925 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] HTTP exception thrown: Instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 could not be found. Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Request method failure captured: Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 HTTP/1.1 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYrp47nV394YZFLdBOq4Hzcb2jxP3CYinquNQMI2OS9ZH9Mk1Cv2ky87-Wxo_plajxyjYyjlS56A_T8HqNXwy1I5H9bCCeXbYdkytUrmB8gLRW01ddh0rLABoPXL1_o2TDgYdLRHEpcNVW5k49MB8gE-nC5RuT3bMAiuoojAPYKsGBI Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_587c41ae3469462b8099222b2bb2a278", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/587c41ae3469462b8099222b2bb2a278"}]}] Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 587c41ae3469462b8099222b2bb2a278 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-724590563 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8803ca2433cb474392f803e913c5d783 Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-724590563-project Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 could not be found. Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9'} Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 could not be found. Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 could not be found. Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:28.603083 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:28.607764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:28.607764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:28.607764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:28.607764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:28.607764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:28.607764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 could not be found. Aug 27 03:13:28.607764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:13:28.609767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] Returning 404 to user: Instance a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:28.611368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfb8c9f5-834d-42be-b00e-8978666d4766 tempest-ServersOnMultiNodesTest-724590563 tempest-ServersOnMultiNodesTest-724590563-project] 10.222.0.69 "GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9" status: 404 len: 111 microversion: 2.1 time: 0.071084 Aug 27 03:13:28.612537 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 834/1651] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:28 2022] GET /compute/v2.1/servers/a20b4f1b-4a52-49f0-8d69-1d567e0f4ef9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:28.632160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:28.636436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:28.649612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.650412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.652847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.654144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.657221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.658853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:29.174153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:29.214478 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed2d17a0-5867-4309-b567-0bf868d6d254 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1475 microversion: 2.1 time: 0.599940 Aug 27 03:13:29.231395 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 835/1652] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:28 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1475 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:29.260628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:29.262057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:29.298921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:29.300044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:29.300699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:29.303371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:29.303882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:29.304424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:29.898704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:29.921609 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9f0774a-4c51-4896-8dfe-8d4c0fa29fcd tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.668284 Aug 27 03:13:29.925138 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 836/1653] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:29 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:29.932543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:29.934136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:29.944330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:29.945142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:29.945755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:29.946844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:29.947487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:29.948087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.007574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:13:30.008622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:13:30.009442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:13:30.010404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:13:30.010404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:13:30.034134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.034659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.035106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.036456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.036886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.037325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.060048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:30.067965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Getting quotas for user 38c24c41cfbb4a1caea77801a0b3432d and project 5d5cbb2fd5214cf28f9b0964a8f1a4bf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:30.182226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:13:30.186845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81dca977-6803-423c-98ac-33ba49823121',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:13:30.336477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:30.354643 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5c71700-aab2-4e6d-ab04-a72964e5d144 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1311 microversion: 2.1 time: 0.426044 Aug 27 03:13:30.356392 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 837/1654] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:29 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1311 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:30.365448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:30.366187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:30.374865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.375653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.376666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.377828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.378435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.380767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.500009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30c5e343-6622-48be-b51e-27ba5fa02d0b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062997 Aug 27 03:13:30.501849 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 818/1655] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:13:30.511896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:30.513866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:30.527710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.528981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.531097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.533704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.534944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.536212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.678362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:30.694917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:30.696587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:30.707314 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e8dacb0-3d6c-4aee-8831-61ca080b3950 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.348857 Aug 27 03:13:30.727653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 838/1656] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:30 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:30.745251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45813287-8f61-453d-8cfa-5035f49b0d76 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:30.750129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45813287-8f61-453d-8cfa-5035f49b0d76 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:30.843174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45813287-8f61-453d-8cfa-5035f49b0d76 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:30.857077 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45813287-8f61-453d-8cfa-5035f49b0d76 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1052 microversion: 2.1 time: 0.125850 Aug 27 03:13:30.858463 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 839/1657] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:30 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1052 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:30.958552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:30.959754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:31.000135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:31.008423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:31.009101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:31.009886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:31.011623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:31.012038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:31.558515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:31.570942 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-36908b44-d8ab-474f-94b4-557631f19e02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1473 microversion: 2.1 time: 1.067346 Aug 27 03:13:31.572139 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 819/1658] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:30 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1473 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:31.576928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:31.577770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:31.585921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:31.586663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:31.587439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:31.588323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:31.589412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:31.590007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:31.899937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:31.912673 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4238e8e3-7dfa-4472-883f-adda1c1673b4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.962458 Aug 27 03:13:31.914345 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 840/1659] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:30 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:31.932129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:31.933947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:31.945436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:31.946416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:31.947247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:31.948298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:31.949207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:31.950104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.237547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:32.258879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-399c5f67-eb50-4790-b556-04915050c8bc tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1311 microversion: 2.1 time: 0.683335 Aug 27 03:13:32.259513 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 820/1660] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:31 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1311 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:32.267974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:32.268939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:32.275768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.276640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.277331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.278472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.279174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.279853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.411682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:32.434054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:32.441320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:32.443644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:32.447690 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b198702d-9616-4a2a-a8df-9ce46c285bd5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.531965 Aug 27 03:13:32.454902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-677ce1c2-30f3-4c17-9d44-0d9deda159ff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1150 microversion: 2.1 time: 0.191772 Aug 27 03:13:32.464964 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 821/1661] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:32 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1150 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:32.465400 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 841/1662] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:31 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:32.593055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:32.593668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:32.605460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.605970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.606515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.607737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.608231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.608659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.947733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:32.948379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:32.956927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.965863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.966541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.967465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.968149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.968744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.253420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:33.263583 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-770b4695-3351-4212-8e28-d4dd16ce0a01 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1470 microversion: 2.1 time: 0.674359 Aug 27 03:13:33.275393 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 822/1663] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:32 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1470 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:33.304955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3936ea85-e450-4f03-9317-d2f9e239f58e req-ce8fd9b9-148a-4842-86b9-bd704f4252d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0be9928-bcb0-43b0-9e81-6bdb4a893dec", "tag": "22d11f08-a2b6-454b-a038-38064a777790"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:33.326963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3936ea85-e450-4f03-9317-d2f9e239f58e req-ce8fd9b9-148a-4842-86b9-bd704f4252d1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.327445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3936ea85-e450-4f03-9317-d2f9e239f58e req-ce8fd9b9-148a-4842-86b9-bd704f4252d1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.327880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3936ea85-e450-4f03-9317-d2f9e239f58e req-ce8fd9b9-148a-4842-86b9-bd704f4252d1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.355764 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3936ea85-e450-4f03-9317-d2f9e239f58e req-ce8fd9b9-148a-4842-86b9-bd704f4252d1 service nova] Creating event network-changed:22d11f08-a2b6-454b-a038-38064a777790 for instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec on n-h2-852086-5 Aug 27 03:13:33.386957 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3936ea85-e450-4f03-9317-d2f9e239f58e req-ce8fd9b9-148a-4842-86b9-bd704f4252d1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111219 Aug 27 03:13:33.387600 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 823/1664] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:33.402540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:33.414275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:33.429265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.432961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.434691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.434888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:33.437138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.440453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.441427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.446339 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6f4aaf5-9309-416d-974b-d7fdb1b6c3b1 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.502667 Aug 27 03:13:33.446935 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 842/1665] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:32 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:33.474566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:33.475451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:33.491078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.491877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.492319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.493164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.493699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.494132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.649506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:33.757018 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69cadd56-fb11-4861-b7d9-c3e5b5705979 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "POST /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5/action" status: 202 len: 0 microversion: 2.1 time: 0.308778 Aug 27 03:13:33.757976 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 843/1666] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:13:33 2022] POST /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:13:33.763398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:33.769718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:33.786939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.787716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.788334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.789232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.789841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.790458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:34.319061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:34.352662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:34.356929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:34.358593 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a11b593f-713a-4b01-bf83-50a55dd5f92b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.599356 Aug 27 03:13:34.361295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 844/1667] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:33 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:34.392508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:34.393788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:34.410977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:34.412238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:34.413674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:34.416238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:34.417472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:34.418606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:34.547839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:34.565064 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bbc5d294-e4df-4cad-bba4-b333aa7a0e43 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1168 microversion: 2.1 time: 0.196868 Aug 27 03:13:34.566530 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 845/1668] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:34 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1168 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:34.589985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:34.591473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:34.611038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:34.611941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:34.612552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:34.613928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:34.617880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:34.618580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:34.774097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:34.796317 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-05bfe5fd-2eab-496b-8a3a-355f1fc82db4 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1311 microversion: 2.1 time: 1.404269 Aug 27 03:13:34.807468 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 824/1669] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:33 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1311 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:34.815632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:34.816818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:34.840281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:34.841637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:34.843426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:34.844856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:34.846085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:34.848644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:35.210034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:35.231300 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-adb570ae-e86a-49b9-aad2-6a6363989183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 0.661905 Aug 27 03:13:35.235028 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 846/1670] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:34 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:35.252971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8d7aca20-9e98-4f14-9888-68fe887ce072 req-7b55606a-fcae-4697-b929-38497dbb951e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f233cfb6-a746-4919-b6cf-a694f07cfeba", "name": "network-vif-plugged", "status": "completed", "tag": "23046e60-7876-4073-85a0-4b1a400b8657"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:35.285048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8d7aca20-9e98-4f14-9888-68fe887ce072 req-7b55606a-fcae-4697-b929-38497dbb951e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:35.288594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8d7aca20-9e98-4f14-9888-68fe887ce072 req-7b55606a-fcae-4697-b929-38497dbb951e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:35.289160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8d7aca20-9e98-4f14-9888-68fe887ce072 req-7b55606a-fcae-4697-b929-38497dbb951e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:35.320723 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8d7aca20-9e98-4f14-9888-68fe887ce072 req-7b55606a-fcae-4697-b929-38497dbb951e service nova] Creating event network-vif-plugged:23046e60-7876-4073-85a0-4b1a400b8657 for instance f233cfb6-a746-4919-b6cf-a694f07cfeba on n-h1-852086-5 Aug 27 03:13:35.327394 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8d7aca20-9e98-4f14-9888-68fe887ce072 req-7b55606a-fcae-4697-b929-38497dbb951e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089582 Aug 27 03:13:35.327394 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 847/1671] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:35.417808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:35.419050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:35.439077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:35.439957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:35.440755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:35.442321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:35.443609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:35.444385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:35.498850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:35.533949 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ba2f605-6ab1-422a-b7bd-2e90f7cf1722 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1396 microversion: 2.1 time: 0.723207 Aug 27 03:13:35.534877 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 825/1672] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:34 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1396 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:35.598669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:35.599888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:35.607895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:35.608388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:35.608912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:35.609890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:35.610137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:35.611631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:35.696939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:35.709140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:35.710621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:35.712611 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de845590-ff3a-4992-a6d5-96b4ae963613 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1813 microversion: 2.25 time: 0.322799 Aug 27 03:13:35.713552 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 848/1673] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:35 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1813 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:13:35.761071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:35.777954 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85644715-a176-44d3-ad62-0b3e3e1e9c68 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1168 microversion: 2.1 time: 0.184920 Aug 27 03:13:35.779416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 826/1674] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:35 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1168 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:35.822967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:35.823761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:35.830795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:35.831402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:35.832904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:35.833711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:35.834447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:35.835156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:36.178341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:36.189757 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7990dd2d-d83d-4de8-bf41-b88e695e2852 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1311 microversion: 2.1 time: 0.371640 Aug 27 03:13:36.191059 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 849/1675] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:35 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:36.265571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:36.266499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:36.285430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:36.287423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:36.288336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:36.294353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:36.295412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:36.296029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:36.507810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-480873388", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:36.631209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] validate_networks() for [('795686d4-8fb6-4361-8b06-7d0eab3e904b', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:13:37.592787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:37.619698 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6e11c634-1127-45cb-ae9d-931ba6832571 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 1.359133 Aug 27 03:13:37.624775 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 827/1676] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:36 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:37.642770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:37.643400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:37.673894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:37.674515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:37.675196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:37.675960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:37.677827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:37.678308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:37.746595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:13:37.747157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:13:37.747487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:13:37.747940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:13:37.748372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:13:37.760232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:37.760731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:37.761178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:37.761934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:37.762425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:37.762856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:37.792810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for project 3372b4747f714009ad9a04a488019e78. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:37.798730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for user 7268918710454b128eaa3621f708efb9 and project 3372b4747f714009ad9a04a488019e78. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:37.812650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:13:37.815045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:13:37.898866 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23db8723-2a24-43b9-8501-b39293611df4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.397121 Aug 27 03:13:37.900677 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 850/1677] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:13:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:13:38.182929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1732310691", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:38.342314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] validate_networks() for [('bff05ece-9bd1-4fe5-bb75-c54fe03198c6', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:13:39.388500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:39.414847 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2c943337-6614-483b-b6d2-dff01303a3b5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1577 microversion: 2.1 time: 1.785187 Aug 27 03:13:39.431362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 828/1678] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:37 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1577 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:39.462237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:39.463008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:39.489488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:39.490004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:39.490485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:39.499479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:39.500275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:39.501531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:40.046895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:40.089654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:40.390661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:40.420754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:40.448647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:40.451199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c75a7b43-c011-4b96-85f3-26eacdf889f0 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1803 microversion: 2.25 time: 1.018667 Aug 27 03:13:40.453939 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 829/1679] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:39 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1803 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:40.471523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:40.472382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:40.495956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:40.498412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:40.499294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:40.500420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:40.501107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:40.501721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:40.679099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:13:40.680065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:13:40.680065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:13:40.680223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:13:40.680588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:13:40.705083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:40.710531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:40.711255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:40.715564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:40.716356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:40.716979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:40.768315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Getting quotas for project d3533cb9e2134a848d7c323a5429cf1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:40.786340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Getting quotas for user 29a0da528c064a1c9d2029be0bbdee92 and project d3533cb9e2134a848d7c323a5429cf1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:40.825026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:40.828810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:13:40.834869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:13:40.918502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:40.939776 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ebf62452-8588-4306-93b1-fcb887ee46b6 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1210 microversion: 2.1 time: 0.480907 Aug 27 03:13:40.946507 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 830/1680] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:40 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1210 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:40.953547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:40.959154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:40.969882 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4e24c76-f3be-4ae1-85e7-566fa71a75c5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.065702 Aug 27 03:13:40.971130 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 851/1681] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:13:40.977083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:40.979823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:40.982982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:40.983387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5e698a07-969f-446d-9cbe-aaed1235af36 req-ffd87427-57f7-4f88-a1db-3ca805e39356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "name": "network-vif-plugged", "status": "completed", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:40.984082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:40.984568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:40.985007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.008353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5e698a07-969f-446d-9cbe-aaed1235af36 req-ffd87427-57f7-4f88-a1db-3ca805e39356 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:41.009454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5e698a07-969f-446d-9cbe-aaed1235af36 req-ffd87427-57f7-4f88-a1db-3ca805e39356 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:41.011264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5e698a07-969f-446d-9cbe-aaed1235af36 req-ffd87427-57f7-4f88-a1db-3ca805e39356 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.062397 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5e698a07-969f-446d-9cbe-aaed1235af36 req-ffd87427-57f7-4f88-a1db-3ca805e39356 service nova] Creating event network-vif-plugged:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h1-852086-5 Aug 27 03:13:41.073746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-5e698a07-969f-446d-9cbe-aaed1235af36 req-ffd87427-57f7-4f88-a1db-3ca805e39356 service nova] Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:13:41.109152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5e698a07-969f-446d-9cbe-aaed1235af36 req-ffd87427-57f7-4f88-a1db-3ca805e39356 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136586 Aug 27 03:13:41.112274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 852/1682] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:41.123007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:41.126726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:41.147957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:41.148732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:41.149349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.150324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:41.150964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:41.155176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.715130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:41.726466 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dad03901-da3e-4782-826d-4f9b0a937d1a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1294 microversion: 2.1 time: 0.611244 Aug 27 03:13:41.727692 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 853/1683] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:41 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1294 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:41.748171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:41.748829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:41.773726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:41.774264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:41.774710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.780871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:41.781763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:41.782296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.808127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:41.845585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-beb65c4b-6bf9-4668-a428-c3bbc2618299 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1311 microversion: 2.1 time: 0.894255 Aug 27 03:13:41.847238 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 831/1684] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:40 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1311 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:41.872763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:41.873723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:41.897509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:41.897911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:41.898424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.899102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:41.907078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:41.913126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:41.995641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:42.288012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:42.300740 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc7a24d7-bce9-4812-8184-843fbeecd183 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 0.570374 Aug 27 03:13:42.302254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 854/1685] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:41 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:42.310284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-721bb1e2-0df8-49ea-91a6-18ae11f9a152 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '.version_select at 0x7fe4601ff820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:42.320905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-721bb1e2-0df8-49ea-91a6-18ae11f9a152 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:42.326656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-721bb1e2-0df8-49ea-91a6-18ae11f9a152 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:42.327424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-721bb1e2-0df8-49ea-91a6-18ae11f9a152 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:42.354273 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-721bb1e2-0df8-49ea-91a6-18ae11f9a152 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 4225 microversion: 2.25 time: 0.050610 Aug 27 03:13:42.374638 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 855/1686] 10.222.0.69 () {60 vars in 1184 bytes} [Sat Aug 27 03:13:42 2022] GET /compute/v2.1/os-migrations => generated 4225 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:42.380278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:42.381281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:42.400297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:42.400918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:42.415015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:42.416080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:42.416647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:42.417339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:42.559826 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ce7ac7c-b8fb-4842-8f3d-a444320dee6e tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.705367 Aug 27 03:13:42.560438 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 832/1687] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:13:41 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba/os-interface => generated 285 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:42.566457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:42.567299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:42.588831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:42.589942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:42.590973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:42.593657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:42.595348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:42.595796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:42.649366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:42.662012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1968117-cbe1-4ac6-aa50-78ed1c39821d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1228 microversion: 2.1 time: 0.285855 Aug 27 03:13:42.667875 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 856/1688] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:42 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1228 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:42.674062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:42.678529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:42.703582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:42.704676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:42.707764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:42.708982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:42.711719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:42.712533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.012844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 607b043e-1bab-4c1d-8348-610a19b23bfa {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:43.091521 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1cb5b91-c803-444c-b750-3f8253f68de2 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 2422 microversion: 2.25 time: 0.420026 Aug 27 03:13:43.094580 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 857/1689] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:42 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 2422 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:43.120011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d220e44e-b4f0-438c-b172-5d7e6a959e1a req-cc03a39d-30fb-4ba3-9d48-0f88efe1a08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe54ba8-26e0-4fc0-a19e-88f2ea976dc5", "tag": "06c9b27a-30de-4395-82f1-ce0edd651398"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:43.164004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d220e44e-b4f0-438c-b172-5d7e6a959e1a req-cc03a39d-30fb-4ba3-9d48-0f88efe1a08c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.173194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d220e44e-b4f0-438c-b172-5d7e6a959e1a req-cc03a39d-30fb-4ba3-9d48-0f88efe1a08c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.175518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d220e44e-b4f0-438c-b172-5d7e6a959e1a req-cc03a39d-30fb-4ba3-9d48-0f88efe1a08c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.214673 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d220e44e-b4f0-438c-b172-5d7e6a959e1a req-cc03a39d-30fb-4ba3-9d48-0f88efe1a08c service nova] Creating event network-changed:06c9b27a-30de-4395-82f1-ce0edd651398 for instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 on n-h1-852086-5 Aug 27 03:13:43.228629 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d220e44e-b4f0-438c-b172-5d7e6a959e1a req-cc03a39d-30fb-4ba3-9d48-0f88efe1a08c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129379 Aug 27 03:13:43.229798 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 858/1690] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:43.236204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:43.237183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:43.248070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.248576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.249012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.251962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.255391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.256307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.406215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:43.420244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:43.421459 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-70b7bc77-f6bb-431e-bfac-f9ebcafdb3d1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1210 microversion: 2.1 time: 0.858858 Aug 27 03:13:43.432360 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8fee3444-6886-4c3b-825c-e6a765ba06c4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1282 microversion: 2.1 time: 0.200513 Aug 27 03:13:43.437777 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 833/1691] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:42 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1210 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:43.444424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 859/1692] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:43 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:43.451930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:43.454025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:43.458798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:43.459792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:43.465395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.466697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.467256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.468349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.468724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.469203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.469386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.469922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.470209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.471237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.471857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.472554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.887208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid 607b043e-1bab-4c1d-8348-610a19b23bfa {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:43.913894 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-221da8c4-5044-4e39-8f90-17a0b3d5c7cb tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 2422 microversion: 2.25 time: 0.460943 Aug 27 03:13:43.916501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 860/1693] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:13:43 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 2422 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:13:43.924295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5f33f93b-290d-4e39-9d45-7c4c62d58748 req-6c7d2404-b721-4560-91d3-7ef6553d4ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0be9928-bcb0-43b0-9e81-6bdb4a893dec", "name": "network-vif-plugged", "status": "completed", "tag": "22d11f08-a2b6-454b-a038-38064a777790"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:43.936840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5f33f93b-290d-4e39-9d45-7c4c62d58748 req-6c7d2404-b721-4560-91d3-7ef6553d4ab4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.937544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5f33f93b-290d-4e39-9d45-7c4c62d58748 req-6c7d2404-b721-4560-91d3-7ef6553d4ab4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.938496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5f33f93b-290d-4e39-9d45-7c4c62d58748 req-6c7d2404-b721-4560-91d3-7ef6553d4ab4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.955076 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5f33f93b-290d-4e39-9d45-7c4c62d58748 req-6c7d2404-b721-4560-91d3-7ef6553d4ab4 service nova] Creating event network-vif-plugged:22d11f08-a2b6-454b-a038-38064a777790 for instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec on n-h2-852086-5 Aug 27 03:13:43.962554 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5f33f93b-290d-4e39-9d45-7c4c62d58748 req-6c7d2404-b721-4560-91d3-7ef6553d4ab4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044363 Aug 27 03:13:43.963438 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 861/1694] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:43.972118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:43.974125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:43.983704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.984377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.986492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:43.988083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:43.989408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:43.990753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.053651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:44.056078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:44.065241 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-390cc6bd-840f-4af9-bd95-d623f56fa6cf tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1311 microversion: 2.1 time: 0.625753 Aug 27 03:13:44.078736 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 834/1695] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:43 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1311 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:44.084702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:44.085534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:44.092093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.092818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.093430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.094359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.094986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.095611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.317610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:44.333544 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3dd1d3a7-c7fd-46ee-98c7-935ab3b74270 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1282 microversion: 2.1 time: 0.252663 Aug 27 03:13:44.335135 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 835/1696] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:44 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:44.340504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:44.341226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:44.349996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.350829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.351441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.353103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.353890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.355539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.451068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:44.462464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68be0a0a-7e2c-4087-bcdc-092c9beb1f67 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 0.497050 Aug 27 03:13:44.479974 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 862/1697] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:43 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:44.489324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:44.490115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:44.508560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.509073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.509516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.510271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.510728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.511412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.555954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lazy-loading 'services' on Instance uuid 607b043e-1bab-4c1d-8348-610a19b23bfa {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:44.669600 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d16623d-f454-4d2f-8a9e-c59dfa2e2e1f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments/3a059d73-ee8d-45bf-a172-1f8430ff52d5" status: 202 len: 0 microversion: 2.25 time: 0.330062 Aug 27 03:13:44.671422 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 836/1698] 10.222.0.69 () {60 vars in 1457 bytes} [Sat Aug 27 03:13:44 2022] DELETE /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments/3a059d73-ee8d-45bf-a172-1f8430ff52d5 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:44.679400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:44.680447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:44.689294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.692353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.693421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:44.694908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:44.695887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:44.696581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:45.240696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:45.265247 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb259b8d-d8ab-4a96-9868-0b6f9f57c425 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.783122 Aug 27 03:13:45.280906 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 863/1699] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:44 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:45.303766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:45.316316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:45.346019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:45.350874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:45.351839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:45.353099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:45.353771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:45.354734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:45.400480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:45.414533 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-afb9fa8d-93f6-473c-8694-ff8a6dfd6b85 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1282 microversion: 2.1 time: 0.741446 Aug 27 03:13:45.466992 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 837/1700] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:44 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1282 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:45.487033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:45.488162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:45.511686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:45.512724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:45.514306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:45.517728 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef4951b1-8c4d-4e79-b98e-235ea92fb952 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.223840 Aug 27 03:13:45.519086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:45.522100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:45.523219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:45.524582 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 864/1701] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:45 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:45.558834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:45.560289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:45.578082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:45.579013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:45.579654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:45.585821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:45.586629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:45.587332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.149086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:46.174058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57b6fd98-6370-48f8-9fd5-534b583eed60 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.639366 Aug 27 03:13:46.174729 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 865/1702] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:45 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:46.200662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-21b318ab-f6b5-435a-a1f2-44e95700fae9 req-533127fa-f6b1-4ac6-baed-339f4a0b572f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "name": "network-vif-unplugged", "status": "completed", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:46.237270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21b318ab-f6b5-435a-a1f2-44e95700fae9 req-533127fa-f6b1-4ac6-baed-339f4a0b572f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.239839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21b318ab-f6b5-435a-a1f2-44e95700fae9 req-533127fa-f6b1-4ac6-baed-339f4a0b572f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.240824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21b318ab-f6b5-435a-a1f2-44e95700fae9 req-533127fa-f6b1-4ac6-baed-339f4a0b572f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.266357 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-21b318ab-f6b5-435a-a1f2-44e95700fae9 req-533127fa-f6b1-4ac6-baed-339f4a0b572f service nova] Creating event network-vif-unplugged:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h1-852086-5 Aug 27 03:13:46.274433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-21b318ab-f6b5-435a-a1f2-44e95700fae9 req-533127fa-f6b1-4ac6-baed-339f4a0b572f service nova] Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:13:46.296189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-21b318ab-f6b5-435a-a1f2-44e95700fae9 req-533127fa-f6b1-4ac6-baed-339f4a0b572f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104430 Aug 27 03:13:46.300544 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 866/1703] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:46.312296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:46.313441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:46.321373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.321964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.322494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.325208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.326439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.327413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.493768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:46.510971 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f45edc58-7fc5-410a-9f0d-2388845d2bb9 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1311 microversion: 2.1 time: 1.039521 Aug 27 03:13:46.514210 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 838/1704] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:45 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1311 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:46.533001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:46.533972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:46.562107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.563723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.565896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.567647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.569329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.574099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.634914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:46.648646 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97ae507d-3dc0-4f1b-a56e-765e0d090f6a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 0.342903 Aug 27 03:13:46.662766 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 867/1705] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:46 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:46.671294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:46.672220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:46.683937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.684753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.685396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:46.686399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:46.687045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:46.687669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.451784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:47.454976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:47.461133 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7f3b448-bdaa-4135-9284-831e3a1b63fe tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.945543 Aug 27 03:13:47.462346 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 839/1706] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:46 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:47.467672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:47.470319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:47.478552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.479348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.479787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.480333 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8dfc355-7dd5-4f02-877b-49b3d93ec9d4 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.816211 Aug 27 03:13:47.480535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.480996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.493763 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 868/1707] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:46 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:47.493968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.494440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:47.494440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:47.509853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.510515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.511240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.512246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.513053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.513720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.545970 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-177cf4df-fb1b-45fd-82c5-14835a91ba58 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082211 Aug 27 03:13:47.547031 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 840/1708] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:47 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:47.556685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:47.557309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:47.571484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.571986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.572415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:47.573146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:47.577792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:47.578694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.009340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:48.026980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08e5fc2e-a469-4650-8aca-ed305e83422b tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.544438 Aug 27 03:13:48.027580 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 869/1709] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:47 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:48.050344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:48.056413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:48.068033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:48.070501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.071251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.071872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.073118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.073825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.074537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.085320 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d1c58a0f-ae9f-42c6-aecb-468db0ed2310 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1461 microversion: 2.1 time: 0.530511 Aug 27 03:13:48.099287 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 841/1710] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:47 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1461 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:48.396212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Calling method '.version_select at 0x7fe457d3e3a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:48.418875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.421965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.422621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.471946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.472752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.473901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.524232 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c64a42d-876c-42ae-a268-2dbf29bde7f4 tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/1cf788bbf414414d9a169a637f0e6cbb?start=2022-08-26T03%3A13%3A48.100591&end=2022-08-28T03%3A13%3A48.100591" status: 200 len: 692 microversion: 2.1 time: 0.414561 Aug 27 03:13:48.538672 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 842/1711] 10.222.0.69 () {58 vars in 1412 bytes} [Sat Aug 27 03:13:48 2022] GET /compute/v2.1/os-simple-tenant-usage/1cf788bbf414414d9a169a637f0e6cbb?start=2022-08-26T03%3A13%3A48.100591&end=2022-08-28T03%3A13%3A48.100591 => generated 692 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:48.543926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4abab1ed-5ea9-4eb4-8fa1-8fdacd57a7cd req-cddc5da4-19c3-463b-80f7-c8cf74fa5f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:48.573910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4abab1ed-5ea9-4eb4-8fa1-8fdacd57a7cd req-cddc5da4-19c3-463b-80f7-c8cf74fa5f01 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.574449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4abab1ed-5ea9-4eb4-8fa1-8fdacd57a7cd req-cddc5da4-19c3-463b-80f7-c8cf74fa5f01 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.574889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4abab1ed-5ea9-4eb4-8fa1-8fdacd57a7cd req-cddc5da4-19c3-463b-80f7-c8cf74fa5f01 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.598634 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4abab1ed-5ea9-4eb4-8fa1-8fdacd57a7cd req-cddc5da4-19c3-463b-80f7-c8cf74fa5f01 service nova] Creating event network-changed:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h1-852086-5 Aug 27 03:13:48.608862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-4abab1ed-5ea9-4eb4-8fa1-8fdacd57a7cd req-cddc5da4-19c3-463b-80f7-c8cf74fa5f01 service nova] Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:13:48.638270 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4abab1ed-5ea9-4eb4-8fa1-8fdacd57a7cd req-cddc5da4-19c3-463b-80f7-c8cf74fa5f01 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097903 Aug 27 03:13:48.639289 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 843/1712] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:48.645206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:48.646101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:48.663484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.668797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.669585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.671167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:48.671801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:48.674873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:48.963596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:48.973288 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e6c07d7-4f6a-4855-9da2-cb317ffc5496 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 0.931176 Aug 27 03:13:48.982907 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 870/1713] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:48 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:48.989370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:48.994826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:49.015450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:49.022289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:49.023507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:49.025075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:49.026204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:49.027204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:49.711462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:49.721330 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87fdada3-fa82-4336-b6d6-b5fdd749c02f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 1.080734 Aug 27 03:13:49.721942 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 844/1714] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:48 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:49.736416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '.version_select at 0x7fe457ceff70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:49.790210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:49.790836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:49.791291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:49.819972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:49.820644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:49.821311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:49.864312 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2575502-7c0f-475e-83ee-b9f693bc8c45 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/1cf788bbf414414d9a169a637f0e6cbb?start=2022-08-26T03%3A13%3A48.100591&end=2022-08-28T03%3A13%3A48.100591" status: 200 len: 692 microversion: 2.1 time: 0.128194 Aug 27 03:13:49.865988 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 845/1715] 10.222.0.69 () {58 vars in 1412 bytes} [Sat Aug 27 03:13:49 2022] GET /compute/v2.1/os-simple-tenant-usage/1cf788bbf414414d9a169a637f0e6cbb?start=2022-08-26T03%3A13%3A48.100591&end=2022-08-28T03%3A13%3A48.100591 => generated 692 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:49.889776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:49.892938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:49.919224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:49.920073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:49.920863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:49.921833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:49.923311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:49.923977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.009526 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a4b712d-6a32-4808-a14c-cfa6f5d5652f tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135592 Aug 27 03:13:50.013591 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 846/1716] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:49 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:50.021963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6ac5e50c-a815-48f2-aa73-55dfe34c310c req-59d75d85-ccd7-4eb7-808a-baa75fb289be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851", "tag": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:50.064491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ac5e50c-a815-48f2-aa73-55dfe34c310c req-59d75d85-ccd7-4eb7-808a-baa75fb289be service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.064976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ac5e50c-a815-48f2-aa73-55dfe34c310c req-59d75d85-ccd7-4eb7-808a-baa75fb289be service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.065412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ac5e50c-a815-48f2-aa73-55dfe34c310c req-59d75d85-ccd7-4eb7-808a-baa75fb289be service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.096144 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6ac5e50c-a815-48f2-aa73-55dfe34c310c req-59d75d85-ccd7-4eb7-808a-baa75fb289be service nova] Creating event network-changed:94baeff4-2d7b-4a93-9158-c9c1d15ccd6c for instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 on n-h1-852086-5 Aug 27 03:13:50.111307 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6ac5e50c-a815-48f2-aa73-55dfe34c310c req-59d75d85-ccd7-4eb7-808a-baa75fb289be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092626 Aug 27 03:13:50.112512 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 847/1717] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:50.132896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:50.137692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:50.152314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.153120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.154854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.155836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.159572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.161277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.559413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:50.576967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2ba82ef9-2ded-4d4a-b6ad-b6d733f17dc4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.462044 Aug 27 03:13:50.591108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:50.591698 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 848/1718] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:50 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:50.592619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:50.593334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:50.609504 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dcc331a5-8406-43bd-a9b6-ff187487f08f tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 1.622344 Aug 27 03:13:50.622219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.622219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.622219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.622219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.622219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.622219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:50.622914 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 871/1719] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:48 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:50.730767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c219e63-84b9-44ca-a9d8-a07d940f2e85 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Calling method '.version_select at 0x7fe4577c13a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:50.751867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:50.808224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:50.949210 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c219e63-84b9-44ca-a9d8-a07d940f2e85 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.332119 Aug 27 03:13:50.951261 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 872/1720] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:13:50 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:13:50.958671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Calling method '.version_select at 0x7fe457787790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:50.990409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:50.992113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:50.992982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.003187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:51.015347 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3082412-dffe-468f-8737-d6b2e147e21d tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1577 microversion: 2.1 time: 0.427951 Aug 27 03:13:51.027327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.030013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.030724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.032185 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 849/1721] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:50 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1577 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:51.059586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.060829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.079628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.080146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.080602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.081422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.088799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.089319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.192997 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dacb9c14-7bc0-428c-9d48-a1c57d84b8ae tempest-TenantUsagesTestJSON-306194304 tempest-TenantUsagesTestJSON-306194304-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T03%3A13%3A48.100591&end=2022-08-28T03%3A13%3A48.100591&detailed=1" status: 200 len: 19223 microversion: 2.1 time: 0.240045 Aug 27 03:13:51.194429 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 873/1722] 10.222.0.69 () {58 vars in 1335 bytes} [Sat Aug 27 03:13:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T03%3A13%3A48.100591&end=2022-08-28T03%3A13%3A48.100591&detailed=1 => generated 19223 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:51.200151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0f82c7ff-c1ff-43b3-b7af-24ae28860e1c req-5f169045-9cce-457f-867a-7ca396e1c9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f233cfb6-a746-4919-b6cf-a694f07cfeba", "tag": "23046e60-7876-4073-85a0-4b1a400b8657"}, {"name": "network-changed", "server_uuid": "6f4f04b9-f46a-4481-9160-0caf013828a7", "tag": "f9ec0a90-d300-4853-b566-fbc0557b153d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:51.221576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0f82c7ff-c1ff-43b3-b7af-24ae28860e1c req-5f169045-9cce-457f-867a-7ca396e1c9fa service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.223707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0f82c7ff-c1ff-43b3-b7af-24ae28860e1c req-5f169045-9cce-457f-867a-7ca396e1c9fa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.224617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0f82c7ff-c1ff-43b3-b7af-24ae28860e1c req-5f169045-9cce-457f-867a-7ca396e1c9fa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.244890 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0f82c7ff-c1ff-43b3-b7af-24ae28860e1c req-5f169045-9cce-457f-867a-7ca396e1c9fa service nova] Creating event network-changed:23046e60-7876-4073-85a0-4b1a400b8657 for instance f233cfb6-a746-4919-b6cf-a694f07cfeba on n-h1-852086-5 Aug 27 03:13:51.245411 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0f82c7ff-c1ff-43b3-b7af-24ae28860e1c req-5f169045-9cce-457f-867a-7ca396e1c9fa service nova] Creating event network-changed:f9ec0a90-d300-4853-b566-fbc0557b153d for instance 6f4f04b9-f46a-4481-9160-0caf013828a7 on n-h2-852086-5 Aug 27 03:13:51.264268 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0f82c7ff-c1ff-43b3-b7af-24ae28860e1c req-5f169045-9cce-457f-867a-7ca396e1c9fa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068112 Aug 27 03:13:51.265136 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 874/1723] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:51.272033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.272994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.281304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.282820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.283086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.283843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.284312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.284749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.377109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:51.395900 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9511600e-e691-4901-afe8-fad0967cce06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 0.362232 Aug 27 03:13:51.400133 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 850/1724] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:51 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:51.412665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5ae3103-63f9-4779-994c-d3404c308708 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Action: 'create', calling method: .version_select at 0x7fe457cef5e0>, body: {"pool": "non_exist_pool"} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:51.492602 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d5ae3103-63f9-4779-994c-d3404c308708 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] HTTP exception thrown: Floating IP pool not found. Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5ae3103-63f9-4779-994c-d3404c308708 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Request method failure captured: Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 26 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYvtUh8hEwVEEUrEetR1vJWXRNre_gcruqoC8p7FgzWSLh2mSsgquoifTAPwEUuVxZ1j2ooRKFHsffc5YWQoQuLAHZ5xEI_EsfrgaPPyYy7NLzuD--PrVb44Zo0Y0k-dtI7BjvpynYs-tFpkTSxc-94ZHQPkC_W7qBz17BpotTidVTM Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c21d9294be83467893040636328ee2a9 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-23971388 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c21d9294be83467893040636328ee2a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c21d9294be83467893040636328ee2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c21d9294be83467893040636328ee2a9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c21d9294be83467893040636328ee2a9"}]}] Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-23971388 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c21d9294be83467893040636328ee2a9 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-23971388 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsNegativeTestJSON-23971388-project Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: a88848b422b0495e80a259b54e1d6b63 Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-23971388-project Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: {"pool": "non_exist_pool"} Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: exception: Floating IP pool not found. Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:51.494480 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:51.500293 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 27 03:13:51.500293 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.500293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5ae3103-63f9-4779-994c-d3404c308708 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Returning 404 to user: Floating IP pool not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:51.500293 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5ae3103-63f9-4779-994c-d3404c308708 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.096002 Aug 27 03:13:51.500293 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 851/1725] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:13:51 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:13:51.512685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.518605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.519520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:51.528846 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb27abf9-d380-4387-afd5-3f524bf0794e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.262367 Aug 27 03:13:51.537356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.537959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.538536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.539181 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 875/1726] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:51 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:51.539315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.544117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.544812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.548157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.549038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.556397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.556899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.557351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.558056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.561728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.562478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.571667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:51.602973 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9e7a2d8-7867-417f-b313-fad0a7d7b965 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103396 Aug 27 03:13:51.605044 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 852/1727] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:51 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:51.610588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b963c5d-797b-4305-97d6-f7a0807d10b9 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Calling method '.version_select at 0x7fe457cfe940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.624896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:51.683892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-4b963c5d-797b-4305-97d6-f7a0807d10b9 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP aa2ef0bf-3eab-4fda-9c25-313f83476958 could not be found", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:13:51.684810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-4b963c5d-797b-4305-97d6-f7a0807d10b9 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] HTTP exception thrown: Floating IP not found for ID aa2ef0bf-3eab-4fda-9c25-313f83476958 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b963c5d-797b-4305-97d6-f7a0807d10b9 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Request method failure captured: Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-floating-ips/aa2ef0bf-3eab-4fda-9c25-313f83476958 HTTP/1.1 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYvtUh8hEwVEEUrEetR1vJWXRNre_gcruqoC8p7FgzWSLh2mSsgquoifTAPwEUuVxZ1j2ooRKFHsffc5YWQoQuLAHZ5xEI_EsfrgaPPyYy7NLzuD--PrVb44Zo0Y0k-dtI7BjvpynYs-tFpkTSxc-94ZHQPkC_W7qBz17BpotTidVTM Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c21d9294be83467893040636328ee2a9 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-23971388 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c21d9294be83467893040636328ee2a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c21d9294be83467893040636328ee2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c21d9294be83467893040636328ee2a9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c21d9294be83467893040636328ee2a9"}]}] Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-23971388 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c21d9294be83467893040636328ee2a9 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-23971388 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsNegativeTestJSON-23971388-project Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: a88848b422b0495e80a259b54e1d6b63 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-23971388-project Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: exception: Floating IP not found for ID aa2ef0bf-3eab-4fda-9c25-313f83476958 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'aa2ef0bf-3eab-4fda-9c25-313f83476958'} Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP aa2ef0bf-3eab-4fda-9c25-313f83476958 could not be found Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5628276a-f3aa-432e-9ba5-4949f646a6fb'] Aug 27 03:13:51.687363 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID aa2ef0bf-3eab-4fda-9c25-313f83476958. Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID aa2ef0bf-3eab-4fda-9c25-313f83476958 Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID aa2ef0bf-3eab-4fda-9c25-313f83476958 Aug 27 03:13:51.692544 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:51.698022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b963c5d-797b-4305-97d6-f7a0807d10b9 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] Returning 404 to user: Floating IP not found for ID aa2ef0bf-3eab-4fda-9c25-313f83476958 {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:51.699154 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b963c5d-797b-4305-97d6-f7a0807d10b9 tempest-FloatingIPsNegativeTestJSON-23971388 tempest-FloatingIPsNegativeTestJSON-23971388-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/aa2ef0bf-3eab-4fda-9c25-313f83476958" status: 404 len: 111 microversion: 2.1 time: 0.092966 Aug 27 03:13:51.699914 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 853/1728] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:13:51 2022] DELETE /compute/v2.1/os-floating-ips/aa2ef0bf-3eab-4fda-9c25-313f83476958 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:51.712897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.713816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.721790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.724087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.724986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.727213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.728277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.731219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.771271 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2bdde07-0f17-4ce2-aab5-ac43f72c8ef2 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 204 len: 0 microversion: 2.1 time: 0.230331 Aug 27 03:13:51.772640 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 876/1729] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:51 2022] DELETE /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:51.793005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:51.794478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:51.814565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.815318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.815994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:51.817586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:51.818303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:51.818978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.017364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:52.035672 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80ac109f-476a-4305-a118-a933938910e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.257012 Aug 27 03:13:52.037840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 877/1730] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:51 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:52.052662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:52.053603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:52.060479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.061005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.061436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.062154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.062348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:52.062819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.063228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.090414 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84e1cba7-f94e-4ba6-b22f-8b1356a8b00a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.365233 Aug 27 03:13:52.091784 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 854/1731] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:51 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:52.355052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:52.367231 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-def3f509-0523-4288-a783-45d5c8392a5b tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1467 microversion: 2.1 time: 0.327927 Aug 27 03:13:52.367840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 878/1732] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:52 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:52.427139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:52.428119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:52.451046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:52.453458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.454403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.455533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.456997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.458282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.458976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.556762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:52.557549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:52.577855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.578507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.579108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.579725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.592135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.592586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.895616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:52.906738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-96d59af9-8ef7-44a9-a8a5-f6a3fce6b6f5 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.354455 Aug 27 03:13:52.909311 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 879/1733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:52 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:52.926924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:52.930021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:52.951288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.952236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.953062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.964764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:52.966057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:52.966966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:52.975044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:53.042657 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23ae3073-f889-4518-aabd-efe200c588da tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131295 Aug 27 03:13:53.043955 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 880/1734] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:52 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:53.091968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:53.093014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:53.104063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.108138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.108808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:53.112145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.113767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.114956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:53.357161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:53.372908 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd3ca5b1-85c7-48b3-91d5-76b4f1e06a84 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.310183 Aug 27 03:13:53.374611 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 881/1735] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:53 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:53.382233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:53.383443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:53.392323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.393253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.394460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:53.396160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.396812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.397248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:53.431793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:53.444565 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21994eea-590c-44d5-b8c3-5040ccde9d53 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1469 microversion: 2.1 time: 1.023015 Aug 27 03:13:53.446796 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 855/1736] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:52 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1469 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:53.469118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:53.476982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:53.496074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.496598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.497020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:53.497753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.502664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.503351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:53.617384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:53.642828 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50c80842-5e7b-4003-9dca-dd2a0b6f51ae tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.260784 Aug 27 03:13:53.677649 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 882/1737] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:53 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:53.947102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:53.948541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:53.967735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.968312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.968770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:53.969784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:53.970540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:53.971001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.296792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:54.312286 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81593a3d-c7e6-471e-8355-7dae31da580e tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1467 microversion: 2.1 time: 0.863302 Aug 27 03:13:54.326194 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 856/1738] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:53 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1467 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:54.326680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:54.326801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:54.329138 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76223bd9-9a11-41d8-97ff-967ccc35dbb1 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.391341 Aug 27 03:13:54.329340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:54.331336 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 883/1739] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:53 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:54.339339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.339848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.340285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.341510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.342155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.342796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.380120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9fbcddc4-ac49-4ab8-8f67-2bf26a5d1754 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065488 Aug 27 03:13:54.390426 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 857/1740] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:54 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:54.402441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:54.403413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:54.415233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.416319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.418729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.420287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.421751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.422628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.476526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:54.478009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:54.485716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.487031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.487675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.488742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.489517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.491079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.815760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:54.839343 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1689fc2a-3a7d-45e1-b00c-d75e222c4886 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.442609 Aug 27 03:13:54.840603 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 884/1741] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:54 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:54.868341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:54.870453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:54.882917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.884120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.885172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:54.887365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:54.888641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:54.889816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:55.161652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:55.167412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:55.182763 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f859c8f9-657d-4077-9747-5e6824616f1d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.340461 Aug 27 03:13:55.183956 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eb06cfd0-618d-49d3-ba54-6bb12f1733c8 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1462 microversion: 2.1 time: 0.715316 Aug 27 03:13:55.184890 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 858/1742] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:54 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1462 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:55.196114 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 885/1743] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:54 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:55.344630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:55.346339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:55.363430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:55.367132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:55.367946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:55.369200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:55.373004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:55.374605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:55.407973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:55.409024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:55.416732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:55.417612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:55.418376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:55.419353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:55.420147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:55.420812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:55.740600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:55.752678 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c42c7488-eb17-4a27-8fe8-a54305fe3e46 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1467 microversion: 2.1 time: 0.416858 Aug 27 03:13:55.757389 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 886/1744] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:55 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1467 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:55.763245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:55.766360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:55.776415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:55.777068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:55.777690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:55.779415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:55.779947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:55.780447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.069021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:56.077836 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e87242b3-81e0-499e-aebf-c283696b37ee tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.318621 Aug 27 03:13:56.084862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 887/1745] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:55 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:56.098328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:56.101823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:56.129731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.130739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.131777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.133354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.134226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.135104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.187821 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9453f201-3992-4784-8ccb-e8beb49124f4 tempest-MigrationsAdminTest-300938204 tempest-MigrationsAdminTest-300938204-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1613 microversion: 2.1 time: 0.977175 Aug 27 03:13:56.194643 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 859/1746] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:55 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1613 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:56.202388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c7a5eba1-5733-40ea-b051-663f01f19f5b req-191dc008-14a8-4f41-80da-349037128980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe54ba8-26e0-4fc0-a19e-88f2ea976dc5", "name": "network-vif-plugged", "status": "completed", "tag": "06c9b27a-30de-4395-82f1-ce0edd651398"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:56.211050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43f5cab5-36a9-4825-bedf-8e139f4c6b79 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.123636 Aug 27 03:13:56.212929 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 888/1747] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:13:56 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:56.224891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:56.226851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:56.252766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.255568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.259165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.260260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.266964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.267419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.271271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7a5eba1-5733-40ea-b051-663f01f19f5b req-191dc008-14a8-4f41-80da-349037128980 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.271769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7a5eba1-5733-40ea-b051-663f01f19f5b req-191dc008-14a8-4f41-80da-349037128980 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.272209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7a5eba1-5733-40ea-b051-663f01f19f5b req-191dc008-14a8-4f41-80da-349037128980 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.293491 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c7a5eba1-5733-40ea-b051-663f01f19f5b req-191dc008-14a8-4f41-80da-349037128980 service nova] Creating event network-vif-plugged:06c9b27a-30de-4395-82f1-ce0edd651398 for instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 on n-h1-852086-5 Aug 27 03:13:56.303484 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c7a5eba1-5733-40ea-b051-663f01f19f5b req-191dc008-14a8-4f41-80da-349037128980 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105965 Aug 27 03:13:56.305128 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 860/1748] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:56.314197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:56.315875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:56.328652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.329495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.329961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.330797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.332998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.333632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.612805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:56.623168 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3130976e-11e4-4761-8d0e-777427af6c7e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.408749 Aug 27 03:13:56.640965 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 889/1749] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:56 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:56.646312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:56.647489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:56.655848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.656842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.657626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.658580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.659261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.659939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.691112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:56.802901 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1035f36a-4fb4-478a-b88b-73ff610fba45 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 204 len: 0 microversion: 2.1 time: 0.159871 Aug 27 03:13:56.806720 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 890/1750] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:56 2022] DELETE /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:56.810430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f44c9983-78b8-41ca-9881-37f536b47277 req-109441fa-c879-4c11-82ba-6be7685d5cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0be9928-bcb0-43b0-9e81-6bdb4a893dec", "name": "network-vif-deleted", "tag": "22d11f08-a2b6-454b-a038-38064a777790"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:56.822947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f44c9983-78b8-41ca-9881-37f536b47277 req-109441fa-c879-4c11-82ba-6be7685d5cbd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.822947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f44c9983-78b8-41ca-9881-37f536b47277 req-109441fa-c879-4c11-82ba-6be7685d5cbd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.823206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f44c9983-78b8-41ca-9881-37f536b47277 req-109441fa-c879-4c11-82ba-6be7685d5cbd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.839202 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f44c9983-78b8-41ca-9881-37f536b47277 req-109441fa-c879-4c11-82ba-6be7685d5cbd service nova] Creating event network-vif-deleted:22d11f08-a2b6-454b-a038-38064a777790 for instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec on n-h2-852086-5 Aug 27 03:13:56.845055 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f44c9983-78b8-41ca-9881-37f536b47277 req-109441fa-c879-4c11-82ba-6be7685d5cbd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039529 Aug 27 03:13:56.846258 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 891/1751] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:56.853679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:56.854406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:56.856918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:56.865913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.866727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.867364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.868363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.869058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.869667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.875230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b8a04404-55dd-4761-b3b3-c3380c2b0d92 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.568474 Aug 27 03:13:56.909554 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 861/1752] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:56 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:56.923389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.923883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.924323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.924842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lazy-loading 'fault' on Instance uuid b0be9928-bcb0-43b0-9e81-6bdb4a893dec {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:56.927848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:56.931401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:56.947788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.950627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.951209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.952179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:56.955080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:56.957184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:56.974150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebee10484abe4e07a03835a0472c42ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf788bbf414414d9a169a637f0e6cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:56.983454 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0744eaa2-575c-4540-a709-be571a0f0358 tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 200 len: 1301 microversion: 2.1 time: 0.135404 Aug 27 03:13:56.984597 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 892/1753] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:56 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 1301 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:57.103461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:57.104587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:57.112650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:57.114692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:57.115201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:57.116517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:57.123733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:57.126300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:57.289833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:57.297909 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d601a41a-d2f5-41d5-9cfa-043618fd61ef tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1468 microversion: 2.1 time: 0.383349 Aug 27 03:13:57.298537 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 862/1754] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:56 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:57.443772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:57.457757 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27b94bd9-841e-4f35-b290-65ef53cbccc2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.357043 Aug 27 03:13:57.472400 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 893/1755] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:57 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:57.644893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:57.645871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:57.653734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:57.654578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:57.655373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:57.656438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:57.657837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:57.659015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:57.879171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:57.897810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3189c4f6-fbd7-46eb-ace1-e0b423f4f23a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.256049 Aug 27 03:13:57.898067 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 863/1756] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:57 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:57.903331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:57.904100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:57.907767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:57.912802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:57.913403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:57.913941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:57.914790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:57.915854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:57.916549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.010292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:58.011238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] [instance: b0be9928-bcb0-43b0-9e81-6bdb4a893dec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:58.018131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.018681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.019138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.020042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.020687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.021283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.035999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] HTTP exception thrown: Instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec could not be found. Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Request method failure captured: Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec HTTP/1.1 Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYvHn0g-Xh0r2LbxmzaRDe6beJvj8MeYcJ45bHJM9Icton8qPuLgyo4rH_R1R00xkO_m0YchksBv3WcJSKqWYpWJ2H6JBBLVpks2oTuMA-9jwx6BoLe4ARlHjE5Cff93UZ5AIS7PU8Lg2o8J8QAIK19pBe2LioyQboxk0mkeHdwPulM Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1cf788bbf414414d9a169a637f0e6cbb Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TenantUsagesTestJSON-1867040591 Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1cf788bbf414414d9a169a637f0e6cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1cf788bbf414414d9a169a637f0e6cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1cf788bbf414414d9a169a637f0e6cbb", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1cf788bbf414414d9a169a637f0e6cbb"}]}] Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TenantUsagesTestJSON-1867040591 Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1cf788bbf414414d9a169a637f0e6cbb Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1867040591 Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TenantUsagesTestJSON-1867040591-project Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ebee10484abe4e07a03835a0472c42ef Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TenantUsagesTestJSON-1867040591-project Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec could not be found. Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'b0be9928-bcb0-43b0-9e81-6bdb4a893dec'} Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec could not be found. Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec could not be found. Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:58.038568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.043869 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:58.043869 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:58.043869 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:58.043869 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:58.043869 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:58.043869 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec could not be found. Aug 27 03:13:58.043869 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:13:58.045856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] Returning 404 to user: Instance b0be9928-bcb0-43b0-9e81-6bdb4a893dec could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:58.047507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc3a169f-1778-4381-b939-13c187135f6d tempest-TenantUsagesTestJSON-1867040591 tempest-TenantUsagesTestJSON-1867040591-project] 10.222.0.69 "GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec" status: 404 len: 111 microversion: 2.1 time: 0.046188 Aug 27 03:13:58.048248 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 864/1757] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:57 2022] GET /compute/v2.1/servers/b0be9928-bcb0-43b0-9e81-6bdb4a893dec => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:58.177398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:58.189824 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-540a22ac-5538-45c9-9bd2-a70225822af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.288707 Aug 27 03:13:58.192190 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 894/1758] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:57 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:58.321955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:58.323313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:58.335050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.342989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.343732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.344710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.345399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.346031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.377058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-678c9a91-6762-4257-bcad-202149b60123 req-7821dc68-d41c-4660-b24b-90778677c7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "name": "network-vif-plugged", "status": "completed", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}, {"server_uuid": "6f4f04b9-f46a-4481-9160-0caf013828a7", "name": "network-vif-plugged", "status": "completed", "tag": "f9ec0a90-d300-4853-b566-fbc0557b153d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:58.397186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-678c9a91-6762-4257-bcad-202149b60123 req-7821dc68-d41c-4660-b24b-90778677c7a0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.398646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-678c9a91-6762-4257-bcad-202149b60123 req-7821dc68-d41c-4660-b24b-90778677c7a0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.400881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-678c9a91-6762-4257-bcad-202149b60123 req-7821dc68-d41c-4660-b24b-90778677c7a0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.438274 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-678c9a91-6762-4257-bcad-202149b60123 req-7821dc68-d41c-4660-b24b-90778677c7a0 service nova] Creating event network-vif-plugged:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h1-852086-5 Aug 27 03:13:58.439062 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-678c9a91-6762-4257-bcad-202149b60123 req-7821dc68-d41c-4660-b24b-90778677c7a0 service nova] Creating event network-vif-plugged:f9ec0a90-d300-4853-b566-fbc0557b153d for instance 6f4f04b9-f46a-4481-9160-0caf013828a7 on n-h2-852086-5 Aug 27 03:13:58.448736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-678c9a91-6762-4257-bcad-202149b60123 req-7821dc68-d41c-4660-b24b-90778677c7a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075858 Aug 27 03:13:58.454065 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 895/1759] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:13:58.489826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:58.491007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:58.509512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.511380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.512429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.514398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.515342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.515791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.551239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:58.912879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:58.929622 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54750ede-0795-41c4-ac80-312b7b8ee17c tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1468 microversion: 2.1 time: 0.611880 Aug 27 03:13:58.938376 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 865/1760] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:58 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1468 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:58.946355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:58.949041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:58.967989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.970705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.971784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:58.975590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:58.977907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:58.978747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:59.270096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:59.280825 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a600f0a-f164-496d-b7ff-4552effe7148 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1198 microversion: 2.1 time: 0.799588 Aug 27 03:13:59.303522 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 896/1761] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:58 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1198 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:59.314032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:59.315532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:59.346921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:59.348090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:59.349192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:59.350786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:59.351487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:59.352091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:59.407805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:59.423489 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfd77fcc-5510-4efb-9cd6-22c1ed292dda tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.489352 Aug 27 03:13:59.427742 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 866/1762] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:58 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:59.841559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:59.845955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-796f458c-a3ba-4745-93ea-31976b7a8a60 req-96087826-1e16-4de1-a3d0-0bdc35f84013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d50287c-c39c-4566-85d0-c5945d4856e5", "name": "network-vif-deleted", "tag": "ce895f11-0b00-4bcb-b76b-52fd8c9a4f32"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:59.884820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-796f458c-a3ba-4745-93ea-31976b7a8a60 req-96087826-1e16-4de1-a3d0-0bdc35f84013 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:59.886768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-796f458c-a3ba-4745-93ea-31976b7a8a60 req-96087826-1e16-4de1-a3d0-0bdc35f84013 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:59.886768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-796f458c-a3ba-4745-93ea-31976b7a8a60 req-96087826-1e16-4de1-a3d0-0bdc35f84013 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:59.931687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-796f458c-a3ba-4745-93ea-31976b7a8a60 req-96087826-1e16-4de1-a3d0-0bdc35f84013 service nova] Creating event network-vif-deleted:ce895f11-0b00-4bcb-b76b-52fd8c9a4f32 for instance 9d50287c-c39c-4566-85d0-c5945d4856e5 on n-h1-852086-5 Aug 27 03:13:59.948634 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-796f458c-a3ba-4745-93ea-31976b7a8a60 req-96087826-1e16-4de1-a3d0-0bdc35f84013 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108139 Aug 27 03:13:59.958334 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 867/1763] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:13:59.965979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:59.973128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:59.994433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:00.001814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:00.008793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:00.010379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:00.011678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:00.012792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:00.028398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:00.054022 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f6402fd-bed1-4bb2-8745-4ca2bcd89952 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.749187 Aug 27 03:14:00.065219 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 897/1764] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:59 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:00.143792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:00.145793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:00.146869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:00.147521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lazy-loading 'fault' on Instance uuid 9d50287c-c39c-4566-85d0-c5945d4856e5 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:00.305601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:00.307909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:00.308690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:00.329424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:00.329927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:00.340892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:00.341763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:00.342279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:00.342717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:00.356264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e8573bd5-0090-42f9-af34-fb3f4248946a tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 200 len: 1303 microversion: 2.1 time: 0.396247 Aug 27 03:14:00.363799 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 868/1765] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:59 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 1303 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:00.459133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:00.460041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:00.483766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:00.488674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:00.490904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:00.493674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:00.495263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:00.497485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:00.991192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:01.012657 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46af553b-e01e-4b94-ad05-b8f24339aae6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1324 microversion: 2.1 time: 0.562863 Aug 27 03:14:01.013014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:01.029861 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 869/1766] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:00 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1324 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:14:01.042055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d248c6ad-fada-4b55-860f-5bc907790bf0 req-bea4b85f-5af3-4e7c-8b3f-bcbd63c296cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851", "name": "network-vif-plugged", "status": "completed", "tag": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:01.093802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d248c6ad-fada-4b55-860f-5bc907790bf0 req-bea4b85f-5af3-4e7c-8b3f-bcbd63c296cd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.094741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d248c6ad-fada-4b55-860f-5bc907790bf0 req-bea4b85f-5af3-4e7c-8b3f-bcbd63c296cd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.095684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d248c6ad-fada-4b55-860f-5bc907790bf0 req-bea4b85f-5af3-4e7c-8b3f-bcbd63c296cd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.120868 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d248c6ad-fada-4b55-860f-5bc907790bf0 req-bea4b85f-5af3-4e7c-8b3f-bcbd63c296cd service nova] Creating event network-vif-plugged:94baeff4-2d7b-4a93-9158-c9c1d15ccd6c for instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 on n-h1-852086-5 Aug 27 03:14:01.137727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d248c6ad-fada-4b55-860f-5bc907790bf0 req-bea4b85f-5af3-4e7c-8b3f-bcbd63c296cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103489 Aug 27 03:14:01.139125 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 870/1767] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:01.149350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:01.150579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:01.170642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:01.181417 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0d0aa0b-fc33-4601-ac30-963d1268cf3b tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1379 microversion: 2.1 time: 0.877848 Aug 27 03:14:01.183679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 898/1768] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:00 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1379 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:01.185788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.186528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.190478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.193042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.193816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.195957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.455938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:01.467477 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c23300be-f272-4a83-af0d-37426619c109 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.326738 Aug 27 03:14:01.469152 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 871/1769] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:01 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:01.482643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:01.483643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 9d50287c-c39c-4566-85d0-c5945d4856e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:01.498705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.504071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.504962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.506124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.506794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.507527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.519454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:01.539161 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] HTTP exception thrown: Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 could not be found. Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Request method failure captured: Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 HTTP/1.1 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqBAd8swq9-uqjm4IZW5HCRr-5xW9nNEMlqSHaBp199x34fKq_4-cIeM_oRdJBxt3vXRkt1j2SF5s52iiRG_0kA9YS1xx_Hnol_gcRhoKPN-TuYz7xS3uOaJeb4iY5sW4YUAu-C0UTE7bD7DyHV8ipNEhn6mIw_9pYS4XwcfWJOtec Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_82d80176cbd24a32922fe33269a9ae59", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}] Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 3ad6820606064210a5a0e2fa2bfa4bb7 Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 could not be found. Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '9d50287c-c39c-4566-85d0-c5945d4856e5'} Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 could not be found. Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 could not be found. Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:01.545140 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 could not be found. Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Returning 404 to user: Instance 9d50287c-c39c-4566-85d0-c5945d4856e5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-253e3742-f4e1-40fb-8b87-2887306eb938 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5" status: 404 len: 111 microversion: 2.1 time: 0.074743 Aug 27 03:14:01.551708 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 872/1770] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:01 2022] GET /compute/v2.1/servers/9d50287c-c39c-4566-85d0-c5945d4856e5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:01.559739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:01.560467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:01.579013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.579725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.580600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.581980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.582809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.583435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.677587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:01.830666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:01.831365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:01.834872 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-614e5c8e-d671-4764-988c-f6bc8677d2eb tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 204 len: 0 microversion: 2.1 time: 0.268233 Aug 27 03:14:01.835739 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 873/1771] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:01 2022] DELETE /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:01.844470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:01.845185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:01.852074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.854421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.856322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.857098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.857652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.858070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.865799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.866339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.866786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:01.867510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:01.867973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:01.870141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.146941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:02.158868 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c373e047-a802-4a84-90c7-190bce5bfeda tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1534 microversion: 2.1 time: 0.318507 Aug 27 03:14:02.178776 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 874/1772] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:01 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1534 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:02.188021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6c78452-d9f9-4f3e-8596-d13910b4076f tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1530 microversion: 2.1 time: 0.973137 Aug 27 03:14:02.188877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:02.189386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:02.197847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.198370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.199302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.200743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.201452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.202074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.219003 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 899/1773] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:01 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1530 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:02.234044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:02.235364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:02.265987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.267088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.269788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.272599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.274750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.278092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.519017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:02.544412 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba043020-1fb8-4bbe-b04a-093e060e9d27 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1521 microversion: 2.1 time: 0.361204 Aug 27 03:14:02.554601 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 875/1774] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:02 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:02.566535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:02.568451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:02.582228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.582873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.583639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.584445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.584910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.585665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.787364 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47ad66cc-73b2-4650-8ad5-3fe59e79359c tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1530 microversion: 2.1 time: 0.557577 Aug 27 03:14:02.789076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:02.794686 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 900/1775] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:02 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1530 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:02.808628 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7efd03c3-094b-494d-8514-9128b1afbdb2 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1324 microversion: 2.1 time: 0.252195 Aug 27 03:14:02.809654 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 876/1776] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:02 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:02.815365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:02.817680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:02.822183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:02.827859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.828615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.830548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.831838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.832644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.833480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.851632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.853083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.853877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.863551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.863551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.863551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.877805 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-478e7c82-e84d-4793-97e3-59721f542f74 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062198 Aug 27 03:14:02.894249 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 877/1777] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:14:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:02.904333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852086-5", "block_migration": false, "disk_over_commit": false}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:02.908666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:02.930953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.935016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.935706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.939511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.940118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.940796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:03.005455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lazy-loading 'flavor' on Instance uuid efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:03.044210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Going to try to live migrate instance to n-h2-852086-5 {{(pid=122407) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:14:03.193959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:03.221896 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aec0fa89-f588-46af-b398-a1e467b2f5a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1521 microversion: 2.1 time: 0.425130 Aug 27 03:14:03.227478 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 901/1778] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:02 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:03.248198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:03.250106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:03.263778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.265900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.267036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:03.270366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.272689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.274387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:03.525143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:03.539699 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2cad8f18-5bc3-4a30-aac4-07c4de0de6f6 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1534 microversion: 2.1 time: 0.308728 Aug 27 03:14:03.541595 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 902/1779] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:03 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1534 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:03.546589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1823690153"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:03.549314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:03.557463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.558263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.559188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:03.560110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.560728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.561532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:04.018664 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d4e3e44-4e68-4e14-a555-c14c258a4540 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7/action" status: 202 len: 0 microversion: 2.1 time: 0.475541 Aug 27 03:14:04.021183 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 903/1780] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:03 2022] POST /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:14:04.593902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a76744a7-ad76-4c57-9efa-96f693537c7d tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:04.611945 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a76744a7-ad76-4c57-9efa-96f693537c7d tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.588590 Aug 27 03:14:04.614565 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 904/1781] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:04.623159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:04.624147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:04.632783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:04.633490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:04.652180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:04.659489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:04.660991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:04.662917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.045001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:05.060993 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57cfdc39-37a5-49a3-bc63-2a8108098189 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1521 microversion: 2.1 time: 0.443867 Aug 27 03:14:05.061797 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 905/1782] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:04 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:05.079997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b2a44c06-460a-4557-a600-95baff067679 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '.version_select at 0x7fe4601acc10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:05.507368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b2a44c06-460a-4557-a600-95baff067679 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e" status: 204 len: 0 microversion: 2.1 time: 0.442957 Aug 27 03:14:05.507931 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 906/1783] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:05 2022] DELETE /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:05.513034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:05.513650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:05.526793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.527366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.527774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.533749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.535707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.535707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.607979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.609394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.610014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.610719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lazy-loading 'fault' on Instance uuid b61cb6ca-8b57-4408-b6a2-5e8e542ce81a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:05.715276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:05.741269 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0a955c0-ac99-4b16-8c78-4fad91988392 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 200 len: 1368 microversion: 2.1 time: 0.231259 Aug 27 03:14:05.758833 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 907/1784] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:05 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:05.764083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5188b71b-5a34-4245-bff2-3977f5bd472f req-c19b6af5-1061-48d7-b6fe-0facb8751f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61cb6ca-8b57-4408-b6a2-5e8e542ce81a", "name": "network-vif-deleted", "tag": "7c4936ee-07ae-40cf-b35c-9ec273970636"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:05.775668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5188b71b-5a34-4245-bff2-3977f5bd472f req-c19b6af5-1061-48d7-b6fe-0facb8751f09 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.776543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5188b71b-5a34-4245-bff2-3977f5bd472f req-c19b6af5-1061-48d7-b6fe-0facb8751f09 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.777161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5188b71b-5a34-4245-bff2-3977f5bd472f req-c19b6af5-1061-48d7-b6fe-0facb8751f09 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.800731 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5188b71b-5a34-4245-bff2-3977f5bd472f req-c19b6af5-1061-48d7-b6fe-0facb8751f09 service nova] Creating event network-vif-deleted:7c4936ee-07ae-40cf-b35c-9ec273970636 for instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a on n-h2-852086-5 Aug 27 03:14:05.807612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5188b71b-5a34-4245-bff2-3977f5bd472f req-c19b6af5-1061-48d7-b6fe-0facb8751f09 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047049 Aug 27 03:14:05.808368 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 908/1785] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:05.815682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3603ee49-7c7d-47f1-8e9b-30dad8b59f06 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:05.845428 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3603ee49-7c7d-47f1-8e9b-30dad8b59f06 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.035554 Aug 27 03:14:05.846354 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 909/1786] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:14:05 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:05.855149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c51d2641-65e7-448b-adc3-bb82bc4151c8 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'create', calling method: .version_select at 0x7fe4601f9670>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:06.416889 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51cd3b98-92af-4e6f-810f-06df0798cec0 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5/action" status: 202 len: 0 microversion: 2.1 time: 3.520786 Aug 27 03:14:06.417909 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 878/1787] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:02 2022] POST /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5/action => generated 0 bytes in 3523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:06.446064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59f2f959-c66d-40b5-b581-86830204a2e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '.version_select at 0x7fe457cefd30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:06.554737 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-59f2f959-c66d-40b5-b581-86830204a2e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Image not found. Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59f2f959-c66d-40b5-b581-86830204a2e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e HTTP/1.1 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '354779b5-e1b0-40c8-8910-f4292adf3d0e'} Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 354779b5-e1b0-40c8-8910-f4292adf3d0e Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:14:06.560581 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 354779b5-e1b0-40c8-8910-f4292adf3d0e could not be found. Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59f2f959-c66d-40b5-b581-86830204a2e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59f2f959-c66d-40b5-b581-86830204a2e1 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e" status: 404 len: 62 microversion: 2.1 time: 0.143916 Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 879/1788] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:14:06 2022] GET /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e => generated 62 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:14:06.577564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f631b37-e03f-42b6-8dd5-825ff93f18b3 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:06.588699 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f631b37-e03f-42b6-8dd5-825ff93f18b3 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022916 Aug 27 03:14:06.594821 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 880/1789] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:06.602748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:06.603708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:06.615317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:06.616219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:06.616896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:06.618494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:06.619965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:06.620698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.365543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:07.374395 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39c1b350-0188-4543-8eeb-b1f4123c9889 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.777245 Aug 27 03:14:07.375720 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 881/1790] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:06 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:07.381918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:07.382839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:07.401235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.402137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.415795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.417107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.418857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.419526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.006196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:08.015992 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-13e0ad44-6c82-4e1b-bc8e-8b5ba7a8ebc7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1539 microversion: 2.1 time: 0.638895 Aug 27 03:14:08.016781 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 882/1791] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:07 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1539 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:08.030055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65eba290-4640-4ce5-bd43-357f7e058e6e tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.032296 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c51d2641-65e7-448b-adc3-bb82bc4151c8 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.184179 Aug 27 03:14:08.033792 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 910/1792] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:14:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:08.041001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.042153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: b61cb6ca-8b57-4408-b6a2-5e8e542ce81a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:08.051059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:08.051573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:08.052082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.052919 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65eba290-4640-4ce5-bd43-357f7e058e6e tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034752 Aug 27 03:14:08.053875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:08.054492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:08.054991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.060753 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 883/1793] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:08.070950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-507efe51-cb48-4a1c-93f7-dd3cb9d289c0 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.075505 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] HTTP exception thrown: Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a could not be found. Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Request method failure captured: Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a HTTP/1.1 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqBAd8swq9-uqjm4IZW5HCRr-5xW9nNEMlqSHaBp199x34fKq_4-cIeM_oRdJBxt3vXRkt1j2SF5s52iiRG_0kA9YS1xx_Hnol_gcRhoKPN-TuYz7xS3uOaJeb4iY5sW4YUAu-C0UTE7bD7DyHV8ipNEhn6mIw_9pYS4XwcfWJOtec Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_82d80176cbd24a32922fe33269a9ae59", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}] Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 3ad6820606064210a5a0e2fa2bfa4bb7 Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a could not be found. Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b61cb6ca-8b57-4408-b6a2-5e8e542ce81a'} Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a could not be found. Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a could not be found. Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:08.077742 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:08.082721 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:08.082721 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:08.082721 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:08.082721 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:08.082721 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:08.082721 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a could not be found. Aug 27 03:14:08.082721 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:08.086360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Returning 404 to user: Instance b61cb6ca-8b57-4408-b6a2-5e8e542ce81a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:08.088228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87cccf17-c317-46d9-9660-19f2afa910a7 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a" status: 404 len: 111 microversion: 2.1 time: 0.052035 Aug 27 03:14:08.093072 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 911/1794] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/servers/b61cb6ca-8b57-4408-b6a2-5e8e542ce81a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:08.101807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce6799f4-8891-4d52-8778-6ab9c65b0fa1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '.version_select at 0x7fe4577894c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.123001 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-507efe51-cb48-4a1c-93f7-dd3cb9d289c0 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.060918 Aug 27 03:14:08.124576 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 884/1795] 10.222.0.69 () {58 vars in 1165 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:08.127001 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce6799f4-8891-4d52-8778-6ab9c65b0fa1 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237474216" status: 202 len: 0 microversion: 2.1 time: 0.031458 Aug 27 03:14:08.128065 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 912/1796] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237474216 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:08.147832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1264dd7c-c9b4-45f6-8163-d9d9b633e97a tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.175277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1264dd7c-c9b4-45f6-8163-d9d9b633e97a tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034773 Aug 27 03:14:08.177170 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 885/1797] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:08.189988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9bba64a8-d9f4-4428-8c49-70554db3d362 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.238436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9bba64a8-d9f4-4428-8c49-70554db3d362 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.053401 Aug 27 03:14:08.239633 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 913/1798] 10.222.0.69 () {58 vars in 1169 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:08.239972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1881001208", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:08.256863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eefa8f3e-a00e-4e13-b73f-611400e41fdb tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.294317 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eefa8f3e-a00e-4e13-b73f-611400e41fdb tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.043044 Aug 27 03:14:08.295613 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 914/1799] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:08.309917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2f7fa04-1d3a-4058-8805-5f616759d81c tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.322037 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2f7fa04-1d3a-4058-8805-5f616759d81c tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016977 Aug 27 03:14:08.323211 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 915/1800] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:08.339331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6109a906-00c6-4fd4-a449-00f1e3c6a123 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.346792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] validate_networks() for [('bff05ece-9bd1-4fe5-bb75-c54fe03198c6', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:14:08.414362 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6109a906-00c6-4fd4-a449-00f1e3c6a123 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.081011 Aug 27 03:14:08.415731 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 916/1801] 10.222.0.69 () {58 vars in 1167 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:08.430915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.432493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:08.440178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:08.443528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:08.444183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.444978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:08.446888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:08.447433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.828787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:08.844182 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6013eeeb-4681-45f4-ac24-9ae9971b6590 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.426678 Aug 27 03:14:08.848160 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 917/1802] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:08.854644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d363878a-ea9f-4aa3-a19a-3f4b36331e10 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.867255 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d363878a-ea9f-4aa3-a19a-3f4b36331e10 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017220 Aug 27 03:14:08.868479 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 918/1803] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:08.885066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c40185e-5ca9-41e5-9d33-c4b8bff448f3 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.944506 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c40185e-5ca9-41e5-9d33-c4b8bff448f3 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.068851 Aug 27 03:14:08.946198 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 919/1804] 10.222.0.69 () {58 vars in 1144 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:14:08.964492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e25178ad-8ba5-4448-9aef-560d24b69ffd tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:08.994489 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e25178ad-8ba5-4448-9aef-560d24b69ffd tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038164 Aug 27 03:14:09.000710 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 920/1805] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:09.013050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2209417a-5922-4a25-8b2a-8717b0f67d30 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:09.052694 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2209417a-5922-4a25-8b2a-8717b0f67d30 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.044651 Aug 27 03:14:09.062306 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 921/1806] 10.222.0.69 () {58 vars in 1148 bytes} [Sat Aug 27 03:14:09 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:09.077254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:09.079177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:09.105513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.107106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.108130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.109551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.110562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.111317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.693212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:09.703625 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fde44f9-69fa-44dd-8fdc-44df2c94cbf7 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1521 microversion: 2.1 time: 0.644123 Aug 27 03:14:09.709404 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 922/1807] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:09 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1521 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:09.729483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8284f62d-055d-4be7-a54f-60ecca4232a3 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:09.754694 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8284f62d-055d-4be7-a54f-60ecca4232a3 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.040491 Aug 27 03:14:09.762980 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 923/1808] 10.222.0.69 () {58 vars in 1140 bytes} [Sat Aug 27 03:14:09 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:09.772543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:09.773356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:09.789660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.790271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.790781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.791582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.792108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.794628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.836622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:09.956472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:10.049027 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77d77a2f-284c-4e2e-a64a-7cbb5f5554f3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 204 len: 0 microversion: 2.1 time: 0.283741 Aug 27 03:14:10.051553 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 924/1809] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:09 2022] DELETE /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:10.060583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:10.065460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:10.075420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.076207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.076858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.077879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.078556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.079199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.091403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:14:10.092402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:14:10.094712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:14:10.096766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:14:10.098533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:14:10.132226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.134874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.149017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.149998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.150869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.151517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.205653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:10.213786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Getting quotas for project d3533cb9e2134a848d7c323a5429cf1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:14:10.227976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Getting quotas for user 29a0da528c064a1c9d2029be0bbdee92 and project d3533cb9e2134a848d7c323a5429cf1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:14:10.265037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:14:10.272335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:10.397847 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30da6ffe-9725-46d4-b03a-6afb8c4f86f2 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 204 len: 0 microversion: 2.1 time: 0.344398 Aug 27 03:14:10.399319 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 925/1810] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:10 2022] DELETE /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:10.413739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53e960b7-6715-4fd6-9914-458d5a169bbf tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:10.424113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9a1ff2d7-f805-4cde-b95d-4d604ea2bcc5 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.188502 Aug 27 03:14:10.436157 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53e960b7-6715-4fd6-9914-458d5a169bbf tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035002 Aug 27 03:14:10.438555 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 886/1811] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:14:10.445196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 926/1812] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:10.457052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:10.458893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:10.462857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:10.466340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:10.469519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.470318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.470930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.471921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.473055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.473492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.499099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.499590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.500026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.500740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.501198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.501621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.853339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:10.874407 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79ffb252-5351-4f31-8093-5a42948b8856 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1527 microversion: 2.1 time: 0.424317 Aug 27 03:14:10.879940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 927/1813] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:10 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1527 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:10.889167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:10.890406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:10.924831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.927470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.929158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.930952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.932668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.933964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:11.039850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:11.068473 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5df9118d-2621-4cb7-beda-27c82c243eac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.628303 Aug 27 03:14:11.072884 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 887/1814] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:10 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:11.086367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5dae01e2-0aad-4a29-a8cf-b1918cf9f5f4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:11.090647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5dae01e2-0aad-4a29-a8cf-b1918cf9f5f4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:11.430574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:11.435419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5dae01e2-0aad-4a29-a8cf-b1918cf9f5f4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:11.457395 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5dae01e2-0aad-4a29-a8cf-b1918cf9f5f4 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1224 microversion: 2.1 time: 0.382189 Aug 27 03:14:11.462705 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f9f0f90-9242-4b65-8f58-8d1192af7d9d tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1468 microversion: 2.1 time: 0.578947 Aug 27 03:14:11.466298 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 888/1815] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:11 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1224 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:11.504106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 928/1816] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:10 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1468 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:11.514621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a573ad45-bf16-4ee4-86d3-157a418059ca tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:11.576177 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a573ad45-bf16-4ee4-86d3-157a418059ca tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.102153 Aug 27 03:14:11.577404 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 889/1817] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:14:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:11.592438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1ad4565-e458-4c49-8d09-4cab7ec222c4 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:11.669485 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1ad4565-e458-4c49-8d09-4cab7ec222c4 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080482 Aug 27 03:14:11.671811 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 929/1818] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:14:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:11.710910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2902ddaa-3bdb-4e2a-bc53-9f8e010daee7 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:11.737318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2902ddaa-3bdb-4e2a-bc53-9f8e010daee7 tempest-FlavorsV2TestJSON-690852318 tempest-FlavorsV2TestJSON-690852318-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031483 Aug 27 03:14:11.738058 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 890/1819] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:11.908960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:11.911908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:11.944790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:11.947349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:11.949528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:11.953379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:11.955635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:11.957871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.096064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:12.097228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:12.112349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:12.115591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:12.117259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.131281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:12.137669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:12.150318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.775442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:12.803746 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-834c6172-5474-49ea-86d9-1a899097584b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1527 microversion: 2.1 time: 0.906481 Aug 27 03:14:12.813625 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 930/1820] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:11 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1527 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:12.836505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0087cf4b-b4fc-40b4-8079-047437486093 req-35363c7e-a259-405f-b0ea-de4eab082c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4f04b9-f46a-4481-9160-0caf013828a7", "name": "network-vif-plugged", "status": "completed", "tag": "f9ec0a90-d300-4853-b566-fbc0557b153d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:12.873638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0087cf4b-b4fc-40b4-8079-047437486093 req-35363c7e-a259-405f-b0ea-de4eab082c38 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:12.879106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0087cf4b-b4fc-40b4-8079-047437486093 req-35363c7e-a259-405f-b0ea-de4eab082c38 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:12.879912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0087cf4b-b4fc-40b4-8079-047437486093 req-35363c7e-a259-405f-b0ea-de4eab082c38 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.942417 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0087cf4b-b4fc-40b4-8079-047437486093 req-35363c7e-a259-405f-b0ea-de4eab082c38 service nova] Creating event network-vif-plugged:f9ec0a90-d300-4853-b566-fbc0557b153d for instance 6f4f04b9-f46a-4481-9160-0caf013828a7 on n-h2-852086-5 Aug 27 03:14:12.955552 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0087cf4b-b4fc-40b4-8079-047437486093 req-35363c7e-a259-405f-b0ea-de4eab082c38 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137794 Aug 27 03:14:12.961834 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 931/1821] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:12.983884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:12.987209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:13.006286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.007090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.008400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.013924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.014778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.015454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.463472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:13.476773 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f37e0583-8449-4d3d-b411-e95eff6929df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 1.385198 Aug 27 03:14:13.477410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 891/1822] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:12 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:13.494367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:13.495000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:13.497118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:13.523672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.527734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.529462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.531215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.535485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.536288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.257316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:14.279427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-52c3ba6f-45fc-4e39-8ea3-6ac8080e3e31 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1468 microversion: 2.1 time: 0.788360 Aug 27 03:14:14.282719 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 892/1823] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:13 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1468 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:14.307997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:14.315503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:14.334425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.336064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.337414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.338454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.344241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.345968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.481900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:14.499084 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59cb1700-f75f-4df2-957b-516bdfb3392c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1276 microversion: 2.1 time: 1.533845 Aug 27 03:14:14.516980 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 932/1824] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:12 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1276 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:14.516980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5d0e76b6-9b8a-49c6-8253-1fad73526f34 req-32398a62-0e97-4932-8bdf-9a19eb4c1556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6506c3-9989-47ab-88c5-0258c00070d9", "name": "network-vif-deleted", "tag": "de7751cd-3d09-4c1d-b715-b797a59a532e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:14.558595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5d0e76b6-9b8a-49c6-8253-1fad73526f34 req-32398a62-0e97-4932-8bdf-9a19eb4c1556 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.559101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5d0e76b6-9b8a-49c6-8253-1fad73526f34 req-32398a62-0e97-4932-8bdf-9a19eb4c1556 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.559547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5d0e76b6-9b8a-49c6-8253-1fad73526f34 req-32398a62-0e97-4932-8bdf-9a19eb4c1556 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.619953 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5d0e76b6-9b8a-49c6-8253-1fad73526f34 req-32398a62-0e97-4932-8bdf-9a19eb4c1556 service nova] Creating event network-vif-deleted:de7751cd-3d09-4c1d-b715-b797a59a532e for instance 0c6506c3-9989-47ab-88c5-0258c00070d9 on n-h1-852086-5 Aug 27 03:14:14.634655 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5d0e76b6-9b8a-49c6-8253-1fad73526f34 req-32398a62-0e97-4932-8bdf-9a19eb4c1556 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124555 Aug 27 03:14:14.635766 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 933/1825] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:14.641994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:14.648554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:14.734824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.743003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.743753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.744717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.746762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.747457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.177540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:15.195495 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-23aa85b2-0f7d-4b9c-8542-ce8d03bb1956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1527 microversion: 2.1 time: 0.911013 Aug 27 03:14:15.196721 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 893/1826] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:14 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1527 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:15.311095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:15.313176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:15.321403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.322418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.323108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.324823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.325510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.326206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.397867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.402211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.405050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.405797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lazy-loading 'fault' on Instance uuid 0c6506c3-9989-47ab-88c5-0258c00070d9 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:15.539557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:15.541994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:15.561068 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e37ceb45-50f8-4155-be20-32ee57b18c55 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 200 len: 1302 microversion: 2.1 time: 0.257185 Aug 27 03:14:15.561718 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 894/1827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:15 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 1302 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:15.569354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:15.573726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:15.593930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.596022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.596740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.604035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.604877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.606087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.614548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:15.624772 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a237d20-e880-4ac3-aa18-328e7bf331cd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.987491 Aug 27 03:14:15.654542 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 934/1828] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:14 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:15.761459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:15.782501 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-891f5e8a-9d52-4039-a6f2-fb5ae7875caa tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1282 microversion: 2.1 time: 0.214667 Aug 27 03:14:15.783419 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 895/1829] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:15 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:16.240598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:16.243132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:16.276734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.277397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.277984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:16.279903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.281203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.281912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:16.599756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:16.602390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 0c6506c3-9989-47ab-88c5-0258c00070d9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:16.630396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.631167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.631778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:16.632699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.633507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.634113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:16.673595 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] HTTP exception thrown: Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 could not be found. Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Request method failure captured: Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 HTTP/1.1 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqBAd8swq9-uqjm4IZW5HCRr-5xW9nNEMlqSHaBp199x34fKq_4-cIeM_oRdJBxt3vXRkt1j2SF5s52iiRG_0kA9YS1xx_Hnol_gcRhoKPN-TuYz7xS3uOaJeb4iY5sW4YUAu-C0UTE7bD7DyHV8ipNEhn6mIw_9pYS4XwcfWJOtec Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_82d80176cbd24a32922fe33269a9ae59", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}] Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 3ad6820606064210a5a0e2fa2bfa4bb7 Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 could not be found. Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '0c6506c3-9989-47ab-88c5-0258c00070d9'} Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 could not be found. Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 could not be found. Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:16.676528 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:16.682038 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:16.682038 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:16.682038 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:16.682038 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:16.682038 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:16.682038 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 could not be found. Aug 27 03:14:16.682038 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:16.686859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Returning 404 to user: Instance 0c6506c3-9989-47ab-88c5-0258c00070d9 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:16.686859 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-215b1fa5-3bfa-4639-aea5-8d2c61331669 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9" status: 404 len: 111 microversion: 2.1 time: 0.092455 Aug 27 03:14:16.686859 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 896/1830] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:16 2022] GET /compute/v2.1/servers/0c6506c3-9989-47ab-88c5-0258c00070d9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:14:16.708679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:16.711531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:16.732617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.740832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.741808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:16.742805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:16.743485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:16.744152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.282473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:17.293051 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf19b5d8-7da2-4ec7-88c6-7ec0a0a54408 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.589079 Aug 27 03:14:17.293638 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 897/1831] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:16 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:17.307972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.308488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:17.312141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:17.330438 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c14ed84-dff5-46a0-9793-1c86ce524956 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1485 microversion: 2.1 time: 1.109694 Aug 27 03:14:17.333622 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 935/1832] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:16 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1485 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:14:17.335393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.335908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.336362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.346848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.351736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.352633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.378843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.380300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:17.396619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.398240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.399326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.400993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.401682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.402376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.421238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:17.617536 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-af570c27-f8b2-4b74-b618-cef5119c0c4e tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 204 len: 0 microversion: 2.1 time: 0.317180 Aug 27 03:14:17.618725 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 898/1833] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:17 2022] DELETE /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:17.633557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.634628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:17.648292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.649135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.649773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.651338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.651986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.652604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.805020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:17.820999 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83eb911d-f038-40cd-a609-32f02c2b3d47 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1282 microversion: 2.1 time: 0.467534 Aug 27 03:14:17.823873 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 936/1834] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:17 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1282 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:17.831777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f3e5a493-28c5-4ac3-a6d7-1ac3b7911c9d req-f895150d-0e9e-4621-aae2-fa55f4998483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4f04b9-f46a-4481-9160-0caf013828a7", "name": "network-vif-deleted", "tag": "f9ec0a90-d300-4853-b566-fbc0557b153d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:17.869193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f3e5a493-28c5-4ac3-a6d7-1ac3b7911c9d req-f895150d-0e9e-4621-aae2-fa55f4998483 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.869742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f3e5a493-28c5-4ac3-a6d7-1ac3b7911c9d req-f895150d-0e9e-4621-aae2-fa55f4998483 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.870212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f3e5a493-28c5-4ac3-a6d7-1ac3b7911c9d req-f895150d-0e9e-4621-aae2-fa55f4998483 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.901022 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f3e5a493-28c5-4ac3-a6d7-1ac3b7911c9d req-f895150d-0e9e-4621-aae2-fa55f4998483 service nova] Creating event network-vif-deleted:f9ec0a90-d300-4853-b566-fbc0557b153d for instance 6f4f04b9-f46a-4481-9160-0caf013828a7 on n-h2-852086-5 Aug 27 03:14:17.920478 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f3e5a493-28c5-4ac3-a6d7-1ac3b7911c9d req-f895150d-0e9e-4621-aae2-fa55f4998483 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094251 Aug 27 03:14:17.924940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 937/1835] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:17.977221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:17.995376 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-148c7435-2ccb-40c7-b8f5-59107d999baf tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1469 microversion: 2.1 time: 0.371722 Aug 27 03:14:18.009522 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 899/1836] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:17 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:18.339970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.343553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:18.355510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.357334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.358951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.361583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.362975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.375438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.435761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc86ea36-1c74-469c-b7f7-9719be2eb8e9 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.453487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:18.474743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc86ea36-1c74-469c-b7f7-9719be2eb8e9 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.548080 Aug 27 03:14:18.482449 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 938/1837] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:18.492803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.513681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:18.539305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.539809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.543198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.550859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.551597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.552054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.699895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.727161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.728623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.732900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lazy-loading 'fault' on Instance uuid 6f4f04b9-f46a-4481-9160-0caf013828a7 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:18.792206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:18.803041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6178917f-41ed-4e08-af26-1b6a095e3fb7 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.473414 Aug 27 03:14:18.808698 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 900/1838] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:18.846461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.854195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:18.867134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.868200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.868918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.869947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.870682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.874450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.916306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:18.935475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-feb7b6e7-53ff-493a-90ed-bcbb3467e8a5 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 200 len: 1314 microversion: 2.1 time: 0.449851 Aug 27 03:14:18.936133 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 939/1839] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:18.958683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.974338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:18.975138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Searching by: {'deleted': False, 'project_id': '169bb4af498e4606b896ea4d711b9d12'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:14:18.987052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.988237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.988913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.989809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.997420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.998264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.066889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:14:19.150266 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44115428-d9da-4afd-a759-b26775d612e7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.196850 Aug 27 03:14:19.151590 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 940/1840] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/servers => generated 334 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:19.162918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:19.163574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:19.181282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.181801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.182288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.183045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.183523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.183959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.247462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:19.258973 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7c71b48-0059-4c27-a855-e8df6135b2ef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.416743 Aug 27 03:14:19.260211 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 901/1841] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:19.266696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:19.274246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:19.278456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Searching by: {'deleted': False, 'project_id': '169bb4af498e4606b896ea4d711b9d12'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:14:19.288319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.289305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.290124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.291501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.292202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.293154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.356866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:14:19.452509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:19.474059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.474475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.475462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.671541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8391a51c-d5ca-43aa-b7f9-a02f3080c3f7 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.409725 Aug 27 03:14:19.693369 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 902/1842] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:14:19 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:19.701432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1101434c-aa3b-407e-ba95-019c91946bc5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:19.715591 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1101434c-aa3b-407e-ba95-019c91946bc5 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018465 Aug 27 03:14:19.725972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 903/1843] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:19.823429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f360ecdd-5d5c-4d2b-8108-72980b79b7b4 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1038791876", "imageRef": "653d0440-11e7-49d1-82b3-43dbfa12a0c9", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:19.914320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-f360ecdd-5d5c-4d2b-8108-72980b79b7b4 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:14:19.954641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:19.966798 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-453a5fa6-c996-433e-b931-009301812a02 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1469 microversion: 2.1 time: 0.813792 Aug 27 03:14:19.967909 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 941/1844] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:19 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1469 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:19.974441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:19.975218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:19.983659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.984091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.984527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.985363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:19.985830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:19.986297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.250332 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f360ecdd-5d5c-4d2b-8108-72980b79b7b4 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f360ecdd-5d5c-4d2b-8108-72980b79b7b4 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] Request method failure captured: Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 143 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwJshK_QObhMwsqSIQn-nCz8uOXOU11WSzLjoueP_0llWDwj6-KoPS9lXlqwobUCXh3BwKAZ-S29hlg6l53o_j3mSWDL2cEEVGWLNjJUrjuuUqIZ26pzGYlzJrpFBhU8KGktZJqcWHruovuY6VBSjsG2UXKtwkUQEfWn9wQ5Nk6IJ8 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 112d33df825c4890be69d15a3b2b2e28 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FlavorsV2NegativeTest-4180677 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/112d33df825c4890be69d15a3b2b2e28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/112d33df825c4890be69d15a3b2b2e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_112d33df825c4890be69d15a3b2b2e28", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/112d33df825c4890be69d15a3b2b2e28"}]}] Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FlavorsV2NegativeTest-4180677 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 112d33df825c4890be69d15a3b2b2e28 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-4180677 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FlavorsV2NegativeTest-4180677-project Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 453f429222d64873b6ae3a2b93b51226 Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FlavorsV2NegativeTest-4180677-project Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1038791876", "imageRef": "653d0440-11e7-49d1-82b3-43dbfa12a0c9", "flavorRef": "452"}} Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: exception: Flavor's memory is too small for requested image. Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1038791876', 'imageRef': '653d0440-11e7-49d1-82b3-43dbfa12a0c9', 'flavorRef': '452'}}} Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:14:20.253781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f360ecdd-5d5c-4d2b-8108-72980b79b7b4 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:20.260041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f360ecdd-5d5c-4d2b-8108-72980b79b7b4 tempest-FlavorsV2NegativeTest-4180677 tempest-FlavorsV2NegativeTest-4180677-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.436805 Aug 27 03:14:20.261557 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 904/1845] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:14:19 2022] POST /compute/v2.1/servers => generated 93 bytes in 442 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 27 03:14:20.270115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:20.270115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:20.276432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.277167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.277873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.278892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.279516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.280159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.298448 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 HTTP/1.1 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6f4f04b9-f46a-4481-9160-0caf013828a7'} Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.301057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:20.306714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:20.311269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:20.311269 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49ccdca2-6a70-4672-a1c3-3deb590a23af tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 404 len: 111 microversion: 2.1 time: 0.049448 Aug 27 03:14:20.312192 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 905/1846] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:20 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:20.318500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:20.319405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:20.328905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.329737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.330439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.331508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.332200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.332802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.612043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:20.624172 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-13827ef5-226e-4c2b-a33a-aa710c62fb22 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.310596 Aug 27 03:14:20.625110 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 906/1847] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:20 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:20.634081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1900446661", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:20.722758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:20.749523 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8c66afd-a92d-44ef-aad1-82a0730e0a67 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.779292 Aug 27 03:14:20.750636 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 942/1848] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:19 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:20.787422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] validate_networks() for [('795686d4-8fb6-4361-8b06-7d0eab3e904b', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:14:20.787899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:20.791325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:20.820426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.824978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.829901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.830749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:20.843672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:20.847386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:20.966516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:21.006228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:21.197076 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93f7e21f-fef5-4983-a60d-25270d8c41ee tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 204 len: 0 microversion: 2.1 time: 0.442250 Aug 27 03:14:21.200629 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 943/1849] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:20 2022] DELETE /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:21.208131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6f6a8ac7-eeac-4fa2-bd97-bc393d68d458 req-a0108afd-43f7-460f-a67e-72c8b423d144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50391137-b227-49eb-8694-c599b899a117", "name": "network-vif-deleted", "tag": "3f471807-d996-408f-bf48-36d371055ba3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:21.226960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f6a8ac7-eeac-4fa2-bd97-bc393d68d458 req-a0108afd-43f7-460f-a67e-72c8b423d144 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.227452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f6a8ac7-eeac-4fa2-bd97-bc393d68d458 req-a0108afd-43f7-460f-a67e-72c8b423d144 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.227887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f6a8ac7-eeac-4fa2-bd97-bc393d68d458 req-a0108afd-43f7-460f-a67e-72c8b423d144 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.282040 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6f6a8ac7-eeac-4fa2-bd97-bc393d68d458 req-a0108afd-43f7-460f-a67e-72c8b423d144 service nova] Creating event network-vif-deleted:3f471807-d996-408f-bf48-36d371055ba3 for instance 50391137-b227-49eb-8694-c599b899a117 on n-h2-852086-5 Aug 27 03:14:21.288364 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6f6a8ac7-eeac-4fa2-bd97-bc393d68d458 req-a0108afd-43f7-460f-a67e-72c8b423d144 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088649 Aug 27 03:14:21.288985 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 944/1850] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:21.297485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:21.299257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:21.316551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.317215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.317655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.318714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.321709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.322698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.374623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.375497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.376138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.377170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lazy-loading 'fault' on Instance uuid 50391137-b227-49eb-8694-c599b899a117 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:21.624931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:14:21.625649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:14:21.626638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:14:21.627333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:14:21.628483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:14:21.675716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.678060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.678588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.679406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.679872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.680295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.727359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for project 3372b4747f714009ad9a04a488019e78. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:14:21.735982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Getting quotas for user 7268918710454b128eaa3621f708efb9 and project 3372b4747f714009ad9a04a488019e78. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:14:21.790115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:14:21.806361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:21.945720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c1f121a-941f-4b0d-9bc0-da78ff9a8f8a tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.318836 Aug 27 03:14:21.950675 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 907/1851] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:14:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:14:21.961034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:21.961664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:21.981545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.982049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.982525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:21.983252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:21.983850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:21.984361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:22.085892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad6820606064210a5a0e2fa2bfa4bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d80176cbd24a32922fe33269a9ae59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:22.099438 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fc7295e-1591-490e-846b-39a233df5e06 tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 200 len: 1303 microversion: 2.1 time: 0.808906 Aug 27 03:14:22.100045 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 945/1852] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:21 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 1303 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:22.114869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:22.115288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:22.136811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:22.137391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:22.138359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:22.139594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:22.140723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:22.141454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:22.391690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:22.411192 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7898a042-23d2-453f-b16d-1cd2521a32cf tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1702 microversion: 2.1 time: 0.455444 Aug 27 03:14:22.428584 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 908/1853] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:21 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1702 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:22.450614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:22.454715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:22.464110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:22.466565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:22.467202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:22.468153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:22.468994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:22.469951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:22.736914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:22.750109 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c25ed19a-f6e6-4836-8220-22fcc58760a0 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.648917 Aug 27 03:14:22.757538 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 946/1854] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:22 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:22.772509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f305c51c-1554-44ed-9523-6e2bfe74cff6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:22.773622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:22.775315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f305c51c-1554-44ed-9523-6e2bfe74cff6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:22.803627 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea4c3714-398f-474c-8868-fca554011ffc tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.362840 Aug 27 03:14:22.804296 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 909/1855] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:22 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:22.929644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f305c51c-1554-44ed-9523-6e2bfe74cff6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:22.937660 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f305c51c-1554-44ed-9523-6e2bfe74cff6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1225 microversion: 2.1 time: 0.177633 Aug 27 03:14:22.942607 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 947/1856] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:22 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:23.124694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:23.125224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] [instance: 50391137-b227-49eb-8694-c599b899a117] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:23.136597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.137071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.137507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.138259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.138717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.139158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.176461 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] HTTP exception thrown: Instance 50391137-b227-49eb-8694-c599b899a117 could not be found. Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Request method failure captured: Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 HTTP/1.1 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqBAd8swq9-uqjm4IZW5HCRr-5xW9nNEMlqSHaBp199x34fKq_4-cIeM_oRdJBxt3vXRkt1j2SF5s52iiRG_0kA9YS1xx_Hnol_gcRhoKPN-TuYz7xS3uOaJeb4iY5sW4YUAu-C0UTE7bD7DyHV8ipNEhn6mIw_9pYS4XwcfWJOtec Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_82d80176cbd24a32922fe33269a9ae59", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/82d80176cbd24a32922fe33269a9ae59"}]}] Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 82d80176cbd24a32922fe33269a9ae59 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MigrationsAdminTest-1673796581 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 3ad6820606064210a5a0e2fa2bfa4bb7 Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MigrationsAdminTest-1673796581-project Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 50391137-b227-49eb-8694-c599b899a117 could not be found. Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '50391137-b227-49eb-8694-c599b899a117'} Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50391137-b227-49eb-8694-c599b899a117 could not be found. Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50391137-b227-49eb-8694-c599b899a117 could not be found. Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:23.178621 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:23.184313 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:23.184313 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:23.184313 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:23.184313 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:23.184313 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:23.184313 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50391137-b227-49eb-8694-c599b899a117 could not be found. Aug 27 03:14:23.184313 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:23.186388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] Returning 404 to user: Instance 50391137-b227-49eb-8694-c599b899a117 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:23.187966 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19ed2b02-de9b-49c3-aa21-596df76632ab tempest-MigrationsAdminTest-1673796581 tempest-MigrationsAdminTest-1673796581-project] 10.222.0.69 "GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117" status: 404 len: 111 microversion: 2.1 time: 0.067385 Aug 27 03:14:23.188966 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 910/1857] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:23 2022] GET /compute/v2.1/servers/50391137-b227-49eb-8694-c599b899a117 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:23.355685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f24b2ee4-8320-4fa7-b273-e176664eb1c5 req-aa3de58b-53ed-420d-98bb-01ee2373479c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ffcf06-bb0f-437f-a93e-3a52f8778829", "tag": "f221db85-aad0-4270-8580-abbd7867f1bd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:23.401164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f24b2ee4-8320-4fa7-b273-e176664eb1c5 req-aa3de58b-53ed-420d-98bb-01ee2373479c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.405139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f24b2ee4-8320-4fa7-b273-e176664eb1c5 req-aa3de58b-53ed-420d-98bb-01ee2373479c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.408013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f24b2ee4-8320-4fa7-b273-e176664eb1c5 req-aa3de58b-53ed-420d-98bb-01ee2373479c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.448467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:23.449519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:23.452115 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f24b2ee4-8320-4fa7-b273-e176664eb1c5 req-aa3de58b-53ed-420d-98bb-01ee2373479c service nova] Creating event network-changed:f221db85-aad0-4270-8580-abbd7867f1bd for instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 on n-h2-852086-5 Aug 27 03:14:23.474188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.476335 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f24b2ee4-8320-4fa7-b273-e176664eb1c5 req-aa3de58b-53ed-420d-98bb-01ee2373479c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120188 Aug 27 03:14:23.478127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.478761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.478905 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 948/1858] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:23.481297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.483466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.486905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.783574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:23.785870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:23.805637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:23.807912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.811589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.815431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.816740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.818599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.821741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.822337 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f0db53a-ff06-4fc9-b640-268f669cbb73 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1702 microversion: 2.1 time: 0.380834 Aug 27 03:14:23.823587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 911/1859] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:23 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1702 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:23.838519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:23.839138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:23.859127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.859618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.860053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:23.860763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:23.861216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:23.861638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.351074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:24.360739 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e1cbfe0-d51d-4fad-84c8-c72bf07bb088 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.582982 Aug 27 03:14:24.374716 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 949/1860] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:23 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:24.381631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:24.383436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:24.400945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.402719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.404325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.407801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.411078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.411947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.522331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:24.544562 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92d6fb2e-34fe-405d-b228-db929590b3dd tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.719879 Aug 27 03:14:24.549515 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 912/1861] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:23 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:24.625659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:24.654136 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5d6787bc-fe69-470e-b5c2-5779f93a6ac8 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1295 microversion: 2.1 time: 0.275916 Aug 27 03:14:24.660112 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 950/1862] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:24 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1295 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:24.851339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:24.852661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:24.860851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.866739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.869417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.876851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.879282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.881035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:25.215858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:25.226237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:25.234859 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c236f9b-7969-4a80-a4e0-610baee948d4 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1634 microversion: 2.1 time: 0.384337 Aug 27 03:14:25.248631 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 913/1863] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:24 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1634 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:25.389018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:25.390127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:25.408471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:25.412993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:25.413858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:25.416184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:25.418354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:25.419486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:25.502565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-574594975", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "9649e43c-11f6-4e3a-856e-10515d640ffa"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:25.635948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] validate_networks() for [('9649e43c-11f6-4e3a-856e-10515d640ffa', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:14:25.933701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:25.949136 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-682ebdbe-65ef-4f4a-8442-5664c088beef tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.566664 Aug 27 03:14:25.949953 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 914/1864] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:25 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:14:25.958754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:25.959664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:25.976949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:25.983209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:25.984165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:25.985129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:25.985796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:25.986523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:26.887848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:26.892775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:14:26.894253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:14:26.894985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:14:26.895570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:14:26.896177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:14:26.906859 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7215a907-7c80-4dfc-83f8-b3e84a0df43d tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.955465 Aug 27 03:14:26.915736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:26.917869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:26.918453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:26.920822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:26.921208 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 915/1865] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:25 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:26.926071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:26.927232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:26.936199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:26.936824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:26.947470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:26.952706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:26.953437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:26.954442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:26.955102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:26.955784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:26.988674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:14:26.998471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for user d1e2476870c64964814aabc9c60399cf and project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:14:27.020690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:14:27.024181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:27.139001 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd3fb1ce-0853-4cd8-af13-eca3f82303ff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138505 Aug 27 03:14:27.147611 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 951/1866] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:14:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:14:27.154425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:27.155714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:27.164033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:27.166110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:27.166926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:27.178510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:27.179051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:27.184529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:27.280349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:27.280859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:27.281305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:27.286466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lazy-loading 'fault' on Instance uuid f233cfb6-a746-4919-b6cf-a694f07cfeba {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:27.528665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:27.540724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f3cb2af0-3bee-44d3-a246-a8938ef8237e tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1325 microversion: 2.1 time: 0.618177 Aug 27 03:14:27.548171 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 916/1867] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:26 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1325 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:27.563989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f168f6e0-72c4-466a-812a-2e9eae376672 req-c33b42d1-f429-4dc5-b77f-3014f2f19d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f233cfb6-a746-4919-b6cf-a694f07cfeba", "name": "network-vif-deleted", "tag": "23046e60-7876-4073-85a0-4b1a400b8657"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:27.601373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f168f6e0-72c4-466a-812a-2e9eae376672 req-c33b42d1-f429-4dc5-b77f-3014f2f19d63 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:27.607686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f168f6e0-72c4-466a-812a-2e9eae376672 req-c33b42d1-f429-4dc5-b77f-3014f2f19d63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:27.608584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f168f6e0-72c4-466a-812a-2e9eae376672 req-c33b42d1-f429-4dc5-b77f-3014f2f19d63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:27.658922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c093521eb52f431eaac1c2ab229092ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169bb4af498e4606b896ea4d711b9d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:27.659153 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f168f6e0-72c4-466a-812a-2e9eae376672 req-c33b42d1-f429-4dc5-b77f-3014f2f19d63 service nova] Creating event network-vif-deleted:23046e60-7876-4073-85a0-4b1a400b8657 for instance f233cfb6-a746-4919-b6cf-a694f07cfeba on n-h1-852086-5 Aug 27 03:14:27.672159 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86d1cc5c-0ecc-41f6-8e7c-196b59858d1b tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 200 len: 1360 microversion: 2.1 time: 0.521170 Aug 27 03:14:27.683892 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 952/1868] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:27 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 1360 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:27.696262 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f168f6e0-72c4-466a-812a-2e9eae376672 req-c33b42d1-f429-4dc5-b77f-3014f2f19d63 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132562 Aug 27 03:14:27.697362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 917/1869] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:27.701648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:27.725550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:27.752246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:27.754271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:27.754994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:27.758396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:27.761854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:27.762661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:27.764667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-279f28e7-a6b3-459b-bf75-d13c6fb77518 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:27.769030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-279f28e7-a6b3-459b-bf75-d13c6fb77518 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:27.989100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-279f28e7-a6b3-459b-bf75-d13c6fb77518 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:28.007954 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-279f28e7-a6b3-459b-bf75-d13c6fb77518 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1207 microversion: 2.1 time: 0.299793 Aug 27 03:14:28.009575 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 918/1870] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:27 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1207 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:28.027625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:28.028284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:28.070274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:28.074291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:28.077959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:28.081285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:28.086372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:28.090094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:28.657360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:28.671380 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34aed373-9738-46e0-a287-3c21e02fd435 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.652833 Aug 27 03:14:28.672078 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 919/1871] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:28 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:28.699410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:28.700047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:28.743241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:28.748429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:28.752043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:28.752043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:28.752043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:28.764174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:29.359104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:29.389210 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e311f955-733d-4652-a038-881e7ae2f284 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 1.703915 Aug 27 03:14:29.392211 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 953/1872] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:27 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:29.400175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:29.405094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] [instance: f233cfb6-a746-4919-b6cf-a694f07cfeba] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:29.433321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:29.436278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:29.439445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:29.445466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:29.446441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:29.447219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:29.464516 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] HTTP exception thrown: Instance f233cfb6-a746-4919-b6cf-a694f07cfeba could not be found. Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Request method failure captured: Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba HTTP/1.1 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYu9LdBGkpUPQIxlu12M4yarEwjWCchGWBzr2biVmvVIPXLvntWKK5GKQfVReDoPAPw-Q2EXs2pThnGVPRFykPw-tuWwc-4N_CgBtqdkJZUj3vksKgFS19aBPoZ13dO6AJ-VJbbS7D-uxwQRAU5suR7h2PlhzpvaTavgi4lLfmkHus8 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 169bb4af498e4606b896ea4d711b9d12 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-882964220 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/169bb4af498e4606b896ea4d711b9d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/169bb4af498e4606b896ea4d711b9d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_169bb4af498e4606b896ea4d711b9d12", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/169bb4af498e4606b896ea4d711b9d12"}]}] Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-882964220 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 169bb4af498e4606b896ea4d711b9d12 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-882964220 Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-882964220-project Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c093521eb52f431eaac1c2ab229092ef Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-882964220-project Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance f233cfb6-a746-4919-b6cf-a694f07cfeba could not be found. Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'f233cfb6-a746-4919-b6cf-a694f07cfeba'} Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f233cfb6-a746-4919-b6cf-a694f07cfeba could not be found. Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f233cfb6-a746-4919-b6cf-a694f07cfeba could not be found. Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:29.466897 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:29.471732 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:29.471732 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:29.471732 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:29.471732 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:29.471732 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f233cfb6-a746-4919-b6cf-a694f07cfeba could not be found. Aug 27 03:14:29.471732 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:29.475959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Returning 404 to user: Instance f233cfb6-a746-4919-b6cf-a694f07cfeba could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:29.477092 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f688ee92-ef2e-4670-a79c-dd188494c1d9 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba" status: 404 len: 111 microversion: 2.1 time: 0.083686 Aug 27 03:14:29.478218 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 954/1873] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:29 2022] GET /compute/v2.1/servers/f233cfb6-a746-4919-b6cf-a694f07cfeba => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:29.483249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:29.484226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:29.492856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:29.493723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:29.494536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:29.495741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:29.496673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:29.497357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:29.707258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:29.728381 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f8928a7-996a-4419-a1f3-23030aebd3c9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1259 microversion: 2.1 time: 0.246164 Aug 27 03:14:29.735535 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 955/1874] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:29 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:29.758654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b5dbe62-adf2-4d4d-ac08-5308f30f7477 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] Calling method '.version_select at 0x7fe460313b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:29.809739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:29.812446 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b5dbe62-adf2-4d4d-ac08-5308f30f7477 tempest-ServersTestJSON-882964220 tempest-ServersTestJSON-882964220-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939888622" status: 202 len: 0 microversion: 2.1 time: 0.075586 Aug 27 03:14:29.818411 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 956/1875] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939888622 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:29.825202 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d2492a4-6c89-4b8f-97a6-39a6f7c98660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1325 microversion: 2.1 time: 1.141750 Aug 27 03:14:29.833152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:29.834291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:29.839051 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 920/1876] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:28 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1325 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:29.844900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:29.845591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:29.846286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:29.847982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:29.848476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:29.848911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:30.417811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:30.418552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:30.463747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:30.469130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:30.472383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:30.475710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:30.478788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:30.482452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.188354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:31.201746 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47ee352a-8f54-4b4b-acc0-df90507babff tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 1.383164 Aug 27 03:14:31.202386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 957/1877] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:29 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:31.217102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:31.218042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:31.235479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.235976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.258040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.259212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.259704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.260441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.494600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:31.510206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3cac46ee-9658-4284-9d9c-5b31cee633e3 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 1.099950 Aug 27 03:14:31.512590 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 921/1878] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:30 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:14:31.563727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-dd2a4e91-5d52-4777-a147-d8eac84efcf6 req-28452b79-8d89-4c2e-84f2-027ab296fff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a60bd733-0e7d-48b4-a30a-560a78a7ad07", "tag": "d0fd4e76-e6b2-491a-ab68-8aaaa10e48d3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:31.587287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dd2a4e91-5d52-4777-a147-d8eac84efcf6 req-28452b79-8d89-4c2e-84f2-027ab296fff4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.591203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dd2a4e91-5d52-4777-a147-d8eac84efcf6 req-28452b79-8d89-4c2e-84f2-027ab296fff4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.591949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dd2a4e91-5d52-4777-a147-d8eac84efcf6 req-28452b79-8d89-4c2e-84f2-027ab296fff4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.621471 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-dd2a4e91-5d52-4777-a147-d8eac84efcf6 req-28452b79-8d89-4c2e-84f2-027ab296fff4 service nova] Creating event network-changed:d0fd4e76-e6b2-491a-ab68-8aaaa10e48d3 for instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 on n-h1-852086-5 Aug 27 03:14:31.627277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-dd2a4e91-5d52-4777-a147-d8eac84efcf6 req-28452b79-8d89-4c2e-84f2-027ab296fff4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082411 Aug 27 03:14:31.629250 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 922/1879] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:31.637241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:31.638356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:31.646350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.647457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.648227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.648406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:31.649286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.649989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.650682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.661848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24ca9a0b-c74d-43cf-af6c-86710f69255f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1265 microversion: 2.1 time: 0.458286 Aug 27 03:14:31.662481 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 958/1880] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:31 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1265 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:31.683020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-eb152b1d-d2ef-482f-b627-e03bfb715f9c req-4f223ae9-dddf-43a6-b42d-90c478e93487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe54ba8-26e0-4fc0-a19e-88f2ea976dc5", "name": "network-vif-unplugged", "status": "completed", "tag": "06c9b27a-30de-4395-82f1-ce0edd651398"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:31.704829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:31.718586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-eb152b1d-d2ef-482f-b627-e03bfb715f9c req-4f223ae9-dddf-43a6-b42d-90c478e93487 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:31.719069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-eb152b1d-d2ef-482f-b627-e03bfb715f9c req-4f223ae9-dddf-43a6-b42d-90c478e93487 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:31.719503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-eb152b1d-d2ef-482f-b627-e03bfb715f9c req-4f223ae9-dddf-43a6-b42d-90c478e93487 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:31.743592 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-eb152b1d-d2ef-482f-b627-e03bfb715f9c req-4f223ae9-dddf-43a6-b42d-90c478e93487 service nova] Creating event network-vif-unplugged:06c9b27a-30de-4395-82f1-ce0edd651398 for instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 on n-h1-852086-5 Aug 27 03:14:31.759808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-eb152b1d-d2ef-482f-b627-e03bfb715f9c req-4f223ae9-dddf-43a6-b42d-90c478e93487 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094415 Aug 27 03:14:31.761094 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 959/1881] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:32.245481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b89d8a0-e7cd-415d-9360-a05bee35f49d tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] Action: 'create', calling method: .version_select at 0x7fe46026a160>, body: {"security_group": {"name": "tempest-securitygroup-102017579", "description": "tempest-description-484976322"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:32.539580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:32.550001 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cceff9d0-43a6-4936-9d75-f8f98865c7b3 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1325 microversion: 2.1 time: 0.918573 Aug 27 03:14:32.562576 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 923/1882] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:31 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1325 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:32.569547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:32.570220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:32.594293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:32.594796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:32.595279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:32.596017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:32.596617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:32.597050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:33.094729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:33.129815 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a7c20379-22dd-47e1-b976-63d7f013fe13 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.565982 Aug 27 03:14:33.132455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 924/1883] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:32 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:33.162934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:33.163959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:33.182770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:33.183675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:33.184699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:33.186878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:33.187675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:33.189353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:33.441456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:33.451812 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-740ad93b-741c-49ea-80dd-4540146e4c56 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.312746 Aug 27 03:14:33.453061 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 925/1884] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:33 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:33.460921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:33.461860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:33.470822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:33.471767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:33.472804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:33.475717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:33.476796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:33.477408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:33.791679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:33.801065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-98308a54-a58a-46dc-9d3b-41664fe3394f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1307 microversion: 2.1 time: 0.346558 Aug 27 03:14:33.802308 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 926/1885] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:33 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:33.807907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1040909994", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "34528e57-9495-4744-8566-85d04ab8d770"}], "block_device_mapping_v2": [{"uuid": "3eb6604a-ec11-4f14-848a-d9a5c01123ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:33.828447 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b89d8a0-e7cd-415d-9360-a05bee35f49d tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.065710 Aug 27 03:14:33.831444 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 960/1886] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:14:31 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:33.837552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:33.839296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:33.852435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:33.853241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:33.853930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:33.855021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:33.857253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:33.858326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:33.941683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] validate_networks() for [('34528e57-9495-4744-8566-85d04ab8d770', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:14:34.196741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:34.216796 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8c745a3-1db9-4a67-80e2-3c7be4ca55bd tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1325 microversion: 2.1 time: 0.383287 Aug 27 03:14:34.223387 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 961/1887] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:33 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:34.235333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-98c020e7-2c4a-40ac-88c3-53361ab99848 req-f1016a76-1177-4e7f-a342-0458ccaef777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe54ba8-26e0-4fc0-a19e-88f2ea976dc5", "tag": "06c9b27a-30de-4395-82f1-ce0edd651398"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:34.262066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-98c020e7-2c4a-40ac-88c3-53361ab99848 req-f1016a76-1177-4e7f-a342-0458ccaef777 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:34.262587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-98c020e7-2c4a-40ac-88c3-53361ab99848 req-f1016a76-1177-4e7f-a342-0458ccaef777 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:34.263046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-98c020e7-2c4a-40ac-88c3-53361ab99848 req-f1016a76-1177-4e7f-a342-0458ccaef777 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:34.301311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-98c020e7-2c4a-40ac-88c3-53361ab99848 req-f1016a76-1177-4e7f-a342-0458ccaef777 service nova] Creating event network-changed:06c9b27a-30de-4395-82f1-ce0edd651398 for instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 on n-h1-852086-5 Aug 27 03:14:34.312601 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-98c020e7-2c4a-40ac-88c3-53361ab99848 req-f1016a76-1177-4e7f-a342-0458ccaef777 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086621 Aug 27 03:14:34.315821 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 962/1888] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:34.327251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3e33f96-b879-4546-917a-f23e1426f6c4 tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] Action: 'create', calling method: .version_select at 0x7fe46026af70>, body: {"security_group": {"name": "tempest-securitygroup-2035426120", "description": "tempest-description-1512944791"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:35.057032 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3e33f96-b879-4546-917a-f23e1426f6c4 tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.737230 Aug 27 03:14:35.058548 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 963/1889] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:14:34 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:35.085224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:35.089340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:35.114094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:35.115309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:35.117274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:35.121468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:35.122865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:35.126808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:35.779238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:35.802957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43d850cd-1528-4f4c-a568-4e8a9f9dd59e tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.734071 Aug 27 03:14:35.806257 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 964/1890] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:35 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:35.814397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:35.818241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:35.830453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:35.831345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:35.832066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:35.833060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:35.833802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:35.834528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:36.200676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:36.222400 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf57865a-4412-407a-9258-36cec54a0cbf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.413847 Aug 27 03:14:36.227593 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 965/1891] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:35 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:36.238352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:36.240991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:36.263864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:36.264358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:36.264851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:36.265519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:36.265980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:36.275909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:36.303892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:36.702091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:14:36.702730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:14:36.703203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:14:36.703896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:14:36.704550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:14:36.723103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=19 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:36.726561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:36.729686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:36.730368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:36.732636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:36.734590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:36.735305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:36.736667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:36.756272 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b290a62a-e93f-4d4a-8994-278ce9b3d8d4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1307 microversion: 2.1 time: 0.524470 Aug 27 03:14:36.761271 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 966/1892] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:36 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1307 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:36.779263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:36.795024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:14:36.804438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Getting quotas for user 21a64079d45547ba80c22c309d216438 and project 99adbc97973247998f0bfbbc486a410e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:14:36.894852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:14:36.897333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3eb6604a-ec11-4f14-848a-d9a5c01123ce',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:36.911172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-914c1054-251a-4bb3-a31f-6c3a99f1ba64 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] Action: 'create', calling method: .version_select at 0x7fe4601f93a0>, body: {"security_group": {"name": "tempest-securitygroup-2037799108", "description": "tempest-description-1907262094"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:36.955319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:37.025544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:37.172499 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e58581c3-062a-4394-807e-a2c461dc5ce3 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.368537 Aug 27 03:14:37.175788 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 927/1893] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:14:37.184063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:37.189504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:37.203528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.204415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.205129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.206929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.207573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.208225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.706329 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-914c1054-251a-4bb3-a31f-6c3a99f1ba64 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.942739 Aug 27 03:14:37.719088 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 967/1894] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:14:36 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:37.724137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-81a8a5ac-b7f9-487c-8366-7a271b39f9f8 req-5d8aa180-de53-47f6-ae87-48335f37c8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ffcf06-bb0f-437f-a93e-3a52f8778829", "name": "network-vif-plugged", "status": "completed", "tag": "f221db85-aad0-4270-8580-abbd7867f1bd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:37.747658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81a8a5ac-b7f9-487c-8366-7a271b39f9f8 req-5d8aa180-de53-47f6-ae87-48335f37c8c2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.748795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81a8a5ac-b7f9-487c-8366-7a271b39f9f8 req-5d8aa180-de53-47f6-ae87-48335f37c8c2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.749723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81a8a5ac-b7f9-487c-8366-7a271b39f9f8 req-5d8aa180-de53-47f6-ae87-48335f37c8c2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.778475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-81a8a5ac-b7f9-487c-8366-7a271b39f9f8 req-5d8aa180-de53-47f6-ae87-48335f37c8c2 service nova] Creating event network-vif-plugged:f221db85-aad0-4270-8580-abbd7867f1bd for instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 on n-h2-852086-5 Aug 27 03:14:37.791397 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-81a8a5ac-b7f9-487c-8366-7a271b39f9f8 req-5d8aa180-de53-47f6-ae87-48335f37c8c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074142 Aug 27 03:14:37.793220 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 968/1895] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:37.848193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:37.852126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:37.865456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.866859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.866859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:37.868327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:37.869198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:37.871272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:38.121634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:38.141582 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c76478e8-5dff-43f0-badc-c9d6a3635603 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1325 microversion: 2.1 time: 0.964414 Aug 27 03:14:38.142403 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 928/1896] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:37 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1325 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:38.155071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5ce9d053-6ff2-4c7f-a315-0396ef439ec3 req-a87639a0-6dd1-42dd-b5bd-4c7f19489e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab700a6-df98-4f70-b929-c19c3ac0ab95", "tag": "cd5030f1-5035-4949-973e-4441f8c7b544"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:38.194225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5ce9d053-6ff2-4c7f-a315-0396ef439ec3 req-a87639a0-6dd1-42dd-b5bd-4c7f19489e3e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:38.194706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5ce9d053-6ff2-4c7f-a315-0396ef439ec3 req-a87639a0-6dd1-42dd-b5bd-4c7f19489e3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:38.195134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5ce9d053-6ff2-4c7f-a315-0396ef439ec3 req-a87639a0-6dd1-42dd-b5bd-4c7f19489e3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:38.218314 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5ce9d053-6ff2-4c7f-a315-0396ef439ec3 req-a87639a0-6dd1-42dd-b5bd-4c7f19489e3e service nova] Creating event network-changed:cd5030f1-5035-4949-973e-4441f8c7b544 for instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 on n-h1-852086-5 Aug 27 03:14:38.233321 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5ce9d053-6ff2-4c7f-a315-0396ef439ec3 req-a87639a0-6dd1-42dd-b5bd-4c7f19489e3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086649 Aug 27 03:14:38.234553 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 929/1897] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:38.245272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:38.246111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:38.253120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:38.253826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:38.254653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:38.255567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:38.256178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:38.256770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:38.401181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:38.418071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:38.420091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:38.421267 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab34b606-be84-41c3-9845-67d9c0b75111 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1185 microversion: 2.25 time: 0.185452 Aug 27 03:14:38.421831 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 930/1898] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:38 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:38.447182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:38.448002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:38.464297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:38.464799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:38.471724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:38.472518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:38.473000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:38.475796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:38.504948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:38.523159 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c6e326b-6b22-48e0-b1d3-c337d1bd2110 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.727864 Aug 27 03:14:38.524292 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 969/1899] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:37 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:38.567085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1694c785-74d3-4b11-aabd-7ee69a411724 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] Action: 'create', calling method: .version_select at 0x7fe45c0c8280>, body: {"security_group": {"name": "tempest-securitygroup-836936170", "description": "tempest-description-888780563"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:39.052324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:39.071654 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51274ed7-4dac-4dc1-90fd-7f7734a33495 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1324 microversion: 2.1 time: 0.632899 Aug 27 03:14:39.074095 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 931/1900] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:38 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:39.079573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:39.083536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:39.094596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:39.096126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:39.108039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:39.108861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:39.110122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:39.110864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:39.426457 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1694c785-74d3-4b11-aabd-7ee69a411724 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.881838 Aug 27 03:14:39.427393 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 970/1901] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:14:38 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:39.435701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:39.441981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:39.451826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:39.452776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:39.454983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:39.456792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:39.458692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:39.460084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:39.509319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:39.534386 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff42f6d0-ef06-44d3-8cc3-7dd752afa5ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1307 microversion: 2.1 time: 0.458802 Aug 27 03:14:39.535664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 932/1902] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:39 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1307 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:39.544871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8771524c-a0a6-4c7d-8cc6-d1531a171395 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] Calling method '.version_select at 0x7fe457bb7040>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:39.955195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:39.974957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aec256f2-320b-4383-9cea-5f2c6db814c6 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1325 microversion: 2.1 time: 0.544649 Aug 27 03:14:39.986131 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 971/1903] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:39 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1325 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:40.003243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:40.004255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:40.043260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:40.044296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:40.045113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:40.046427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:40.058964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:40.059814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:40.257109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:40.270737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:40.272790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:40.275081 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a08dda8a-1158-45e5-8451-2bec7f4035a4 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1233 microversion: 2.25 time: 0.286693 Aug 27 03:14:40.276136 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 972/1904] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:39 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1233 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:40.312814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:40.313765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:40.324545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:40.326123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:40.326755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:40.327671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:40.328301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:40.328911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:40.753473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:40.764721 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc704742-17bf-488e-b52e-675d2f6d9785 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1389 microversion: 2.1 time: 0.458157 Aug 27 03:14:40.767365 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 973/1905] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:40 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1389 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:40.775246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d61d1fa5-0701-4d7e-a7f6-ba7cf8897d9d req-0a5a2a4e-ecff-4c5b-aea4-4a5d6570a6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60bd733-0e7d-48b4-a30a-560a78a7ad07", "name": "network-vif-plugged", "status": "completed", "tag": "d0fd4e76-e6b2-491a-ab68-8aaaa10e48d3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:40.803242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d61d1fa5-0701-4d7e-a7f6-ba7cf8897d9d req-0a5a2a4e-ecff-4c5b-aea4-4a5d6570a6c1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:40.804168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d61d1fa5-0701-4d7e-a7f6-ba7cf8897d9d req-0a5a2a4e-ecff-4c5b-aea4-4a5d6570a6c1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:40.805003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d61d1fa5-0701-4d7e-a7f6-ba7cf8897d9d req-0a5a2a4e-ecff-4c5b-aea4-4a5d6570a6c1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:40.825180 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d61d1fa5-0701-4d7e-a7f6-ba7cf8897d9d req-0a5a2a4e-ecff-4c5b-aea4-4a5d6570a6c1 service nova] Creating event network-vif-plugged:d0fd4e76-e6b2-491a-ab68-8aaaa10e48d3 for instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 on n-h1-852086-5 Aug 27 03:14:40.835056 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d61d1fa5-0701-4d7e-a7f6-ba7cf8897d9d req-0a5a2a4e-ecff-4c5b-aea4-4a5d6570a6c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064424 Aug 27 03:14:40.836621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 974/1906] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:40.843287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:40.844395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:40.859093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:40.860575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:40.861304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:40.863864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:40.864640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:40.865342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:41.473058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:41.486444 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-588e6e98-c658-45a3-a8e9-1fbaa4bc12ab tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 200 len: 1520 microversion: 2.1 time: 0.644530 Aug 27 03:14:41.488679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 975/1907] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:40 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 1520 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:41.501124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:41.501923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:41.523507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:41.554883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:41.559333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:41.562596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:41.566609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:41.567229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:41.891112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:41.914617 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-606d1be3-742f-415c-8db7-38a56899d1ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1307 microversion: 2.1 time: 0.423064 Aug 27 03:14:41.914732 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 976/1908] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:41 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1307 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:41.932485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:41.933419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:41.953188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:41.954771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:41.955308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:41.955804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:41.956616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:41.960101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:41.960565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:42.390511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:42.407532 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3067f0d1-85ad-4e3f-994a-243c51174637 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1325 microversion: 2.1 time: 0.486887 Aug 27 03:14:42.412799 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 977/1909] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:41 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:42.426778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:42.430045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:42.447474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:42.450038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:42.451665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:42.454779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:42.456813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:42.457585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:43.073047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:43.092300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:43.093932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:43.096785 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76fefb4b-16e5-48e4-9b99-387a5eb03c6b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1293 microversion: 2.25 time: 0.677951 Aug 27 03:14:43.110559 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 978/1910] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:42 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1293 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:43.116177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'action', calling method: .version_select at 0x7fe45dc4b310>, body: {"addFloatingIp": {"address": "172.25.1.179"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:43.119183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:43.125863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:43.134705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:43.135490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:43.136564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:43.137261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:43.138097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:43.290864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:14:43.294439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquired lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:14:46.775281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:46.794901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8771524c-a0a6-4c7d-8cc6-d1531a171395 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] 10.222.0.69 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12294 microversion: 2.1 time: 7.256227 Aug 27 03:14:46.796589 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 933/1911] 10.222.0.69 () {58 vars in 1191 bytes} [Sat Aug 27 03:14:39 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12294 bytes in 7260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:14:46.829884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=5 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:46.988501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-621421329", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "a94426e5-af0f-4735-a2d1-c5a3fb986478"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:47.180823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] validate_networks() for [('a94426e5-af0f-4735-a2d1-c5a3fb986478', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:14:48.568805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:14:48.569450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:14:48.569704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:14:48.570117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:14:48.570575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:14:48.588454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:48.589244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:48.589901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:48.591060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:48.591965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:48.592625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:48.616323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Getting quotas for project 9d018df5801a4c85a198d22999986d43. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:14:48.629885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Getting quotas for user fad527dfec194654b0a90c1e7b39f3a1 and project 9d018df5801a4c85a198d22999986d43. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:14:48.656283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:14:48.660706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:48.726334 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48fe6d91-a619-4824-898e-7a9f94639995 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927562 Aug 27 03:14:48.727819 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 934/1912] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:14:48.733362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:48.734547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:48.745416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:48.746422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:48.747491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:48.748698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:48.749385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:48.749832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:49.050902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:49.053520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:49.070356 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-287b070f-cc04-43fd-8ece-e2d6daf0e86f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1379 microversion: 2.1 time: 0.340962 Aug 27 03:14:49.071205 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 935/1913] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:48 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1379 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:49.082616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:49.083398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:49.101502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:49.102922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:49.103458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:49.106004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:49.106608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:49.107439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:49.291026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Building network info cache for instance {{(pid=122408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:14:49.400268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:49.412615 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4e78447-9747-4195-ba69-9bd3e007d3a0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1307 microversion: 2.1 time: 0.339974 Aug 27 03:14:49.414033 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 936/1914] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:49 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:49.420907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:49.422738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:49.433710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:49.436376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:49.437119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:49.439231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:49.441143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:49.442846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:49.811230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:49.834409 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f5b01b38-8909-4b39-961e-e278376ad319 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1522 microversion: 2.1 time: 0.417204 Aug 27 03:14:49.836745 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 937/1915] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:49 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:49.845410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:49.852101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:49.873547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:49.880568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:49.881353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:49.884975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:49.891580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:49.894712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:50.224593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:50.234317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:50.236245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:50.238217 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8e4a44a0-04a6-42fc-8c5b-678db2ca59d5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1293 microversion: 2.25 time: 0.396991 Aug 27 03:14:50.257638 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 938/1916] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:49 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1293 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:50.278596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8a840385-19d2-40af-a4a7-1701970f696b req-567b4f0c-abe2-46b6-b215-5c69f5c1aa07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab700a6-df98-4f70-b929-c19c3ac0ab95", "name": "network-vif-plugged", "status": "completed", "tag": "cd5030f1-5035-4949-973e-4441f8c7b544"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:50.294591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8a840385-19d2-40af-a4a7-1701970f696b req-567b4f0c-abe2-46b6-b215-5c69f5c1aa07 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:50.296774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8a840385-19d2-40af-a4a7-1701970f696b req-567b4f0c-abe2-46b6-b215-5c69f5c1aa07 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:50.297352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8a840385-19d2-40af-a4a7-1701970f696b req-567b4f0c-abe2-46b6-b215-5c69f5c1aa07 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:50.319771 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8a840385-19d2-40af-a4a7-1701970f696b req-567b4f0c-abe2-46b6-b215-5c69f5c1aa07 service nova] Creating event network-vif-plugged:cd5030f1-5035-4949-973e-4441f8c7b544 for instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 on n-h1-852086-5 Aug 27 03:14:50.326009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8a840385-19d2-40af-a4a7-1701970f696b req-567b4f0c-abe2-46b6-b215-5c69f5c1aa07 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065626 Aug 27 03:14:50.327057 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 939/1917] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:50.333845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6a6b0c00-70f0-454e-a428-35ac4e2f779d tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] Calling method '.version_select at 0x7fe457baa550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:50.757592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Updating instance_info_cache with network_info: [{"id": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c", "address": "fa:16:3e:98:a8:99", "network": {"id": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1375419615-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d3533cb9e2134a848d7c323a5429cf1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94baeff4-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:14:50.795507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6a6b0c00-70f0-454e-a428-35ac4e2f779d tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.466370 Aug 27 03:14:50.796206 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 940/1918] 10.222.0.69 () {58 vars in 1191 bytes} [Sat Aug 27 03:14:50 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:50.801529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Releasing lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:14:50.803224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-50e231c6-811c-49be-b0ec-54e8f18e73a3 req-0cdb9c08-b24f-4434-a956-ac704d2b692c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6961efe-d7b6-4144-b0b6-77266b0b756d", "tag": "d0222350-a39e-4f7c-b624-888e8e836388"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:50.804345 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb2271e3-28c7-40cc-aff4-56e19684b14c tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action" status: 202 len: 0 microversion: 2.1 time: 7.692052 Aug 27 03:14:50.807261 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 979/1919] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:43 2022] POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action => generated 0 bytes in 7696 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:14:50.820570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:50.821879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:50.823375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-50e231c6-811c-49be-b0ec-54e8f18e73a3 req-0cdb9c08-b24f-4434-a956-ac704d2b692c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:50.823939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-50e231c6-811c-49be-b0ec-54e8f18e73a3 req-0cdb9c08-b24f-4434-a956-ac704d2b692c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:50.838656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-50e231c6-811c-49be-b0ec-54e8f18e73a3 req-0cdb9c08-b24f-4434-a956-ac704d2b692c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:50.849078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:50.850291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:50.851140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:50.852501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:50.853380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:50.854178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:50.863441 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-50e231c6-811c-49be-b0ec-54e8f18e73a3 req-0cdb9c08-b24f-4434-a956-ac704d2b692c service nova] Creating event network-changed:d0222350-a39e-4f7c-b624-888e8e836388 for instance a6961efe-d7b6-4144-b0b6-77266b0b756d on n-h2-852086-5 Aug 27 03:14:50.882574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-50e231c6-811c-49be-b0ec-54e8f18e73a3 req-0cdb9c08-b24f-4434-a956-ac704d2b692c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084724 Aug 27 03:14:50.886516 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 941/1920] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:50.896796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75eb739d-ca25-47c9-b72d-142bff428698 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '.version_select at 0x7fe457ba69d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:50.904763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75eb739d-ca25-47c9-b72d-142bff428698 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:50.905642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75eb739d-ca25-47c9-b72d-142bff428698 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:50.906439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75eb739d-ca25-47c9-b72d-142bff428698 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:50.920863 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-75eb739d-ca25-47c9-b72d-142bff428698 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 2703 microversion: 2.1 time: 0.030197 Aug 27 03:14:50.931043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 942/1921] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:14:50 2022] GET /compute/v2.1/os-migrations => generated 2703 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:50.939132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:50.940312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:50.950264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:50.950877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:50.951618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:50.952598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:50.953147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:50.954311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:51.007746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:51.022150 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-312aebc0-427b-4fa1-8ed8-62cbac68591e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1283 microversion: 2.1 time: 0.213472 Aug 27 03:14:51.026128 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 980/1922] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:50 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1283 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:51.043095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:51.056690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:51.057923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:51.081334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:51.082656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:51.085210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:51.086943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:51.090384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:51.091579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:51.306536 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aab8613f-7885-4c2c-9dfa-0d285cecad10 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 204 len: 0 microversion: 2.1 time: 0.372053 Aug 27 03:14:51.310001 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 943/1923] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:50 2022] DELETE /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:51.320137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'action', calling method: .version_select at 0x7fe45e5f2280>, body: {"addFloatingIp": {"address": "172.25.1.179"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:51.329027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:51.349848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:51.350443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:51.350902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:51.352884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:51.354557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:51.355594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:51.477132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "refresh_cache-73ffcf06-bb0f-437f-a93e-3a52f8778829" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:14:51.477770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquired lock "refresh_cache-73ffcf06-bb0f-437f-a93e-3a52f8778829" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:14:51.600216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:51.620462 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da9fe75c-f105-4bc1-a8d2-c3048670af46 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1307 microversion: 2.1 time: 0.589997 Aug 27 03:14:51.622860 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 981/1924] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:51 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:51.645526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ab85659-e8b5-44a8-9d04-18f9f7f008c1 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] Calling method '.version_select at 0x7fe460381160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:52.123163 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ab85659-e8b5-44a8-9d04-18f9f7f008c1 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/e4f735d1-1ed5-499c-bc86-f629516d03bc" status: 202 len: 0 microversion: 2.1 time: 0.498347 Aug 27 03:14:52.125040 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 982/1925] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:14:51 2022] DELETE /compute/v2.1/os-security-groups/e4f735d1-1ed5-499c-bc86-f629516d03bc => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:52.319706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1881622191", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": "none"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:52.389044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:14:52.389564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:14:52.390399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:14:52.390546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:14:52.391226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:14:52.403544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:52.404077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:52.405208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:52.406107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:52.406871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:52.407299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:52.429421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Getting quotas for project 3a394dd7ecbe47099439a15a08938199. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:14:52.435920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Getting quotas for user e914768f36c84f21aba47de727badbfc and project 3a394dd7ecbe47099439a15a08938199. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:14:52.450901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:14:52.453586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:52.512144 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d10506b-4bbf-4119-bcf7-e92afd6bb2c5 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.385208 Aug 27 03:14:52.513476 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 983/1926] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 387 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:14:52.519439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:52.520392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:52.529499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:52.530345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:52.530978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:52.532169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:52.532813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:52.534036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:52.737740 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5aa1c73c-461c-419c-b19f-ca81ffbceb65 tempest-LiveMigrationTest-1037738836 tempest-LiveMigrationTest-1037738836-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1530 microversion: 2.1 time: 0.221652 Aug 27 03:14:52.739579 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 984/1927] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:52 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1530 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:52.744752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:52.745698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:52.764206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:52.764835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:52.765392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:52.766355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:52.766963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:52.768101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:52.969858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:52.984818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:52.987036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:52.988755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-517c6491-e741-4fdc-8259-e549176720c2 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 0.247996 Aug 27 03:14:52.989634 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 985/1928] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:52 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:52.995248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:52.996139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:53.003231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.003936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.004661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.005574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.006210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.006819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.251181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:53.271010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-010810b8-2ab2-4bcf-a354-3a4224e6ab82 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1528 microversion: 2.1 time: 0.279441 Aug 27 03:14:53.272732 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 986/1929] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:52 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1528 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:53.296724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:53.298751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:53.309422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.310330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.310755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.311697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.312263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.312696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.329313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:53.381256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:53.389417 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd8f6898-ad65-4e5d-bb60-72146203820f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1283 microversion: 2.1 time: 0.105068 Aug 27 03:14:53.389998 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 987/1930] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:53 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1283 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:53.395643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d15b2c97-2dc4-42e7-913a-cdb137748e36 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] Calling method '.version_select at 0x7fe46037a820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:53.682350 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d15b2c97-2dc4-42e7-913a-cdb137748e36 tempest-SecurityGroupsTestAdminJSON-713261358 tempest-SecurityGroupsTestAdminJSON-713261358-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/df51d473-72a1-4b2c-8c69-753594c95994" status: 202 len: 0 microversion: 2.1 time: 0.291219 Aug 27 03:14:53.683548 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 988/1931] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:14:53 2022] DELETE /compute/v2.1/os-security-groups/df51d473-72a1-4b2c-8c69-753594c95994 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:53.688442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:53.694128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:53.709911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.713036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.714778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.715812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.717391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.718055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.935882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:53.956292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:53.961597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:53.963453 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4785157-2df9-41c9-a20b-81093f2d2e13 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 200 len: 1277 microversion: 2.47 time: 0.278611 Aug 27 03:14:53.964868 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 989/1932] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:53 2022] GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:53.974514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:53.976803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:53.985982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.986873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.987562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.988608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.989969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.990712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.181663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:54.197673 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8318780-ccae-492e-9172-0d5af978c20b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1487 microversion: 2.1 time: 0.230588 Aug 27 03:14:54.199339 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 990/1933] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:53 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1487 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:54.205832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:54.206938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:54.216832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:54.217150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:54.217602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.218637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:54.219109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:54.219546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.253412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:14:54.363599 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e34e8181-cbb1-4420-a647-7d167a3b18b2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "DELETE /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 204 len: 0 microversion: 2.1 time: 0.162066 Aug 27 03:14:54.364014 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 991/1934] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:54 2022] DELETE /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:14:54.370443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2cfaab88-58a0-4bad-91c1-4d6706dc1060 req-206e967d-d206-47a4-8391-2936cb0b5775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851", "tag": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:54.385619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2cfaab88-58a0-4bad-91c1-4d6706dc1060 req-206e967d-d206-47a4-8391-2936cb0b5775 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:54.386182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2cfaab88-58a0-4bad-91c1-4d6706dc1060 req-206e967d-d206-47a4-8391-2936cb0b5775 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:54.386622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2cfaab88-58a0-4bad-91c1-4d6706dc1060 req-206e967d-d206-47a4-8391-2936cb0b5775 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.405938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2cfaab88-58a0-4bad-91c1-4d6706dc1060 req-206e967d-d206-47a4-8391-2936cb0b5775 service nova] Creating event network-changed:94baeff4-2d7b-4a93-9158-c9c1d15ccd6c for instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 on n-h1-852086-5 Aug 27 03:14:54.421474 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2cfaab88-58a0-4bad-91c1-4d6706dc1060 req-206e967d-d206-47a4-8391-2936cb0b5775 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055164 Aug 27 03:14:54.423100 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 992/1935] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:54.431408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9e17581-e336-4797-9ce0-c9173c818988 tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] Calling method '.version_select at 0x7fe4602f0f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:54.890859 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9e17581-e336-4797-9ce0-c9173c818988 tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/e79224a1-7386-4d68-b146-d6d638158de4" status: 202 len: 0 microversion: 2.1 time: 0.463595 Aug 27 03:14:54.895480 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 993/1936] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:14:54 2022] DELETE /compute/v2.1/os-security-groups/e79224a1-7386-4d68-b146-d6d638158de4 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:54.901635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:54.902727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:54.924401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:54.925578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:54.926337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.927333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:54.927983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:54.928633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.288166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:55.299231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:55.300991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:55.302303 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eddb5306-d86d-4d0f-a193-73cdb67892af tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 0.405430 Aug 27 03:14:55.302995 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 994/1937] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:54 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:55.308656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:55.314310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:55.315893 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.network.neutron [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] re-assign floating IP 172.25.1.179 from instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 Aug 27 03:14:55.327966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.328737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.329179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.330452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.330924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.331455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.400994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Building network info cache for instance {{(pid=122407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:14:55.436660 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31d35b33-5ce2-4bf3-a709-a8e324d34756 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95/action" status: 202 len: 0 microversion: 2.1 time: 0.131506 Aug 27 03:14:55.437679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 995/1938] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:55 2022] POST /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:55.445128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:55.445951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:55.453570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.454072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.454654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.455999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.456520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.456959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.512150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.513309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.513834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.515022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lazy-loading 'fault' on Instance uuid a60bd733-0e7d-48b4-a30a-560a78a7ad07 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:55.616293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7268918710454b128eaa3621f708efb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3372b4747f714009ad9a04a488019e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:55.630239 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f374704e-ce14-450e-b382-5fcb79b86e2b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 200 len: 1315 microversion: 2.1 time: 0.191027 Aug 27 03:14:55.641041 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 996/1939] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:55 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:55.651425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:55.652290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:55.662536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.663131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.663676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.664526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.665075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.665584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.979931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:56.043838 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86d670f8-0bf9-448d-8488-f604d81ca2a9 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1385 microversion: 2.1 time: 0.400890 Aug 27 03:14:56.044699 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 997/1940] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:55 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1385 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:56.099938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:56.103641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:56.151820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:56.152876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:56.165425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:56.168908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:56.169554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:56.171915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:56.550154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Updating instance_info_cache with network_info: [{"id": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c", "address": "fa:16:3e:98:a8:99", "network": {"id": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1375419615-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d3533cb9e2134a848d7c323a5429cf1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94baeff4-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:14:56.595080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Building network info cache for instance {{(pid=122407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:14:56.686196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:56.695534 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca7b7dd4-947d-43cb-b872-45fea4b313c8 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.641817 Aug 27 03:14:56.695534 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 998/1941] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:56 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:56.711003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e2946b79-1051-4c56-a65a-9e65da11b375 req-1ab081f6-6b5e-4005-b851-510ea32e0784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851", "tag": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:56.727641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e2946b79-1051-4c56-a65a-9e65da11b375 req-1ab081f6-6b5e-4005-b851-510ea32e0784 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:56.728131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e2946b79-1051-4c56-a65a-9e65da11b375 req-1ab081f6-6b5e-4005-b851-510ea32e0784 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:56.734657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e2946b79-1051-4c56-a65a-9e65da11b375 req-1ab081f6-6b5e-4005-b851-510ea32e0784 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:56.769914 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e2946b79-1051-4c56-a65a-9e65da11b375 req-1ab081f6-6b5e-4005-b851-510ea32e0784 service nova] Creating event network-changed:94baeff4-2d7b-4a93-9158-c9c1d15ccd6c for instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 on n-h1-852086-5 Aug 27 03:14:56.787344 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e2946b79-1051-4c56-a65a-9e65da11b375 req-1ab081f6-6b5e-4005-b851-510ea32e0784 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090436 Aug 27 03:14:56.787983 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 999/1942] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:56.801288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41e0e097-c977-4c30-8650-13a010b4c982 tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] Calling method '.version_select at 0x7fe460337700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:57.167714 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41e0e097-c977-4c30-8650-13a010b4c982 tempest-SecurityGroupsTestAdminJSON-514606136 tempest-SecurityGroupsTestAdminJSON-514606136-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/274e15f5-ed19-4fce-95dc-b588b50a9a7c" status: 202 len: 0 microversion: 2.1 time: 0.378462 Aug 27 03:14:57.168351 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1000/1943] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:14:56 2022] DELETE /compute/v2.1/os-security-groups/274e15f5-ed19-4fce-95dc-b588b50a9a7c => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:14:57.174913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:57.175917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:57.196455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:57.197379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:57.198136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:57.200799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:57.202008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:57.205472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:57.328674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:57.340084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:57.342259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:57.343690 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a5b2007-8141-478b-afd9-2498cc6feffa tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 200 len: 1339 microversion: 2.47 time: 0.173480 Aug 27 03:14:57.345280 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1001/1944] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:57 2022] GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 1339 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:57.350370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:57.355032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:57.371938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:57.372711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:57.374114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:57.374881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:57.375340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:57.375858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:57.879310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:57.903214 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e7e2d0d-9a21-4d96-8bbe-fc2226a0be77 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 200 len: 1472 microversion: 2.1 time: 0.556342 Aug 27 03:14:57.909767 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1002/1945] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:57 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 1472 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:57.931942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:57.935602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:57.951953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Updating instance_info_cache with network_info: [{"id": "f221db85-aad0-4270-8580-abbd7867f1bd", "address": "fa:16:3e:17:2d:3e", "network": {"id": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1375419615-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d3533cb9e2134a848d7c323a5429cf1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf221db85-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:14:57.961416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:57.962812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:57.964627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:57.968905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Releasing lock "refresh_cache-73ffcf06-bb0f-437f-a93e-3a52f8778829" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:14:57.969512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:57.970081 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-de2ba00d-0587-4419-b68a-7d4e388a43f9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829/action" status: 202 len: 0 microversion: 2.1 time: 6.656606 Aug 27 03:14:57.971553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:57.971768 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 944/1946] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:51 2022] POST /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829/action => generated 0 bytes in 6663 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:14:57.979689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:57.982577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-23f4510e-4dfd-44e5-af5a-36b28f17e356 req-2ffaa6a9-ca31-4fee-8828-f38fa7d2643f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe54ba8-26e0-4fc0-a19e-88f2ea976dc5", "name": "network-vif-deleted", "tag": "06c9b27a-30de-4395-82f1-ce0edd651398"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:58.007493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-23f4510e-4dfd-44e5-af5a-36b28f17e356 req-2ffaa6a9-ca31-4fee-8828-f38fa7d2643f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.008006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-23f4510e-4dfd-44e5-af5a-36b28f17e356 req-2ffaa6a9-ca31-4fee-8828-f38fa7d2643f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.008433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-23f4510e-4dfd-44e5-af5a-36b28f17e356 req-2ffaa6a9-ca31-4fee-8828-f38fa7d2643f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.036356 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-23f4510e-4dfd-44e5-af5a-36b28f17e356 req-2ffaa6a9-ca31-4fee-8828-f38fa7d2643f service nova] Creating event network-vif-deleted:06c9b27a-30de-4395-82f1-ce0edd651398 for instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 on n-h2-852086-5 Aug 27 03:14:58.048215 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-23f4510e-4dfd-44e5-af5a-36b28f17e356 req-2ffaa6a9-ca31-4fee-8828-f38fa7d2643f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075334 Aug 27 03:14:58.049201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 945/1947] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:58.060791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:58.061504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: a60bd733-0e7d-48b4-a30a-560a78a7ad07] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:58.077685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.078466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.079138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.081499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.083366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.084181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.107809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 could not be found. Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 HTTP/1.1 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 could not be found. Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'a60bd733-0e7d-48b4-a30a-560a78a7ad07'} Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 could not be found. Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 could not be found. Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:58.109569 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 could not be found. Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c8699fe-1fc2-4aa0-976a-1a1dafbd4660 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07" status: 404 len: 111 microversion: 2.1 time: 0.058482 Aug 27 03:14:58.115818 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 946/1948] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:58 2022] GET /compute/v2.1/servers/a60bd733-0e7d-48b4-a30a-560a78a7ad07 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:58.117772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:58.118417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:58.128212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.128717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.129175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.130391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.130858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.131289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.236795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:58.246223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f601412-427c-4e33-8b01-660e11804303 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1183 microversion: 2.1 time: 0.132390 Aug 27 03:14:58.247874 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 947/1949] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:58 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:58.268658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:58.269631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:58.282713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.284649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.285379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.286546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.287280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.287903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.571962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:58.586599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aafaa529-7d06-42f6-84b1-8f9dc34ec42c tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.336550 Aug 27 03:14:58.598193 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 948/1950] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:58 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:58.598193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-585831842"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:58.603294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:58.604968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:58.612128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.612961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.613965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.615651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:58.616859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:58.617849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:58.658765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:58.887498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:58.906355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:58.915336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:58.918327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3c37c69-47a0-4053-85f3-31e5a07b5e83 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 1.005270 Aug 27 03:14:58.934761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1003/1951] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:57 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:58.943215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'action', calling method: .version_select at 0x7fe45dc4b3a0>, body: {"removeFloatingIp": {"address": "172.25.1.179"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:58.955752 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed04f829-a095-49cc-90c2-60a4bd77ce76 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95/action" status: 202 len: 0 microversion: 2.1 time: 0.365958 Aug 27 03:14:58.962578 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 949/1952] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:58 2022] POST /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:14:58.968529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfa3ec7a-ae1a-4459-b0e3-a8b879b3f51b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '.version_select at 0x7fe457d3e3a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.028438 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-dfa3ec7a-ae1a-4459-b0e3-a8b879b3f51b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Image not found. Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfa3ec7a-ae1a-4459-b0e3-a8b879b3f51b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e HTTP/1.1 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '354779b5-e1b0-40c8-8910-f4292adf3d0e'} Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 354779b5-e1b0-40c8-8910-f4292adf3d0e to delete Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 354779b5-e1b0-40c8-8910-f4292adf3d0e could not be found. Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.030362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfa3ec7a-ae1a-4459-b0e3-a8b879b3f51b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dfa3ec7a-ae1a-4459-b0e3-a8b879b3f51b tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e" status: 404 len: 62 microversion: 2.1 time: 0.067610 Aug 27 03:14:59.038326 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 950/1953] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:58 2022] DELETE /compute/v2.1/images/354779b5-e1b0-40c8-8910-f4292adf3d0e => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:14:59.046108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.047377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.054391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.055158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.055765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.056808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.057458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.058071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.200999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:59.213534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:59.215148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:59.217464 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e5aec29d-c5bc-4f13-a4bc-20ea3226c39f tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 200 len: 1360 microversion: 2.47 time: 0.182514 Aug 27 03:14:59.218259 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 951/1954] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:14:59 2022] GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:14:59.227280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ffcf06-bb0f-437f-a93e-3a52f8778829", "tag": "f221db85-aad0-4270-8580-abbd7867f1bd"}, {"server_uuid": "a60bd733-0e7d-48b4-a30a-560a78a7ad07", "name": "network-vif-deleted", "tag": "d0fd4e76-e6b2-491a-ab68-8aaaa10e48d3"}, {"name": "network-changed", "server_uuid": "82375a88-2b7f-4141-9d52-9654df74940b", "tag": "ba2c7661-5ad0-4574-825a-76f4bbc07d5c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:59.245272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.245728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.246638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.269716 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] Creating event network-changed:f221db85-aad0-4270-8580-abbd7867f1bd for instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 on n-h2-852086-5 Aug 27 03:14:59.270358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] Creating event network-vif-deleted:d0fd4e76-e6b2-491a-ab68-8aaaa10e48d3 for instance a60bd733-0e7d-48b4-a30a-560a78a7ad07 on n-h1-852086-5 Aug 27 03:14:59.271173 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] Creating event network-changed:ba2c7661-5ad0-4574-825a-76f4bbc07d5c for instance 82375a88-2b7f-4141-9d52-9654df74940b on n-h1-852086-5 Aug 27 03:14:59.283379 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b30ecd20-76ed-496a-b5ae-894f27e57834 req-d2d7ec40-2958-4822-8a99-95a007d4ddc3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.062259 Aug 27 03:14:59.288165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 952/1955] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:59.299605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f985607f-7377-4920-807d-8bde78361fca tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457ba6550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.325973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.344503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.346571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.347590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.349664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.350645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.351741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.367670 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f985607f-7377-4920-807d-8bde78361fca tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.077271 Aug 27 03:14:59.368930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 953/1956] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:14:59 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:59.373934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.375117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.382956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.384224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.384836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.385773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.386420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.387061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.407295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:59.413041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 HTTP/1.1 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6f4f04b9-f46a-4481-9160-0caf013828a7'} Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:59.416046 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.421477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.423350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:59.424606 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4af2ba8c-186f-4d66-ba7b-224e59e43492 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 404 len: 111 microversion: 2.1 time: 0.054443 Aug 27 03:14:59.425719 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 954/1957] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:14:59 2022] DELETE /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:59.433376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1960247261"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:59.436964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.447739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.448455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.449076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.450152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.450884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.451480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.724254 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2ff0179-6a2a-460a-92a6-3e39cc17650b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "POST /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b/action" status: 202 len: 52 microversion: 2.47 time: 0.296054 Aug 27 03:14:59.726760 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 955/1958] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:14:59 2022] POST /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b/action => generated 52 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:14:59.744255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.745190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.749281 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] HTTP exception thrown: Floating IP 172.25.1.179 is not associated with instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851. Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Request method failure captured: Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action HTTP/1.1 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 49 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYvgzDW0moHyY-DabpLpDMCiwtqfxkowKyrAbjggD80uyC-0KxKssCvxxD_gHgVoEgliUZPjvn7VYJFCXANSwStDPjtIU-HhA-U6uNkLGH8Z2f8QuhD6GiMDASte8SY8kuxp4Ya8BdgaAyIJJjRHf8i4paG4PdYwboSu4YEIhkBID28 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d3533cb9e2134a848d7c323a5429cf1b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}] Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 29a0da528c064a1c9d2029be0bbdee92 Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: {"removeFloatingIp": {"address": "172.25.1.179"}} Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: exception: Floating IP 172.25.1.179 is not associated with instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851. Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851', 'body': {'removeFloatingIp': {'address': '172.25.1.179'}}} Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.179 is not associated with instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851. Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.179 is not associated with instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851. Aug 27 03:14:59.751396 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.757944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Returning 409 to user: Floating IP 172.25.1.179 is not associated with instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:59.759054 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa317d76-0ad5-4568-9ab6-424a4fa9631a tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action" status: 409 len: 146 microversion: 2.1 time: 0.822938 Aug 27 03:14:59.762959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.762959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.763606 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1004/1959] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:58 2022] POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action => generated 146 bytes in 828 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:14:59.764990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.765767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.770805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.772028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: 6f4f04b9-f46a-4481-9160-0caf013828a7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.772318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.778562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.779864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.780623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.781279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.782511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.783903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.784567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.801867 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 HTTP/1.1 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6f4f04b9-f46a-4481-9160-0caf013828a7'} Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.803779 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. Aug 27 03:14:59.808302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:14:59.810424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Instance 6f4f04b9-f46a-4481-9160-0caf013828a7 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:14:59.811873 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82fff5f3-410f-4fcd-903b-c33a47461e61 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7" status: 404 len: 111 microversion: 2.1 time: 0.046863 Aug 27 03:14:59.812969 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1005/1960] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:59 2022] GET /compute/v2.1/servers/6f4f04b9-f46a-4481-9160-0caf013828a7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:14:59.818408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.819470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.826071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.826925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.827639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.828617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.829306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.830624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.853114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:59.880841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:59.890459 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad7b8513-2079-46c1-ad50-2d407835d516 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1183 microversion: 2.1 time: 0.161615 Aug 27 03:14:59.891807 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 956/1961] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:59 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:59.898442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:59.899224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:59.906333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.907471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.908111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.909154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:59.910106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:59.910763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:59.944254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:00.062699 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-da71da18-429c-4a1c-8764-66f8e8f878d7 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 204 len: 0 microversion: 2.47 time: 0.167869 Aug 27 03:15:00.064809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 957/1962] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:14:59 2022] DELETE /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:15:00.074882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'action', calling method: .version_select at 0x7fe45e5f23a0>, body: {"removeFloatingIp": {"address": "172.25.1.179"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:00.182345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:00.198209 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0dbf9fd-94b8-42a8-b693-405d62a6826a tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.383823 Aug 27 03:15:00.201879 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1006/1963] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:59 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:00.218211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6e59290-10b2-4b2e-bb8d-dc3ecaaf8c7c tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '.version_select at 0x7fe46037af70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:00.267013 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6e59290-10b2-4b2e-bb8d-dc3ecaaf8c7c tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082375641" status: 202 len: 0 microversion: 2.1 time: 0.060982 Aug 27 03:15:00.270195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1007/1964] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082375641 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:15:00.280802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:00.282226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:00.291167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.292068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.292686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:00.307703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.308448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.310695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:00.392775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:00.409161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.410324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.411301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:00.413356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.414419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.415618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:00.795774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:00.816241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:00.821877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:00.823495 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efc9c8e8-fb25-4207-abe4-dcb849a5125a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 0.551045 Aug 27 03:15:00.842190 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1008/1965] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:00 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:00.854362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:00.854362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:00.864707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.865214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.865646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:00.866405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.866856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.867286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:01.181436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:01.188160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "refresh_cache-73ffcf06-bb0f-437f-a93e-3a52f8778829" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:15:01.189868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquired lock "refresh_cache-73ffcf06-bb0f-437f-a93e-3a52f8778829" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:15:01.203117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:01.206088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:01.209925 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2e25ec2-0dd6-444f-aa7c-5b2b30dcc184 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 200 len: 1366 microversion: 2.47 time: 0.376512 Aug 27 03:15:01.210552 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1009/1966] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:00 2022] GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:01.225732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-533e2aa9-e776-4075-89c2-8ea358fed7e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe460368670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:01.328259 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-533e2aa9-e776-4075-89c2-8ea358fed7e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.116522 Aug 27 03:15:01.334247 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1010/1967] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:01 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:01.357583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:01.360506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:01.378941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:01.381138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:01.381863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:01.382918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:01.383712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:01.384903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:01.611223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:01.630306 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3bceea5-ad2e-4c75-a61c-8f60d3e575ca tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1183 microversion: 2.1 time: 0.293085 Aug 27 03:15:01.633829 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1011/1968] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:01 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:01.655891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:01.657394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:01.671520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:01.672795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:01.674267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:01.675744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:01.676616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:01.677292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:01.981060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:01.993054 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aeef4ae3-3c69-486c-a7df-a9081c26187b tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.356841 Aug 27 03:15:01.994371 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1012/1969] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:01 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:02.010024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.011144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:02.023898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:02.024556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:02.025071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:02.027708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:02.028297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:02.029034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:02.415723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:02.451691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:02.456783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:02.491491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:02.498138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:02.506836 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a12a2a88-a778-4b36-8b30-b9cbdb1ed72a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 0.509254 Aug 27 03:15:02.538299 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1013/1970] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:01 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:02.548045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.552270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:02.567420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:02.568580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:02.571512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:02.572319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:02.573205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:02.573645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:02.738631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:02.758698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:02.768010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:02.770198 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2788ffe3-6525-4352-8cb2-4e46eec6af07 tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 200 len: 1366 microversion: 2.47 time: 0.229176 Aug 27 03:15:02.771630 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1014/1971] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:02.788696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45cc713e-dc68-4232-ac72-5528eb144b43 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe460353d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.862614 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45cc713e-dc68-4232-ac72-5528eb144b43 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.083962 Aug 27 03:15:02.866343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1015/1972] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:02.889485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96ea2855-21cd-4e88-bec2-9105da600f93 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '.version_select at 0x7fe4601f9310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.969621 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-96ea2855-21cd-4e88-bec2-9105da600f93 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Image not found. Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96ea2855-21cd-4e88-bec2-9105da600f93 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/50ba80b2-b5de-4617-b592-e09203648b80 HTTP/1.1 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '50ba80b2-b5de-4617-b592-e09203648b80'} Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50ba80b2-b5de-4617-b592-e09203648b80 to delete Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50ba80b2-b5de-4617-b592-e09203648b80 could not be found. Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:02.979532 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:02.987670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96ea2855-21cd-4e88-bec2-9105da600f93 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:02.991481 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-96ea2855-21cd-4e88-bec2-9105da600f93 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/images/50ba80b2-b5de-4617-b592-e09203648b80" status: 404 len: 62 microversion: 2.1 time: 0.120196 Aug 27 03:15:02.996939 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1016/1973] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:02 2022] DELETE /compute/v2.1/images/50ba80b2-b5de-4617-b592-e09203648b80 => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:15:03.044935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.051073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:03.084861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.085895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.086711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.094143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.095227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.096714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.256902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:03.271087 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e1c2528-5b96-49f6-889a-0f1d5b0d4fa2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 200 len: 1183 microversion: 2.1 time: 0.271954 Aug 27 03:15:03.273120 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1017/1974] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 1183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:03.279129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.280309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:03.299311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.300886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.301602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.315164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.326121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.330241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.380073 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 HTTP/1.1 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'f2487156-8dfd-40a2-ac84-3bd6325a4c45'} Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:03.381755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98cc7b9d-fbc9-4801-8a45-5d8577d68a11 tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 404 len: 111 microversion: 2.1 time: 0.108788 Aug 27 03:15:03.386461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1018/1975] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:03 2022] DELETE /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:03.395091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.395721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:03.413069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.413918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.414460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.415144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.415608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.416044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.736770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Building network info cache for instance {{(pid=122407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:15:03.804402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:03.821182 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1808df28-4493-46d5-8d86-0be5cb2a5b37 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.433463 Aug 27 03:15:03.823612 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1019/1976] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:03.828790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.835897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] [instance: f2487156-8dfd-40a2-ac84-3bd6325a4c45] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:03.857389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.858300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.859540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.860818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.863326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.866722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.895773 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] HTTP exception thrown: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Request method failure captured: Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 HTTP/1.1 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYuWnVBQqHGWMLV72vi6hfXzwFZ1qeIN43rodKBMcXHeST7yW-z3pOxWkf4xUY7G_lghtPYD2Ktkiq651uS-jBtG_Vd--Rd9EaYLkbjbcG9bEKo0gIf84oOlv29QdZTIAifyUMhpkbctzHh4qtLorHFRLIiD_sX_n7gdXa9-SEM1f_Q Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3372b4747f714009ad9a04a488019e78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3372b4747f714009ad9a04a488019e78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3372b4747f714009ad9a04a488019e78"}]}] Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3372b4747f714009ad9a04a488019e78 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-262615859 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7268918710454b128eaa3621f708efb9 Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-262615859-project Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'f2487156-8dfd-40a2-ac84-3bd6325a4c45'} Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.908894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. Aug 27 03:15:03.921045 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:03.924154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] Returning 404 to user: Instance f2487156-8dfd-40a2-ac84-3bd6325a4c45 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:03.926287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d445fe6-af72-49ba-8fc7-a746412e13db tempest-ImagesOneServerNegativeTestJSON-262615859 tempest-ImagesOneServerNegativeTestJSON-262615859-project] 10.222.0.69 "GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45" status: 404 len: 111 microversion: 2.1 time: 0.100976 Aug 27 03:15:03.928393 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1020/1977] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/servers/f2487156-8dfd-40a2-ac84-3bd6325a4c45 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:03.937644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.940685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:03.950649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.951833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.953598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.955769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.957413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.958140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.504261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:04.520603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:04.522086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:04.523931 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0b3bd1f-fab7-4979-84cf-3801855ffd16 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 0.593940 Aug 27 03:15:04.546835 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1021/1978] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:04.565712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3c40ea91-944e-4e83-9e24-3ba463c06bb6 req-f1a3d52d-1a70-4b60-a8aa-670adcc90963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ffcf06-bb0f-437f-a93e-3a52f8778829", "tag": "f221db85-aad0-4270-8580-abbd7867f1bd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:04.572771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:04.592423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3c40ea91-944e-4e83-9e24-3ba463c06bb6 req-f1a3d52d-1a70-4b60-a8aa-670adcc90963 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:04.592907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3c40ea91-944e-4e83-9e24-3ba463c06bb6 req-f1a3d52d-1a70-4b60-a8aa-670adcc90963 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:04.593468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3c40ea91-944e-4e83-9e24-3ba463c06bb6 req-f1a3d52d-1a70-4b60-a8aa-670adcc90963 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.642570 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3c40ea91-944e-4e83-9e24-3ba463c06bb6 req-f1a3d52d-1a70-4b60-a8aa-670adcc90963 service nova] Creating event network-changed:f221db85-aad0-4270-8580-abbd7867f1bd for instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 on n-h2-852086-5 Aug 27 03:15:04.655959 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3c40ea91-944e-4e83-9e24-3ba463c06bb6 req-f1a3d52d-1a70-4b60-a8aa-670adcc90963 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106609 Aug 27 03:15:04.661898 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1022/1979] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:04.669243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8df64cc7-8bf5-4399-8703-7fb3d8ee58f6 req-b6bb25af-5417-4fee-9f0f-b949e1473da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6961efe-d7b6-4144-b0b6-77266b0b756d", "name": "network-vif-plugged", "status": "completed", "tag": "d0222350-a39e-4f7c-b624-888e8e836388"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:04.698697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8df64cc7-8bf5-4399-8703-7fb3d8ee58f6 req-b6bb25af-5417-4fee-9f0f-b949e1473da6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:04.699939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8df64cc7-8bf5-4399-8703-7fb3d8ee58f6 req-b6bb25af-5417-4fee-9f0f-b949e1473da6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:04.700608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8df64cc7-8bf5-4399-8703-7fb3d8ee58f6 req-b6bb25af-5417-4fee-9f0f-b949e1473da6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.731692 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8df64cc7-8bf5-4399-8703-7fb3d8ee58f6 req-b6bb25af-5417-4fee-9f0f-b949e1473da6 service nova] Creating event network-vif-plugged:d0222350-a39e-4f7c-b624-888e8e836388 for instance a6961efe-d7b6-4144-b0b6-77266b0b756d on n-h2-852086-5 Aug 27 03:15:04.738738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8df64cc7-8bf5-4399-8703-7fb3d8ee58f6 req-b6bb25af-5417-4fee-9f0f-b949e1473da6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074744 Aug 27 03:15:04.752942 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1023/1980] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:04.762922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:04.764601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:04.786724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:04.787538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:04.788442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.789811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:04.790669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:04.791684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.885504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:04.890921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:04.892943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.893752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lazy-loading 'fault' on Instance uuid 4cbde27a-88bb-448d-a2a9-2d9ba21e239b {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:05.218443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:05.232449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:05.243074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e914768f36c84f21aba47de727badbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a394dd7ecbe47099439a15a08938199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:05.244860 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98a58dcb-5047-4dc7-9527-bec0532c9b8b tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 200 len: 1371 microversion: 2.47 time: 0.490368 Aug 27 03:15:05.246391 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1024/1981] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:04 2022] GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 1371 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:05.261688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8dd341f1-1260-4772-9598-9dfe6fa408f4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe46037a8b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:05.328244 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8dd341f1-1260-4772-9598-9dfe6fa408f4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.080522 Aug 27 03:15:05.337148 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1025/1982] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:05 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:05.361634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Updating instance_info_cache with network_info: [{"id": "f221db85-aad0-4270-8580-abbd7867f1bd", "address": "fa:16:3e:17:2d:3e", "network": {"id": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1375419615-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d3533cb9e2134a848d7c323a5429cf1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf221db85-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:15:05.399985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Releasing lock "refresh_cache-73ffcf06-bb0f-437f-a93e-3a52f8778829" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:15:05.409959 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca20c094-941c-48c4-a5bc-21f59659fe94 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829/action" status: 202 len: 0 microversion: 2.1 time: 5.335794 Aug 27 03:15:05.421152 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 958/1983] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:15:00 2022] POST /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829/action => generated 0 bytes in 5355 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:15:05.447278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:05.463858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: efe54ba8-26e0-4fc0-a19e-88f2ea976dc5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:05.492760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.493977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.500945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.507146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.508105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.509493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.579958 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] HTTP exception thrown: Instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 could not be found. Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Request method failure captured: Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 HTTP/1.1 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqD0SQMpkQmogEjXzE9LlCsdsnTyew2AK4uj9OkEddG4DcWmfj0kAnSPeciISIH5ehF17gJ1Z6EmwA9UMq1d5QvSFnfetcoe-vQCnVBaYkFyBdb5eshSSBgY8K6rtS2f3AqM8v7x2B55F_2uLReUL1oRbNvnMtewpymGPfjkhbsPI8 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5d5cbb2fd5214cf28f9b0964a8f1a4bf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}] Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 38c24c41cfbb4a1caea77801a0b3432d Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 could not be found. Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'efe54ba8-26e0-4fc0-a19e-88f2ea976dc5'} Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 could not be found. Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 could not be found. Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:05.582573 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:05.594729 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:05.594729 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:05.594729 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:05.594729 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:05.594729 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:05.594729 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 could not be found. Aug 27 03:15:05.594729 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:05.605739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Returning 404 to user: Instance efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:05.608908 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f0b93ac-0fc6-4050-8d55-2ee14ff24906 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5" status: 404 len: 111 microversion: 2.1 time: 0.185340 Aug 27 03:15:05.615512 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 959/1984] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:05 2022] GET /compute/v2.1/servers/efe54ba8-26e0-4fc0-a19e-88f2ea976dc5 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:05.634731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:05.635894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:05.652128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.652628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.653061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.662303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.663075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.670149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.694607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:05.714993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.716503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.717076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.718486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.719261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.719997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.848069 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3de19023-a3a0-404b-93f2-435315e265d6 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.506806 Aug 27 03:15:05.863655 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1026/1985] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:15:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:05.889631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:05.893420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:05.918402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.926009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.927382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.929616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.931714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.937441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.044961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:06.219538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:06.239931 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc0a40a1-949a-4499-8f88-007b2bf57ef9 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.621458 Aug 27 03:15:06.255678 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 960/1986] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:05 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:06.263637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:06.264985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:06.272591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.273449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.274130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.275524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.276230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.276935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.453819 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8ed2001-62dd-4912-a690-d57ae2ccde76 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "DELETE /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 204 len: 0 microversion: 2.1 time: 0.584391 Aug 27 03:15:06.456071 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1027/1987] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:05 2022] DELETE /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:06.483018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:06.496366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.504166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.509435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.510668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.511437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.512105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.613064 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31211da9-d6f5-4828-98d0-0edf6996be3e tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.154225 Aug 27 03:15:06.614359 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1028/1988] 10.222.0.69 () {58 vars in 1170 bytes} [Sat Aug 27 03:15:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:06.631964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:06.634081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] [instance: 4cbde27a-88bb-448d-a2a9-2d9ba21e239b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:06.661236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.662960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.664256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.667443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.670978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.672031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.709544 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] HTTP exception thrown: Instance 4cbde27a-88bb-448d-a2a9-2d9ba21e239b could not be found. Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Request method failure captured: Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b HTTP/1.1 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYwq7Qens7FkRNLjZFEhUGB2BjdUP4JeDX-Uore7HBKibx5vO0KEqJjQEEAb9i2C2gxvl9ywN6WaI49-Mtul6zk8NkE8T7pXiaE2GlwaP2lbHCWUZtro5osvWvJbc7SBCnSmTwApNp0E8thYf9CYNUCHWYLJCs5dsS__rA_SUlyogL0 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 3a394dd7ecbe47099439a15a08938199 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAaction247Test-1584417262 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3a394dd7ecbe47099439a15a08938199"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3a394dd7ecbe47099439a15a08938199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3a394dd7ecbe47099439a15a08938199", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3a394dd7ecbe47099439a15a08938199"}]}] Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAaction247Test-1584417262 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 3a394dd7ecbe47099439a15a08938199 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAaction247Test-1584417262 Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersAaction247Test-1584417262-project Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: e914768f36c84f21aba47de727badbfc Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAaction247Test-1584417262-project Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 4cbde27a-88bb-448d-a2a9-2d9ba21e239b could not be found. Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '4cbde27a-88bb-448d-a2a9-2d9ba21e239b'} Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbde27a-88bb-448d-a2a9-2d9ba21e239b could not be found. Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbde27a-88bb-448d-a2a9-2d9ba21e239b could not be found. Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:06.715860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbde27a-88bb-448d-a2a9-2d9ba21e239b could not be found. Aug 27 03:15:06.720683 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:06.724208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] Returning 404 to user: Instance 4cbde27a-88bb-448d-a2a9-2d9ba21e239b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:06.729508 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31b2f244-6896-4417-823c-fc6141b72faf tempest-ServersAaction247Test-1584417262 tempest-ServersAaction247Test-1584417262-project] 10.222.0.69 "GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b" status: 404 len: 111 microversion: 2.47 time: 0.107410 Aug 27 03:15:06.732540 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1029/1989] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:06 2022] GET /compute/v2.1/servers/4cbde27a-88bb-448d-a2a9-2d9ba21e239b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:06.759921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91e2b998-5ac1-409e-ab7a-43cdd6d4eeaa tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe460381ca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:06.793497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:06.829875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:06.833079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:06.853738 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-452cfa50-2e6e-4f1e-b692-ba03115767c9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 0.596232 Aug 27 03:15:06.878893 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 961/1990] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:06 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:06.902196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.179"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:06.905999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:06.911740 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91e2b998-5ac1-409e-ab7a-43cdd6d4eeaa tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.173618 Aug 27 03:15:06.917497 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1030/1991] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:06 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:06.923462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:06.943718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.944489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.946155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.949054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.949240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:06.949877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.950503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.970191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.976354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.977109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.988083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.989120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.006221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:07.034845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:15:07.037299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquired lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:15:07.109251 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2af7abc2-e3ce-40e0-8f43-a2712d59e225 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.185303 Aug 27 03:15:07.115989 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1031/1992] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:15:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:07.137871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-635961d6-4893-4c39-a910-79a08b79fb7b req-f14e0259-e887-464b-901d-3ad2d41e63e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab700a6-df98-4f70-b929-c19c3ac0ab95", "name": "network-vif-plugged", "status": "completed", "tag": "cd5030f1-5035-4949-973e-4441f8c7b544"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:07.169646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-635961d6-4893-4c39-a910-79a08b79fb7b req-f14e0259-e887-464b-901d-3ad2d41e63e3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:07.170956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-635961d6-4893-4c39-a910-79a08b79fb7b req-f14e0259-e887-464b-901d-3ad2d41e63e3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.174859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-635961d6-4893-4c39-a910-79a08b79fb7b req-f14e0259-e887-464b-901d-3ad2d41e63e3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:07.215910 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-635961d6-4893-4c39-a910-79a08b79fb7b req-f14e0259-e887-464b-901d-3ad2d41e63e3 service nova] Creating event network-vif-plugged:cd5030f1-5035-4949-973e-4441f8c7b544 for instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 on n-h1-852086-5 Aug 27 03:15:07.236511 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-635961d6-4893-4c39-a910-79a08b79fb7b req-f14e0259-e887-464b-901d-3ad2d41e63e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114331 Aug 27 03:15:07.240916 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1032/1993] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:07.271237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:07.292568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:07.293843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.294671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:07.295730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:07.296463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.297146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:07.373195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:07.417587 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fe454ae-a287-4052-8cf8-6891b0aaa363 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=n-d-852086-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.172621 Aug 27 03:15:07.426983 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1033/1994] 10.222.0.69 () {58 vars in 1194 bytes} [Sat Aug 27 03:15:07 2022] GET /compute/v2.1/os-services?host=n-d-852086-5&binary=xxx => generated 16 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:15:07.436289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:07.450587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:07.469347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:07.470015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.472140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:07.474203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:07.477866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.480024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:08.156603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:08.170540 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c90a52e-c32d-4ae0-879f-1e3d0e025032 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.739082 Aug 27 03:15:08.183761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1034/1995] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:07 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:08.200899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:08.224258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:08.228721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:08.239315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:08.243238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:08.245422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:08.247320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:08.367309 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e8fbdc6-736c-4c24-a3a6-2b99f3cf4ac0 tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.181506 Aug 27 03:15:08.391191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1035/1996] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:15:08 2022] GET /compute/v2.1/os-services => generated 944 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:08.397359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:08.397973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:08.431477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:08.431978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:08.432415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:08.433135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:08.433589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:08.434027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.076052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:10.086095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:10.087581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:10.102601 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9790e324-efae-4c43-91ec-a6a09aafd210 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1281 microversion: 2.25 time: 1.696476 Aug 27 03:15:10.106262 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1036/1997] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:08 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1281 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:10.133845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c51a73e3-79f1-44e3-9511-1029f7ba4143 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4603f3940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:10.246556 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c51a73e3-79f1-44e3-9511-1029f7ba4143 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.138900 Aug 27 03:15:10.248423 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1037/1998] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:10 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:10.259995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:10.265189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.265955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.266687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.268051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.268798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.269489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.308666 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b980c6fe-4c80-4027-b945-cb0a5ed36b0f tempest-ServicesAdminNegativeTestJSON-973471081 tempest-ServicesAdminNegativeTestJSON-973471081-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.058943 Aug 27 03:15:10.313455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1038/1999] 10.222.0.69 () {58 vars in 1198 bytes} [Sat Aug 27 03:15:10 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:15:10.326982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Building network info cache for instance {{(pid=122407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:15:10.343875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:10.348311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:10.364201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.366987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.367784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.369754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.370763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.371466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:11.153295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:11.165234 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb472366-3ed8-42c7-8a8e-a2d92ba09f5e tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.849209 Aug 27 03:15:11.166994 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1039/2000] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:10 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:11.185293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-55bb4a20-36aa-4eaa-b291-1f259e7b79db req-b84cb35f-d210-4743-bfe6-ee88804fb873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82375a88-2b7f-4141-9d52-9654df74940b", "name": "network-vif-plugged", "status": "completed", "tag": "ba2c7661-5ad0-4574-825a-76f4bbc07d5c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:11.220070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-55bb4a20-36aa-4eaa-b291-1f259e7b79db req-b84cb35f-d210-4743-bfe6-ee88804fb873 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:11.228894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-55bb4a20-36aa-4eaa-b291-1f259e7b79db req-b84cb35f-d210-4743-bfe6-ee88804fb873 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:11.233654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-55bb4a20-36aa-4eaa-b291-1f259e7b79db req-b84cb35f-d210-4743-bfe6-ee88804fb873 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:11.294655 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-55bb4a20-36aa-4eaa-b291-1f259e7b79db req-b84cb35f-d210-4743-bfe6-ee88804fb873 service nova] Creating event network-vif-plugged:ba2c7661-5ad0-4574-825a-76f4bbc07d5c for instance 82375a88-2b7f-4141-9d52-9654df74940b on n-h1-852086-5 Aug 27 03:15:11.322456 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-55bb4a20-36aa-4eaa-b291-1f259e7b79db req-b84cb35f-d210-4743-bfe6-ee88804fb873 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152762 Aug 27 03:15:11.328083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1040/2001] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:12.071754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59b1c05d-6db2-4354-a4e4-bc32bbd44b38 tempest-ServicesAdminNegativeTestJSON-703390036 tempest-ServicesAdminNegativeTestJSON-703390036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:12.075774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59b1c05d-6db2-4354-a4e4-bc32bbd44b38 tempest-ServicesAdminNegativeTestJSON-703390036 tempest-ServicesAdminNegativeTestJSON-703390036-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b8388d74a0884fd09f17b335fc30d1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23dcc27fdb2b4da59a363044b98bf1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59b1c05d-6db2-4354-a4e4-bc32bbd44b38 tempest-ServicesAdminNegativeTestJSON-703390036 tempest-ServicesAdminNegativeTestJSON-703390036-project] Request method failure captured: Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYw2s8hRlP2vX8RGJoNRSrvfDY-Ucs5Zpa6eT4OLI2fHowqrAvruy0txmeDsUrPeTV1Pj5_caxfmu8DmZuDnBljkzIbEAoOfGIwZNFR7zzwXUQsfvEuoRMgOACAhjyOABZ4s7CMhjBmLcT7opnMYU2cGpwC8CFjYrxxvn4Ny4w6-kmk Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 23dcc27fdb2b4da59a363044b98bf1af Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-703390036 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/23dcc27fdb2b4da59a363044b98bf1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/23dcc27fdb2b4da59a363044b98bf1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_23dcc27fdb2b4da59a363044b98bf1af", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/23dcc27fdb2b4da59a363044b98bf1af"}]}] Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-703390036 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 23dcc27fdb2b4da59a363044b98bf1af Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-703390036 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServicesAdminNegativeTestJSON-703390036-project Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b8388d74a0884fd09f17b335fc30d1e2 Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-703390036-project Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: action_args: {} Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 03:15:12.101715 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 03:15:12.106599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:12.114720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59b1c05d-6db2-4354-a4e4-bc32bbd44b38 tempest-ServicesAdminNegativeTestJSON-703390036 tempest-ServicesAdminNegativeTestJSON-703390036-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:12.121339 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59b1c05d-6db2-4354-a4e4-bc32bbd44b38 tempest-ServicesAdminNegativeTestJSON-703390036 tempest-ServicesAdminNegativeTestJSON-703390036-project] 10.222.0.69 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.790390 Aug 27 03:15:12.136920 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1041/2002] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:15:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 808 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:12.172492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-71382359-6d16-409c-824f-bbf5ffcfdcaa req-82b8916a-6444-4bf3-91c7-9519517cf295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851", "tag": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:12.238660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71382359-6d16-409c-824f-bbf5ffcfdcaa req-82b8916a-6444-4bf3-91c7-9519517cf295 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:12.243119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71382359-6d16-409c-824f-bbf5ffcfdcaa req-82b8916a-6444-4bf3-91c7-9519517cf295 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:12.245683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71382359-6d16-409c-824f-bbf5ffcfdcaa req-82b8916a-6444-4bf3-91c7-9519517cf295 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:12.316934 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-71382359-6d16-409c-824f-bbf5ffcfdcaa req-82b8916a-6444-4bf3-91c7-9519517cf295 service nova] Creating event network-changed:94baeff4-2d7b-4a93-9158-c9c1d15ccd6c for instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 on n-h1-852086-5 Aug 27 03:15:12.343904 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-71382359-6d16-409c-824f-bbf5ffcfdcaa req-82b8916a-6444-4bf3-91c7-9519517cf295 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202143 Aug 27 03:15:12.358822 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1042/2003] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:12.376284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:12.381372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:12.407557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:12.413907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:12.416893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:12.420340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:12.423994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:12.429136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:13.068854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:13.105645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:13.118855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:13.122997 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6316189a-3820-406d-9a42-f950ea338bac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1477 microversion: 2.25 time: 0.766539 Aug 27 03:15:13.146615 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1043/2004] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:12 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1477 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:13.173336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4c07de0-8435-4d62-950d-eb8bc1714e8a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457d0c280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:13.291819 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4c07de0-8435-4d62-950d-eb8bc1714e8a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.142786 Aug 27 03:15:13.303291 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1044/2005] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:13 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:13.314722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5c72048d-7a22-4c40-a7ce-8f1dc9742802 req-9a0f2a5e-dc6c-4aac-b676-ffd5d6d4ee0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ffcf06-bb0f-437f-a93e-3a52f8778829", "name": "network-vif-deleted", "tag": "f221db85-aad0-4270-8580-abbd7867f1bd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:13.346479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5c72048d-7a22-4c40-a7ce-8f1dc9742802 req-9a0f2a5e-dc6c-4aac-b676-ffd5d6d4ee0b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:13.349589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5c72048d-7a22-4c40-a7ce-8f1dc9742802 req-9a0f2a5e-dc6c-4aac-b676-ffd5d6d4ee0b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:13.350305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5c72048d-7a22-4c40-a7ce-8f1dc9742802 req-9a0f2a5e-dc6c-4aac-b676-ffd5d6d4ee0b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:13.397058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5c72048d-7a22-4c40-a7ce-8f1dc9742802 req-9a0f2a5e-dc6c-4aac-b676-ffd5d6d4ee0b service nova] Creating event network-vif-deleted:f221db85-aad0-4270-8580-abbd7867f1bd for instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 on n-h2-852086-5 Aug 27 03:15:13.416960 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5c72048d-7a22-4c40-a7ce-8f1dc9742802 req-9a0f2a5e-dc6c-4aac-b676-ffd5d6d4ee0b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111744 Aug 27 03:15:13.420428 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1045/2006] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:13.444359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:13.445488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:13.470559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:13.475009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:13.476520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:13.479539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:13.486494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:13.487891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:14.016868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:14.032725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a20a69ac-2e33-4990-9f02-15c10ac0ad98 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1331 microversion: 2.1 time: 0.609504 Aug 27 03:15:14.037509 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1046/2007] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:13 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1331 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:14.970277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:14.973172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:14.999189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:15.002912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:15.017358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:15.022903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:15.026379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:15.026897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:15.516894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid a6961efe-d7b6-4144-b0b6-77266b0b756d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:15.628542 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1382b1ab-8f27-4ff7-bcce-d09f228b69f3 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1970 microversion: 2.25 time: 1.588746 Aug 27 03:15:15.641483 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1047/2008] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:14 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1970 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:15.663830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6a50f1b-9e69-4f53-a06f-cc1900753e7a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457d20af0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:15.804935 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6a50f1b-9e69-4f53-a06f-cc1900753e7a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.156794 Aug 27 03:15:15.805610 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1048/2009] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:15 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:15.836683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:15.837369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:15.879981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:15.880486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:15.880932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:15.881670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:15.882131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:15.900046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.333834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:16.343639 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2737efa3-716c-4f1b-a5f3-01e8870b2d20 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1535 microversion: 2.1 time: 0.532397 Aug 27 03:15:16.350785 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1049/2010] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:15 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1535 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:16.360526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:16.362074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:16.386699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:16.387553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:16.388214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.389144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:16.392757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:16.393660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.471102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:16.702985 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e907995-f374-4ec2-96dd-385d9e045281 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 204 len: 0 microversion: 2.1 time: 0.350507 Aug 27 03:15:16.705948 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1050/2011] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:16 2022] DELETE /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:16.714132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:16.715308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:16.723971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:16.724848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:16.725518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.726544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:16.727312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:16.727975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.956743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:16.977446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Updating instance_info_cache with network_info: [{"id": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c", "address": "fa:16:3e:98:a8:99", "network": {"id": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1375419615-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d3533cb9e2134a848d7c323a5429cf1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94baeff4-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:15:17.042776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Releasing lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:15:17.046944 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3dccf4d8-3817-4315-9107-3730e25c1132 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action" status: 202 len: 0 microversion: 2.1 time: 10.165663 Aug 27 03:15:17.052768 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 962/2012] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:15:06 2022] POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action => generated 0 bytes in 10173 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:15:17.083831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-08c1309c-3bab-49f3-bfdd-3ce1a24c6b9f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'create', calling method: .version_select at 0x7fe457a5a430>, body: {"pool": "279e5f41-bc2d-46f2-89e8-57d46bdfdebc"} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:17.144479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid a6961efe-d7b6-4144-b0b6-77266b0b756d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:17.190508 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ab81d5d-cc0b-46c0-9e0f-2f2e6ed3242e tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1970 microversion: 2.25 time: 0.481949 Aug 27 03:15:17.207633 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1051/2013] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:16 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1970 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:17.261527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:17.263127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:17.290422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:17.291836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:17.292872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:17.294452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:17.295553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:17.296568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:17.927470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:17.950824 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30f2ede4-4e08-4700-b4f9-29af07c49502 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 200 len: 1666 microversion: 2.1 time: 0.740963 Aug 27 03:15:17.968978 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1052/2014] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:17 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 1666 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:17.986545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cd9b31b-a438-4a67-a37e-fa4782f16561 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe46039bd30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:18.096491 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1cd9b31b-a438-4a67-a37e-fa4782f16561 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.125885 Aug 27 03:15:18.097268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1053/2015] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:17 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:18.108850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f88c4345-731b-4f46-be7b-cd5395dee9ea tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '.version_select at 0x7fe46037aa60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:18.869665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f88c4345-731b-4f46-be7b-cd5395dee9ea tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/db03bb40-04bb-486c-b63e-7fd8e3d14f87" status: 200 len: 185 microversion: 2.1 time: 0.771022 Aug 27 03:15:18.870600 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1054/2016] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:15:18 2022] GET /compute/v2.1/os-floating-ips/db03bb40-04bb-486c-b63e-7fd8e3d14f87 => generated 185 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:18.875682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:18.882103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:18.882630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:18.883079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:18.883832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:18.892253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:18.892821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:18.955118 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f83b5ca-2c86-481d-86ee-65e30d36d782 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.083003 Aug 27 03:15:18.956859 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1055/2017] 10.222.0.69 () {60 vars in 1217 bytes} [Sat Aug 27 03:15:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:15:18.962085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.179"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:19.938239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:19.948660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:19.949184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:19.949634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:19.950401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:19.950865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:19.951296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:20.580090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:15:20.580751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquired lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:15:23.741532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Building network info cache for instance {{(pid=122408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:15:23.974599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-08c1309c-3bab-49f3-bfdd-3ce1a24c6b9f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.917750 Aug 27 03:15:23.975582 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 963/2018] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:15:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:23.980892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852086-5", "block_migration": "auto"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:23.985140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:24.014314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:24.014737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:24.015182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:24.015922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:24.016382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:24.016810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:24.109909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'flavor' on Instance uuid a6961efe-d7b6-4144-b0b6-77266b0b756d {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:24.165682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Going to try to live migrate instance to n-h1-852086-5 {{(pid=122407) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:15:26.589373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Updating instance_info_cache with network_info: [{"id": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c", "address": "fa:16:3e:98:a8:99", "network": {"id": "bff05ece-9bd1-4fe5-bb75-c54fe03198c6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1375419615-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d3533cb9e2134a848d7c323a5429cf1b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap94baeff4-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:15:26.653234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Releasing lock "refresh_cache-c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:15:26.654790 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72561ed7-f25c-42a7-9c7b-d4e02fa453df tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action" status: 202 len: 0 microversion: 2.1 time: 7.696292 Aug 27 03:15:26.655749 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1056/2019] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:15:18 2022] POST /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851/action => generated 0 bytes in 7698 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:15:26.699756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:26.700792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: 3433e1f2-f285-4966-92cb-9379c704c79f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:26.741688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.742536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.743272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:26.744437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.745207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.775222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:26.885944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:26.898356 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] HTTP exception thrown: Instance 3433e1f2-f285-4966-92cb-9379c704c79f could not be found. Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Request method failure captured: Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f HTTP/1.1 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYqD0SQMpkQmogEjXzE9LlCsdsnTyew2AK4uj9OkEddG4DcWmfj0kAnSPeciISIH5ehF17gJ1Z6EmwA9UMq1d5QvSFnfetcoe-vQCnVBaYkFyBdb5eshSSBgY8K6rtS2f3AqM8v7x2B55F_2uLReUL1oRbNvnMtewpymGPfjkhbsPI8 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5d5cbb2fd5214cf28f9b0964a8f1a4bf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}] Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 38c24c41cfbb4a1caea77801a0b3432d Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 3433e1f2-f285-4966-92cb-9379c704c79f could not be found. Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3433e1f2-f285-4966-92cb-9379c704c79f'} Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3433e1f2-f285-4966-92cb-9379c704c79f could not be found. Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3433e1f2-f285-4966-92cb-9379c704c79f could not be found. Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:26.901879 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3433e1f2-f285-4966-92cb-9379c704c79f could not be found. Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Returning 404 to user: Instance 3433e1f2-f285-4966-92cb-9379c704c79f could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72c17eed-e3e8-4269-a3e6-898481a512df tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f" status: 404 len: 111 microversion: 2.1 time: 0.236433 Aug 27 03:15:26.907379 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1057/2020] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:26 2022] GET /compute/v2.1/servers/3433e1f2-f285-4966-92cb-9379c704c79f => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:26.951075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-216bb8fa-5d1a-4a16-b1ab-87409c65db3a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45c653160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:27.092909 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-216bb8fa-5d1a-4a16-b1ab-87409c65db3a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.168106 Aug 27 03:15:27.100504 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1058/2021] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:26 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:27.108233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a7dccc4e-e3a2-4385-b262-c1646f805d1c req-f625bc3b-8b58-41a8-89a9-744e3a94ef9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3433e1f2-f285-4966-92cb-9379c704c79f", "name": "network-vif-deleted", "tag": "9ebee722-b0c2-440d-bedb-e10ee3451871"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:27.161198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a7dccc4e-e3a2-4385-b262-c1646f805d1c req-f625bc3b-8b58-41a8-89a9-744e3a94ef9a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.166227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a7dccc4e-e3a2-4385-b262-c1646f805d1c req-f625bc3b-8b58-41a8-89a9-744e3a94ef9a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.166994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a7dccc4e-e3a2-4385-b262-c1646f805d1c req-f625bc3b-8b58-41a8-89a9-744e3a94ef9a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.219041 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a7dccc4e-e3a2-4385-b262-c1646f805d1c req-f625bc3b-8b58-41a8-89a9-744e3a94ef9a service nova] Creating event network-vif-deleted:9ebee722-b0c2-440d-bedb-e10ee3451871 for instance 3433e1f2-f285-4966-92cb-9379c704c79f on n-h2-852086-5 Aug 27 03:15:27.237490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a7dccc4e-e3a2-4385-b262-c1646f805d1c req-f625bc3b-8b58-41a8-89a9-744e3a94ef9a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134447 Aug 27 03:15:27.242307 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1059/2022] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:27.585968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c653280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:27.592676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.603319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.604262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.664506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.665515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.666277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.697459 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] HTTP exception thrown: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Request method failure captured: Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3 HTTP/1.1 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 56 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYxK4PBxF3QLsTR4Lb3YTZENLE4qULPLmu6G6KsZ8E5eVC0sk4B7o88y8olZ5TGxd_Nc0ePcyncqLrbJMDPYWxm8kuNNzW-m8ayBThMdbt-k2suH74R1Qxcnx2zRjbGdu47Rwg1alPxee26KtCQXj4ePmfVthZED2nNsyBIw_nQeSpo Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b88c7db992784d6c8b5b2ccf58f55d54 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b88c7db992784d6c8b5b2ccf58f55d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88c7db992784d6c8b5b2ccf58f55d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b88c7db992784d6c8b5b2ccf58f55d54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88c7db992784d6c8b5b2ccf58f55d54"}]}] Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b88c7db992784d6c8b5b2ccf58f55d54 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 24df8432535d4ec1836fe17d19ad7223 Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: exception: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'bc925371-a596-4413-b607-f8770c6760c3', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:15:27.700545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Returning 404 to user: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:27.709261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fddd6461-a440-49aa-849b-10538f787488 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3" status: 404 len: 110 microversion: 2.53 time: 0.457953 Aug 27 03:15:27.722584 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1060/2023] 10.222.0.69 () {62 vars in 1309 bytes} [Sat Aug 27 03:15:27 2022] PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3 => generated 110 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:27.735962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.84"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:27.740596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:27.778481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.798393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.799127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.799952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.800431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.801049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.837571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:15:27.838528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquired lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:15:27.936768 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56c4ff03-809e-4d9d-813b-f4870f478801 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d/action" status: 202 len: 0 microversion: 2.25 time: 3.957853 Aug 27 03:15:27.940814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 964/2024] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:15:23 2022] POST /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d/action => generated 0 bytes in 3964 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:27.950481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:27.951401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:27.960125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.961796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.962956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.970278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:27.972006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:27.972816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:28.004000 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] HTTP exception thrown: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Request method failure captured: Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 HTTP/1.1 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYvgzDW0moHyY-DabpLpDMCiwtqfxkowKyrAbjggD80uyC-0KxKssCvxxD_gHgVoEgliUZPjvn7VYJFCXANSwStDPjtIU-HhA-U6uNkLGH8Z2f8QuhD6GiMDASte8SY8kuxp4Ya8BdgaAyIJJjRHf8i4paG4PdYwboSu4YEIhkBID28 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d3533cb9e2134a848d7c323a5429cf1b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}] Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 29a0da528c064a1c9d2029be0bbdee92 Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '73ffcf06-bb0f-437f-a93e-3a52f8778829'} Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:28.005880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:28.010975 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.015040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Returning 404 to user: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:28.023158 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae955fdf-e2b0-46aa-953d-a1206edc6d48 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "DELETE /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 404 len: 111 microversion: 2.1 time: 0.080431 Aug 27 03:15:28.027142 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 965/2025] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:27 2022] DELETE /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:28.034639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-195dfba2-ad24-43d6-973d-af7425ce96ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '.version_select at 0x7fe457a19670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:28.068718 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-195dfba2-ad24-43d6-973d-af7425ce96ac tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060680721" status: 202 len: 0 microversion: 2.1 time: 0.038831 Aug 27 03:15:28.077494 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 966/2026] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:15:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060680721 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:15:28.087838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Action: 'update', calling method: .version_select at 0x7fe457b46940>, body: {"status": "disabled"} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:28.095938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.097168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.098504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:28.116762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.117964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.119031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:28.135466 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] HTTP exception thrown: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Request method failure captured: Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3 HTTP/1.1 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 22 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYxK4PBxF3QLsTR4Lb3YTZENLE4qULPLmu6G6KsZ8E5eVC0sk4B7o88y8olZ5TGxd_Nc0ePcyncqLrbJMDPYWxm8kuNNzW-m8ayBThMdbt-k2suH74R1Qxcnx2zRjbGdu47Rwg1alPxee26KtCQXj4ePmfVthZED2nNsyBIw_nQeSpo Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b88c7db992784d6c8b5b2ccf58f55d54 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b88c7db992784d6c8b5b2ccf58f55d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88c7db992784d6c8b5b2ccf58f55d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b88c7db992784d6c8b5b2ccf58f55d54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88c7db992784d6c8b5b2ccf58f55d54"}]}] Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b88c7db992784d6c8b5b2ccf58f55d54 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 24df8432535d4ec1836fe17d19ad7223 Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: {"status": "disabled"} Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: exception: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'bc925371-a596-4413-b607-f8770c6760c3', 'body': {'status': 'disabled'}} Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:15:28.140015 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Returning 404 to user: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:28.154798 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-785a5ac7-bb3e-432b-8cd7-f8cdc5223351 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3" status: 404 len: 110 microversion: 2.53 time: 0.073918 Aug 27 03:15:28.158600 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 967/2027] 10.222.0.69 () {62 vars in 1309 bytes} [Sat Aug 27 03:15:28 2022] PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3 => generated 110 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:28.177399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:28.178831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:28.192546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.193710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.194773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:28.196471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.197534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.198589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:28.945374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:28.966616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:28.980587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:28.983847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:28.994770 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0db5912a-70f1-481d-8e0e-0095d795b2b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.818902 Aug 27 03:15:28.996649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 968/2028] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:28 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:29.008479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:29.015385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: 73ffcf06-bb0f-437f-a93e-3a52f8778829] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:29.046325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:29.047946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:29.049968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:29.051726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:29.055489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:29.056792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:29.120779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] HTTP exception thrown: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Request method failure captured: Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 HTTP/1.1 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYvgzDW0moHyY-DabpLpDMCiwtqfxkowKyrAbjggD80uyC-0KxKssCvxxD_gHgVoEgliUZPjvn7VYJFCXANSwStDPjtIU-HhA-U6uNkLGH8Z2f8QuhD6GiMDASte8SY8kuxp4Ya8BdgaAyIJJjRHf8i4paG4PdYwboSu4YEIhkBID28 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d3533cb9e2134a848d7c323a5429cf1b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}] Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 29a0da528c064a1c9d2029be0bbdee92 Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '73ffcf06-bb0f-437f-a93e-3a52f8778829'} Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.125889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. Aug 27 03:15:29.144809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.148285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Returning 404 to user: Instance 73ffcf06-bb0f-437f-a93e-3a52f8778829 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:29.153349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce601b87-4b75-47f9-be94-4c8da9920af1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829" status: 404 len: 111 microversion: 2.1 time: 0.154563 Aug 27 03:15:29.170637 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 969/2029] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:28 2022] GET /compute/v2.1/servers/73ffcf06-bb0f-437f-a93e-3a52f8778829 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:29.180333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e725d52d-29e3-4104-8d70-14c2c84e52ab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457baa8b0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:29.337466 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e725d52d-29e3-4104-8d70-14c2c84e52ab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1413 microversion: 2.1 time: 0.164385 Aug 27 03:15:29.343347 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 970/2030] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:29 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1413 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:29.358987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Action: 'update', calling method: .version_select at 0x7fe457a19af0>, body: {"status": "enabled"} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:29.370685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:29.387354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:29.388655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:29.408844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:29.410238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:29.411295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:29.427173 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] HTTP exception thrown: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Request method failure captured: Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3 HTTP/1.1 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 21 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYxK4PBxF3QLsTR4Lb3YTZENLE4qULPLmu6G6KsZ8E5eVC0sk4B7o88y8olZ5TGxd_Nc0ePcyncqLrbJMDPYWxm8kuNNzW-m8ayBThMdbt-k2suH74R1Qxcnx2zRjbGdu47Rwg1alPxee26KtCQXj4ePmfVthZED2nNsyBIw_nQeSpo Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b88c7db992784d6c8b5b2ccf58f55d54 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b88c7db992784d6c8b5b2ccf58f55d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88c7db992784d6c8b5b2ccf58f55d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b88c7db992784d6c8b5b2ccf58f55d54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88c7db992784d6c8b5b2ccf58f55d54"}]}] Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b88c7db992784d6c8b5b2ccf58f55d54 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 24df8432535d4ec1836fe17d19ad7223 Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: {"status": "enabled"} Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: exception: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'bc925371-a596-4413-b607-f8770c6760c3', 'body': {'status': 'enabled'}} Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:15:29.433695 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. Aug 27 03:15:29.451563 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:29.457055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Returning 404 to user: Service bc925371-a596-4413-b607-f8770c6760c3 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:29.459065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-57d64d63-c0c0-400a-877f-03b22afc8f7e tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3" status: 404 len: 110 microversion: 2.53 time: 0.112219 Aug 27 03:15:29.474653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 971/2031] 10.222.0.69 () {62 vars in 1309 bytes} [Sat Aug 27 03:15:29 2022] PUT /compute/v2.1/os-services/bc925371-a596-4413-b607-f8770c6760c3 => generated 110 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:29.483429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7c047d84-cddb-4618-82f7-2956c28e747d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '.version_select at 0x7fe457bb7af0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:31.424735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Building network info cache for instance {{(pid=122408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:15:33.774149 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7c047d84-cddb-4618-82f7-2956c28e747d tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/db03bb40-04bb-486c-b63e-7fd8e3d14f87" status: 202 len: 0 microversion: 2.1 time: 4.297344 Aug 27 03:15:33.775287 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 972/2032] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:15:29 2022] DELETE /compute/v2.1/os-floating-ips/db03bb40-04bb-486c-b63e-7fd8e3d14f87 => generated 0 bytes in 4299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:15:33.780816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cb3aab5b-bd18-44be-8ea6-811ad95a29ac req-6be6e3ff-1953-4ee9-978a-13321ac11310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851", "tag": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:33.803472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cb3aab5b-bd18-44be-8ea6-811ad95a29ac req-6be6e3ff-1953-4ee9-978a-13321ac11310 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.804166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cb3aab5b-bd18-44be-8ea6-811ad95a29ac req-6be6e3ff-1953-4ee9-978a-13321ac11310 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.804775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cb3aab5b-bd18-44be-8ea6-811ad95a29ac req-6be6e3ff-1953-4ee9-978a-13321ac11310 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:33.822922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cb3aab5b-bd18-44be-8ea6-811ad95a29ac req-6be6e3ff-1953-4ee9-978a-13321ac11310 service nova] Creating event network-changed:94baeff4-2d7b-4a93-9158-c9c1d15ccd6c for instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 on n-h1-852086-5 Aug 27 03:15:33.831232 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cb3aab5b-bd18-44be-8ea6-811ad95a29ac req-6be6e3ff-1953-4ee9-978a-13321ac11310 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053262 Aug 27 03:15:33.832901 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 973/2033] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:33.881713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:33.886559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.887274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.887928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:33.889679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.890587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.891196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:33.931258 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-370566e9-8734-450a-abc6-c75503c5caf6 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.094065 Aug 27 03:15:33.933572 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 974/2034] 10.222.0.69 () {60 vars in 1178 bytes} [Sat Aug 27 03:15:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:33.950149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:33.953593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:33.977976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.978665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.979137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:33.979890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.984133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.988239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.047610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Updating instance_info_cache with network_info: [{"id": "ba2c7661-5ad0-4574-825a-76f4bbc07d5c", "address": "fa:16:3e:07:50:8d", "network": {"id": "a94426e5-af0f-4735-a2d1-c5a3fb986478", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1194485085-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d018df5801a4c85a198d22999986d43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapba2c7661-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:15:34.072019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Releasing lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:15:34.074008 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fcdb7d4b-53a8-40d0-9367-37f27f8fbaaa tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action" status: 202 len: 0 microversion: 2.1 time: 6.350216 Aug 27 03:15:34.077772 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1061/2035] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:15:27 2022] POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action => generated 0 bytes in 6354 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:15:34.087082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15324095-0376-49a4-9f9c-1793f0c944ae tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457e04310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.164543 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15324095-0376-49a4-9f9c-1793f0c944ae tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1422 microversion: 2.1 time: 0.085083 Aug 27 03:15:34.165376 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1062/2036] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:34 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:34.170500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.171353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:34.181209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.182117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.183034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.184272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.184976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.185993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.250507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:34.388887 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd02e850-9344-43e3-9347-56c56b72b5ce tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 204 len: 0 microversion: 2.1 time: 0.221410 Aug 27 03:15:34.393032 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1063/2037] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:34 2022] DELETE /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:34.405455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.406594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:34.416234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.417809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.419217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.421693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.422600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.423284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.477423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:34.609240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:34.622492 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d71e4644-6eea-49f6-ada2-12ef9a9c501f tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 204 len: 0 microversion: 2.1 time: 0.222387 Aug 27 03:15:34.623092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1064/2038] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:34 2022] DELETE /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:34.628235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.640398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.646064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.650783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.651743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.652235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.652680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.658522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=17 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:34.722050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae14b041-2a7f-428b-8d41-f73ed65f5283 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.097709 Aug 27 03:15:34.725997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:34.732142 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1065/2039] 10.222.0.69 () {60 vars in 1211 bytes} [Sat Aug 27 03:15:34 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:34.735393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:34.742937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:34.745433 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0baedb42-d058-4a82-8281-02502745c050 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.809235 Aug 27 03:15:34.746876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c417fcfa-c92d-4185-ae77-0b703cc4b08f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'create', calling method: .version_select at 0x7fe45c45e160>, body: {"pool": "279e5f41-bc2d-46f2-89e8-57d46bdfdebc"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:34.750491 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 975/2040] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:33 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:34.755491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e6c930f-4c19-42c4-8e1c-15e82ad1b2c4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457a54af0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.836362 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7e6c930f-4c19-42c4-8e1c-15e82ad1b2c4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 200 len: 1422 microversion: 2.1 time: 0.084263 Aug 27 03:15:34.850902 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 976/2041] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:15:34 2022] GET /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:34.860570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.862205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:34.870517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.872595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.874360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.876092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.877740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.878412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.215022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:35.230476 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0964b19-14b1-48be-b6bb-26c3d96292d2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1482 microversion: 2.1 time: 0.376827 Aug 27 03:15:35.232590 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 977/2042] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:34 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1482 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:35.243099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:35.244138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:35.263710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.264980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.270524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.274096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.277135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.279398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.639146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:35.652061 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-69a59618-da02-447f-8c97-6fe19e59b5da tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1527 microversion: 2.1 time: 0.418119 Aug 27 03:15:35.652962 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 978/2043] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:35 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1527 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:35.667600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:35.676444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.677667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.678129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.679016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.679484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.679906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.758255 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0375918a-c3a9-4c1b-ba38-fc01f6a15a58 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.102515 Aug 27 03:15:35.759751 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 979/2044] 10.222.0.69 () {60 vars in 1178 bytes} [Sat Aug 27 03:15:35 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:35.764710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e6c1e72f-c448-4d17-974a-aed182de683e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4579c2c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:37.085321 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e6c1e72f-c448-4d17-974a-aed182de683e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 204 len: 0 microversion: 2.1 time: 1.324124 Aug 27 03:15:37.086272 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 980/2045] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:35 2022] DELETE /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 0 bytes in 1326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:37.094589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:37.112894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.118294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.119059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.120738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.121560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.122559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.170812 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b84e8fae-2b14-41c3-b6c1-df958c21792d tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=n-d-852086-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.082833 Aug 27 03:15:37.172502 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 981/2046] 10.222.0.69 () {60 vars in 1235 bytes} [Sat Aug 27 03:15:37 2022] GET /compute/v2.1/os-services?host=n-d-852086-5&binary=xxx => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:37.179339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:37.180336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:37.189151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.190103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.190792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.191885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.192575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.193308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.471709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:37.489501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:37.494106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:37.497541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc60d83a-380f-4967-aad7-bf45ce2189ed tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.322820 Aug 27 03:15:37.509241 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 982/2047] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:37 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:37.509241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7db54dfa-cba0-4c78-8e7a-114ebc0e48c6 req-73c4c70a-e4f5-46f5-aaa3-62028ea78af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82375a88-2b7f-4141-9d52-9654df74940b", "tag": "ba2c7661-5ad0-4574-825a-76f4bbc07d5c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:37.545772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7db54dfa-cba0-4c78-8e7a-114ebc0e48c6 req-73c4c70a-e4f5-46f5-aaa3-62028ea78af1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.546287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7db54dfa-cba0-4c78-8e7a-114ebc0e48c6 req-73c4c70a-e4f5-46f5-aaa3-62028ea78af1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.546722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7db54dfa-cba0-4c78-8e7a-114ebc0e48c6 req-73c4c70a-e4f5-46f5-aaa3-62028ea78af1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.577653 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7db54dfa-cba0-4c78-8e7a-114ebc0e48c6 req-73c4c70a-e4f5-46f5-aaa3-62028ea78af1 service nova] Creating event network-changed:ba2c7661-5ad0-4574-825a-76f4bbc07d5c for instance 82375a88-2b7f-4141-9d52-9654df74940b on n-h1-852086-5 Aug 27 03:15:37.586102 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7db54dfa-cba0-4c78-8e7a-114ebc0e48c6 req-73c4c70a-e4f5-46f5-aaa3-62028ea78af1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084821 Aug 27 03:15:37.607017 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 983/2048] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:37.636894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:37.640553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:37.667586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.668807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.669753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:37.670729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:37.671506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:37.672183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:38.031973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:38.053959 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81d2f6f2-1d1f-485a-a0b9-2b4d6016f2cb tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 200 len: 1440 microversion: 2.1 time: 0.445035 Aug 27 03:15:38.060502 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 984/2049] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:37 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 1440 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:38.098388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:38.099424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:38.123748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:38.131590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:38.132630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:38.136848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:38.141530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:38.142953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:38.495285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:38.559368 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-da6ebb08-0ed5-4346-8e45-7fd6ed1217a1 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1485 microversion: 2.1 time: 0.496120 Aug 27 03:15:38.561432 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 985/2050] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:38 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1485 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:38.790307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a05bcbd1-5d1a-4420-8ffe-dc53a0ab586f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Action: 'create', calling method: .version_select at 0x7fe457a645e0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:38.927355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a05bcbd1-5d1a-4420-8ffe-dc53a0ab586f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Getting quotas for project ba1cd2f9648c4b11992eb55ba069e6ea. Resources: {'server_groups'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:38.953524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a05bcbd1-5d1a-4420-8ffe-dc53a0ab586f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Getting quotas for user 9c7af44a663149c1b0fbdf4b15d454a6 and project ba1cd2f9648c4b11992eb55ba069e6ea. Resources: {'server_groups'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:39.240767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a05bcbd1-5d1a-4420-8ffe-dc53a0ab586f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Getting quotas for project ba1cd2f9648c4b11992eb55ba069e6ea. Resources: {'server_groups'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:39.265532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a05bcbd1-5d1a-4420-8ffe-dc53a0ab586f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Getting quotas for user 9c7af44a663149c1b0fbdf4b15d454a6 and project ba1cd2f9648c4b11992eb55ba069e6ea. Resources: {'server_groups'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:39.313742 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a05bcbd1-5d1a-4420-8ffe-dc53a0ab586f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.746207 Aug 27 03:15:39.314555 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 986/2051] 10.222.0.69 () {62 vars in 1214 bytes} [Sat Aug 27 03:15:38 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:15:39.336555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:39.341629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:39.356244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:39.358858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:39.361709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:39.363702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:39.366782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:39.367516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:39.428348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:39.753452 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cca14255-b816-43b6-aa4c-6d94e70e815c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 204 len: 0 microversion: 2.1 time: 0.420746 Aug 27 03:15:39.757861 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 987/2052] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:39 2022] DELETE /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:39.832819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:39.853816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:39.854744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:39.856246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:39.860032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:39.860856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:39.864478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:39.956613 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c51e322b-7648-4c6d-91f8-40f978525ebb tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.158042 Aug 27 03:15:39.965311 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 988/2053] 10.222.0.69 () {60 vars in 1178 bytes} [Sat Aug 27 03:15:39 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:39.974355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c87a39ea-cdc0-4f67-b6c7-894136804527 req-47708cdd-f7f5-4aca-b104-b54c97333c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b27cbd-aa6c-43c5-9260-0a77d1b83677", "name": "network-vif-deleted", "tag": "fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:39.994630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c87a39ea-cdc0-4f67-b6c7-894136804527 req-47708cdd-f7f5-4aca-b104-b54c97333c81 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:39.996097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c87a39ea-cdc0-4f67-b6c7-894136804527 req-47708cdd-f7f5-4aca-b104-b54c97333c81 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:39.996732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c87a39ea-cdc0-4f67-b6c7-894136804527 req-47708cdd-f7f5-4aca-b104-b54c97333c81 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.012525 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c87a39ea-cdc0-4f67-b6c7-894136804527 req-47708cdd-f7f5-4aca-b104-b54c97333c81 service nova] Creating event network-vif-deleted:fbaa6ab7-edeb-4a39-8c22-cecc5b5f5bed for instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 on n-h1-852086-5 Aug 27 03:15:40.038254 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c87a39ea-cdc0-4f67-b6c7-894136804527 req-47708cdd-f7f5-4aca-b104-b54c97333c81 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069157 Aug 27 03:15:40.039855 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 989/2054] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:40.071596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-91f12ef0-c3bf-4a7d-86a4-3dce9cd2eaaa req-9b03fc3d-ff99-4fcd-af48-4594f5f87b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab700a6-df98-4f70-b929-c19c3ac0ab95", "name": "network-vif-unplugged", "status": "completed", "tag": "cd5030f1-5035-4949-973e-4441f8c7b544"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:40.116786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-91f12ef0-c3bf-4a7d-86a4-3dce9cd2eaaa req-9b03fc3d-ff99-4fcd-af48-4594f5f87b05 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.117828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-91f12ef0-c3bf-4a7d-86a4-3dce9cd2eaaa req-9b03fc3d-ff99-4fcd-af48-4594f5f87b05 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.118492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-91f12ef0-c3bf-4a7d-86a4-3dce9cd2eaaa req-9b03fc3d-ff99-4fcd-af48-4594f5f87b05 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.134284 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-91f12ef0-c3bf-4a7d-86a4-3dce9cd2eaaa req-9b03fc3d-ff99-4fcd-af48-4594f5f87b05 service nova] Creating event network-vif-unplugged:cd5030f1-5035-4949-973e-4441f8c7b544 for instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 on n-h1-852086-5 Aug 27 03:15:40.152770 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-91f12ef0-c3bf-4a7d-86a4-3dce9cd2eaaa req-9b03fc3d-ff99-4fcd-af48-4594f5f87b05 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109020 Aug 27 03:15:40.161484 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 990/2055] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:40.167928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.170120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:40.178435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.179196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.179814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.180884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.181554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.182154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.435200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:40.454245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:40.462891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:40.464278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0dc167ff-55a9-4d24-85c6-4375bfc5bd81 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.301116 Aug 27 03:15:40.465060 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 991/2056] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:40 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:40.474527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.475417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: b8b27cbd-aa6c-43c5-9260-0a77d1b83677] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:40.490110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.491378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.491982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.493668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.494324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.494931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.535702 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] HTTP exception thrown: Instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 could not be found. Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Request method failure captured: Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 HTTP/1.1 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqD0SQMpkQmogEjXzE9LlCsdsnTyew2AK4uj9OkEddG4DcWmfj0kAnSPeciISIH5ehF17gJ1Z6EmwA9UMq1d5QvSFnfetcoe-vQCnVBaYkFyBdb5eshSSBgY8K6rtS2f3AqM8v7x2B55F_2uLReUL1oRbNvnMtewpymGPfjkhbsPI8 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5d5cbb2fd5214cf28f9b0964a8f1a4bf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}] Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 38c24c41cfbb4a1caea77801a0b3432d Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 could not be found. Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'b8b27cbd-aa6c-43c5-9260-0a77d1b83677'} Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 could not be found. Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 could not be found. Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:40.545312 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:40.551366 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:40.551366 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:40.551366 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:40.551366 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:40.551366 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:40.551366 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 could not be found. Aug 27 03:15:40.551366 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:40.553795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Returning 404 to user: Instance b8b27cbd-aa6c-43c5-9260-0a77d1b83677 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:40.555970 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-418e92ca-53e2-4403-8517-7838808a4664 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677" status: 404 len: 111 microversion: 2.1 time: 0.089948 Aug 27 03:15:40.556548 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 992/2057] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:40 2022] GET /compute/v2.1/servers/b8b27cbd-aa6c-43c5-9260-0a77d1b83677 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:40.578704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fde3093d-de14-46d1-9a04-7a06bf646c5f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.600202 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fde3093d-de14-46d1-9a04-7a06bf646c5f tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.030920 Aug 27 03:15:40.600746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 993/2058] 10.222.0.69 () {60 vars in 1193 bytes} [Sat Aug 27 03:15:40 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:15:40.606221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.607427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:40.625229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c417fcfa-c92d-4185-ae77-0b703cc4b08f tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.886995 Aug 27 03:15:40.625811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.633788 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1066/2059] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:15:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:40.634014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.634014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.634014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.634014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.634014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.650519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.656718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.657224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.660561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.661604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.670414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.670989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.704773 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-319cc9a9-be25-4dbc-a938-dc5eba849d54 tempest-ServicesAdminNegativeV253TestJSON-1316282621 tempest-ServicesAdminNegativeV253TestJSON-1316282621-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.074956 Aug 27 03:15:40.714526 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1067/2060] 10.222.0.69 () {60 vars in 1239 bytes} [Sat Aug 27 03:15:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:40.722684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2d058f7c-5877-44ff-99a6-8248fe3e87eb req-01271f59-6a58-4009-adf2-f1551e5365d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851", "name": "network-vif-deleted", "tag": "94baeff4-2d7b-4a93-9158-c9c1d15ccd6c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:40.726216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.726216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.731815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.733686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lazy-loading 'fault' on Instance uuid c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:40.743379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2d058f7c-5877-44ff-99a6-8248fe3e87eb req-01271f59-6a58-4009-adf2-f1551e5365d4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.744001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2d058f7c-5877-44ff-99a6-8248fe3e87eb req-01271f59-6a58-4009-adf2-f1551e5365d4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.744555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2d058f7c-5877-44ff-99a6-8248fe3e87eb req-01271f59-6a58-4009-adf2-f1551e5365d4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.760001 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2d058f7c-5877-44ff-99a6-8248fe3e87eb req-01271f59-6a58-4009-adf2-f1551e5365d4 service nova] Creating event network-vif-deleted:94baeff4-2d7b-4a93-9158-c9c1d15ccd6c for instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 on n-h1-852086-5 Aug 27 03:15:40.774497 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2d058f7c-5877-44ff-99a6-8248fe3e87eb req-01271f59-6a58-4009-adf2-f1551e5365d4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058079 Aug 27 03:15:40.775998 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1068/2061] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:40.784348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1138321594", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "9649e43c-11f6-4e3a-856e-10515d640ffa"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:40.862497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a0da528c064a1c9d2029be0bbdee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3533cb9e2134a848d7c323a5429cf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:40.875518 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-483c8cae-dc95-4535-8927-71152290beb9 tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 200 len: 1314 microversion: 2.1 time: 0.273500 Aug 27 03:15:40.882342 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 994/2062] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:40 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:40.884734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] validate_networks() for [('9649e43c-11f6-4e3a-856e-10515d640ffa', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:15:40.889209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.896745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:40.903570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.904216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.904768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.905820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:40.906449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:40.907064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:40.984390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:41.059504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:41.169223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:41.205977 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2939ddc2-f54e-4eb5-8c6e-c8e9be26366f tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 204 len: 0 microversion: 2.1 time: 0.320192 Aug 27 03:15:41.215589 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 995/2063] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:40 2022] DELETE /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:41.229925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3239b7e7-e8c1-48d0-b745-a2c38995c8eb tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:41.257478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3239b7e7-e8c1-48d0-b745-a2c38995c8eb tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/c3efd071-6ba7-4295-bdd7-d92f55dfe6dd" status: 200 len: 235 microversion: 2.64 time: 0.040360 Aug 27 03:15:41.262586 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 996/2064] 10.222.0.69 () {60 vars in 1304 bytes} [Sat Aug 27 03:15:41 2022] GET /compute/v2.1/os-server-groups/c3efd071-6ba7-4295-bdd7-d92f55dfe6dd => generated 235 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:15:41.274666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.150"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:41.302997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:41.329222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:41.330662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:41.331351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:41.332250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:41.338637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:41.339353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:41.382697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:15:41.383370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquired lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:15:42.694444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:15:42.694826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:15:42.695047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:15:42.695463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:15:42.695965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:15:42.715288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:42.716103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:42.716555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:42.717317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:42.717785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:42.726301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:42.748571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:42.754637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for user d1e2476870c64964814aabc9c60399cf and project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:42.806360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:15:42.854226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:15:42.915747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc.", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:15:42.916437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Releasing lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:15:42.917059 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc. Aug 27 03:15:42.917059 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-53c8b6d6-6be6-4d93-86f6-5ecc539f32c1'] Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Request method failure captured: Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action HTTP/1.1 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 46 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwhIL5owYK-h8gZU5DKvVHVVrsH5jxiHCdDbGp6HeduyzLUyuUBty3__gal6HyPKe1KczHsiSdT4C3OjMoIghP7ACoYoa7je7dz2EW4mHCwgRVou2k1HWOKNAfNDDtm2nQKHNI4QTDz-Gj6UH-qscLMO5nb3bBcZA_uRU2eBwn26gY Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d018df5801a4c85a198d22999986d43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d018df5801a4c85a198d22999986d43", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}] Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fad527dfec194654b0a90c1e7b39f3a1 Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: {"addFloatingIp": {"address": "172.25.1.150"}} Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: exception: Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc. Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-53c8b6d6-6be6-4d93-86f6-5ecc539f32c1'] Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '82375a88-2b7f-4141-9d52-9654df74940b', 'body': {'addFloatingIp': {'address': '172.25.1.150'}}} Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:15:42.926345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc. Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53c8b6d6-6be6-4d93-86f6-5ecc539f32c1'] Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc. Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53c8b6d6-6be6-4d93-86f6-5ecc539f32c1'] Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc. Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53c8b6d6-6be6-4d93-86f6-5ecc539f32c1'] Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc. Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53c8b6d6-6be6-4d93-86f6-5ecc539f32c1'] Aug 27 03:15:42.931599 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:42.938763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Returning 400 to user: Cannot associate floating IP 172.25.1.150 (061c309f-92cf-4116-911a-a8a99dad057b) with port ba2c7661-5ad0-4574-825a-76f4bbc07d5c using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 279e5f41-bc2d-46f2-89e8-57d46bdfdebc. Aug 27 03:15:42.938763 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-53c8b6d6-6be6-4d93-86f6-5ecc539f32c1'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:42.938763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e7c2fa46-b0a0-4de6-ace5-a78d593276f2 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action" status: 400 len: 381 microversion: 2.1 time: 1.666478 Aug 27 03:15:42.940009 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 997/2065] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:15:41 2022] POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action => generated 381 bytes in 1676 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:42.955653 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-807372c3-c746-4158-b3e7-f74bb3e8867b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.177549 Aug 27 03:15:42.962331 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1069/2066] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:15:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:15:42.975251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:42.977474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:42.987898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:42.988669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:42.990896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:42.992666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:42.993405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:42.994247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.304582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4a2b43f-aade-4f85-b61b-d94c614bcdc9 tempest-ServicesAdminNegativeV253TestJSON-421874385 tempest-ServicesAdminNegativeV253TestJSON-421874385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:43.311790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4a2b43f-aade-4f85-b61b-d94c614bcdc9 tempest-ServicesAdminNegativeV253TestJSON-421874385 tempest-ServicesAdminNegativeV253TestJSON-421874385-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4de1f7a15e6247e4ae5acae0bb59034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29d28088bda40c498ca42a477b5e955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4a2b43f-aade-4f85-b61b-d94c614bcdc9 tempest-ServicesAdminNegativeV253TestJSON-421874385 tempest-ServicesAdminNegativeV253TestJSON-421874385-project] Request method failure captured: Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYxIXkPuONGB-AmDXW1vOBrCVYFG8T2gnzeIbS7h-NbR4zoxlLADadeLCncxOrMCV_FZySFBStSqkKQlyXZksCV9aPw0Q8ZzegPau9m1YiBuaC5Qj7V0dLG5326KJJQM3W6H0-HTw8zA_HwLgNM5r8a3fr0H6X_YAztzp4LFufzg6Y0 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f29d28088bda40c498ca42a477b5e955 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-421874385 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f29d28088bda40c498ca42a477b5e955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f29d28088bda40c498ca42a477b5e955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f29d28088bda40c498ca42a477b5e955", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f29d28088bda40c498ca42a477b5e955"}]}] Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-421874385 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f29d28088bda40c498ca42a477b5e955 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-421874385 Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-421874385-project Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 4de1f7a15e6247e4ae5acae0bb59034b Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-421874385-project Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: action_args: {} Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:15:43.314415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 03:15:43.321028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.332568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4a2b43f-aade-4f85-b61b-d94c614bcdc9 tempest-ServicesAdminNegativeV253TestJSON-421874385 tempest-ServicesAdminNegativeV253TestJSON-421874385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:43.333866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4a2b43f-aade-4f85-b61b-d94c614bcdc9 tempest-ServicesAdminNegativeV253TestJSON-421874385 tempest-ServicesAdminNegativeV253TestJSON-421874385-project] 10.222.0.69 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.392097 Aug 27 03:15:43.358256 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 998/2067] 10.222.0.69 () {60 vars in 1178 bytes} [Sat Aug 27 03:15:42 2022] GET /compute/v2.1/os-services => generated 112 bytes in 403 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:43.370800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-63329881-f1eb-4afc-8d45-e87ef278d84e tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:43.456293 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-63329881-f1eb-4afc-8d45-e87ef278d84e tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/c3efd071-6ba7-4295-bdd7-d92f55dfe6dd" status: 204 len: 0 microversion: 2.64 time: 0.096534 Aug 27 03:15:43.459455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 999/2068] 10.222.0.69 () {60 vars in 1307 bytes} [Sat Aug 27 03:15:43 2022] DELETE /compute/v2.1/os-server-groups/c3efd071-6ba7-4295-bdd7-d92f55dfe6dd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:15:43.488490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:43.491592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:43.520233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:43.520962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:43.521418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.522203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:43.522679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:43.523113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.589579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c24c41cfbb4a1caea77801a0b3432d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5cbb2fd5214cf28f9b0964a8f1a4bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:43.607239 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c60d2782-1300-4e03-ada8-2471d759ccd2 tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 200 len: 1499 microversion: 2.1 time: 0.642795 Aug 27 03:15:43.630332 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1070/2069] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:42 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 1499 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:43.653520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:43.654514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] [instance: c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:43.664521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:43.672196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:43.673126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.678097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:43.681966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:43.683178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.723406 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] HTTP exception thrown: Instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 could not be found. Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Request method failure captured: Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 HTTP/1.1 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYvgzDW0moHyY-DabpLpDMCiwtqfxkowKyrAbjggD80uyC-0KxKssCvxxD_gHgVoEgliUZPjvn7VYJFCXANSwStDPjtIU-HhA-U6uNkLGH8Z2f8QuhD6GiMDASte8SY8kuxp4Ya8BdgaAyIJJjRHf8i4paG4PdYwboSu4YEIhkBID28 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d3533cb9e2134a848d7c323a5429cf1b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d3533cb9e2134a848d7c323a5429cf1b"}]}] Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d3533cb9e2134a848d7c323a5429cf1b Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2048642977 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 29a0da528c064a1c9d2029be0bbdee92 Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2048642977-project Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 could not be found. Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851'} Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 could not be found. Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 could not be found. Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.728096 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 could not be found. Aug 27 03:15:43.734739 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:15:43.738565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] Returning 404 to user: Instance c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:43.746479 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c47074a6-507e-4c7f-81ce-586b0cd913bf tempest-FloatingIPsAssociationTestJSON-2048642977 tempest-FloatingIPsAssociationTestJSON-2048642977-project] 10.222.0.69 "GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851" status: 404 len: 111 microversion: 2.1 time: 0.112064 Aug 27 03:15:43.751049 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1071/2070] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:43 2022] GET /compute/v2.1/servers/c4b3a9e3-4d7f-47d3-84b8-c8f3ec6d0851 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:43.762208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bda4690b-6dea-4d7f-9190-ff5a831c6eea tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '.version_select at 0x7fe457d0c1f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:44.072029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:44.093402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:44.101028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:44.104290 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9f7112a-227a-4a9b-bde3-c56b2b80004a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.636111 Aug 27 03:15:44.121598 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1000/2071] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:43 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:44.131143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b80ab53-09fa-4c34-9e02-b9de233db14a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:44.132644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4b80ab53-09fa-4c34-9e02-b9de233db14a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:44.254288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4b80ab53-09fa-4c34-9e02-b9de233db14a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:44.266044 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b80ab53-09fa-4c34-9e02-b9de233db14a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1208 microversion: 2.1 time: 0.140695 Aug 27 03:15:44.267270 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1001/2072] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:44 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1208 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:44.274018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9aab21e-507c-4ef9-95b0-e0916b8c5263 tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:44.288296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d9aab21e-507c-4ef9-95b0-e0916b8c5263 tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] HTTP exception thrown: Instance group c3efd071-6ba7-4295-bdd7-d92f55dfe6dd could not be found. Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9aab21e-507c-4ef9-95b0-e0916b8c5263 tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Request method failure captured: Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-server-groups/c3efd071-6ba7-4295-bdd7-d92f55dfe6dd HTTP/1.1 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYxYU0mKHPLVR3zSSUU436bwwgQZpWbHQQNn8BNDtlxgmDK5cfScsyjGFWsF40z44Z3IeEFCpjlqSwMSDKEZdg5N7RnPx9WXXykbYIO4mTDOLtYllxoqdUSJMlRZHaQm3c-k6WjEd_nXoOE3FddGmzT1kisQgqxIWjSwzmT0ZC1fM_k Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.64 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: ba1cd2f9648c4b11992eb55ba069e6ea Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerGroup264TestJSON-261334846 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ba1cd2f9648c4b11992eb55ba069e6ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba1cd2f9648c4b11992eb55ba069e6ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ba1cd2f9648c4b11992eb55ba069e6ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba1cd2f9648c4b11992eb55ba069e6ea"}]}] Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerGroup264TestJSON-261334846 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: ba1cd2f9648c4b11992eb55ba069e6ea Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerGroup264TestJSON-261334846 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerGroup264TestJSON-261334846-project Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 9c7af44a663149c1b0fbdf4b15d454a6 Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerGroup264TestJSON-261334846-project Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance group c3efd071-6ba7-4295-bdd7-d92f55dfe6dd could not be found. Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'c3efd071-6ba7-4295-bdd7-d92f55dfe6dd'} Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c3efd071-6ba7-4295-bdd7-d92f55dfe6dd could not be found. Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c3efd071-6ba7-4295-bdd7-d92f55dfe6dd could not be found. Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:44.297218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c3efd071-6ba7-4295-bdd7-d92f55dfe6dd could not be found. Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9aab21e-507c-4ef9-95b0-e0916b8c5263 tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] Returning 404 to user: Instance group c3efd071-6ba7-4295-bdd7-d92f55dfe6dd could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9aab21e-507c-4ef9-95b0-e0916b8c5263 tempest-ServerGroup264TestJSON-261334846 tempest-ServerGroup264TestJSON-261334846-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/c3efd071-6ba7-4295-bdd7-d92f55dfe6dd" status: 404 len: 117 microversion: 2.64 time: 0.035795 Aug 27 03:15:44.308088 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1002/2073] 10.222.0.69 () {60 vars in 1307 bytes} [Sat Aug 27 03:15:44 2022] DELETE /compute/v2.1/os-server-groups/c3efd071-6ba7-4295-bdd7-d92f55dfe6dd => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:15:44.314968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5544cccd-e3c2-4377-bcce-9e0528724134 req-df2c3155-c9a1-442b-8e74-aca9636720be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab700a6-df98-4f70-b929-c19c3ac0ab95", "name": "network-vif-deleted", "tag": "cd5030f1-5035-4949-973e-4441f8c7b544"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:44.352645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5544cccd-e3c2-4377-bcce-9e0528724134 req-df2c3155-c9a1-442b-8e74-aca9636720be service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:44.353133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5544cccd-e3c2-4377-bcce-9e0528724134 req-df2c3155-c9a1-442b-8e74-aca9636720be service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:44.353567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5544cccd-e3c2-4377-bcce-9e0528724134 req-df2c3155-c9a1-442b-8e74-aca9636720be service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:44.379422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5544cccd-e3c2-4377-bcce-9e0528724134 req-df2c3155-c9a1-442b-8e74-aca9636720be service nova] Creating event network-vif-deleted:cd5030f1-5035-4949-973e-4441f8c7b544 for instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 on n-h1-852086-5 Aug 27 03:15:44.389641 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5544cccd-e3c2-4377-bcce-9e0528724134 req-df2c3155-c9a1-442b-8e74-aca9636720be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082183 Aug 27 03:15:44.392836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1003/2074] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:44.399968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fb6db540-d4aa-4ab0-9fd7-e95c55f59df7 req-cdf2ff95-27eb-43d9-980a-7636cde41532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037", "name": "network-vif-deleted", "tag": "4334a30f-24f4-491f-8ecf-cdb1ac1394b1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:44.415571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb6db540-d4aa-4ab0-9fd7-e95c55f59df7 req-cdf2ff95-27eb-43d9-980a-7636cde41532 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:44.416081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb6db540-d4aa-4ab0-9fd7-e95c55f59df7 req-cdf2ff95-27eb-43d9-980a-7636cde41532 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:44.416686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb6db540-d4aa-4ab0-9fd7-e95c55f59df7 req-cdf2ff95-27eb-43d9-980a-7636cde41532 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:44.434927 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fb6db540-d4aa-4ab0-9fd7-e95c55f59df7 req-cdf2ff95-27eb-43d9-980a-7636cde41532 service nova] Creating event network-vif-deleted:4334a30f-24f4-491f-8ecf-cdb1ac1394b1 for instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 on n-h1-852086-5 Aug 27 03:15:44.441475 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fb6db540-d4aa-4ab0-9fd7-e95c55f59df7 req-cdf2ff95-27eb-43d9-980a-7636cde41532 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046483 Aug 27 03:15:44.443414 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1004/2075] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:44.803530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45ca467e-1896-433f-adab-e722782d1aad tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4579ed790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1743279113", "description": "tempest-description-1247076522"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:45.440587 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45ca467e-1896-433f-adab-e722782d1aad tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.995349 Aug 27 03:15:45.453045 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1005/2076] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:15:44 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:45.462978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:45.464836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] [instance: ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:45.478065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:45.480106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:45.484464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:45.487665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:45.489468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:45.490202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:45.520716 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] HTTP exception thrown: Instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 could not be found. Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Request method failure captured: Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 HTTP/1.1 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYqD0SQMpkQmogEjXzE9LlCsdsnTyew2AK4uj9OkEddG4DcWmfj0kAnSPeciISIH5ehF17gJ1Z6EmwA9UMq1d5QvSFnfetcoe-vQCnVBaYkFyBdb5eshSSBgY8K6rtS2f3AqM8v7x2B55F_2uLReUL1oRbNvnMtewpymGPfjkhbsPI8 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5d5cbb2fd5214cf28f9b0964a8f1a4bf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5d5cbb2fd5214cf28f9b0964a8f1a4bf"}]}] Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 5d5cbb2fd5214cf28f9b0964a8f1a4bf Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-LiveMigrationTest-1573565385 Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 38c24c41cfbb4a1caea77801a0b3432d Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-LiveMigrationTest-1573565385-project Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 could not be found. Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037'} Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 could not be found. Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 could not be found. Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:45.525607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 could not be found. Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] Returning 404 to user: Instance ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:45.531150 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbe7154d-e0d1-4645-9781-e9da2874998c tempest-LiveMigrationTest-1573565385 tempest-LiveMigrationTest-1573565385-project] 10.222.0.69 "GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037" status: 404 len: 111 microversion: 2.1 time: 0.074685 Aug 27 03:15:45.537558 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1006/2077] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:45 2022] GET /compute/v2.1/servers/ef480d6e-0ba0-49fb-a9f3-e52b5fbc1037 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:45.569181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:45.569814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:45.615412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:45.620863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:45.621426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:45.624585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:45.631239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:45.632127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.353468 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bda4690b-6dea-4d7f-9190-ff5a831c6eea tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/061c309f-92cf-4116-911a-a8a99dad057b" status: 202 len: 0 microversion: 2.1 time: 2.601116 Aug 27 03:15:46.355609 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1072/2078] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:15:43 2022] DELETE /compute/v2.1/os-floating-ips/061c309f-92cf-4116-911a-a8a99dad057b => generated 0 bytes in 2604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:15:46.363720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:46.364470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:46.382859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.388804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.389268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.390500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:46.391140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:46.391902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:46.509849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:46.527907 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-081d2ce7-9894-460f-ad29-e07e96e39a8d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1266 microversion: 2.1 time: 0.167641 Aug 27 03:15:46.546520 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1073/2079] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:46 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:46.560988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-badaccc8-8997-49c4-8959-ffe58868f27e tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe45c653a60>, body: {"security_group_rule": {"parent_group_id": "b62de86c-2aa2-4a1d-8c0d-0b05a3acc8f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:46.727324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:46.743194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:46.744815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:46.756672 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b1f7716e-51ee-4fee-bbb9-f07b5ee7158a tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 1.217719 Aug 27 03:15:46.757372 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1007/2080] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:45 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:46.778571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.84"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:47.053276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-badaccc8-8997-49c4-8959-ffe58868f27e tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.504791 Aug 27 03:15:47.067478 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1074/2081] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:15:46 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:47.085576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ddbd4e6b-ceb0-4968-ab0e-50924e0cdd69 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4603f3940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-847385027", "description": "tempest-description-1973595652"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:47.409633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:47.422285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:47.422886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:47.423498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:47.425328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:47.426265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:47.427532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:47.604763 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ddbd4e6b-ceb0-4968-ab0e-50924e0cdd69 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.522818 Aug 27 03:15:47.607286 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1075/2082] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:15:47 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:47.619848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:47.619848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:47.648262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:47.648984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:47.649599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:47.650610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:47.651434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:47.652168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:47.957138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:47.977027 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-52a36356-1507-454e-8fa6-096d675c1ccc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 0.367430 Aug 27 03:15:47.989066 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1076/2083] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:47 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:47.989066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c3e188b-0473-476c-a8d9-3f15bfafccb6 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4603f34c0>, body: {"security_group_rule": {"parent_group_id": "ab363fd0-1809-4431-86f5-ce3fa5db9778", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:48.185319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:15:48.186670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquired lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:15:48.571167 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c3e188b-0473-476c-a8d9-3f15bfafccb6 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.589163 Aug 27 03:15:48.572757 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1077/2084] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:15:47 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:48.590947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:48.592621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:48.604488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:48.605106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:48.605954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:48.606704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:48.607278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:48.607858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:49.087835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:49.109432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:49.126700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:49.127938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa9c0a71-646b-4155-a2dd-4209095d4712 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.553397 Aug 27 03:15:49.157355 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1078/2085] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:48 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:49.167813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-496b456f-901c-4f72-a562-5981e4c03c56 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe457e040d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1248453017", "description": "tempest-description-1077608666"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:49.752042 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-496b456f-901c-4f72-a562-5981e4c03c56 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.592455 Aug 27 03:15:49.753272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1079/2086] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:15:49 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:49.766875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:49.768067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:49.778588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:49.780100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:49.781688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:49.783703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:49.784972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:49.784972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:49.906493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:50.064771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:50.073584 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0cdca9ec-9eb4-44db-b4aa-7360082a1f9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 0.318486 Aug 27 03:15:50.087521 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1080/2087] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:49 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:50.093227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b0dcf86b-0ece-4d35-be55-206013e55809 req-fb1c0f1b-bd1b-4276-989b-47329d698286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0fd9cc-6856-4230-a8e8-e8f92c613ccc", "tag": "0601f318-b434-4387-91e4-1fc89f3a0c8c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:50.107308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b0dcf86b-0ece-4d35-be55-206013e55809 req-fb1c0f1b-bd1b-4276-989b-47329d698286 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.108329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b0dcf86b-0ece-4d35-be55-206013e55809 req-fb1c0f1b-bd1b-4276-989b-47329d698286 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.108942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b0dcf86b-0ece-4d35-be55-206013e55809 req-fb1c0f1b-bd1b-4276-989b-47329d698286 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.125227 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b0dcf86b-0ece-4d35-be55-206013e55809 req-fb1c0f1b-bd1b-4276-989b-47329d698286 service nova] Creating event network-changed:0601f318-b434-4387-91e4-1fc89f3a0c8c for instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc on n-h1-852086-5 Aug 27 03:15:50.133124 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b0dcf86b-0ece-4d35-be55-206013e55809 req-fb1c0f1b-bd1b-4276-989b-47329d698286 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043960 Aug 27 03:15:50.134073 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1081/2088] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:50.139560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d370b31b-f3ff-4362-94fa-39c0de877813 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4603f30d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-247615833", "description": "tempest-description-2134885254"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:50.355788 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d370b31b-f3ff-4362-94fa-39c0de877813 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.220261 Aug 27 03:15:50.364707 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1082/2089] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:15:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:50.382272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:50.384041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:50.394685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.395441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.396069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.397014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:50.397650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:50.398305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:50.618534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:50.646355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:50.647705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:50.648900 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0117538-f0d9-4ffe-afc3-6e74bc994733 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.282928 Aug 27 03:15:50.649664 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1083/2090] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:50 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:50.654493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d13d044d-17fc-4091-b051-10cbb5575136 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe45c45e940>, body: {"security_group_rule": {"parent_group_id": "9d62e264-d0f8-4351-ad34-146b32595613", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7dd7fc50-2147-41cf-9d4f-9e89c68923dd"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:51.564760 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d13d044d-17fc-4091-b051-10cbb5575136 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.913445 Aug 27 03:15:51.566254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1084/2091] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:15:50 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:51.573531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:51.575508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:51.592570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:51.594457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:51.595215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:51.600697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:51.601371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:51.616325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:51.944503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:51.948687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:51.976084 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ed7b58a-1313-4b76-952f-61b7692adfab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 0.407821 Aug 27 03:15:51.980223 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1085/2092] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:51 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:51.988173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9aea9f3a-280e-4667-b3fd-cbbc5dce61b9 req-db42d522-a86a-43c9-a0d5-9dd199de9269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6961efe-d7b6-4144-b0b6-77266b0b756d", "name": "network-vif-unplugged", "status": "completed", "tag": "d0222350-a39e-4f7c-b624-888e8e836388"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:52.015007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9aea9f3a-280e-4667-b3fd-cbbc5dce61b9 req-db42d522-a86a-43c9-a0d5-9dd199de9269 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:52.015784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9aea9f3a-280e-4667-b3fd-cbbc5dce61b9 req-db42d522-a86a-43c9-a0d5-9dd199de9269 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:52.016497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9aea9f3a-280e-4667-b3fd-cbbc5dce61b9 req-db42d522-a86a-43c9-a0d5-9dd199de9269 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:52.034717 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9aea9f3a-280e-4667-b3fd-cbbc5dce61b9 req-db42d522-a86a-43c9-a0d5-9dd199de9269 service nova] Creating event network-vif-unplugged:d0222350-a39e-4f7c-b624-888e8e836388 for instance a6961efe-d7b6-4144-b0b6-77266b0b756d on n-h2-852086-5 Aug 27 03:15:52.061360 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9aea9f3a-280e-4667-b3fd-cbbc5dce61b9 req-db42d522-a86a-43c9-a0d5-9dd199de9269 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076507 Aug 27 03:15:52.063226 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1086/2093] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:52.073220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14676d40-cb18-4d42-9d96-59d2c7b1e206 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4603684c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-303666019", "description": "tempest-description-675554580"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:52.289140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Building network info cache for instance {{(pid=122407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:15:52.674416 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14676d40-cb18-4d42-9d96-59d2c7b1e206 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.609236 Aug 27 03:15:52.684178 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1087/2094] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:15:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:52.691013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:52.693763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:52.710727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:52.711634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:52.712322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:52.713274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:52.727266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:52.728176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:52.745796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:52.791230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:53.092243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:53.118082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:53.121702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:53.130548 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e440989-ef78-4fd7-a7b1-b5318be83cec tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.443814 Aug 27 03:15:53.135191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1088/2095] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:52 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:53.146640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0222270-fa56-42df-af0f-39d85336b9a5 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4603f3b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2131317507", "description": "tempest-description-788386322"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:53.688227 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0222270-fa56-42df-af0f-39d85336b9a5 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.551745 Aug 27 03:15:53.690306 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1089/2096] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:15:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:53.706288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:53.719583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:53.727473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:53.728387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:53.729062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:53.730046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:53.730767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:53.731442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:54.262325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:54.475340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:54.493463 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c59db0b-2247-4827-b983-e570c35590a2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 0.793403 Aug 27 03:15:54.494644 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1090/2097] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:53 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:54.505818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aded5123-7945-4ec0-a0c4-c944f8c24d01 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe457d0c430>, body: {"security_group_rule": {"parent_group_id": "e5baf665-2008-4605-b9ab-cdb7d66d0428", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1fbc1795-7af9-4009-8667-f000ecbaa301"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:55.698947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Updating instance_info_cache with network_info: [{"id": "ba2c7661-5ad0-4574-825a-76f4bbc07d5c", "address": "fa:16:3e:07:50:8d", "network": {"id": "a94426e5-af0f-4735-a2d1-c5a3fb986478", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1194485085-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d018df5801a4c85a198d22999986d43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapba2c7661-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:15:55.740122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Releasing lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:15:55.741941 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-01c136f5-a8ca-4452-bf48-75ae22dab352 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action" status: 202 len: 0 microversion: 2.1 time: 8.982642 Aug 27 03:15:55.742585 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1008/2098] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:15:46 2022] POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action => generated 0 bytes in 8984 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:15:55.773209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:55.774560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:55.801748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:55.803002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:55.803963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:55.805572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:55.806694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:55.807671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:55.972187 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aded5123-7945-4ec0-a0c4-c944f8c24d01 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.475609 Aug 27 03:15:55.978476 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1091/2099] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:15:54 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:56.013820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b24b2b89-f62e-4edf-9f03-58b33e151194 req-8aa03ee9-5af7-4810-b780-2714b2715b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82375a88-2b7f-4141-9d52-9654df74940b", "tag": "ba2c7661-5ad0-4574-825a-76f4bbc07d5c"}, {"name": "network-changed", "server_uuid": "a6961efe-d7b6-4144-b0b6-77266b0b756d", "tag": "d0222350-a39e-4f7c-b624-888e8e836388"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:56.030630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b24b2b89-f62e-4edf-9f03-58b33e151194 req-8aa03ee9-5af7-4810-b780-2714b2715b30 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:56.031530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b24b2b89-f62e-4edf-9f03-58b33e151194 req-8aa03ee9-5af7-4810-b780-2714b2715b30 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:56.032920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b24b2b89-f62e-4edf-9f03-58b33e151194 req-8aa03ee9-5af7-4810-b780-2714b2715b30 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:56.063521 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b24b2b89-f62e-4edf-9f03-58b33e151194 req-8aa03ee9-5af7-4810-b780-2714b2715b30 service nova] Creating event network-changed:ba2c7661-5ad0-4574-825a-76f4bbc07d5c for instance 82375a88-2b7f-4141-9d52-9654df74940b on n-h1-852086-5 Aug 27 03:15:56.064344 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b24b2b89-f62e-4edf-9f03-58b33e151194 req-8aa03ee9-5af7-4810-b780-2714b2715b30 service nova] Creating event network-changed:d0222350-a39e-4f7c-b624-888e8e836388 for instance a6961efe-d7b6-4144-b0b6-77266b0b756d on n-h2-852086-5 Aug 27 03:15:56.100331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b24b2b89-f62e-4edf-9f03-58b33e151194 req-8aa03ee9-5af7-4810-b780-2714b2715b30 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118449 Aug 27 03:15:56.101260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1092/2100] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:56.123484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:56.124936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:56.143035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:56.143943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:56.144560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:56.145587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:56.145943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:56.146395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:56.943585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:56.961668 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca6ce3a4-05dd-44be-ab58-e79d54bd1cd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 0.853122 Aug 27 03:15:56.966209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1093/2101] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:56 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:56.990649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33391d7e-6aad-4cd3-bf26-263321a45a07 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '.version_select at 0x7fe45c4c7f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:57.077243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:57.091758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:57.094695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:57.097744 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9db5f29-46b7-49a1-be59-da55c78353e7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 1.353616 Aug 27 03:15:57.099262 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1009/2102] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:55 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:15:57.105703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7bf85dd7-348a-46cc-9d75-66cc53168a96 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe4579fcdc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:57.965020 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7bf85dd7-348a-46cc-9d75-66cc53168a96 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/1fbc1795-7af9-4009-8667-f000ecbaa301" status: 202 len: 0 microversion: 2.1 time: 0.864221 Aug 27 03:15:57.969372 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1010/2103] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:15:57 2022] DELETE /compute/v2.1/os-security-groups/1fbc1795-7af9-4009-8667-f000ecbaa301 => generated 0 bytes in 867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:15:57.976356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-be6bc256-19b9-4e26-b9c6-04fb9cf232bd tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe457ba69d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:58.330899 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-be6bc256-19b9-4e26-b9c6-04fb9cf232bd tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/e5baf665-2008-4605-b9ab-cdb7d66d0428" status: 200 len: 246 microversion: 2.1 time: 0.359107 Aug 27 03:15:58.334138 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1011/2104] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:15:57 2022] GET /compute/v2.1/os-security-groups/e5baf665-2008-4605-b9ab-cdb7d66d0428 => generated 246 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:15:58.353289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:58.356219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:58.373001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:58.373494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:58.374748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:58.375510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:58.376162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:58.377322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:59.377369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:59.395373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d292fb3-b27e-41e1-8d8a-3f15b77973e5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 1.059055 Aug 27 03:15:59.396221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1012/2105] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:58 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:59.415144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:59.415759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:59.432169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:59.432777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:59.433444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:59.434206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:59.434782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:59.435142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:00.122189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:00.163864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:00.168215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:00.173040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6bc16282-3418-4894-a825-3c3a8bbcc559 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.772946 Aug 27 03:16:00.177369 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1013/2106] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:15:59 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:00.218446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a17ca529-7e30-44af-aee4-867685f3f2d7 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4579edaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-389998061", "description": "tempest-description-353434591"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:00.698480 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33391d7e-6aad-4cd3-bf26-263321a45a07 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/cb21d458-66d0-49ab-b1c6-2c859275d6a1" status: 202 len: 0 microversion: 2.1 time: 3.730440 Aug 27 03:16:00.699500 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1094/2107] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:15:56 2022] DELETE /compute/v2.1/os-floating-ips/cb21d458-66d0-49ab-b1c6-2c859275d6a1 => generated 0 bytes in 3733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:00.714702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7676577c-b371-42bf-8c86-aabf3d416997 req-9a82e3fe-0d84-46d4-b13a-a8ed8ad4cb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0fd9cc-6856-4230-a8e8-e8f92c613ccc", "name": "network-vif-plugged", "status": "completed", "tag": "0601f318-b434-4387-91e4-1fc89f3a0c8c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:00.741896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7676577c-b371-42bf-8c86-aabf3d416997 req-9a82e3fe-0d84-46d4-b13a-a8ed8ad4cb8b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:00.742607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7676577c-b371-42bf-8c86-aabf3d416997 req-9a82e3fe-0d84-46d4-b13a-a8ed8ad4cb8b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:00.743075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7676577c-b371-42bf-8c86-aabf3d416997 req-9a82e3fe-0d84-46d4-b13a-a8ed8ad4cb8b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:00.780364 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7676577c-b371-42bf-8c86-aabf3d416997 req-9a82e3fe-0d84-46d4-b13a-a8ed8ad4cb8b service nova] Creating event network-vif-plugged:0601f318-b434-4387-91e4-1fc89f3a0c8c for instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc on n-h1-852086-5 Aug 27 03:16:00.790869 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7676577c-b371-42bf-8c86-aabf3d416997 req-9a82e3fe-0d84-46d4-b13a-a8ed8ad4cb8b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089040 Aug 27 03:16:00.794055 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1095/2108] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:00.807943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:00.811294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:00.825671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:00.832300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:00.833219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:00.834227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:00.834892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:00.835586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:01.290427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a17ca529-7e30-44af-aee4-867685f3f2d7 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.094990 Aug 27 03:16:01.295290 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1014/2109] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:16:00 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:01.312629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34fdc471-76c7-4130-bf81-33e1edbbfe18 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34fdc471-76c7-4130-bf81-33e1edbbfe18 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Request method failure captured: Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action HTTP/1.1 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 34 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwhIL5owYK-h8gZU5DKvVHVVrsH5jxiHCdDbGp6HeduyzLUyuUBty3__gal6HyPKe1KczHsiSdT4C3OjMoIghP7ACoYoa7je7dz2EW4mHCwgRVou2k1HWOKNAfNDDtm2nQKHNI4QTDz-Gj6UH-qscLMO5nb3bBcZA_uRU2eBwn26gY Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d018df5801a4c85a198d22999986d43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d018df5801a4c85a198d22999986d43", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}] Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fad527dfec194654b0a90c1e7b39f3a1 Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: {"addFloatingIp": {"address": ""}} Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '82375a88-2b7f-4141-9d52-9654df74940b', 'body': {'addFloatingIp': {'address': ''}}} Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '' Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:16:01.330891 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34fdc471-76c7-4130-bf81-33e1edbbfe18 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34fdc471-76c7-4130-bf81-33e1edbbfe18 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action" status: 400 len: 142 microversion: 2.1 time: 0.036247 Aug 27 03:16:01.340052 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1015/2110] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:01 2022] POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action => generated 142 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:16:01.344722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:01.344722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:01.358387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:01.359420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:01.360097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:01.361648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:01.362255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:01.364712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:01.471722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:01.488067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-816a8aeb-a7f2-4b3c-9160-ad14bdbb63e3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 0.692387 Aug 27 03:16:01.499080 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1096/2111] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:00 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:01.513373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac0d05e9-068d-4027-88b2-3de4d52e774a tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe460402040>, body: {"security_group_rule": {"parent_group_id": "21221e3c-9392-46e4-850e-f91ac12f1f5c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:02.168685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:02.182640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:02.184808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:02.186479 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad5ba39b-6786-48d3-8a9d-b34893780ccf tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.849638 Aug 27 03:16:02.187805 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1016/2112] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:01 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:02.198559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:02.201640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:02.211839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.212671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.213212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.214114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.227552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.231519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.315991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:16:02.316682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquired lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:16:02.609327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac0d05e9-068d-4027-88b2-3de4d52e774a tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.104072 Aug 27 03:16:02.611975 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1097/2113] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:16:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:02.623060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:02.624274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:02.635034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.636483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.637207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.638349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.639210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.640690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.799708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Releasing lock "refresh_cache-82375a88-2b7f-4141-9d52-9654df74940b" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:16:02.800376 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] HTTP exception thrown: floating IP not found Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Request method failure captured: Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action HTTP/1.1 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 41 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwhIL5owYK-h8gZU5DKvVHVVrsH5jxiHCdDbGp6HeduyzLUyuUBty3__gal6HyPKe1KczHsiSdT4C3OjMoIghP7ACoYoa7je7dz2EW4mHCwgRVou2k1HWOKNAfNDDtm2nQKHNI4QTDz-Gj6UH-qscLMO5nb3bBcZA_uRU2eBwn26gY Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d018df5801a4c85a198d22999986d43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d018df5801a4c85a198d22999986d43", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}] Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fad527dfec194654b0a90c1e7b39f3a1 Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: exception: floating IP not found Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '82375a88-2b7f-4141-9d52-9654df74940b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 27 03:16:02.810210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:02.817778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Returning 404 to user: floating IP not found {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:02.819865 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-459bbdb5-e574-4e89-94fb-bda057589824 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action" status: 404 len: 67 microversion: 2.1 time: 0.623644 Aug 27 03:16:02.819865 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1017/2114] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:02 2022] POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action => generated 67 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:16:02.866089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab60b793-bff9-4775-bc14-677071cb2c35 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Action: 'create', calling method: .version_select at 0x7fe4579fc550>, body: {"security_group_rule": {"parent_group_id": "21221e3c-9392-46e4-850e-f91ac12f1f5c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:03.183759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:03.201472 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f252c720-9cf8-402b-8763-0ec9ec475edd tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1308 microversion: 2.1 time: 0.586960 Aug 27 03:16:03.202428 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1098/2115] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:02 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:03.215967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5175a398-55e4-481c-a0ac-9ee7941bd619 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:03.320790 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-5175a398-55e4-481c-a0ac-9ee7941bd619 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5175a398-55e4-481c-a0ac-9ee7941bd619 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Request method failure captured: Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action HTTP/1.1 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 44 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYwhIL5owYK-h8gZU5DKvVHVVrsH5jxiHCdDbGp6HeduyzLUyuUBty3__gal6HyPKe1KczHsiSdT4C3OjMoIghP7ACoYoa7je7dz2EW4mHCwgRVou2k1HWOKNAfNDDtm2nQKHNI4QTDz-Gj6UH-qscLMO5nb3bBcZA_uRU2eBwn26gY Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d018df5801a4c85a198d22999986d43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d018df5801a4c85a198d22999986d43", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}] Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: fad527dfec194654b0a90c1e7b39f3a1 Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: exception: Floating IP not found for address 0.0.0.0. Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '82375a88-2b7f-4141-9d52-9654df74940b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 27 03:16:03.323853 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 27 03:16:03.328674 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:03.335794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5175a398-55e4-481c-a0ac-9ee7941bd619 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:03.338228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5175a398-55e4-481c-a0ac-9ee7941bd619 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action" status: 404 len: 88 microversion: 2.1 time: 0.133937 Aug 27 03:16:03.339281 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1099/2116] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:03 2022] POST /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b/action => generated 88 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:16:03.353726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:03.354831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:03.363504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.364290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.364855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.365684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.366305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.366857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.744506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:03.772394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:03.781431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:03.790586 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19e8a4f1-9fd5-4c79-a868-18dfbe8e8116 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.445439 Aug 27 03:16:03.794823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab60b793-bff9-4775-bc14-677071cb2c35 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.972776 Aug 27 03:16:03.795270 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1100/2117] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:03 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:03.795763 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1018/2118] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:16:02 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:03.805633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:03.806714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:03.815861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.816878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.817591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.819424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.820126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.820990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.824630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e66ad0d-2a4f-49c6-807d-d52f79a407ec tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe457a053a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:03.871568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:03.968921 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e66ad0d-2a4f-49c6-807d-d52f79a407ec tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "GET /compute/v2.1/os-security-groups/21221e3c-9392-46e4-850e-f91ac12f1f5c" status: 200 len: 663 microversion: 2.1 time: 0.148199 Aug 27 03:16:03.971340 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1019/2119] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:16:03 2022] GET /compute/v2.1/os-security-groups/21221e3c-9392-46e4-850e-f91ac12f1f5c => generated 663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:03.988134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4ed83b8-db56-4234-a4b1-5036ba4be513 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe4579c2280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:04.000509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af0f7ef5-fdc2-4bd6-a62d-cae48d4a5a41 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "DELETE /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 204 len: 0 microversion: 2.1 time: 0.200681 Aug 27 03:16:04.002720 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1101/2120] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:16:03 2022] DELETE /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:16:04.014969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:04.015758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:04.023285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.024697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.025492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.027016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.027650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.028982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.368160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:04.384880 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36e4d6fc-2d22-4e24-885e-4bdd965c08a0 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1541 microversion: 2.1 time: 0.377021 Aug 27 03:16:04.385460 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1102/2121] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:04 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1541 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:04.412720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:04.413561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:04.427121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.429854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.432585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.433596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.437587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.438372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.025554 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4ed83b8-db56-4234-a4b1-5036ba4be513 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-group-rules/03577d10-35d5-4da9-aa65-9e3c6d0b8915" status: 202 len: 0 microversion: 2.1 time: 1.046323 Aug 27 03:16:05.034078 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1020/2122] 10.222.0.69 () {58 vars in 1287 bytes} [Sat Aug 27 03:16:03 2022] DELETE /compute/v2.1/os-security-group-rules/03577d10-35d5-4da9-aa65-9e3c6d0b8915 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:05.039215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:05.040345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:05.046983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.047893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.048545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.049862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.050590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.051197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.156885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:05.167501 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67146533-2aa8-418b-860d-7e37f551447b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1489 microversion: 2.1 time: 0.762156 Aug 27 03:16:05.168928 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1103/2123] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:04 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1489 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:05.176529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0cabc317-3891-4223-9c0c-fd3ce6b71e7f tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe457d7e790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:05.404197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:05.416356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:05.418104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:05.419675 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d2f89dfe-acc8-4acd-8007-8b2875a1abc8 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1487 microversion: 2.25 time: 0.384278 Aug 27 03:16:05.434591 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1021/2124] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:05 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1487 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:05.442199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0e9734c-6b12-4709-85a1-327c005299e9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:05.448775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0e9734c-6b12-4709-85a1-327c005299e9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.449695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0e9734c-6b12-4709-85a1-327c005299e9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.450564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0e9734c-6b12-4709-85a1-327c005299e9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.618692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f0e9734c-6b12-4709-85a1-327c005299e9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Going to try to stop instance {{(pid=122407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:16:05.686266 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0e9734c-6b12-4709-85a1-327c005299e9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc/action" status: 202 len: 0 microversion: 2.1 time: 0.248775 Aug 27 03:16:05.686813 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1022/2125] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:05 2022] POST /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:05.705603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:05.706580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:05.721547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.722215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.722667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.723387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.723844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.724303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.164010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0cabc317-3891-4223-9c0c-fd3ce6b71e7f tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/21221e3c-9392-46e4-850e-f91ac12f1f5c" status: 202 len: 0 microversion: 2.1 time: 0.993746 Aug 27 03:16:06.166177 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1104/2126] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:16:05 2022] DELETE /compute/v2.1/os-security-groups/21221e3c-9392-46e4-850e-f91ac12f1f5c => generated 0 bytes in 997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:06.175851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:06.177177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:06.201070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:06.203623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.204489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.207892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.211843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.212524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.214568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.248606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad527dfec194654b0a90c1e7b39f3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d018df5801a4c85a198d22999986d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:06.270585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab6a426c-90e2-46c3-ba58-8b749c6c9c45 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 200 len: 1541 microversion: 2.1 time: 0.567578 Aug 27 03:16:06.270585 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1023/2127] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:05 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 1541 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:06.274224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f48d78f-ae4d-435a-8529-85f806036a33 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe4579ed0d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:06.337836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-0f48d78f-ae4d-435a-8529-85f806036a33 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:16:06.338642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-0f48d78f-ae4d-435a-8529-85f806036a33 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Neutron security group 1fbc1795-7af9-4009-8667-f000ecbaa301 not found {{(pid=122407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:16:06.339731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-0f48d78f-ae4d-435a-8529-85f806036a33 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] HTTP exception thrown: Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist Aug 27 03:16:06.339731 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-b93e6227-60f0-45cb-956b-900b33b50ec4'] Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f48d78f-ae4d-435a-8529-85f806036a33 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Request method failure captured: Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-security-groups/1fbc1795-7af9-4009-8667-f000ecbaa301 HTTP/1.1 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYxfUtX6KA2yPZTA8lNyLB3WUI8o-YCbvbtJzYyyVXlxkLcEGcnpU8xEOuyhEVwDSuqgPjNgWajJZYG3R9SyU5DDihmWJquldbUBkasZVnb9nSTg_mQkiHW9e2EhE-jhBsuODtrTGv_vEvmBc5KY4E55Cr7Kf7ARh4gDPWieyUfIN1g Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3edee376562d407c85728f667e3f8e19 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2030039773 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3edee376562d407c85728f667e3f8e19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3edee376562d407c85728f667e3f8e19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3edee376562d407c85728f667e3f8e19", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3edee376562d407c85728f667e3f8e19"}]}] Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2030039773 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3edee376562d407c85728f667e3f8e19 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2030039773 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupRulesTestJSON-2030039773-project Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8c8bd033f2f94906b54e41730b966cb9 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2030039773-project Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-b93e6227-60f0-45cb-956b-900b33b50ec4'] Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1fbc1795-7af9-4009-8667-f000ecbaa301'} Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:16:06.342680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b93e6227-60f0-45cb-956b-900b33b50ec4'] Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b93e6227-60f0-45cb-956b-900b33b50ec4'] Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b93e6227-60f0-45cb-956b-900b33b50ec4'] Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b93e6227-60f0-45cb-956b-900b33b50ec4'] Aug 27 03:16:06.348943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:06.362926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f48d78f-ae4d-435a-8529-85f806036a33 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Returning 404 to user: Security group 1fbc1795-7af9-4009-8667-f000ecbaa301 does not exist Aug 27 03:16:06.362926 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-b93e6227-60f0-45cb-956b-900b33b50ec4'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:06.364838 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f48d78f-ae4d-435a-8529-85f806036a33 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/1fbc1795-7af9-4009-8667-f000ecbaa301" status: 404 len: 194 microversion: 2.1 time: 0.092180 Aug 27 03:16:06.366134 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1024/2128] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:16:06 2022] DELETE /compute/v2.1/os-security-groups/1fbc1795-7af9-4009-8667-f000ecbaa301 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:16:06.382141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9133f48d-199e-4fe3-9cfe-ea2e984dea0f tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe45795eaf0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:06.719646 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9133f48d-199e-4fe3-9cfe-ea2e984dea0f tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/e5baf665-2008-4605-b9ab-cdb7d66d0428" status: 202 len: 0 microversion: 2.1 time: 0.349282 Aug 27 03:16:06.725972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1025/2129] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:16:06 2022] DELETE /compute/v2.1/os-security-groups/e5baf665-2008-4605-b9ab-cdb7d66d0428 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:06.731398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:06.732021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:06.748664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.749579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.750243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.755935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.756740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.757389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.040347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:07.056615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:07.059459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:07.061322 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a73255c-5dd5-47be-951b-70264195091c tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1477 microversion: 2.25 time: 0.334227 Aug 27 03:16:07.062646 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1026/2130] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:06 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:07.068947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b89ba286-f648-4ff2-9303-715ee463c3be req-737bd7e1-873c-4264-8ea9-51a3c975bfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82375a88-2b7f-4141-9d52-9654df74940b", "name": "network-vif-deleted", "tag": "ba2c7661-5ad0-4574-825a-76f4bbc07d5c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:07.083009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b89ba286-f648-4ff2-9303-715ee463c3be req-737bd7e1-873c-4264-8ea9-51a3c975bfb4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.083788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b89ba286-f648-4ff2-9303-715ee463c3be req-737bd7e1-873c-4264-8ea9-51a3c975bfb4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.084439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b89ba286-f648-4ff2-9303-715ee463c3be req-737bd7e1-873c-4264-8ea9-51a3c975bfb4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.112887 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b89ba286-f648-4ff2-9303-715ee463c3be req-737bd7e1-873c-4264-8ea9-51a3c975bfb4 service nova] Creating event network-vif-deleted:ba2c7661-5ad0-4574-825a-76f4bbc07d5c for instance 82375a88-2b7f-4141-9d52-9654df74940b on n-h1-852086-5 Aug 27 03:16:07.118853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b89ba286-f648-4ff2-9303-715ee463c3be req-737bd7e1-873c-4264-8ea9-51a3c975bfb4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054693 Aug 27 03:16:07.121096 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1027/2131] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:07.129161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6eb880d8-2ff8-46f3-85ea-0a40fb851b26 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe457b8b430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:07.172380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:07.192733 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c93542c-0d3a-4f40-b4b5-977180370b8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.024691 Aug 27 03:16:07.193653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1105/2132] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:06 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:07.199172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f185ed4-edba-46ee-99da-b4d44cdd1c10 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '.version_select at 0x7fe460381820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:07.207313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f185ed4-edba-46ee-99da-b4d44cdd1c10 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.214955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f185ed4-edba-46ee-99da-b4d44cdd1c10 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.215415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f185ed4-edba-46ee-99da-b4d44cdd1c10 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.227916 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f185ed4-edba-46ee-99da-b4d44cdd1c10 tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.25 time: 0.032874 Aug 27 03:16:07.228458 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1106/2133] 10.222.0.69 () {60 vars in 1184 bytes} [Sat Aug 27 03:16:07 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:07.251145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:07.258525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:07.270946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.273375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.283822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.284911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.286105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.286793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.826341 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6eb880d8-2ff8-46f3-85ea-0a40fb851b26 tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/7dd7fc50-2147-41cf-9d4f-9e89c68923dd" status: 202 len: 0 microversion: 2.1 time: 0.701174 Aug 27 03:16:07.832291 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1028/2134] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:16:07 2022] DELETE /compute/v2.1/os-security-groups/7dd7fc50-2147-41cf-9d4f-9e89c68923dd => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:07.838303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:07.839324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] [instance: 82375a88-2b7f-4141-9d52-9654df74940b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:07.853551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.854400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.855064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.859897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.861288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.862036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.875961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:07.905578 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] HTTP exception thrown: Instance 82375a88-2b7f-4141-9d52-9654df74940b could not be found. Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Request method failure captured: Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b HTTP/1.1 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwhIL5owYK-h8gZU5DKvVHVVrsH5jxiHCdDbGp6HeduyzLUyuUBty3__gal6HyPKe1KczHsiSdT4C3OjMoIghP7ACoYoa7je7dz2EW4mHCwgRVou2k1HWOKNAfNDDtm2nQKHNI4QTDz-Gj6UH-qscLMO5nb3bBcZA_uRU2eBwn26gY Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d018df5801a4c85a198d22999986d43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d018df5801a4c85a198d22999986d43", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d018df5801a4c85a198d22999986d43"}]}] Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d018df5801a4c85a198d22999986d43 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fad527dfec194654b0a90c1e7b39f3a1 Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 82375a88-2b7f-4141-9d52-9654df74940b could not be found. Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '82375a88-2b7f-4141-9d52-9654df74940b'} Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82375a88-2b7f-4141-9d52-9654df74940b could not be found. Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82375a88-2b7f-4141-9d52-9654df74940b could not be found. Aug 27 03:16:07.909050 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82375a88-2b7f-4141-9d52-9654df74940b could not be found. Aug 27 03:16:07.913785 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:07.920261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] Returning 404 to user: Instance 82375a88-2b7f-4141-9d52-9654df74940b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:07.930417 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d482e57c-adb5-47a7-88d5-d5eafc9043de tempest-FloatingIPsAssociationNegativeTestJSON-1228816036 tempest-FloatingIPsAssociationNegativeTestJSON-1228816036-project] 10.222.0.69 "GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b" status: 404 len: 111 microversion: 2.1 time: 0.090557 Aug 27 03:16:07.932371 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1029/2135] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:07 2022] GET /compute/v2.1/servers/82375a88-2b7f-4141-9d52-9654df74940b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:16:07.942064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39da0acf-f7da-40e1-9203-aefa3c0df34c tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe457bc0790>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:07.945586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] Lazy-loading 'services' on Instance uuid a6961efe-d7b6-4144-b0b6-77266b0b756d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:16:07.982078 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12999351-b5eb-401a-a46b-4f9837441d4c tempest-LiveAutoBlockMigrationV225Test-1941000744 tempest-LiveAutoBlockMigrationV225Test-1941000744-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1970 microversion: 2.25 time: 0.734464 Aug 27 03:16:07.987360 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1107/2136] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:07 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1970 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:08.029246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:08.029663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:08.038836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.039605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.040219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.041160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.041787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.042412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.081092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:08.145541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:08.195780 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a300e83-a59b-437d-9371-21109aa7da35 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 204 len: 0 microversion: 2.25 time: 0.171626 Aug 27 03:16:08.197398 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1108/2137] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:16:08 2022] DELETE /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:16:08.206557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:08.207803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:08.218114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.219028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.219703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.220768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.221514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.222213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.597319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:08.614530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:08.616615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:08.617836 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c271b14-2ac2-4700-b7d7-d78b8aa7aed7 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1483 microversion: 2.25 time: 0.416367 Aug 27 03:16:08.618437 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1109/2138] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:08 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1483 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:08.628108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:08.629122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:08.653258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.653762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.654725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.655691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.656334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.656944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.589101 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39da0acf-f7da-40e1-9203-aefa3c0df34c tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/9d62e264-d0f8-4351-ad34-146b32595613" status: 202 len: 0 microversion: 2.1 time: 1.655003 Aug 27 03:16:09.593964 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1030/2139] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:16:07 2022] DELETE /compute/v2.1/os-security-groups/9d62e264-d0f8-4351-ad34-146b32595613 => generated 0 bytes in 1661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:09.600863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20422e39-52c9-4ebd-97c8-145406ec540a tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe457a7fca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:09.752402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:09.772202 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd8c216d-4211-4858-a4fd-0a02535e1e55 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.148071 Aug 27 03:16:09.792137 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1110/2140] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:08 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:09.799663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:09.812987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:09.823157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.824200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.824827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.827078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.828353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.829229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:10.655389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:10.671576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:10.673050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:10.674768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4497d018-c0d9-4da2-8845-7940f7122b47 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1483 microversion: 2.25 time: 0.881388 Aug 27 03:16:10.679094 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1111/2141] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:09 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1483 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:10.799040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:10.799910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:10.813890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:10.814454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:10.814903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:10.815684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:10.816100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:10.825241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.496304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:11.527376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc52385a-e99e-40c2-9b3e-f695e1231844 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 0.730058 Aug 27 03:16:11.529065 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1112/2142] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:10 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:11.704248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:11.705373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:11.722792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.723425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.723886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.724640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.725096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.725520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.063791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:12.088680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:12.097496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:12.098831 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-963f8888-c263-4bc7-ab99-5b752b32672b tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1441 microversion: 2.25 time: 0.399736 Aug 27 03:16:12.101040 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1113/2143] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:11 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1441 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:12.126022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-babff295-8989-473b-b3a3-d2be83fd2aa7 req-18fc0d9a-31fa-4314-afe9-3583dca1a51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6961efe-d7b6-4144-b0b6-77266b0b756d", "name": "network-vif-deleted", "tag": "d0222350-a39e-4f7c-b624-888e8e836388"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:12.157671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-babff295-8989-473b-b3a3-d2be83fd2aa7 req-18fc0d9a-31fa-4314-afe9-3583dca1a51d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.168169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-babff295-8989-473b-b3a3-d2be83fd2aa7 req-18fc0d9a-31fa-4314-afe9-3583dca1a51d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.168858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-babff295-8989-473b-b3a3-d2be83fd2aa7 req-18fc0d9a-31fa-4314-afe9-3583dca1a51d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.213716 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-babff295-8989-473b-b3a3-d2be83fd2aa7 req-18fc0d9a-31fa-4314-afe9-3583dca1a51d service nova] Creating event network-vif-deleted:d0222350-a39e-4f7c-b624-888e8e836388 for instance a6961efe-d7b6-4144-b0b6-77266b0b756d on n-h1-852086-5 Aug 27 03:16:12.234370 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-babff295-8989-473b-b3a3-d2be83fd2aa7 req-18fc0d9a-31fa-4314-afe9-3583dca1a51d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124381 Aug 27 03:16:12.235790 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1114/2144] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:12.551123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:12.552789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:12.567874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.568657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.572432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.573957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.574684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.575292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.606129 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20422e39-52c9-4ebd-97c8-145406ec540a tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/ab363fd0-1809-4431-86f5-ce3fa5db9778" status: 202 len: 0 microversion: 2.1 time: 3.010750 Aug 27 03:16:12.610025 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1031/2145] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:16:09 2022] DELETE /compute/v2.1/os-security-groups/ab363fd0-1809-4431-86f5-ce3fa5db9778 => generated 0 bytes in 3015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:12.616867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b0adf680-9a2c-4c49-bb5d-9c573608871c tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] Calling method '.version_select at 0x7fe4579c2670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:13.323386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:13.336607 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67ee5f09-d4a3-4416-b091-6a101a4d770b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 0.791188 Aug 27 03:16:13.338135 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1115/2146] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:12 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:13.342837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:13.343453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:13.363770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.364452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.364708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.365447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.365909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.366374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.653451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:13.693598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:13.695612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:13.697027 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15e9c473-4b57-434a-a89e-a2e82c7dd5b5 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1266 microversion: 2.25 time: 0.357886 Aug 27 03:16:13.710311 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1116/2147] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:13 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:14.045031 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b0adf680-9a2c-4c49-bb5d-9c573608871c tempest-SecurityGroupRulesTestJSON-2030039773 tempest-SecurityGroupRulesTestJSON-2030039773-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/b62de86c-2aa2-4a1d-8c0d-0b05a3acc8f6" status: 202 len: 0 microversion: 2.1 time: 1.433612 Aug 27 03:16:14.046526 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1032/2148] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:16:12 2022] DELETE /compute/v2.1/os-security-groups/b62de86c-2aa2-4a1d-8c0d-0b05a3acc8f6 => generated 0 bytes in 1436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:14.358980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:14.359630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:14.369709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.370331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.370724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.371443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.374823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.382950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.733391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:14.733996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:14.737009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:14.752292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.757556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.758267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.771819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.772571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.773213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.992966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:15.002957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:15.008438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:15.020297 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d02853c-ca86-4b12-a98d-b3fdaa24cc21 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1266 microversion: 2.25 time: 0.291609 Aug 27 03:16:15.021454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1033/2149] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:14 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:16:15.097265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:15.115594 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bda753ab-c855-46e6-b2d2-2ea6b4458d75 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 0.760474 Aug 27 03:16:15.116805 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1117/2150] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:14 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:16.044943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:16.045661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:16.061448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.062284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.062903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.063824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.064541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.065143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.137888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:16.139112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:16.150653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.154823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.155521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.156500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.157136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.158366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.375370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.393608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.395520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.396879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-088d3e7f-3999-4b09-89ba-b844b865faac tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1266 microversion: 2.25 time: 0.355840 Aug 27 03:16:16.397951 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1034/2151] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:16 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:16.973031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.997192 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5636a597-f143-4be1-9654-6d29f5eb43d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 0.864570 Aug 27 03:16:16.998413 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1118/2152] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:16 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:17.427931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:17.429165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:17.457882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.461851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.462155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.462933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.463391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.463827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.694757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:17.710911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:17.712725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:17.714119 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f5b36767-0044-4c53-b389-14e11d388922 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1266 microversion: 2.25 time: 0.291362 Aug 27 03:16:17.714925 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1035/2153] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:17 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:18.019450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:18.024357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:18.049439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.050524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.052603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:18.054684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.057765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.063860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:18.745033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:18.746238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:18.755559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.756050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.756488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:18.757207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.757664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.758086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.057955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.075879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.077357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.078580 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e38a9a6-5b71-4794-bb25-0dda38a1290d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1266 microversion: 2.25 time: 0.337594 Aug 27 03:16:19.079151 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1036/2154] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:18 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:16:19.372592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.393893 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d62586d-9e18-4544-871f-0aa514e0bcdf tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.375943 Aug 27 03:16:19.396831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1119/2155] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:18 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:20.106716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:20.108061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:20.128449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.143971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.151582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.154266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.156561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.157262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.423156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:20.424117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:20.441418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.442372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.443024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.444754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.447350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.449667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.990404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:21.014627 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-094e1108-aa1b-4297-9d6f-0857bcb2519c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 0.581158 Aug 27 03:16:21.029014 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1120/2156] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:20 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:21.538506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:21.548100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:21.556119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:21.557958 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-94927c5f-8e09-4b77-81f0-8e087ff12de9 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 200 len: 1189 microversion: 2.25 time: 1.460621 Aug 27 03:16:21.559106 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1037/2157] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:20 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 1189 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:21.740508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1043619115", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:21.826355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] validate_networks() for [('543c57a2-cb9a-4ef1-87c5-f860c6ad661a', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:16:22.037544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:22.038478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:22.053105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:22.053724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:22.060906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:22.061991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:22.062702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:22.063366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.606988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:23.607636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:23.608912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:23.609544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:23.610084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:23.629796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.630875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.633254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.634373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.638984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.639681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.715416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Getting quotas for project 390e782e0da546d6b4dfc2cc089b4d84. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:23.731597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Getting quotas for user f573336900c6439d94e03ab2db24a931 and project 390e782e0da546d6b4dfc2cc089b4d84. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:23.769198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:16:23.775930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:16:23.853421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:23.864171 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-370a7a50-f696-4d86-9bd2-c5dbc6ec76ed tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.830749 Aug 27 03:16:23.870806 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1038/2158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:22 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:23.888543 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6fce2b4-0cc4-4bba-8c7f-6e478549157c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.871613 Aug 27 03:16:23.892560 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1121/2159] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:16:23.905840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c18f60f6-4a29-44dd-b333-7e207fcb561e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:23.906786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c18f60f6-4a29-44dd-b333-7e207fcb561e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:23.906914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:23.907487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: a6961efe-d7b6-4144-b0b6-77266b0b756d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:23.940476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.940758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.941207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.941950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.942441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.953725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.005009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] HTTP exception thrown: Instance a6961efe-d7b6-4144-b0b6-77266b0b756d could not be found. Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Request method failure captured: Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d HTTP/1.1 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYq4kHtBdih8O47lO3r3TEQOWti_0ne_BjKx-_7RM-Pfn6i2NNYjSLHB4TzUsHkH0ubVxmc5_gfoShZZXtwzyO-jgTe3E9udXCqNRJDEiSxEDrwpGZJd3rClNtm26LXOEwl9v0eRfqreIcn1H_KXLlrD1Bokj4AvU-IDG_a88BDQLR8 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_99adbc97973247998f0bfbbc486a410e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}] Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 21a64079d45547ba80c22c309d216438 Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance a6961efe-d7b6-4144-b0b6-77266b0b756d could not be found. Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'a6961efe-d7b6-4144-b0b6-77266b0b756d'} Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6961efe-d7b6-4144-b0b6-77266b0b756d could not be found. Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6961efe-d7b6-4144-b0b6-77266b0b756d could not be found. Aug 27 03:16:24.006664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6961efe-d7b6-4144-b0b6-77266b0b756d could not be found. Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Returning 404 to user: Instance a6961efe-d7b6-4144-b0b6-77266b0b756d could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:24.015154 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0183cae-769b-4ed1-b7a4-969c1e0d2a10 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d" status: 404 len: 111 microversion: 2.25 time: 0.134743 Aug 27 03:16:24.024239 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1039/2160] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:23 2022] GET /compute/v2.1/servers/a6961efe-d7b6-4144-b0b6-77266b0b756d => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:16:24.281547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c18f60f6-4a29-44dd-b333-7e207fcb561e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:24.294996 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c18f60f6-4a29-44dd-b333-7e207fcb561e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1217 microversion: 2.1 time: 0.393362 Aug 27 03:16:24.297945 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1122/2161] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:23 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1217 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:24.898019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:24.898731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:24.923717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:24.924618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:24.925882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.927723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:24.936442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:24.937178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.317250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:25.318975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.366389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.366389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.366389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.386357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.386859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.387302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.831819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:25.862313 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ce14d7e-4333-4e3d-ae7a-ac81a0c5535d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1221 microversion: 2.1 time: 0.549076 Aug 27 03:16:25.876442 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1123/2162] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:25 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1221 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:26.483323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:26.517243 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2522f4fd-90e4-44d9-92a9-20df5b604cab tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.622793 Aug 27 03:16:26.528287 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1040/2163] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:24 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:26.886627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:26.887629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:26.912219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.914569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.915324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.916355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.919925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.922826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.318386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:27.330961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85df3acf-d2e7-4daa-84a8-8a3745f927aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1277 microversion: 2.1 time: 0.448194 Aug 27 03:16:27.337810 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1041/2164] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:26 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1277 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:27.406402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9a18ddb-f35f-488c-9d8d-8a2de060eb16 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Calling method '.version_select at 0x7fe45c6535e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:27.543504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:27.544902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:27.556196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.560125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.560819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.566357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.567240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.567947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.652444 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9a18ddb-f35f-488c-9d8d-8a2de060eb16 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382" status: 200 len: 371 microversion: 2.1 time: 0.772243 Aug 27 03:16:27.673302 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1124/2165] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:16:26 2022] GET /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382 => generated 371 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:27.692930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Action: 'update', calling method: .version_select at 0x7fe4603f3550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:27.935565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.936379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.937067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.938131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.939550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.940246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.087072 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25467e14-56b8-467c-bca5-9cf81a6e1a97 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382" status: 200 len: 328 microversion: 2.1 time: 0.409049 Aug 27 03:16:28.110529 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1125/2166] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:16:27 2022] PUT /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382 => generated 328 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:28.129579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8aade471-2163-40cd-963b-a693aad5f238 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.188009 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8aade471-2163-40cd-963b-a693aad5f238 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382" status: 202 len: 0 microversion: 2.1 time: 0.075376 Aug 27 03:16:28.196336 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1126/2167] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:16:28 2022] DELETE /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:28.213000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f277e679-88c8-4920-a68a-4105adad2963 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Calling method '.version_select at 0x7fe45c653280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.470089 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f277e679-88c8-4920-a68a-4105adad2963 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382" status: 200 len: 371 microversion: 2.1 time: 0.272151 Aug 27 03:16:28.470882 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1127/2168] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:16:28 2022] GET /compute/v2.1/os-quota-sets/28de60c1ce7b4cf5afa91c3cbbdac382 => generated 371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:28.505710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.507246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:28.542047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.547001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.554127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.555322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.556238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.556924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:29.263935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:29.273210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6dabcffd-575c-4363-95b7-ea50c5f55e62 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.733848 Aug 27 03:16:29.303243 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1042/2169] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:27 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:29.321229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f0d42f8-3623-4e13-b731-42c96c9e560f tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Calling method '.version_select at 0x7fe457bb7af0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:29.995196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:30.020830 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23eb3f31-2f56-4d48-9788-f030603b5263 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1275 microversion: 2.1 time: 1.533159 Aug 27 03:16:30.022806 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1128/2170] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:28 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1275 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:30.102293 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f0d42f8-3623-4e13-b731-42c96c9e560f tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220/defaults" status: 200 len: 371 microversion: 2.1 time: 0.798337 Aug 27 03:16:30.117102 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1043/2171] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:16:29 2022] GET /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220/defaults => generated 371 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:30.313269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:30.314776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:30.335070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:30.336510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:30.337262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:30.339219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:30.343309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:30.344050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:30.796953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Action: 'update', calling method: .version_select at 0x7fe457a1c3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:31.289148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.289820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.290502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.291371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.291945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.292491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.555304 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e8eb154-63bf-4e3f-8547-2509ccec3f37 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649" status: 200 len: 328 microversion: 2.1 time: 0.762047 Aug 27 03:16:31.584929 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1044/2172] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:16:30 2022] PUT /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649 => generated 328 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:31.607489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:31.608371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:31.649757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.652210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.657620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.666591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.667331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.670795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.787817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:31.802305 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d06b7f06-2aea-48c9-b942-f4995a45977a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.487500 Aug 27 03:16:31.818294 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1129/2173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:30 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:31.866545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:31.875406 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50e3d994-a17d-460b-8965-ebc1fb4e532f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1275 microversion: 2.1 time: 0.289104 Aug 27 03:16:31.886338 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1045/2174] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:31 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:31.899254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Calling method '.version_select at 0x7fe457a1c430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:32.093665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fbf9054-e48b-46c5-8f48-f198a3d783fd tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Action: 'create', calling method: .version_select at 0x7fe45c4714c0>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:32.791848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:32.793910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:32.799557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:32.803750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:32.810019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:32.811391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:32.917790 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0e5ad14-1d94-4d87-9e5a-7b6bcef8f4da tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649/detail" status: 200 len: 916 microversion: 2.1 time: 1.029914 Aug 27 03:16:32.918664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1046/2175] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:16:31 2022] GET /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649/detail => generated 916 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:32.969165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:32.970008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:33.003703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:33.012595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:33.016356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:33.017980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:33.021069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:33.025181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:33.600479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:33.608806 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a1590821-530b-4586-9615-46ce519ccd8e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 0.671216 Aug 27 03:16:33.621852 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1047/2176] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:32 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:33.628508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:33.635001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:33.665025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:33.668022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:33.668654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:33.671542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:33.672446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:33.674524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:34.080530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:34.101141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fa9adbac-edd2-457a-9c70-b7f61f8e921b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1275 microversion: 2.1 time: 0.483076 Aug 27 03:16:34.102312 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1048/2177] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:33 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1275 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:34.122299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Action: 'update', calling method: .version_select at 0x7fe457a191f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:34.911973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.916779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.917381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:34.924827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.925699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.927179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:35.108231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:35.110122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:35.113473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:35.114979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:35.115726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:35.116397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:35.277354 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-968ac0b9-d45c-425c-95d1-371720a7b72c tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649?user_id=6d68ee2c7fce4d61a45960d89d536cc2" status: 200 len: 328 microversion: 2.1 time: 1.172269 Aug 27 03:16:35.291037 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1049/2178] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:16:34 2022] PUT /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649?user_id=6d68ee2c7fce4d61a45960d89d536cc2 => generated 328 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:35.301922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:35.302975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:35.309890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:35.314483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:35.316756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:35.321720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:35.322613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:35.323301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:36.321646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:36.350553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00eb8e38-028f-4d9b-95bf-cb62e3707339 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1499 microversion: 2.1 time: 1.057863 Aug 27 03:16:36.360340 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1050/2179] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:35 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1499 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:36.380120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:36.381654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:36.393000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:36.402918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:36.405766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:36.406877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:36.407537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:36.408635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:36.847940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:36.888010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-035a0fb6-7861-4d4e-a484-9859158b4dd5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1317 microversion: 2.1 time: 0.519406 Aug 27 03:16:36.895227 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1051/2180] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:36 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:36.908499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2cce3b4-ce8e-47d6-8950-d5c2723d7b41 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Calling method '.version_select at 0x7fe457a7f5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:37.515623 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2cce3b4-ce8e-47d6-8950-d5c2723d7b41 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649?user_id=6d68ee2c7fce4d61a45960d89d536cc2" status: 200 len: 370 microversion: 2.1 time: 0.618494 Aug 27 03:16:37.520779 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1052/2181] 10.222.0.69 () {58 vars in 1323 bytes} [Sat Aug 27 03:16:36 2022] GET /compute/v2.1/os-quota-sets/f09f3674e0564f6883d5b2749f3e9649?user_id=6d68ee2c7fce4d61a45960d89d536cc2 => generated 370 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:37.954769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:38.000787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab126219-2335-4e97-b504-c9ec593f2c77 tempest-ListImageFiltersNegativeTestJSON-317309168 tempest-ListImageFiltersNegativeTestJSON-317309168-project] Calling method '.version_select at 0x7fe4579fc790>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:38.137125 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ab126219-2335-4e97-b504-c9ec593f2c77 tempest-ListImageFiltersNegativeTestJSON-317309168 tempest-ListImageFiltersNegativeTestJSON-317309168-project] HTTP exception thrown: Image not found. Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab126219-2335-4e97-b504-c9ec593f2c77 tempest-ListImageFiltersNegativeTestJSON-317309168 tempest-ListImageFiltersNegativeTestJSON-317309168-project] Request method failure captured: Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/images/c44fae64-46b4-4c03-8cee-9ead6bbd2a87 HTTP/1.1 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyTvgBAMM6W_z6kbgFXdH9zy3X0bB-a-qbcIN7f9lwf_3jIz6xcgS56l9S79ZGCkq0qLjzjyBVasEjebt0JUoLp4u1GDdWg6aEP97Zt0mt_hQr5RB8Mg_AUnGCQPGbFFqZeGxKkkC3bXRK7a73vwqFP29tLcWjxDVUQ_Rq525rT7k0 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 5ab86b471572470fbfff4253f6a8003c Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-317309168 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5ab86b471572470fbfff4253f6a8003c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5ab86b471572470fbfff4253f6a8003c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5ab86b471572470fbfff4253f6a8003c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5ab86b471572470fbfff4253f6a8003c"}]}] Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-317309168 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 5ab86b471572470fbfff4253f6a8003c Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-317309168 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListImageFiltersNegativeTestJSON-317309168-project Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0dc2c69b30434a3d8324bf9f8e20883b Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-317309168-project Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'c44fae64-46b4-4c03-8cee-9ead6bbd2a87'} Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c44fae64-46b4-4c03-8cee-9ead6bbd2a87 Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:16:38.139533 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c44fae64-46b4-4c03-8cee-9ead6bbd2a87 could not be found. Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:16:38.145369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab126219-2335-4e97-b504-c9ec593f2c77 tempest-ListImageFiltersNegativeTestJSON-317309168 tempest-ListImageFiltersNegativeTestJSON-317309168-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:38.161518 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab126219-2335-4e97-b504-c9ec593f2c77 tempest-ListImageFiltersNegativeTestJSON-317309168 tempest-ListImageFiltersNegativeTestJSON-317309168-project] 10.222.0.69 "GET /compute/v2.1/images/c44fae64-46b4-4c03-8cee-9ead6bbd2a87" status: 404 len: 62 microversion: 2.1 time: 0.623760 Aug 27 03:16:38.161518 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1053/2182] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:16:37 2022] GET /compute/v2.1/images/c44fae64-46b4-4c03-8cee-9ead6bbd2a87 => generated 62 bytes in 625 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:16:38.171718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:38.172437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:38.250539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:38.253333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:38.255999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:38.257016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:38.258067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:38.264507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:38.281549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:38.366912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:38.420188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=20 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:38.701392 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84c28eec-2430-4a63-acae-b79c0b0c9268 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 204 len: 0 microversion: 2.25 time: 0.553510 Aug 27 03:16:38.716385 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1054/2183] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:16:38 2022] DELETE /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:16:38.741344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:38.741959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:38.795334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:38.796037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:38.796587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:38.797985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:38.801567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:38.802154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:39.411548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:39.424327 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-665af273-faa7-49a1-9c73-32786f7de788 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 200 len: 1476 microversion: 2.1 time: 0.705235 Aug 27 03:16:39.427880 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1055/2184] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:38 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 1476 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:39.441642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:39.442291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:39.451062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:39.451565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:39.451997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:39.452708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:39.455521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:39.460509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:39.822062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:39.834303 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca4119a9-f369-4a56-8f44-7537f3b8d585 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1317 microversion: 2.1 time: 0.405142 Aug 27 03:16:39.856214 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1056/2185] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:39 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:39.868316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:39.872868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:39.911628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:39.912358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:39.912950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:39.916610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:39.917899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:39.919804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:40.260125 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0fbf9054-e48b-46c5-8f48-f198a3d783fd tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.440412 Aug 27 03:16:40.261737 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1130/2186] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:16:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:40.269320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-219124fe-8fdf-4254-a401-7fb208b37fa4 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Calling method '.version_select at 0x7fe45c8645e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:40.364740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:40.730308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:40.746336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:40.748589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:40.750440 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-af9fddc7-3eab-4fec-a07a-b302c60128d6 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1731 microversion: 2.25 time: 0.892710 Aug 27 03:16:40.753278 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1057/2187] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:39 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1731 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:40.772760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8b6e6b5a-9720-441c-8e44-cdc45165c202 req-81b73c14-0075-4606-bcf9-5389be692097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45dca35c-d122-40f4-986b-5b77851f6f3d", "tag": "2018ab3e-4e07-4098-b98e-9002dd279856"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:40.796145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b6e6b5a-9720-441c-8e44-cdc45165c202 req-81b73c14-0075-4606-bcf9-5389be692097 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:40.798091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b6e6b5a-9720-441c-8e44-cdc45165c202 req-81b73c14-0075-4606-bcf9-5389be692097 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:40.799891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b6e6b5a-9720-441c-8e44-cdc45165c202 req-81b73c14-0075-4606-bcf9-5389be692097 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:40.832007 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8b6e6b5a-9720-441c-8e44-cdc45165c202 req-81b73c14-0075-4606-bcf9-5389be692097 service nova] Creating event network-changed:2018ab3e-4e07-4098-b98e-9002dd279856 for instance 45dca35c-d122-40f4-986b-5b77851f6f3d on n-h1-852086-5 Aug 27 03:16:40.842279 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8b6e6b5a-9720-441c-8e44-cdc45165c202 req-81b73c14-0075-4606-bcf9-5389be692097 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086615 Aug 27 03:16:40.846020 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1058/2188] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:40.862534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1959398953"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:40.868289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:40.878380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:40.879049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:40.879624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:40.881521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:40.882690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:40.883561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:41.056918 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-219124fe-8fdf-4254-a401-7fb208b37fa4 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220/defaults" status: 200 len: 371 microversion: 2.1 time: 0.793578 Aug 27 03:16:41.057846 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1131/2189] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:16:40 2022] GET /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220/defaults => generated 371 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:41.072353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd078ebf-812c-4e97-a9fe-b7f72e6ac7e9 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Action: 'create', calling method: .version_select at 0x7fe45c653700>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:41.312335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7101da23-d37b-4c3a-ab84-377c188209f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc/action" status: 202 len: 0 microversion: 2.1 time: 0.460999 Aug 27 03:16:41.314941 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1059/2190] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:40 2022] POST /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:16:41.325422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:41.326150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:41.329294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:41.356191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:41.356932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:41.357536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:41.358297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:41.358766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:41.359184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:41.636922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:41.655510 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9356b413-b5c4-45c2-812f-7b6557f60edb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1317 microversion: 2.1 time: 0.336479 Aug 27 03:16:41.657423 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1060/2191] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:41 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:41.668441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Action: 'update', calling method: .version_select at 0x7fe4579beee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:41.795680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:42.684761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:42.685368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:42.685672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:42.692741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:42.693226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:42.698533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.127869 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e700732-3047-4ef9-a620-62668dbcf475 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220" status: 200 len: 329 microversion: 2.1 time: 1.466763 Aug 27 03:16:43.137071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1061/2192] 10.222.0.69 () {60 vars in 1263 bytes} [Sat Aug 27 03:16:41 2022] PUT /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220 => generated 329 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:43.155249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9fbd75b4-e53b-4f65-84ac-4df7d030210c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457a64670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:43.230637 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9fbd75b4-e53b-4f65-84ac-4df7d030210c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 200 len: 1414 microversion: 2.1 time: 0.091853 Aug 27 03:16:43.231730 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1062/2193] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:16:43 2022] GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:43.245761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:43.246484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:43.262056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.267948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.268688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.269584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.271917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.272466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.407213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:43.419292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:43.420743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:43.426218 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c1d6cebb-025b-4992-b0ca-8aae8fa27896 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 200 len: 1664 microversion: 2.25 time: 0.194166 Aug 27 03:16:43.440535 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1063/2194] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:43 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 1664 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:43.718848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:43.721303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.722028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.722721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.723671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.727184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.727770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.795724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bb46f6a4-031e-42c9-8fd8-0dc150b3db2b tempest-AZV2TestJSON-779064787 tempest-AZV2TestJSON-779064787-project] 10.222.0.69 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.339194 Aug 27 03:16:43.800295 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1064/2195] 10.222.0.69 () {58 vars in 1164 bytes} [Sat Aug 27 03:16:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:16:43.813946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:43.816252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:43.824726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.825704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.826369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.828272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.830610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.831239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:44.869454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:44.891548 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-730a30ce-a889-4eef-97de-670f7483ebdb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1317 microversion: 2.1 time: 1.087912 Aug 27 03:16:44.899814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1065/2196] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:43 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1317 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:44.926658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Action: 'update', calling method: .version_select at 0x7fe457a64a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:45.015243 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd078ebf-812c-4e97-a9fe-b7f72e6ac7e9 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.946656 Aug 27 03:16:45.016766 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1132/2197] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:16:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:45.022938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-068551f8-2663-4608-b91a-0c645b73aa6d req-cb06e9b8-9209-4132-a1d1-dd11924261b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607b043e-1bab-4c1d-8348-610a19b23bfa", "name": "network-vif-deleted", "tag": "01d2411e-6250-4e8c-bc59-812d60bccff5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:45.039205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-068551f8-2663-4608-b91a-0c645b73aa6d req-cb06e9b8-9209-4132-a1d1-dd11924261b0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:45.039945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-068551f8-2663-4608-b91a-0c645b73aa6d req-cb06e9b8-9209-4132-a1d1-dd11924261b0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:45.040517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-068551f8-2663-4608-b91a-0c645b73aa6d req-cb06e9b8-9209-4132-a1d1-dd11924261b0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:45.054314 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-068551f8-2663-4608-b91a-0c645b73aa6d req-cb06e9b8-9209-4132-a1d1-dd11924261b0 service nova] Creating event network-vif-deleted:01d2411e-6250-4e8c-bc59-812d60bccff5 for instance 607b043e-1bab-4c1d-8348-610a19b23bfa on n-h2-852086-5 Aug 27 03:16:45.060421 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-068551f8-2663-4608-b91a-0c645b73aa6d req-cb06e9b8-9209-4132-a1d1-dd11924261b0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040802 Aug 27 03:16:45.061681 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1133/2198] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:45.070323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ee4ceca-3856-4943-b27c-e795b53544ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45c543ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:45.376185 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ee4ceca-3856-4943-b27c-e795b53544ba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 200 len: 1414 microversion: 2.1 time: 0.312240 Aug 27 03:16:45.380106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1134/2199] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:16:45 2022] GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 1414 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:45.397849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:45.407203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 607b043e-1bab-4c1d-8348-610a19b23bfa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:45.438179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:45.438702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:45.444138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:45.444925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:45.445402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:45.445835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:45.491479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:45.493476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:45.496103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:45.497243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:45.498790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:45.499562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:45.516811 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] HTTP exception thrown: Instance 607b043e-1bab-4c1d-8348-610a19b23bfa could not be found. Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Request method failure captured: Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa HTTP/1.1 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYq4kHtBdih8O47lO3r3TEQOWti_0ne_BjKx-_7RM-Pfn6i2NNYjSLHB4TzUsHkH0ubVxmc5_gfoShZZXtwzyO-jgTe3E9udXCqNRJDEiSxEDrwpGZJd3rClNtm26LXOEwl9v0eRfqreIcn1H_KXLlrD1Bokj4AvU-IDG_a88BDQLR8 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_99adbc97973247998f0bfbbc486a410e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}] Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 21a64079d45547ba80c22c309d216438 Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 607b043e-1bab-4c1d-8348-610a19b23bfa could not be found. Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '607b043e-1bab-4c1d-8348-610a19b23bfa'} Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607b043e-1bab-4c1d-8348-610a19b23bfa could not be found. Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607b043e-1bab-4c1d-8348-610a19b23bfa could not be found. Aug 27 03:16:45.518951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607b043e-1bab-4c1d-8348-610a19b23bfa could not be found. Aug 27 03:16:45.522105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.530361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Returning 404 to user: Instance 607b043e-1bab-4c1d-8348-610a19b23bfa could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:45.531501 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7788e0c6-d1f4-4757-8bd6-21839cafa5ab tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa" status: 404 len: 111 microversion: 2.25 time: 0.148627 Aug 27 03:16:45.543967 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1135/2200] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:45 2022] GET /compute/v2.1/servers/607b043e-1bab-4c1d-8348-610a19b23bfa => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:16:45.550897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f51369b3-d7a9-47b2-a925-7230dce718e6 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Action: 'create', calling method: .version_select at 0x7fe45ce6b9d0>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:45.953926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=25,nova_api:UPDATE=11 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:46.136946 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3aee1c14-d6fe-4f86-9f79-c32cae3fe322 tempest-QuotasAdminTestJSON-1088603712 tempest-QuotasAdminTestJSON-1088603712-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220" status: 200 len: 329 microversion: 2.1 time: 1.235062 Aug 27 03:16:46.137571 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1066/2201] 10.222.0.69 () {60 vars in 1263 bytes} [Sat Aug 27 03:16:44 2022] PUT /compute/v2.1/os-quota-sets/660910ddadd74f23aef950c8dbf9e220 => generated 329 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:46.142655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12546fe2-bffd-4c50-b0be-0438483f0f68 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '.version_select at 0x7fe45795e940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:46.201264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-12546fe2-bffd-4c50-b0be-0438483f0f68 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345394866" status: 204 len: 0 microversion: 2.25 time: 0.062624 Aug 27 03:16:46.202182 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1067/2202] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345394866 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:16:46.207829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:46.208444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:46.224410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:46.233240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:46.239144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:46.240103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:46.240744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:46.252116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:47.876055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:47.889371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5415b8b-339b-43b5-9080-b4530318c241 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1317 microversion: 2.1 time: 1.686022 Aug 27 03:16:47.900818 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1068/2203] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:46 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1317 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:47.941697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-955a8fa0-a11e-4d41-b9f5-0c2b27409d36 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45cb7e9d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:49.545592 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f51369b3-d7a9-47b2-a925-7230dce718e6 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.999387 Aug 27 03:16:49.547156 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1136/2204] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:16:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:49.560037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:49.560922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:49.578317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:49.579295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:49.580712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:49.587420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:49.588228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:49.589083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:49.938034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:49.958126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f339b2c8-04f5-4912-a748-5bb4d2711e64 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1317 microversion: 2.1 time: 0.408336 Aug 27 03:16:49.958781 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1137/2205] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:49 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:49.995533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33fbca5f-14c7-40ed-a36c-6116036f0f99 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Action: 'create', calling method: .version_select at 0x7fe45c091940>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:55.136530 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33fbca5f-14c7-40ed-a36c-6116036f0f99 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.156977 Aug 27 03:16:55.138943 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1138/2206] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:16:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:55.146058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:55.146939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:55.186542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.187260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.187781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:55.189382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.191695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.193810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:55.254272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:55.540098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=15 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:55.576805 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7e2b17c-38ad-4c7d-9f8d-cc5d3cff184d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 204 len: 0 microversion: 2.25 time: 0.432430 Aug 27 03:16:55.577461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1139/2207] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:16:55 2022] DELETE /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:16:55.601322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:55.603531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:55.622781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.630048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.630756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:55.633817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.634900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.637770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:56.109944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=94 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:56.212732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:56.379715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:56.402952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f207e0fa-b3f4-434f-a5cb-358181a3889b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1317 microversion: 2.1 time: 0.824141 Aug 27 03:16:56.403570 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1140/2208] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:55 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:56.426523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0b13ff8a-0719-492e-a66e-54133602f60c req-6fe7cddd-f867-496b-af67-a053ae251d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dca35c-d122-40f4-986b-5b77851f6f3d", "name": "network-vif-plugged", "status": "completed", "tag": "2018ab3e-4e07-4098-b98e-9002dd279856"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:56.452395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0b13ff8a-0719-492e-a66e-54133602f60c req-6fe7cddd-f867-496b-af67-a053ae251d52 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:56.460498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0b13ff8a-0719-492e-a66e-54133602f60c req-6fe7cddd-f867-496b-af67-a053ae251d52 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:56.461082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0b13ff8a-0719-492e-a66e-54133602f60c req-6fe7cddd-f867-496b-af67-a053ae251d52 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:56.483885 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0b13ff8a-0719-492e-a66e-54133602f60c req-6fe7cddd-f867-496b-af67-a053ae251d52 service nova] Creating event network-vif-plugged:2018ab3e-4e07-4098-b98e-9002dd279856 for instance 45dca35c-d122-40f4-986b-5b77851f6f3d on n-h1-852086-5 Aug 27 03:16:56.510701 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0b13ff8a-0719-492e-a66e-54133602f60c req-6fe7cddd-f867-496b-af67-a053ae251d52 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102277 Aug 27 03:16:56.530437 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1141/2209] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:56.547405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed949ea0-4bcf-461a-b6f8-a2be3a35493c tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Calling method '.version_select at 0x7fe45c2c1d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:57.469762 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed949ea0-4bcf-461a-b6f8-a2be3a35493c tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/d5690275-b0be-40cc-a09a-90006abdc955" status: 200 len: 142 microversion: 2.1 time: 0.937775 Aug 27 03:16:57.472977 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1142/2210] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:16:56 2022] GET /compute/v2.1/os-floating-ips/d5690275-b0be-40cc-a09a-90006abdc955 => generated 142 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:57.478025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:57.481220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:57.510232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.511156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.517669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.519036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.519766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.520426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.889296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:58.209086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:58.228387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:58.229902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:58.246491 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-069dfef7-dc51-49d2-9406-966267f5bb91 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 200 len: 1549 microversion: 2.25 time: 0.763900 Aug 27 03:16:58.249476 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1143/2211] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:16:57 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 1549 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:16:58.868060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8c0f5fb-a67f-4afb-bc09-c38c6c254e45 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe45c28aca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-312076015", "description": "tempest-description-242259810"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:59.379189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8c0f5fb-a67f-4afb-bc09-c38c6c254e45 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.127928 Aug 27 03:16:59.380210 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1144/2212] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:16:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:59.571833 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4e87797-70a0-4be3-8f74-1c079965155d tempest-TenantUsagesNegativeTestJSON-1914754334 tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T03%3A16%3A56.314699&end=2022-08-28T03%3A16%3A56.314699" status: 404 len: 112 microversion: - time: 0.190085 Aug 27 03:16:59.572596 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1145/2213] 10.222.0.69 () {58 vars in 1316 bytes} [Sat Aug 27 03:16:59 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T03%3A16%3A56.314699&end=2022-08-28T03%3A16%3A56.314699 => generated 112 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:16:59.583143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:59.584041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:59.625126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.627337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.630366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:59.632622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.633706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.635464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:00.070644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:00.088954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38881d56-4b09-4ada-abd5-4c4be038500b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.515004 Aug 27 03:17:00.090812 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1146/2214] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:59 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:00.097370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbdc94f1-0c22-4f3d-af96-03bc37e6b100 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Calling method '.version_select at 0x7fe4601afee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:02.989954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbdc94f1-0c22-4f3d-af96-03bc37e6b100 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/d5690275-b0be-40cc-a09a-90006abdc955" status: 202 len: 0 microversion: 2.1 time: 2.896771 Aug 27 03:17:02.991418 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1147/2215] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:17:00 2022] DELETE /compute/v2.1/os-floating-ips/d5690275-b0be-40cc-a09a-90006abdc955 => generated 0 bytes in 2899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:03.002843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2c67a836-c32d-479f-a276-a05f8766b0a5 req-d0a92247-219f-49d0-a496-f186e4d1440a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0fd9cc-6856-4230-a8e8-e8f92c613ccc", "name": "network-vif-plugged", "status": "completed", "tag": "0601f318-b434-4387-91e4-1fc89f3a0c8c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:03.015006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2c67a836-c32d-479f-a276-a05f8766b0a5 req-d0a92247-219f-49d0-a496-f186e4d1440a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.015749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2c67a836-c32d-479f-a276-a05f8766b0a5 req-d0a92247-219f-49d0-a496-f186e4d1440a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.016330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2c67a836-c32d-479f-a276-a05f8766b0a5 req-d0a92247-219f-49d0-a496-f186e4d1440a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.044577 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2c67a836-c32d-479f-a276-a05f8766b0a5 req-d0a92247-219f-49d0-a496-f186e4d1440a service nova] Creating event network-vif-plugged:0601f318-b434-4387-91e4-1fc89f3a0c8c for instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc on n-h1-852086-5 Aug 27 03:17:03.090663 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2c67a836-c32d-479f-a276-a05f8766b0a5 req-d0a92247-219f-49d0-a496-f186e4d1440a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097284 Aug 27 03:17:03.095977 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1148/2216] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:03.111579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ad321c6f-85d0-4a04-b3e8-61669aedf5f4 req-30a7463e-2db0-4a53-8c73-82384906c0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4b4e2-b5c0-44d3-b520-c1571ceee8ef", "name": "network-vif-deleted", "tag": "4485a129-6aee-4bcf-a63f-aa2d14a240e9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:03.135331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ad321c6f-85d0-4a04-b3e8-61669aedf5f4 req-30a7463e-2db0-4a53-8c73-82384906c0db service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.136198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ad321c6f-85d0-4a04-b3e8-61669aedf5f4 req-30a7463e-2db0-4a53-8c73-82384906c0db service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.136833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ad321c6f-85d0-4a04-b3e8-61669aedf5f4 req-30a7463e-2db0-4a53-8c73-82384906c0db service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.163473 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ad321c6f-85d0-4a04-b3e8-61669aedf5f4 req-30a7463e-2db0-4a53-8c73-82384906c0db service nova] Creating event network-vif-deleted:4485a129-6aee-4bcf-a63f-aa2d14a240e9 for instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef on n-h2-852086-5 Aug 27 03:17:03.170917 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ad321c6f-85d0-4a04-b3e8-61669aedf5f4 req-30a7463e-2db0-4a53-8c73-82384906c0db service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073323 Aug 27 03:17:03.174531 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1149/2217] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:03.193733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:03.199219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:03.211713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.212600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.213645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.214951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.215773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.216464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.237294 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] HTTP exception thrown: Instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef could not be found. Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Request method failure captured: Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef HTTP/1.1 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYq4kHtBdih8O47lO3r3TEQOWti_0ne_BjKx-_7RM-Pfn6i2NNYjSLHB4TzUsHkH0ubVxmc5_gfoShZZXtwzyO-jgTe3E9udXCqNRJDEiSxEDrwpGZJd3rClNtm26LXOEwl9v0eRfqreIcn1H_KXLlrD1Bokj4AvU-IDG_a88BDQLR8 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_99adbc97973247998f0bfbbc486a410e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}] Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 21a64079d45547ba80c22c309d216438 Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef could not be found. Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '36c4b4e2-b5c0-44d3-b520-c1571ceee8ef'} Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef could not be found. Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef could not be found. Aug 27 03:17:03.239534 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef could not be found. Aug 27 03:17:03.243381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.245295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Returning 404 to user: Instance 36c4b4e2-b5c0-44d3-b520-c1571ceee8ef could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:03.246677 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1ad2d6c-04d8-47d1-94ab-ab9de32d1208 tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef" status: 404 len: 111 microversion: 2.25 time: 0.069258 Aug 27 03:17:03.250658 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1150/2218] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:17:03 2022] GET /compute/v2.1/servers/36c4b4e2-b5c0-44d3-b520-c1571ceee8ef => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:03.257492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac09426f-10e4-4581-8e12-abdd18da0e9e tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe45c6535e0>, body: {"security_group_rule": {"parent_group_id": "97e0c87d-df9a-473d-837d-453e67bd813a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:03.428734 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-955a8fa0-a11e-4d41-b9f5-0c2b27409d36 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 200 len: 1414 microversion: 2.1 time: 15.526316 Aug 27 03:17:03.438588 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1069/2219] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:16:47 2022] GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 1414 bytes in 15537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:03.443415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1f5240e-984d-4835-8421-0aca5d734cca tempest-TenantUsagesNegativeTestJSON-1914754334 tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin] Calling method '.version_select at 0x7fe457b57a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:03.447739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f1f5240e-984d-4835-8421-0aca5d734cca tempest-TenantUsagesNegativeTestJSON-1914754334 tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1f5240e-984d-4835-8421-0aca5d734cca tempest-TenantUsagesNegativeTestJSON-1914754334 tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin] Request method failure captured: Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-simple-tenant-usage/d45476e670c14ec8a8ae718f4eb35b44?start=2022-08-28T03%3A16%3A56.314699&end=2022-08-26T03%3A16%3A56.314699 HTTP/1.1 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyogT4mLgIVJzxQd4Mu3aei9s6r67NUn45Acm6imIVUnoF7EW_khtHU_VxMvOYpAWYHip5P4NH9bR4_wsYUMVEWh_-oGLAZ1obkih3yYZ7cGDTXWvYJJuxuRPcNKE-XfEaIhmYrLXVVQEZ3ru56GFT9df5lloDGNlan02sik2nm83c Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4a4c002b69a640448cf857788f4a8ca1 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1914754334 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4a4c002b69a640448cf857788f4a8ca1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4a4c002b69a640448cf857788f4a8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4a4c002b69a640448cf857788f4a8ca1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4a4c002b69a640448cf857788f4a8ca1"}]}] Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1914754334 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4a4c002b69a640448cf857788f4a8ca1 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1914754334 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fbcd19cfa5d44358a0c96daf107e99a5 Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid start time. The start time cannot occur after the end time. Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd45476e670c14ec8a8ae718f4eb35b44'} Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 27 03:17:03.463325 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:03.467662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1f5240e-984d-4835-8421-0aca5d734cca tempest-TenantUsagesNegativeTestJSON-1914754334 tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:03.467662 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1f5240e-984d-4835-8421-0aca5d734cca tempest-TenantUsagesNegativeTestJSON-1914754334 tempest-TenantUsagesNegativeTestJSON-1914754334-project-admin] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage/d45476e670c14ec8a8ae718f4eb35b44?start=2022-08-28T03%3A16%3A56.314699&end=2022-08-26T03%3A16%3A56.314699" status: 400 len: 111 microversion: 2.1 time: 0.025143 Aug 27 03:17:03.471188 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1070/2220] 10.222.0.69 () {58 vars in 1412 bytes} [Sat Aug 27 03:17:03 2022] GET /compute/v2.1/os-simple-tenant-usage/d45476e670c14ec8a8ae718f4eb35b44?start=2022-08-28T03%3A16%3A56.314699&end=2022-08-26T03%3A16%3A56.314699 => generated 111 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:03.476687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1494818896", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:03.661024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] validate_networks() for [('543c57a2-cb9a-4ef1-87c5-f860c6ad661a', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:03.803493 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac09426f-10e4-4581-8e12-abdd18da0e9e tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.551050 Aug 27 03:17:03.804697 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1151/2221] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:03 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:03.810071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0745a16b-6cf2-461d-ba8e-11f19c3cb58c tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Calling method '.version_select at 0x7fe457d0c790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:04.165692 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0745a16b-6cf2-461d-ba8e-11f19c3cb58c tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.359630 Aug 27 03:17:04.167200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1152/2222] 10.222.0.69 () {58 vars in 1164 bytes} [Sat Aug 27 03:17:03 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:17:04.175975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:04.179015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:04.186940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.187736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.188449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.190480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.191172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.191804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.225264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:04.397126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a92c09d-9647-4c9f-bdd2-9e047d454c4d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 204 len: 0 microversion: 2.25 time: 0.228008 Aug 27 03:17:04.397896 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1153/2223] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:17:04 2022] DELETE /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:17:04.609453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40b4247a-2106-44f5-a797-caf0f51748df tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Action: 'create', calling method: .version_select at 0x7fe460337dc0>, body: {"keypair": {"name": "tempest-keypair-62626433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC40A4cXAlkm/zFxYQKNabPNTvSweyyziJDBwmiiIMuzD0tgQ2f/W9sDJBZgVswb4LCnQqrk0dW4/ciOyoIpwe9DX4D1ysTTYYqgoX8s1SJdzTh0ywuTqr/08/EsOadGPQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:04.659168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-40b4247a-2106-44f5-a797-caf0f51748df tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Getting quotas for project 9d67836807a0446cac6fa01b909e56f9. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:04.669686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-40b4247a-2106-44f5-a797-caf0f51748df tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Getting quotas for user 75522ce101954381b3b0f81bbe7cf207 and project 9d67836807a0446cac6fa01b909e56f9. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:04.736976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40b4247a-2106-44f5-a797-caf0f51748df tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.336242 Aug 27 03:17:04.738526 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1154/2224] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:04 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:04.837713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:04.838496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:04.838710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:04.839128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:04.839536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:04.858759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.858759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.858759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.859091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.860079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.860079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.910663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Getting quotas for project 390e782e0da546d6b4dfc2cc089b4d84. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:04.928635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Getting quotas for user f573336900c6439d94e03ab2db24a931 and project 390e782e0da546d6b4dfc2cc089b4d84. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:04.971454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:04.981359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:05.037884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-10914bcd-063d-4001-aa39-885301ce0e4f tempest-TenantUsagesNegativeTestJSON-1224590703 tempest-TenantUsagesNegativeTestJSON-1224590703-project] Calling method '.version_select at 0x7fe45c864040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.048985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-10914bcd-063d-4001-aa39-885301ce0e4f tempest-TenantUsagesNegativeTestJSON-1224590703 tempest-TenantUsagesNegativeTestJSON-1224590703-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '27397592433744c488f8df5c592ad7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45476e670c14ec8a8ae718f4eb35b44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-10914bcd-063d-4001-aa39-885301ce0e4f tempest-TenantUsagesNegativeTestJSON-1224590703 tempest-TenantUsagesNegativeTestJSON-1224590703-project] Request method failure captured: Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T03%3A16%3A56.314699&end=2022-08-28T03%3A16%3A56.314699&detailed=1 HTTP/1.1 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYymCSiFeIjeITqj8vlMpHTgHgDX5XBxSGlZlFroiZ_kIN3_c2YWBtn0XSbroWKMe8sDdqKXgNjgrLLVft8I3zp3QB9KC6nDxRBGikmihj6uFzO9Zxewe4dfAYfM190pl-E19szUbnPOq_6yk_EwK3k1IvSTBHgSMey1JdJedna071w Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d45476e670c14ec8a8ae718f4eb35b44 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1224590703 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d45476e670c14ec8a8ae718f4eb35b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d45476e670c14ec8a8ae718f4eb35b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d45476e670c14ec8a8ae718f4eb35b44", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d45476e670c14ec8a8ae718f4eb35b44"}]}] Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1224590703 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d45476e670c14ec8a8ae718f4eb35b44 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1224590703 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TenantUsagesNegativeTestJSON-1224590703-project Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 27397592433744c488f8df5c592ad7b7 Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1224590703-project Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: action_args: {} Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:17:05.067393 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.071018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-10914bcd-063d-4001-aa39-885301ce0e4f tempest-TenantUsagesNegativeTestJSON-1224590703 tempest-TenantUsagesNegativeTestJSON-1224590703-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:05.071794 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-10914bcd-063d-4001-aa39-885301ce0e4f tempest-TenantUsagesNegativeTestJSON-1224590703 tempest-TenantUsagesNegativeTestJSON-1224590703-project] 10.222.0.69 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T03%3A16%3A56.314699&end=2022-08-28T03%3A16%3A56.314699&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.331381 Aug 27 03:17:05.079935 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1155/2225] 10.222.0.69 () {58 vars in 1335 bytes} [Sat Aug 27 03:17:04 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T03%3A16%3A56.314699&end=2022-08-28T03%3A16%3A56.314699&detailed=1 => generated 123 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:05.099461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fa4f1d1-831c-4a1b-9c4a-3fbd3a28ddb0 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe45c2c1c10>, body: {"security_group_rule": {"parent_group_id": "97e0c87d-df9a-473d-837d-453e67bd813a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:05.129038 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6860ac95-293e-48ff-9c33-0b1eebc53896 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.655640 Aug 27 03:17:05.130055 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1071/2226] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:17:05.148510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-deaed7cb-1de0-4ee3-9e85-438e520625c2 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Calling method '.version_select at 0x7fe457b5d5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.578270 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9fa4f1d1-831c-4a1b-9c4a-3fbd3a28ddb0 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: This rule already exists in group 97e0c87d-df9a-473d-837d-453e67bd813a Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fa4f1d1-831c-4a1b-9c4a-3fbd3a28ddb0 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 138 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: {"security_group_rule": {"parent_group_id": "97e0c87d-df9a-473d-837d-453e67bd813a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: exception: This rule already exists in group 97e0c87d-df9a-473d-837d-453e67bd813a Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'security_group_rule': {'parent_group_id': '97e0c87d-df9a-473d-837d-453e67bd813a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 97e0c87d-df9a-473d-837d-453e67bd813a Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 97e0c87d-df9a-473d-837d-453e67bd813a Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:05.580974 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:05.584163 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:05.584163 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:05.584163 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 97e0c87d-df9a-473d-837d-453e67bd813a Aug 27 03:17:05.584163 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:05.587999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fa4f1d1-831c-4a1b-9c4a-3fbd3a28ddb0 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 400 to user: This rule already exists in group 97e0c87d-df9a-473d-837d-453e67bd813a {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:05.589217 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fa4f1d1-831c-4a1b-9c4a-3fbd3a28ddb0 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.512268 Aug 27 03:17:05.590350 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1156/2227] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:05 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 514 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:05.609498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.615891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:05.640943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.642640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.643675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.644445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.644924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.645366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.671478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-deaed7cb-1de0-4ee3-9e85-438e520625c2 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.540030 Aug 27 03:17:05.672648 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1072/2228] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:17:05 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:05.681053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4b6bca8-7dd4-48ef-8709-7c406605b2e4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457b57940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.807186 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4b6bca8-7dd4-48ef-8709-7c406605b2e4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 200 len: 1414 microversion: 2.1 time: 0.131754 Aug 27 03:17:05.811624 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1073/2229] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:05 2022] GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:05.817724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02610574-f3d2-4386-907f-019dcc681b3e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.823574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02610574-f3d2-4386-907f-019dcc681b3e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:06.020985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02610574-f3d2-4386-907f-019dcc681b3e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:06.031666 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02610574-f3d2-4386-907f-019dcc681b3e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1217 microversion: 2.1 time: 0.218441 Aug 27 03:17:06.032249 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1074/2230] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:05 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:06.047143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24c657ed-f6c3-4348-8b2c-4afafe86e18c tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Calling method '.version_select at 0x7fe457a7fdc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:06.405917 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24c657ed-f6c3-4348-8b2c-4afafe86e18c tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-group-rules/f71ffd3e-4889-4e57-b6ae-db50f836e161" status: 202 len: 0 microversion: 2.1 time: 0.372453 Aug 27 03:17:06.406751 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1075/2231] 10.222.0.69 () {58 vars in 1287 bytes} [Sat Aug 27 03:17:06 2022] DELETE /compute/v2.1/os-security-group-rules/f71ffd3e-4889-4e57-b6ae-db50f836e161 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:06.420660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-89371c89-798c-4de4-8e12-bbcb2d3dbebd tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Calling method '.version_select at 0x7fe45c435430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:06.462191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:06.472778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:06.479348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a64079d45547ba80c22c309d216438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99adbc97973247998f0bfbbc486a410e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:06.481678 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34ffab08-fc2a-40be-be75-1064d5fe478e tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 200 len: 1564 microversion: 2.25 time: 0.890120 Aug 27 03:17:06.484202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1157/2232] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:17:05 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 1564 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:17:06.968182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc20bf0e-9abc-4851-9ad8-c2b3ce1ecbd5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Action: 'create', calling method: .version_select at 0x7fe457f04dc0>, body: {"keypair": {"name": "tempest-keypair-2061728819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElJFLqziDxRx8Ltn+E61ydBeKGbT4jDVlbHPQckXEzKC4zWQgIc0Hs2XTNSaaKFhN0xeuW03vFtOpPERVrY0TVEWNIV0E4gYNd2jgEMJkrppdO/6ElwkcnPb3LK3SnS5g=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:07.013859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cc20bf0e-9abc-4851-9ad8-c2b3ce1ecbd5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Getting quotas for project 7b322d2965a643f7a8ebd754e3891a26. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:07.024455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cc20bf0e-9abc-4851-9ad8-c2b3ce1ecbd5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Getting quotas for user b00b17878de5458e8d5a68f59e1ca3fd and project 7b322d2965a643f7a8ebd754e3891a26. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:07.097771 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc20bf0e-9abc-4851-9ad8-c2b3ce1ecbd5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.612034 Aug 27 03:17:07.098663 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1158/2233] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:07.103515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca0d0199-2646-40f6-a211-7bfe96677fe4 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe457d5bb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-475681382", "description": "tempest-description-701324727"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:08.165311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca0d0199-2646-40f6-a211-7bfe96677fe4 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.065043 Aug 27 03:17:08.166776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1159/2234] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:17:07 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:08.172102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6af5514-73e7-4b64-93e8-7b38ff7a9dbb tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4603684c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:08.328037 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6af5514-73e7-4b64-93e8-7b38ff7a9dbb tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 200 len: 1423 microversion: 2.1 time: 0.159827 Aug 27 03:17:08.329175 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1160/2235] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:08 2022] GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 1423 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:08.339535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:08.342807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:08.357309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:08.363601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:08.364277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:08.366976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:08.369758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:08.373365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:08.519664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:08.549851 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ceafd63-7bdd-46fb-93a4-3cf487d31388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1275 microversion: 2.1 time: 0.211331 Aug 27 03:17:08.551765 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1161/2236] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:08 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:08.559116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e1692b13-fb88-4e2e-8655-9bfc5156bda5 req-80ed4fa9-18eb-4f4c-8805-f259e43834c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3688d85b-42f3-4f81-8b01-dd440e545c13", "name": "network-vif-deleted", "tag": "07f1d243-5821-46b5-9426-75ae4b014465"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:08.575260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e1692b13-fb88-4e2e-8655-9bfc5156bda5 req-80ed4fa9-18eb-4f4c-8805-f259e43834c8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:08.575939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e1692b13-fb88-4e2e-8655-9bfc5156bda5 req-80ed4fa9-18eb-4f4c-8805-f259e43834c8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:08.577213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e1692b13-fb88-4e2e-8655-9bfc5156bda5 req-80ed4fa9-18eb-4f4c-8805-f259e43834c8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:08.597924 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e1692b13-fb88-4e2e-8655-9bfc5156bda5 req-80ed4fa9-18eb-4f4c-8805-f259e43834c8 service nova] Creating event network-vif-deleted:07f1d243-5821-46b5-9426-75ae4b014465 for instance 3688d85b-42f3-4f81-8b01-dd440e545c13 on n-h2-852086-5 Aug 27 03:17:08.608861 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e1692b13-fb88-4e2e-8655-9bfc5156bda5 req-80ed4fa9-18eb-4f4c-8805-f259e43834c8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052984 Aug 27 03:17:08.610310 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1162/2237] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:08.617193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:08.618690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] [instance: 3688d85b-42f3-4f81-8b01-dd440e545c13] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:08.627455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:08.628713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:08.629608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:08.630675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:08.631293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:08.632417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:08.666815 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] HTTP exception thrown: Instance 3688d85b-42f3-4f81-8b01-dd440e545c13 could not be found. Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Request method failure captured: Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 HTTP/1.1 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYq4kHtBdih8O47lO3r3TEQOWti_0ne_BjKx-_7RM-Pfn6i2NNYjSLHB4TzUsHkH0ubVxmc5_gfoShZZXtwzyO-jgTe3E9udXCqNRJDEiSxEDrwpGZJd3rClNtm26LXOEwl9v0eRfqreIcn1H_KXLlrD1Bokj4AvU-IDG_a88BDQLR8 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_99adbc97973247998f0bfbbc486a410e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/99adbc97973247998f0bfbbc486a410e"}]}] Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 99adbc97973247998f0bfbbc486a410e Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 21a64079d45547ba80c22c309d216438 Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1813223033-project Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 3688d85b-42f3-4f81-8b01-dd440e545c13 could not be found. Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3688d85b-42f3-4f81-8b01-dd440e545c13'} Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3688d85b-42f3-4f81-8b01-dd440e545c13 could not be found. Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3688d85b-42f3-4f81-8b01-dd440e545c13 could not be found. Aug 27 03:17:08.669841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3688d85b-42f3-4f81-8b01-dd440e545c13 could not be found. Aug 27 03:17:08.674483 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.677248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] Returning 404 to user: Instance 3688d85b-42f3-4f81-8b01-dd440e545c13 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:08.680448 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-276b362b-1273-4d02-888d-478139bcd02d tempest-LiveAutoBlockMigrationV225Test-1813223033 tempest-LiveAutoBlockMigrationV225Test-1813223033-project] 10.222.0.69 "GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13" status: 404 len: 111 microversion: 2.25 time: 0.065835 Aug 27 03:17:08.687872 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1163/2238] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:17:08 2022] GET /compute/v2.1/servers/3688d85b-42f3-4f81-8b01-dd440e545c13 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:08.698402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dde13dc6-ca96-4b0c-840c-1c0c3f76b2e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe45c45ff70>, body: {"security_group_rule": {"parent_group_id": "1e9938c5-5860-48d9-b388-e77c6347e187", "ip_protocol": "tcp", "from_port": 124730591, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:08.868099 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-89371c89-798c-4de4-8e12-bbcb2d3dbebd tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/8646025f-c05c-45c1-b4d3-cc8887950df4" status: 202 len: 0 microversion: 2.1 time: 2.455365 Aug 27 03:17:08.869887 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1076/2239] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:17:06 2022] DELETE /compute/v2.1/os-floating-ips/8646025f-c05c-45c1-b4d3-cc8887950df4 => generated 0 bytes in 2462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:08.878788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f77bc452-0158-4819-adee-a5f0b32fc191 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45795e5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:08.880967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-dde13dc6-ca96-4b0c-840c-1c0c3f76b2e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: Invalid port range 124730591:22. Former value cannot be greater than the later Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dde13dc6-ca96-4b0c-840c-1c0c3f76b2e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 145 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: {"security_group_rule": {"parent_group_id": "1e9938c5-5860-48d9-b388-e77c6347e187", "ip_protocol": "tcp", "from_port": 124730591, "to_port": 22}} Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid port range 124730591:22. Former value cannot be greater than the later Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1e9938c5-5860-48d9-b388-e77c6347e187', 'ip_protocol': 'tcp', 'from_port': 124730591, 'to_port': 22}}} Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 124730591:22. Former value cannot be greater than the later Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 124730591:22. Former value cannot be greater than the later Aug 27 03:17:08.883292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 124730591:22. Former value cannot be greater than the later Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dde13dc6-ca96-4b0c-840c-1c0c3f76b2e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 400 to user: Invalid port range 124730591:22. Former value cannot be greater than the later {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dde13dc6-ca96-4b0c-840c-1c0c3f76b2e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.196214 Aug 27 03:17:08.886387 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1164/2240] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:08 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:08.895086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-201bc9f9-6d34-40f9-8a57-7a61eb86c5ce tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Calling method '.version_select at 0x7fe45c543ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:08.990330 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f77bc452-0158-4819-adee-a5f0b32fc191 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 200 len: 1423 microversion: 2.1 time: 0.116470 Aug 27 03:17:08.990938 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1077/2241] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:08 2022] GET /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:09.000509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c36a74d-1f29-424e-824f-26e51cfb4d0a tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe457a255e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1012793687", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:09.006924 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-5c36a74d-1f29-424e-824f-26e51cfb4d0a tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: Security group id should be uuid Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c36a74d-1f29-424e-824f-26e51cfb4d0a tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 131 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1012793687", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group id should be uuid Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1012793687', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:09.011962 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:09.016138 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 27 03:17:09.016138 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:09.017702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c36a74d-1f29-424e-824f-26e51cfb4d0a tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 400 to user: Security group id should be uuid {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:09.022597 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c36a74d-1f29-424e-824f-26e51cfb4d0a tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.025724 Aug 27 03:17:09.024514 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1078/2242] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:08 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:09.054417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c5cceeb-beae-4870-bf2b-33907d079fff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457b5d940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:09.991009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c5cceeb-beae-4870-bf2b-33907d079fff tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 204 len: 0 microversion: 2.1 time: 0.964806 Aug 27 03:17:09.999648 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1079/2243] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:09 2022] DELETE /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 0 bytes in 970 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:10.018279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71883b1d-a886-4229-9b94-ef97cd90b21c tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe457a7fdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2144097984", "description": "tempest-description-1342679885"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:11.284519 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-201bc9f9-6d34-40f9-8a57-7a61eb86c5ce tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/e1245d68-c755-4634-886e-835b50ad1c61" status: 202 len: 0 microversion: 2.1 time: 2.397800 Aug 27 03:17:11.286269 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1165/2244] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:17:08 2022] DELETE /compute/v2.1/os-floating-ips/e1245d68-c755-4634-886e-835b50ad1c61 => generated 0 bytes in 2400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:11.291532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:11.292571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:11.307100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:11.313488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.314702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.315475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.320711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.321282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.321742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.459288 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-71883b1d-a886-4229-9b94-ef97cd90b21c tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.457926 Aug 27 03:17:11.461041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1080/2245] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:17:09 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:11.466976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:11.467841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:11.478727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.479576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.480223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.481187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.498788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.499783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.544557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:11.653375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:11.672284 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c83d1cba-7bea-4b7c-b77f-c29492a28ab6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1317 microversion: 2.1 time: 0.384715 Aug 27 03:17:11.676306 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1166/2246] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:11 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:11.678207 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8b49891-340d-402a-a670-96e730461777 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 204 len: 0 microversion: 2.1 time: 0.213533 Aug 27 03:17:11.680463 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1081/2247] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:11 2022] DELETE /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:11.682945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7ebe507-a719-48ac-b509-7db8a9b1fcb7 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] Calling method '.version_select at 0x7fe45c8645e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:11.998087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d6e9b0dc-5a33-4e4f-953d-c674c5b1704d tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Action: 'create', calling method: .version_select at 0x7fe457b57ee0>, body: {"keypair": {"name": "tempest-keypair-2089564352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJytVb7uv65NKquRkkUOonkn9k53LmLPe3PSlcvYrthmFTmkngih0ecva4TUz6Mc7hGSVa54h/bkHe3x5tpQRmXYJQI6VZ2S7eG29VVsWgnPt4PBDBbmNqaSCnGUMoaDw=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:12.019501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d6e9b0dc-5a33-4e4f-953d-c674c5b1704d tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:12.027929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d6e9b0dc-5a33-4e4f-953d-c674c5b1704d tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for user b88952e3a469445cbd290a71d79ebb90 and project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:12.064936 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d6e9b0dc-5a33-4e4f-953d-c674c5b1704d tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.383092 Aug 27 03:17:12.072298 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1082/2248] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:12.082575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4540c03d-8faf-4309-a049-2ffd3e8b2e59 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe457a25f70>, body: {"security_group_rule": {"parent_group_id": "b5164ff6-12b7-40bd-a741-38bcd4423625", "ip_protocol": "tempest-999-1370248893", "from_port": 22, "to_port": 22}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:12.242422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-4540c03d-8faf-4309-a049-2ffd3e8b2e59 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: Invalid IP protocol tempest-999-1370248893. Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4540c03d-8faf-4309-a049-2ffd3e8b2e59 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 157 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: {"security_group_rule": {"parent_group_id": "b5164ff6-12b7-40bd-a741-38bcd4423625", "ip_protocol": "tempest-999-1370248893", "from_port": 22, "to_port": 22}} Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid IP protocol tempest-999-1370248893. Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b5164ff6-12b7-40bd-a741-38bcd4423625', 'ip_protocol': 'tempest-999-1370248893', 'from_port': 22, 'to_port': 22}}} Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1370248893. Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1370248893. Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:12.244105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1370248893. Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4540c03d-8faf-4309-a049-2ffd3e8b2e59 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 400 to user: Invalid IP protocol tempest-999-1370248893. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:12.247351 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4540c03d-8faf-4309-a049-2ffd3e8b2e59 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.171638 Aug 27 03:17:12.251675 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1083/2249] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:12 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:12.256625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-9a34332c-76bd-46b9-b4e9-b0fabbb13aac req-1a9d6b73-7db1-4d74-a69d-f04547895ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa627487-0ffe-40a1-9ac1-484acb3b7b89", "tag": "cd3cae21-8c78-43ec-96b2-2966fb0d4c70"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:12.268299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9a34332c-76bd-46b9-b4e9-b0fabbb13aac req-1a9d6b73-7db1-4d74-a69d-f04547895ea9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:12.268861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9a34332c-76bd-46b9-b4e9-b0fabbb13aac req-1a9d6b73-7db1-4d74-a69d-f04547895ea9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:12.269303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9a34332c-76bd-46b9-b4e9-b0fabbb13aac req-1a9d6b73-7db1-4d74-a69d-f04547895ea9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:12.285276 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-9a34332c-76bd-46b9-b4e9-b0fabbb13aac req-1a9d6b73-7db1-4d74-a69d-f04547895ea9 service nova] Creating event network-changed:cd3cae21-8c78-43ec-96b2-2966fb0d4c70 for instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 on n-h2-852086-5 Aug 27 03:17:12.292407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-9a34332c-76bd-46b9-b4e9-b0fabbb13aac req-1a9d6b73-7db1-4d74-a69d-f04547895ea9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039370 Aug 27 03:17:12.293670 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1084/2250] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:12.300208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1718663511", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "9649e43c-11f6-4e3a-856e-10515d640ffa"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:12.372317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] validate_networks() for [('9649e43c-11f6-4e3a-856e-10515d640ffa', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:13.526578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:13.527225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:13.527488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:13.528266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:13.528669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:13.547129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.547909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.549035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.550070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:13.550568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:13.551008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.576351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:13.585568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for user d1e2476870c64964814aabc9c60399cf and project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:13.601362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:13.603817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:13.663671 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-361b9a15-97ab-432c-90ca-4fee452becba tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367662 Aug 27 03:17:13.673124 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1085/2251] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:17:13.673124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e095cb7d-9cb5-4acf-a0b8-7942c0569619 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe4578d3b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:13.682387 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e095cb7d-9cb5-4acf-a0b8-7942c0569619 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-2089564352" status: 200 len: 498 microversion: 2.1 time: 0.017072 Aug 27 03:17:13.693237 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1086/2252] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:17:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2089564352 => generated 498 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:13.693237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1343014073", "imageRef": "d6c09b0f-0c13-4052-8392-56150f46f48f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2714d144-6e9d-4018-a776-c34c70a33b84"}], "security_groups": [{"name": "tempest-securitygroup--883324283"}], "key_name": "tempest-keypair-62626433", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:13.713383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7ebe507-a719-48ac-b509-7db8a9b1fcb7 tempest-FloatingIPDetailsTestJSON-2104238136 tempest-FloatingIPDetailsTestJSON-2104238136-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/dbbb1385-7788-4cb8-9488-0764ec623d22" status: 202 len: 0 microversion: 2.1 time: 2.035225 Aug 27 03:17:13.714621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1167/2253] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:17:11 2022] DELETE /compute/v2.1/os-floating-ips/dbbb1385-7788-4cb8-9488-0764ec623d22 => generated 0 bytes in 2038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:13.722831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81749070-d1f4-4f94-90f8-d1d8a0367e97 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe45c091b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2062282011", "description": "tempest-description-295892696"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:14.074083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] validate_networks() for [('2714d144-6e9d-4018-a776-c34c70a33b84', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:14.135098 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81749070-d1f4-4f94-90f8-d1d8a0367e97 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.418980 Aug 27 03:17:14.136639 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1168/2254] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:17:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:14.141635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:14.143137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:14.152052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:14.153387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:14.154059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:14.155019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:14.155941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:14.156791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:14.162584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:14.637911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:14.666039 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87d32605-7bcb-48bd-b1ef-222541794b70 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1317 microversion: 2.1 time: 0.522910 Aug 27 03:17:14.668391 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1169/2255] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:14 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:14.680321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-302459271", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7dd2d4b6-2ed9-46a7-bf3a-71b9993d39e5"}], "security_groups": [{"name": "tempest-securitygroup--2044460225"}], "key_name": "tempest-keypair-2061728819", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:15.035008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] validate_networks() for [('7dd2d4b6-2ed9-46a7-bf3a-71b9993d39e5', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:15.296268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:15.297316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:15.298006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:15.299215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:15.299816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:15.313586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.315432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.316064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.327269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.328041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.328697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.357599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Getting quotas for project 9d67836807a0446cac6fa01b909e56f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:15.369913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Getting quotas for user 75522ce101954381b3b0f81bbe7cf207 and project 9d67836807a0446cac6fa01b909e56f9. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:15.401220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:15.404318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6c09b0f-0c13-4052-8392-56150f46f48f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:15.507858 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7fee29c0-a44c-46b6-8a58-01fcba8e2229 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.823029 Aug 27 03:17:15.517245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1087/2256] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:17:15.524010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-97a015fa-7a92-4f24-a55c-71f9c0d12986 req-e210e783-6a25-4d77-b036-8ba16af40b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0fd9cc-6856-4230-a8e8-e8f92c613ccc", "name": "network-vif-unplugged", "status": "completed", "tag": "0601f318-b434-4387-91e4-1fc89f3a0c8c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:15.549231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-97a015fa-7a92-4f24-a55c-71f9c0d12986 req-e210e783-6a25-4d77-b036-8ba16af40b16 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.549715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-97a015fa-7a92-4f24-a55c-71f9c0d12986 req-e210e783-6a25-4d77-b036-8ba16af40b16 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.550147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-97a015fa-7a92-4f24-a55c-71f9c0d12986 req-e210e783-6a25-4d77-b036-8ba16af40b16 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.562558 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-97a015fa-7a92-4f24-a55c-71f9c0d12986 req-e210e783-6a25-4d77-b036-8ba16af40b16 service nova] Creating event network-vif-unplugged:0601f318-b434-4387-91e4-1fc89f3a0c8c for instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc on n-h1-852086-5 Aug 27 03:17:15.582368 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-97a015fa-7a92-4f24-a55c-71f9c0d12986 req-e210e783-6a25-4d77-b036-8ba16af40b16 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062769 Aug 27 03:17:15.583404 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1088/2257] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:15.591415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:15.592405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:15.602948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.603667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.604344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.605339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.606291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.606987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.762619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:15.773790 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35b5b231-9f19-48e1-a386-4624072988e2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1266 microversion: 2.1 time: 0.188399 Aug 27 03:17:15.775110 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1089/2258] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:15 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:15.788806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50561699-7c9d-4859-9f4b-0a0bb5204397 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe4578d3670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:15.821989 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50561699-7c9d-4859-9f4b-0a0bb5204397 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089564352" status: 202 len: 0 microversion: 2.1 time: 0.036851 Aug 27 03:17:15.824137 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1090/2259] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089564352 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:15.836653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49bbdea5-5c57-4c38-b43b-b81723d44d6b tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe457ba6b80>, body: {"security_group_rule": {"parent_group_id": "34a1ff44-38b7-48e1-a7c0-631c347fa362", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:15.987531 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-49bbdea5-5c57-4c38-b43b-b81723d44d6b tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49bbdea5-5c57-4c38-b43b-b81723d44d6b tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 138 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: {"security_group_rule": {"parent_group_id": "34a1ff44-38b7-48e1-a7c0-631c347fa362", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'security_group_rule': {'parent_group_id': '34a1ff44-38b7-48e1-a7c0-631c347fa362', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 03:17:15.995309 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49bbdea5-5c57-4c38-b43b-b81723d44d6b tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49bbdea5-5c57-4c38-b43b-b81723d44d6b tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.171208 Aug 27 03:17:15.998485 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1091/2260] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:15 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:16.006454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6dd0183a-6c93-4b5e-892b-be92a1cccef3 req-2b58be1e-3425-4257-b577-07e21b37f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0fd9cc-6856-4230-a8e8-e8f92c613ccc", "name": "network-vif-deleted", "tag": "0601f318-b434-4387-91e4-1fc89f3a0c8c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:16.036929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6dd0183a-6c93-4b5e-892b-be92a1cccef3 req-2b58be1e-3425-4257-b577-07e21b37f1cf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.037418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6dd0183a-6c93-4b5e-892b-be92a1cccef3 req-2b58be1e-3425-4257-b577-07e21b37f1cf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.045809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6dd0183a-6c93-4b5e-892b-be92a1cccef3 req-2b58be1e-3425-4257-b577-07e21b37f1cf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.067521 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6dd0183a-6c93-4b5e-892b-be92a1cccef3 req-2b58be1e-3425-4257-b577-07e21b37f1cf service nova] Creating event network-vif-deleted:0601f318-b434-4387-91e4-1fc89f3a0c8c for instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc on n-h1-852086-5 Aug 27 03:17:16.073173 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6dd0183a-6c93-4b5e-892b-be92a1cccef3 req-2b58be1e-3425-4257-b577-07e21b37f1cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074341 Aug 27 03:17:16.074096 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1092/2261] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:16.080866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-26170005-6577-4566-ac9e-2433571fac9d tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:16.081982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-26170005-6577-4566-ac9e-2433571fac9d tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:16.213628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-26170005-6577-4566-ac9e-2433571fac9d tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:16.224227 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-26170005-6577-4566-ac9e-2433571fac9d tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1244 microversion: 2.1 time: 0.148818 Aug 27 03:17:16.225050 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1093/2262] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:16 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1244 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:16.233359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:16.239881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:16.268612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.268815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.269117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.269900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.270383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.270819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.626053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:16.636931 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eaa789ca-1d9b-4d9b-ba25-0f94e336c0a6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1317 microversion: 2.1 time: 0.410727 Aug 27 03:17:16.655911 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1094/2263] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:16 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:16.667081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-148ad203-f5c7-4e5c-a34c-17e46339e834 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Action: 'create', calling method: .version_select at 0x7fe457b57670>, body: {"keypair": {"name": "tempest-keypair-939646329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjsW+KUiG4YkUovyIr/DViuZUkWuMl3boWXH6u9E3uiuakarFueJZzbtSchtuqM+dztK80B20A5oeq098s+CluPa7jxiev0RQwuUyq55mPR/oby/OnLOoqiMrn3jqMYJA=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:16.692066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-148ad203-f5c7-4e5c-a34c-17e46339e834 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:16.696612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:16.703133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-148ad203-f5c7-4e5c-a34c-17e46339e834 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for user b88952e3a469445cbd290a71d79ebb90 and project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:16.745721 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-148ad203-f5c7-4e5c-a34c-17e46339e834 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085686 Aug 27 03:17:16.747062 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1095/2264] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:16.754306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ef4f5b9b-274d-4e96-bcba-e34b441e385b tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe457a7f0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1794500293", "description": "tempest-description-953170436"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:17.051109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:17.264499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Getting quotas for project 7b322d2965a643f7a8ebd754e3891a26. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:17.279284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Getting quotas for user b00b17878de5458e8d5a68f59e1ca3fd and project 7b322d2965a643f7a8ebd754e3891a26. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:17.338298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:17.339102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:17.339760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:17.340499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:17.341124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:17.378945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.379689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.381580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.382669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.384928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.385840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.453487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Getting quotas for project 7b322d2965a643f7a8ebd754e3891a26. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:17.488740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ef4f5b9b-274d-4e96-bcba-e34b441e385b tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.740224 Aug 27 03:17:17.489715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Getting quotas for user b00b17878de5458e8d5a68f59e1ca3fd and project 7b322d2965a643f7a8ebd754e3891a26. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:17.490306 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1096/2265] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:17:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:17.499796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-925d1735-77e6-4af2-9cd1-406e31a7c43c tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe457baaca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:17.509747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:17.514736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:17.559370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-925d1735-77e6-4af2-9cd1-406e31a7c43c tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-939646329" status: 202 len: 0 microversion: 2.1 time: 0.067271 Aug 27 03:17:17.561482 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1097/2266] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:17:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-939646329 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:17.575674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:17.576305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:17.591742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.592240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.592685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.593400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.593859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.594316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.615169 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74a89afe-95ed-4800-bbd3-f19d159d2659 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.945115 Aug 27 03:17:17.618891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1170/2267] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:17:17.634699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:17.635946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:17.656501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.657286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.658186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.660847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.661984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.662622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.775819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:17.785883 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dd58d09a-003c-43ea-bdcd-acc434e55c28 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1266 microversion: 2.1 time: 0.222229 Aug 27 03:17:17.791334 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1098/2268] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:17 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:17.796504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac161cdb-347a-4b0b-8e6a-140a159308e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe457ba6dc0>, body: {"security_group_rule": {"parent_group_id": "0d102eec-abad-4838-a2f3-b77aae9c76de", "ip_protocol": "tcp", "from_port": 22, "to_port": 467968149}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:18.121681 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ac161cdb-347a-4b0b-8e6a-140a159308e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: Invalid port range 22:467968149. Valid TCP ports should be between 1-65535 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac161cdb-347a-4b0b-8e6a-140a159308e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 145 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: {"security_group_rule": {"parent_group_id": "0d102eec-abad-4838-a2f3-b77aae9c76de", "ip_protocol": "tcp", "from_port": 22, "to_port": 467968149}} Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid port range 22:467968149. Valid TCP ports should be between 1-65535 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0d102eec-abad-4838-a2f3-b77aae9c76de', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 467968149}}} Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:467968149. Valid TCP ports should be between 1-65535 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:467968149. Valid TCP ports should be between 1-65535 Aug 27 03:17:18.124500 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:467968149. Valid TCP ports should be between 1-65535 Aug 27 03:17:18.129824 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:18.134737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac161cdb-347a-4b0b-8e6a-140a159308e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 400 to user: Invalid port range 22:467968149. Valid TCP ports should be between 1-65535 {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:18.136063 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac161cdb-347a-4b0b-8e6a-140a159308e7 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.343264 Aug 27 03:17:18.144792 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1099/2269] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:17 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:18.146459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:18.155343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e1cb42ef-4d51-4012-abf5-5c6803efb062 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Action: 'create', calling method: .version_select at 0x7fe457baac10>, body: {"keypair": {"name": "tempest-keypair-1941856437", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:18.164994 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5043c12c-6b26-43bd-a1cd-5e911162eea1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1302 microversion: 2.1 time: 0.544303 Aug 27 03:17:18.175863 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1171/2270] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:17 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1302 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:18.184461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68bf1084-7605-477f-b34a-2a19e5111bc8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:18.188588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68bf1084-7605-477f-b34a-2a19e5111bc8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:18.208603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e1cb42ef-4d51-4012-abf5-5c6803efb062 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:18.222667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e1cb42ef-4d51-4012-abf5-5c6803efb062 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for user b88952e3a469445cbd290a71d79ebb90 and project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:18.288095 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e1cb42ef-4d51-4012-abf5-5c6803efb062 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.141732 Aug 27 03:17:18.288984 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1100/2271] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:18 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:18.308212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:18.310950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:18.327116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.329022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.331176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.332753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.334365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.335882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.374047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68bf1084-7605-477f-b34a-2a19e5111bc8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:18.382107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68bf1084-7605-477f-b34a-2a19e5111bc8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1277 microversion: 2.1 time: 0.204812 Aug 27 03:17:18.386556 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1172/2272] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:18 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:18.413806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3522d330-9f42-4f98-b69a-091806f91caa req-25653ed1-1c7c-4bbb-b8b5-c6feeb0e4cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa627487-0ffe-40a1-9ac1-484acb3b7b89", "name": "network-vif-plugged", "status": "completed", "tag": "cd3cae21-8c78-43ec-96b2-2966fb0d4c70"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:18.456216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3522d330-9f42-4f98-b69a-091806f91caa req-25653ed1-1c7c-4bbb-b8b5-c6feeb0e4cb2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.460497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3522d330-9f42-4f98-b69a-091806f91caa req-25653ed1-1c7c-4bbb-b8b5-c6feeb0e4cb2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.460989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3522d330-9f42-4f98-b69a-091806f91caa req-25653ed1-1c7c-4bbb-b8b5-c6feeb0e4cb2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.517810 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3522d330-9f42-4f98-b69a-091806f91caa req-25653ed1-1c7c-4bbb-b8b5-c6feeb0e4cb2 service nova] Creating event network-vif-plugged:cd3cae21-8c78-43ec-96b2-2966fb0d4c70 for instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 on n-h2-852086-5 Aug 27 03:17:18.538520 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3522d330-9f42-4f98-b69a-091806f91caa req-25653ed1-1c7c-4bbb-b8b5-c6feeb0e4cb2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148440 Aug 27 03:17:18.556298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1173/2273] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:18.597299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1054874f-38d7-4230-9332-01e14552561d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Action: 'create', calling method: .version_select at 0x7fe45c2c1d30>, body: {"security_group_rule": {"parent_group_id": "33641e57-51ca-4ea9-894d-f09ccde04571", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:19.233355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-1054874f-38d7-4230-9332-01e14552561d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:17:19.234448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-1054874f-38d7-4230-9332-01e14552561d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Neutron security group 33641e57-51ca-4ea9-894d-f09ccde04571 not found {{(pid=122408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 03:17:19.234991 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1054874f-38d7-4230-9332-01e14552561d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist Aug 27 03:17:19.234991 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-ae079d38-333c-4659-ad0b-d7136790317f'] Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1054874f-38d7-4230-9332-01e14552561d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 138 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: {"security_group_rule": {"parent_group_id": "33641e57-51ca-4ea9-894d-f09ccde04571", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: exception: Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-ae079d38-333c-4659-ad0b-d7136790317f'] Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'security_group_rule': {'parent_group_id': '33641e57-51ca-4ea9-894d-f09ccde04571', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:17:19.237231 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae079d38-333c-4659-ad0b-d7136790317f'] Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae079d38-333c-4659-ad0b-d7136790317f'] Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae079d38-333c-4659-ad0b-d7136790317f'] Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae079d38-333c-4659-ad0b-d7136790317f'] Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1054874f-38d7-4230-9332-01e14552561d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 404 to user: Security group 33641e57-51ca-4ea9-894d-f09ccde04571 does not exist Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-ae079d38-333c-4659-ad0b-d7136790317f'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1054874f-38d7-4230-9332-01e14552561d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.681231 Aug 27 03:17:19.240997 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1174/2274] 10.222.0.69 () {60 vars in 1195 bytes} [Sat Aug 27 03:17:18 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 683 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:19.255563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df4e9cd7-4d9e-4594-a745-0bc8494333c5 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe457f1d670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:19.327938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df4e9cd7-4d9e-4594-a745-0bc8494333c5 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941856437" status: 202 len: 0 microversion: 2.1 time: 0.087024 Aug 27 03:17:19.336821 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1175/2275] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:17:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941856437 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:19.355212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:19.367072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:19.390846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.401715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.403917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:19.408176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.425337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.426473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:19.736190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:19.745798 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87646489-827d-4dbe-b68c-155e6d4a0505 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1317 microversion: 2.1 time: 1.449820 Aug 27 03:17:19.759034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1101/2276] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:18 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1317 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:19.763919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:19.764536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:19.783971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.784967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.785831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:19.786764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.787376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.787981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:19.961316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:19.981569 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-984ffdac-ce3c-4fcf-8e91-994b61356c98 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1302 microversion: 2.1 time: 0.221017 Aug 27 03:17:19.995507 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1102/2277] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:19 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1302 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:20.000643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12e346ca-2e55-4705-a0cb-d1ca6ce582e5 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Calling method '.version_select at 0x7fe457bb7b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:20.030259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:20.054711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f92ddbf8-bc71-4bf8-99c7-388d7d65801f tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1308 microversion: 2.1 time: 0.717639 Aug 27 03:17:20.055304 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1176/2278] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:19 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1308 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:20.073720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32358c0b-e9cd-4fd2-b2a2-03a46d4d9e96 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Action: 'create', calling method: .version_select at 0x7fe45c2c1790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2054825132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAViKP6f6Nx2B8A0y+Zic98GW1ArhE1W+vrlCfdombm0eP0pXkPwj2lC6NuSdRdQz5UFlS2L+N2ATS3sqGG9qeSm4wts2y+0BLtwJBmKj/+59qxyd1Ft976fUmAiZMJ8KA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:20.086077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG neutronclient.v2_0.client [None req-12e346ca-2e55-4705-a0cb-d1ca6ce582e5 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist", "detail": ""}} {{(pid=122407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:17:20.086917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-12e346ca-2e55-4705-a0cb-d1ca6ce582e5 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Neutron security group rule 26054c96-fda2-42a5-95a1-10fd76726337 not found {{(pid=122407) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 27 03:17:20.088285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-12e346ca-2e55-4705-a0cb-d1ca6ce582e5 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] HTTP exception thrown: Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist Aug 27 03:17:20.088285 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-d80de42d-8528-48ff-9b34-5c276bf5795f'] Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12e346ca-2e55-4705-a0cb-d1ca6ce582e5 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Request method failure captured: Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-security-group-rules/26054c96-fda2-42a5-95a1-10fd76726337 HTTP/1.1 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYynb_K7GdAqiHSe_jba8gF5F-eVADa-PN1T-Fs3AIzNWZNRSgY8d8Qq4S63opbeqg6fmxHiBXozpFZlBAtXikb2UL5mkQELLse-QPeugGEd8ujDJRk6-MRvLomvOk3RW8WrCjTEhkqrhxeEcg5e_rLbCbsNYtjtQBXZNUn-laYYJYU Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d8242b2ceee40cca2eb196e3c169764", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d8242b2ceee40cca2eb196e3c169764"}]}] Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d8242b2ceee40cca2eb196e3c169764 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2d350d302aaf4e519083b66ac83f202c Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-654706275-project Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: exception: Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-d80de42d-8528-48ff-9b34-5c276bf5795f'] Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '26054c96-fda2-42a5-95a1-10fd76726337'} Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:17:20.090900 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d80de42d-8528-48ff-9b34-5c276bf5795f'] Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d80de42d-8528-48ff-9b34-5c276bf5795f'] Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d80de42d-8528-48ff-9b34-5c276bf5795f'] Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d80de42d-8528-48ff-9b34-5c276bf5795f'] Aug 27 03:17:20.094024 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:20.098555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12e346ca-2e55-4705-a0cb-d1ca6ce582e5 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Returning 404 to user: Security group rule 26054c96-fda2-42a5-95a1-10fd76726337 does not exist Aug 27 03:17:20.098555 n-d-852086-5 devstack@n-api.service[122407]: Neutron server returns request_ids: ['req-d80de42d-8528-48ff-9b34-5c276bf5795f'] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:20.099979 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-12e346ca-2e55-4705-a0cb-d1ca6ce582e5 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-group-rules/26054c96-fda2-42a5-95a1-10fd76726337" status: 404 len: 199 microversion: 2.1 time: 0.103184 Aug 27 03:17:20.100702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1103/2279] 10.222.0.69 () {58 vars in 1287 bytes} [Sat Aug 27 03:17:19 2022] DELETE /compute/v2.1/os-security-group-rules/26054c96-fda2-42a5-95a1-10fd76726337 => generated 199 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:20.111943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:20.115380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:20.121820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-32358c0b-e9cd-4fd2-b2a2-03a46d4d9e96 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:20.136919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-32358c0b-e9cd-4fd2-b2a2-03a46d4d9e96 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for user b88952e3a469445cbd290a71d79ebb90 and project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:20.147608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:20.148105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:20.161509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:20.162827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:20.163456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:20.164179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:20.222817 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32358c0b-e9cd-4fd2-b2a2-03a46d4d9e96 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.166411 Aug 27 03:17:20.223751 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1177/2280] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:20.228590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d3a7b4f-27af-46bf-9693-c9d8b3b79377 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Calling method '.version_select at 0x7fe45c4714c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:20.475388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:20.487293 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbbe8f2a-1e57-41f9-ba7e-af3c36c7e8a9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1329 microversion: 2.1 time: 0.385011 Aug 27 03:17:20.497793 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1104/2281] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:20 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1329 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:20.512540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11595a83-cf09-4082-a533-0a58a270921b tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Action: 'create', calling method: .version_select at 0x7fe457bb8c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1144496700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpjI7wtRmzNTR3JFfcAJXKts8BvXYGP3QJl6lJbo2DNGJYpMo7zBOLKFI6bs7+Vf3fReUuqhCaoAkGsoaPSwxHRtQx8ML/X8bjA2VlrZ8rKWx26xKDtgs0SEJpKfjOXVw=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:20.564681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-11595a83-cf09-4082-a533-0a58a270921b tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:20.599524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-11595a83-cf09-4082-a533-0a58a270921b tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for user b88952e3a469445cbd290a71d79ebb90 and project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:20.730373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11595a83-cf09-4082-a533-0a58a270921b tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.229738 Aug 27 03:17:20.743765 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1105/2282] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:20.759054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00a770ab-2ac4-4ca9-a29a-2780ce325d6e tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Action: 'create', calling method: .version_select at 0x7fe457b5daf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-147770584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5q8xCkNE496tcDhx0OLnpL9d7UQACoduQolGrv+1sFVmdsomLWVy2+a7niAeXPOc6BpfRaGRVzxQiEHs0OXJ1mdb+Peo4roxVgx6FUHLW9fTCmR7M6LJSpWEibKc4U6A=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:20.824961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-00a770ab-2ac4-4ca9-a29a-2780ce325d6e tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:20.847338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-00a770ab-2ac4-4ca9-a29a-2780ce325d6e tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Getting quotas for user b88952e3a469445cbd290a71d79ebb90 and project 762fff3429e049dfbb33835519baa540. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:20.977891 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00a770ab-2ac4-4ca9-a29a-2780ce325d6e tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.231450 Aug 27 03:17:20.979164 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1106/2283] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:20.994958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:20.995823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:21.012606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.014430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.017366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:21.021853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.022824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.023454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:21.698437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:21.711034 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a46f801-d11d-4380-8298-578da313f352 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1317 microversion: 2.1 time: 0.730273 Aug 27 03:17:21.722269 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1107/2284] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:20 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:21.722269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f19efd27-b941-4e40-a45a-3dd2c25283f4 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe4578d3b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:21.733978 n-d-852086-5 devstack@n-api.service[122407]: WARNING oslo_db.sqlalchemy.utils [None req-f19efd27-b941-4e40-a45a-3dd2c25283f4 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:17:21.754921 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f19efd27-b941-4e40-a45a-3dd2c25283f4 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.041885 Aug 27 03:17:21.755806 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1108/2285] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:17:21 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:21.767883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:21.768810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:21.792795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.793946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.794595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:21.795473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.796083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.796659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.079417 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d3a7b4f-27af-46bf-9693-c9d8b3b79377 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/0d102eec-abad-4838-a2f3-b77aae9c76de" status: 202 len: 0 microversion: 2.1 time: 1.854426 Aug 27 03:17:22.080367 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1178/2286] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:17:20 2022] DELETE /compute/v2.1/os-security-groups/0d102eec-abad-4838-a2f3-b77aae9c76de => generated 0 bytes in 1856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:22.086388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:22.087546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:22.108017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.108885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.109593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.112076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.113988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.115703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.613444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:22.622656 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dd1f10bd-ad20-48ef-bc17-202c31e6630e tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 0.865365 Aug 27 03:17:22.623251 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1109/2287] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:21 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:22.664264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:22.666881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:22.684848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.686070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.688023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.688317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.688832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.689273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.901645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:22.919587 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff6c3c2c-1994-465e-9177-214243a0e1e5 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1335 microversion: 2.1 time: 0.275594 Aug 27 03:17:22.920944 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1110/2288] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:22 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1335 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:22.951540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04214e80-3961-4c84-a4a0-d8d2b91ef304 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe4578d3dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:22.995787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:23.013973 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04214e80-3961-4c84-a4a0-d8d2b91ef304 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-147770584" status: 202 len: 0 microversion: 2.1 time: 0.078971 Aug 27 03:17:23.016035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efc89a25-d7c7-4cd2-a58f-c745eee35149 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1308 microversion: 2.1 time: 0.934130 Aug 27 03:17:23.020729 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1111/2289] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-147770584 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:23.034497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3675451f-7c56-4809-97d4-255ddbca8531 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Calling method '.version_select at 0x7fe457bb8940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:23.035205 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1179/2290] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:22 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1308 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:23.053656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:23.056862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:23.081974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:23.082635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:23.082983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:23.087856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:23.089429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:23.089886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:23.913843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3675451f-7c56-4809-97d4-255ddbca8531 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/34a1ff44-38b7-48e1-a7c0-631c347fa362" status: 202 len: 0 microversion: 2.1 time: 0.891585 Aug 27 03:17:23.915908 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1112/2291] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:17:23 2022] DELETE /compute/v2.1/os-security-groups/34a1ff44-38b7-48e1-a7c0-631c347fa362 => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:23.925007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fc2fd510-203c-45c2-b1e1-0962dcf98cfa req-ebaa0db9-a96a-493c-a6bf-02f22441a31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8be50aa-b202-4a09-9930-8c1ac65408cd", "tag": "b984dc9f-19d1-4b06-87eb-65e952deeb6d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:23.954965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fc2fd510-203c-45c2-b1e1-0962dcf98cfa req-ebaa0db9-a96a-493c-a6bf-02f22441a31e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:23.955857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fc2fd510-203c-45c2-b1e1-0962dcf98cfa req-ebaa0db9-a96a-493c-a6bf-02f22441a31e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:23.956394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fc2fd510-203c-45c2-b1e1-0962dcf98cfa req-ebaa0db9-a96a-493c-a6bf-02f22441a31e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:23.987351 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fc2fd510-203c-45c2-b1e1-0962dcf98cfa req-ebaa0db9-a96a-493c-a6bf-02f22441a31e service nova] Creating event network-changed:b984dc9f-19d1-4b06-87eb-65e952deeb6d for instance f8be50aa-b202-4a09-9930-8c1ac65408cd on n-h2-852086-5 Aug 27 03:17:24.001901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fc2fd510-203c-45c2-b1e1-0962dcf98cfa req-ebaa0db9-a96a-493c-a6bf-02f22441a31e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083841 Aug 27 03:17:24.011238 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1113/2292] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:24.017919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e60a5cf8-0a2c-4b49-b325-db2531986b6e tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe457b8b790>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:24.073107 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e60a5cf8-0a2c-4b49-b325-db2531986b6e tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1144496700" status: 202 len: 0 microversion: 2.1 time: 0.059653 Aug 27 03:17:24.074305 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1114/2293] 10.222.0.69 () {58 vars in 1278 bytes} [Sat Aug 27 03:17:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1144496700 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:24.085172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:24.086386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:24.109188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.109771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.110337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.112972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.114447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.114889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:24.115874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.129684 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-004d8052-f2b3-4d8f-9441-3a53dbeed218 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1505 microversion: 2.1 time: 1.093007 Aug 27 03:17:24.130290 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1180/2294] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:23 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1505 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:24.154962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-751d0e8b-b2dc-4287-9de0-cc60c87bb498 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Calling method '.version_select at 0x7fe45c83d8b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:24.533210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:24.544980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1cd3ae45-a3bf-4e09-a02f-5e28eadc3f45 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 0.469337 Aug 27 03:17:24.552364 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1115/2295] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:24 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:24.559282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:24.559981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:24.567574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.569837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.570527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.571462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.572340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.573505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.823477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:24.836413 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b08951d1-4b3e-4aef-b35b-6137227d49b1 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1335 microversion: 2.1 time: 0.282756 Aug 27 03:17:24.858387 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1116/2296] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:24 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1335 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:24.865257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:24.867058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:24.875624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.877017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.878018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.879892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.880689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.881825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.923956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:25.338096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:25.637973 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-751d0e8b-b2dc-4287-9de0-cc60c87bb498 tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/b5164ff6-12b7-40bd-a741-38bcd4423625" status: 202 len: 0 microversion: 2.1 time: 1.506263 Aug 27 03:17:25.638806 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1181/2297] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:17:24 2022] DELETE /compute/v2.1/os-security-groups/b5164ff6-12b7-40bd-a741-38bcd4423625 => generated 0 bytes in 1507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:25.644426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50081d2a-2b3c-4af9-8136-56964e0c4e68 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] Calling method '.version_select at 0x7fe460337820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:25.725912 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50081d2a-2b3c-4af9-8136-56964e0c4e68 tempest-KeyPairsV2TestJSON-1646899905 tempest-KeyPairsV2TestJSON-1646899905-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2054825132" status: 202 len: 0 microversion: 2.1 time: 0.086294 Aug 27 03:17:25.738092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1182/2298] 10.222.0.69 () {58 vars in 1278 bytes} [Sat Aug 27 03:17:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2054825132 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:25.760663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:25.761510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:25.768556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:25.779755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:25.782116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:25.787663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:25.791983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:25.792754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:25.860238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:25.870760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:25.898894 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6359e0c0-78f5-4304-948d-0e196fc49a8c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1308 microversion: 2.1 time: 1.041898 Aug 27 03:17:25.902123 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1117/2299] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:24 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1308 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:25.919678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:25.920643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:25.949591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:25.951159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:25.951954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:25.953125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:25.953821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:25.962718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:26.132581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2de38af3-1738-4aba-8f78-2e8e4eff7ab7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 204 len: 0 microversion: 2.1 time: 0.392782 Aug 27 03:17:26.133733 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1183/2300] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:25 2022] DELETE /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:26.141620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fce9952-6039-47da-8c00-d0b6c0d7de7c tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Calling method '.version_select at 0x7fe457f1d8b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:26.460986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:26.469165 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-066cfde1-0715-427a-80c0-1adff87c3b08 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 0.563393 Aug 27 03:17:26.482560 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1118/2301] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:25 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:26.492371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:26.506050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:26.518978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:26.519942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:26.520547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:26.521279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:26.521743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:26.522190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:27.074217 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fce9952-6039-47da-8c00-d0b6c0d7de7c tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/1e9938c5-5860-48d9-b388-e77c6347e187" status: 202 len: 0 microversion: 2.1 time: 0.938707 Aug 27 03:17:27.075745 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1184/2302] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:17:26 2022] DELETE /compute/v2.1/os-security-groups/1e9938c5-5860-48d9-b388-e77c6347e187 => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:27.097410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-35016b75-1b83-461b-a875-c77cd2d2d80a req-e3405c3c-240b-4e45-beb7-f339f0e69b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa9a826-8f42-4671-86f6-9ee58104324a", "tag": "daafd905-5453-4802-900a-ba4556bb1f8b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:27.156597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-35016b75-1b83-461b-a875-c77cd2d2d80a req-e3405c3c-240b-4e45-beb7-f339f0e69b2d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:27.159683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-35016b75-1b83-461b-a875-c77cd2d2d80a req-e3405c3c-240b-4e45-beb7-f339f0e69b2d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:27.161592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-35016b75-1b83-461b-a875-c77cd2d2d80a req-e3405c3c-240b-4e45-beb7-f339f0e69b2d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:27.179225 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-35016b75-1b83-461b-a875-c77cd2d2d80a req-e3405c3c-240b-4e45-beb7-f339f0e69b2d service nova] Creating event network-changed:daafd905-5453-4802-900a-ba4556bb1f8b for instance 1fa9a826-8f42-4671-86f6-9ee58104324a on n-h1-852086-5 Aug 27 03:17:27.186506 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-35016b75-1b83-461b-a875-c77cd2d2d80a req-e3405c3c-240b-4e45-beb7-f339f0e69b2d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103187 Aug 27 03:17:27.187698 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1185/2303] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:27.196168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:27.197381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:27.210192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:27.211734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:27.212839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:27.214377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:27.215329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:27.216039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:27.432345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:27.494910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:27.506844 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a35d2c0-0e63-4643-881a-af814ba9fec3 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 1.021881 Aug 27 03:17:27.517222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1119/2304] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:26 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:27.522570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:27.523204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:27.541964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:27.542788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:27.543382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:27.544284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:27.544895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:27.545474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:27.969720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:27.981023 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20a7a66c-4c24-460c-b28d-2cb44e7f95c8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1308 microversion: 2.1 time: 0.462571 Aug 27 03:17:27.989466 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1120/2305] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:27 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:27.998295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a6d1348-e729-4a36-a236-cc161da5387d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] Calling method '.version_select at 0x7fe457b5d8b0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:28.493596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:28.514008 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91b3e77e-31dd-4516-b472-0320cef0575a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1511 microversion: 2.1 time: 1.315171 Aug 27 03:17:28.516218 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1186/2306] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:27 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1511 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:28.542187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:28.542819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:28.569789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:28.573949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:28.575805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:28.577595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:28.582252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:28.582923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:28.775406 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a6d1348-e729-4a36-a236-cc161da5387d tempest-SecurityGroupRulesNegativeTestJSON-654706275 tempest-SecurityGroupRulesNegativeTestJSON-654706275-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/97e0c87d-df9a-473d-837d-453e67bd813a" status: 202 len: 0 microversion: 2.1 time: 0.784417 Aug 27 03:17:28.776237 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1121/2307] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:17:27 2022] DELETE /compute/v2.1/os-security-groups/97e0c87d-df9a-473d-837d-453e67bd813a => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:28.781817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:28.796489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:28.842630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:28.848272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:28.853027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:28.859246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:28.865217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:28.869522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:29.570222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:29.581629 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e72302db-f80c-4ac0-b7e0-2c8ec3fcde4f tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 0.804094 Aug 27 03:17:29.582778 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1122/2308] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:28 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:29.589083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:29.589989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:29.620722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:29.622453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:29.623435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:29.624518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:29.625263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:29.630400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:29.911772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:29.926779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97b600d2-0c44-44c7-9f02-d9fa9a3639bd tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 1.400861 Aug 27 03:17:29.941944 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1187/2309] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:28 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:29.953041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:29.954095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:29.965017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:29.966559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:29.968045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.003300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.003839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.004299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.154713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:30.262788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:30.285129 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ce7ee11-82dd-4bb8-b91f-70e66bb27111 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 200 len: 1469 microversion: 2.1 time: 0.341336 Aug 27 03:17:30.312642 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1188/2310] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:29 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:30.323741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d90ffd3e-2f08-46d0-9d39-52b991d2426f req-4e80d3e7-fb09-4f42-a094-397884ef9de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa627487-0ffe-40a1-9ac1-484acb3b7b89", "name": "network-vif-deleted", "tag": "cd3cae21-8c78-43ec-96b2-2966fb0d4c70"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:30.358347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d90ffd3e-2f08-46d0-9d39-52b991d2426f req-4e80d3e7-fb09-4f42-a094-397884ef9de5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.359161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d90ffd3e-2f08-46d0-9d39-52b991d2426f req-4e80d3e7-fb09-4f42-a094-397884ef9de5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.360734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d90ffd3e-2f08-46d0-9d39-52b991d2426f req-4e80d3e7-fb09-4f42-a094-397884ef9de5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.379132 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d90ffd3e-2f08-46d0-9d39-52b991d2426f req-4e80d3e7-fb09-4f42-a094-397884ef9de5 service nova] Creating event network-vif-deleted:cd3cae21-8c78-43ec-96b2-2966fb0d4c70 for instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 on n-h2-852086-5 Aug 27 03:17:30.386331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d90ffd3e-2f08-46d0-9d39-52b991d2426f req-4e80d3e7-fb09-4f42-a094-397884ef9de5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071026 Aug 27 03:17:30.388557 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1189/2311] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:30.410707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0298f304-63df-4283-af1e-b97877d53078 req-ca659e75-2948-4724-a3f6-0c18c53686ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8be50aa-b202-4a09-9930-8c1ac65408cd", "name": "network-vif-plugged", "status": "completed", "tag": "b984dc9f-19d1-4b06-87eb-65e952deeb6d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:30.435595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0298f304-63df-4283-af1e-b97877d53078 req-ca659e75-2948-4724-a3f6-0c18c53686ba service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.444113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0298f304-63df-4283-af1e-b97877d53078 req-ca659e75-2948-4724-a3f6-0c18c53686ba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.444978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0298f304-63df-4283-af1e-b97877d53078 req-ca659e75-2948-4724-a3f6-0c18c53686ba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.476410 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0298f304-63df-4283-af1e-b97877d53078 req-ca659e75-2948-4724-a3f6-0c18c53686ba service nova] Creating event network-vif-plugged:b984dc9f-19d1-4b06-87eb-65e952deeb6d for instance f8be50aa-b202-4a09-9930-8c1ac65408cd on n-h2-852086-5 Aug 27 03:17:30.485504 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0298f304-63df-4283-af1e-b97877d53078 req-ca659e75-2948-4724-a3f6-0c18c53686ba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093958 Aug 27 03:17:30.487645 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1190/2312] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:30.584505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:30.592969 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-483c3393-8b53-4e75-bb19-8406219c818d tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1308 microversion: 2.1 time: 1.008850 Aug 27 03:17:30.593809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1123/2313] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:29 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1308 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:30.606629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:30.607534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:30.621004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.621565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.622190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.623146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.624089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.626059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.963912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-498a80f6-0a7d-434c-91fa-b596776352c0 req-8911dd6b-2442-493b-b3bc-afd19b0f37df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cec7abf-9e6e-4d3d-b51f-e094cc90c757", "tag": "bcbc0986-64a0-4448-ba2f-5fa0fc95e78d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:30.985172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=42 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:31.006501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-498a80f6-0a7d-434c-91fa-b596776352c0 req-8911dd6b-2442-493b-b3bc-afd19b0f37df service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.008461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-498a80f6-0a7d-434c-91fa-b596776352c0 req-8911dd6b-2442-493b-b3bc-afd19b0f37df service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.010997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-498a80f6-0a7d-434c-91fa-b596776352c0 req-8911dd6b-2442-493b-b3bc-afd19b0f37df service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.047503 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-498a80f6-0a7d-434c-91fa-b596776352c0 req-8911dd6b-2442-493b-b3bc-afd19b0f37df service nova] Creating event network-changed:bcbc0986-64a0-4448-ba2f-5fa0fc95e78d for instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 on n-h2-852086-5 Aug 27 03:17:31.065794 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-498a80f6-0a7d-434c-91fa-b596776352c0 req-8911dd6b-2442-493b-b3bc-afd19b0f37df service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106710 Aug 27 03:17:31.068647 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1124/2314] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:31.084380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:31.085275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:31.101408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.102431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.103225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.104295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.105038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.105833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.467733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:31.495708 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89733b52-5a70-4235-8b9f-3254a3fe2155 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 0.893578 Aug 27 03:17:31.502797 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1191/2315] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:30 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:31.510588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:31.516752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:31.546492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.547878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.549007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.560839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.562406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.563429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.564476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:31.599181 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17e24806-9300-4bbb-a286-9bb49ddafc9c tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 0.524759 Aug 27 03:17:31.617094 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1125/2316] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:31 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:31.618219 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:17:31.642817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:31.643483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 HTTP/1.1 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'fa627487-0ffe-40a1-9ac1-484acb3b7b89'} Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:31.643892 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:31.653965 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e54c986-46b5-4a9e-a1d4-929732c23465 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 404 len: 111 microversion: 2.1 time: 0.144017 Aug 27 03:17:31.657543 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1192/2317] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:31 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:31.664960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.665856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.666537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.670216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.671118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.671734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.674501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:31.675253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:31.682864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.683453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.683962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:31.685088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:31.685750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:31.687036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:32.034584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:32.050371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38df573c-bd2c-46cd-bbe5-32349236e2fc tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1308 microversion: 2.1 time: 0.428900 Aug 27 03:17:32.062202 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1126/2318] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:31 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:32.077324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:32.094636 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f4cc19c-090d-40d2-873f-da0e5b9b3b1c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.435308 Aug 27 03:17:32.096083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1193/2319] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:31 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:32.524537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:32.525896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:32.546338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d041ea5f-5644-42f4-9509-5fbd2d6c3aad tempest-ListImagesTestJSON-1354662465 tempest-ListImagesTestJSON-1354662465-project] Calling method '.version_select at 0x7fe4578d3700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:32.555804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:32.557794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:32.558520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:32.560772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:32.561488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:32.564218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:32.676722 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d041ea5f-5644-42f4-9509-5fbd2d6c3aad tempest-ListImagesTestJSON-1354662465 tempest-ListImagesTestJSON-1354662465-project] 10.222.0.69 "GET /compute/v2.1/images/acef3da5-f17c-4877-a77f-8b5440d3d46e" status: 200 len: 784 microversion: 2.1 time: 0.622551 Aug 27 03:17:32.690968 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1127/2320] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:32 2022] GET /compute/v2.1/images/acef3da5-f17c-4877-a77f-8b5440d3d46e => generated 784 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:32.698726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4aa5ee62-3532-48bb-b7f5-f42a041dcd8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4aa5ee62-3532-48bb-b7f5-f42a041dcd8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 163 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": 12345, "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 12345 Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:32.707811 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 03:17:32.711819 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:32.715003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4aa5ee62-3532-48bb-b7f5-f42a041dcd8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:32.716584 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4aa5ee62-3532-48bb-b7f5-f42a041dcd8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.023290 Aug 27 03:17:32.721003 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1128/2321] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:32 2022] POST /compute/v2.1/servers => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:32.728056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:32.729016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:32.737418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:32.738311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:32.739225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:32.740172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:32.740869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:32.741990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:32.966590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:32.979047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-429dec8f-0a9c-4089-b6c8-07b214351db8 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 0.457896 Aug 27 03:17:32.979924 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1194/2322] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:32 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:33.006754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fb6185a-2892-44fc-8a17-5ce3cd1a1049 tempest-ListImagesTestJSON-1354662465 tempest-ListImagesTestJSON-1354662465-project] Calling method '.version_select at 0x7fe45c0913a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:33.189179 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fb6185a-2892-44fc-8a17-5ce3cd1a1049 tempest-ListImagesTestJSON-1354662465 tempest-ListImagesTestJSON-1354662465-project] 10.222.0.69 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.188862 Aug 27 03:17:33.194026 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1195/2323] 10.222.0.69 () {58 vars in 1122 bytes} [Sat Aug 27 03:17:32 2022] GET /compute/v2.1/images => generated 871 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:33.199977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:33.201021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:33.248899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.250001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.251773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.252617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.253558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.254089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.293746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:33.307380 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dec99b5f-e8ba-4207-99f2-9517f216a950 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 0.583810 Aug 27 03:17:33.308741 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1129/2324] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:32 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:33.316573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:33.317575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:33.324090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.324889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.325562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.326561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.327232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.327869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.567025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:33.584029 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6497fc1-4d5c-4935-8493-3a14ab413c15 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.387952 Aug 27 03:17:33.585332 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1196/2325] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:33 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:33.592710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df2da669-b8f0-47ce-8a80-a8cbf0fd39ca tempest-ListImagesTestJSON-1354662465 tempest-ListImagesTestJSON-1354662465-project] Calling method '.version_select at 0x7fe45c091ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:33.725654 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df2da669-b8f0-47ce-8a80-a8cbf0fd39ca tempest-ListImagesTestJSON-1354662465 tempest-ListImagesTestJSON-1354662465-project] 10.222.0.69 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.138746 Aug 27 03:17:33.726845 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1197/2326] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:17:33 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:33.736379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:33.737579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:33.748499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.749745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.751781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.753534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.754240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.754892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.765678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:33.885265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:33.902351 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-297193d9-84a6-4184-bb5a-917b62efdf67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1489 microversion: 2.1 time: 0.591104 Aug 27 03:17:33.903674 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1130/2327] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:33 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1489 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:33.942469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:33.942894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:33.960628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:33.964229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.965479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.966724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:33.968936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:33.971134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:33.972358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.034409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lazy-loading 'flavor' on Instance uuid f8be50aa-b202-4a09-9930-8c1ac65408cd {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:17:34.151881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:34.168852 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf7d710d-cc5b-4311-8608-03a02176297a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.436596 Aug 27 03:17:34.169906 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1198/2328] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:33 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:34.182350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:34.185400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:34.200222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.201982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.203259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.206218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.209103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.209656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.319504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3d4dcae7-8aa3-460a-b9bd-7e59e0497b9b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd/action" status: 202 len: 0 microversion: 2.1 time: 0.379298 Aug 27 03:17:34.328695 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1131/2329] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:17:33 2022] POST /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:34.358391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:34.363619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:34.382108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.383370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.384387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.385784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.387262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.388298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.729072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:34.742060 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37286842-a25e-473f-959d-bea5df3edd04 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 0.569887 Aug 27 03:17:34.743058 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1199/2330] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:34 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:34.747868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:34.749114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:34.757354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.758463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.762775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:34.763881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:34.764593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:34.765253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:35.025281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:35.045106 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64212964-f858-42cc-adee-33ad85c44b10 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 0.712100 Aug 27 03:17:35.046580 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1132/2331] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:34 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:35.505026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:35.516814 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0f4f8ff-ce9e-4782-94ff-cf804446404a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1497 microversion: 2.1 time: 0.772393 Aug 27 03:17:35.520983 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1200/2332] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:34 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1497 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:35.765634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:35.766420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:35.782502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:35.783081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:35.783592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:35.784394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:35.784930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:35.785455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:36.071069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:36.072215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:36.081057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:36.086745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:36.087252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:36.087701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:36.088425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:36.088893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:36.089328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:36.636616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:36.683039 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-514bdbb4-4200-41d4-8771-f3393f1b9f61 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 0.915964 Aug 27 03:17:36.698822 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1133/2333] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:35 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:36.712271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:36.713111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:36.726104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:36.726803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:36.727828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:36.728779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:36.729585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:36.730281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.054903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:37.067055 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9bbc543-ead4-49a5-81ea-356d424755c0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 200 len: 1480 microversion: 2.1 time: 0.372167 Aug 27 03:17:37.067999 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1134/2334] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:36 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 1480 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:37.073088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-399db69f-90aa-471a-b011-ee89ec655f27 req-c32e0c7f-c438-44cb-98c9-59811685979e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa9a826-8f42-4671-86f6-9ee58104324a", "name": "network-vif-plugged", "status": "completed", "tag": "daafd905-5453-4802-900a-ba4556bb1f8b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:37.085893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-399db69f-90aa-471a-b011-ee89ec655f27 req-c32e0c7f-c438-44cb-98c9-59811685979e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:37.102589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-399db69f-90aa-471a-b011-ee89ec655f27 req-c32e0c7f-c438-44cb-98c9-59811685979e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:37.103547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-399db69f-90aa-471a-b011-ee89ec655f27 req-c32e0c7f-c438-44cb-98c9-59811685979e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.128875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-399db69f-90aa-471a-b011-ee89ec655f27 req-c32e0c7f-c438-44cb-98c9-59811685979e service nova] Creating event network-vif-plugged:daafd905-5453-4802-900a-ba4556bb1f8b for instance 1fa9a826-8f42-4671-86f6-9ee58104324a on n-h1-852086-5 Aug 27 03:17:37.136451 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-399db69f-90aa-471a-b011-ee89ec655f27 req-c32e0c7f-c438-44cb-98c9-59811685979e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067202 Aug 27 03:17:37.139884 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1135/2335] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:37.146833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-973561335"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:37.154633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:37.169434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:37.170250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:37.170908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.171974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:37.173243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:37.174033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.213985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:37.328735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:37.342941 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf1bf05c-9bc4-49ec-b277-9c13181c16a1 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 1.277056 Aug 27 03:17:37.344682 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1201/2336] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:36 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:37.591047 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62762487-12cb-4a44-97e4-796dfffac790 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd/action" status: 202 len: 0 microversion: 2.1 time: 0.449452 Aug 27 03:17:37.592381 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1136/2337] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:17:37 2022] POST /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:17:37.607210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b6b5fd5-ce9c-4b32-b8d3-816c03f41e38 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe460301550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:37.712131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:37.713339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:37.725345 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b6b5fd5-ce9c-4b32-b8d3-816c03f41e38 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.125982 Aug 27 03:17:37.738478 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1202/2338] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:37 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:37.741326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:37.742431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:37.744816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.747234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:37.748429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:37.753654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:37.965581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-253ca90c-8e76-470c-98b7-f747efb55907 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1542881019", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:38.096454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:38.109780 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2882883f-b41d-4a74-b312-2905e8defb2a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 0.408392 Aug 27 03:17:38.115528 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1137/2339] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:37 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:38.154825 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-253ca90c-8e76-470c-98b7-f747efb55907 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Block Device 4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f is not bootable. Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-253ca90c-8e76-470c-98b7-f747efb55907 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 358 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1542881019", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: exception: Block Device 4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f is not bootable. Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1542881019', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f'}], 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f is not bootable. Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:38.163944 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f is not bootable. Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f is not bootable. Aug 27 03:17:38.170781 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:38.176422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-253ca90c-8e76-470c-98b7-f747efb55907 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Block Device 4b0ba9a3-eafd-4db3-95d7-c8dd59c6eb0f is not bootable. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:38.178874 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-253ca90c-8e76-470c-98b7-f747efb55907 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.216585 Aug 27 03:17:38.181317 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1203/2340] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:17:38.190445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:38.191687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:38.212738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.220324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.222192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:38.224896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.226628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.228222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:38.364558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:38.366809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:38.389645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.391373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.392602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:38.393703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.394269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.394967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:38.716931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:38.742540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f75f5fc-7bc2-443b-8a8d-228da9ea216f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.555881 Aug 27 03:17:38.762191 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1138/2341] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:38 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:38.781668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-03543c7d-df18-4ddf-a846-16ac85bb4717 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4579beca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:38.884538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-03543c7d-df18-4ddf-a846-16ac85bb4717 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.131870 Aug 27 03:17:38.892929 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1139/2342] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:38 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:38.905672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:38.916867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:38.938738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.940887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.945413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:38.949333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:38.950299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:38.951425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:39.064469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:39.089935 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf8240a8-89c9-4dc2-acc9-94a5e94a18cb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1369 microversion: 2.1 time: 0.725523 Aug 27 03:17:39.090705 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1204/2343] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:38 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1369 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:39.137272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:39.137898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:39.146204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:39.148228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:39.148915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:39.149916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:39.150658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:39.151477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:39.290709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:39.308895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a60b392-b635-4888-b321-d9713b2c951f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.413959 Aug 27 03:17:39.312549 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1140/2344] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:38 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:39.327051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-678c3faa-f31e-4038-a4aa-d3c6740e0964 req-8cb39930-3e88-4af3-b68a-23f27507c951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cec7abf-9e6e-4d3d-b51f-e094cc90c757", "name": "network-vif-plugged", "status": "completed", "tag": "bcbc0986-64a0-4448-ba2f-5fa0fc95e78d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:39.358503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-678c3faa-f31e-4038-a4aa-d3c6740e0964 req-8cb39930-3e88-4af3-b68a-23f27507c951 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:39.359060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-678c3faa-f31e-4038-a4aa-d3c6740e0964 req-8cb39930-3e88-4af3-b68a-23f27507c951 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:39.359700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-678c3faa-f31e-4038-a4aa-d3c6740e0964 req-8cb39930-3e88-4af3-b68a-23f27507c951 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:39.406718 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-678c3faa-f31e-4038-a4aa-d3c6740e0964 req-8cb39930-3e88-4af3-b68a-23f27507c951 service nova] Creating event network-vif-plugged:bcbc0986-64a0-4448-ba2f-5fa0fc95e78d for instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 on n-h2-852086-5 Aug 27 03:17:39.427277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-678c3faa-f31e-4038-a4aa-d3c6740e0964 req-8cb39930-3e88-4af3-b68a-23f27507c951 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104141 Aug 27 03:17:39.428355 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1141/2345] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:39.871045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b32a4197-1d24-4d42-816f-3fdda3315160 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe457baaaf0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeJ1nKmvx4LTe+RU1YqDz+I3Db4DM70+Xrq2USzmCaoVzUzXv6dMWwJcZeeJuboujTEPO5TMLYCRPp2TwBQ6AmrhIGLgCdqofaMTgrH46dZs3jvBq+itGMHa+4g0iaBsQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b32a4197-1d24-4d42-816f-3fdda3315160 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 257 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeJ1nKmvx4LTe+RU1YqDz+I3Db4DM70+Xrq2USzmCaoVzUzXv6dMWwJcZeeJuboujTEPO5TMLYCRPp2TwBQ6AmrhIGLgCdqofaMTgrH46dZs3jvBq+itGMHa+4g0iaBsQ=="}} Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeJ1nKmvx4LTe+RU1YqDz+I3Db4DM70+Xrq2USzmCaoVzUzXv6dMWwJcZeeJuboujTEPO5TMLYCRPp2TwBQ6AmrhIGLgCdqofaMTgrH46dZs3jvBq+itGMHa+4g0iaBsQ=='}}} Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 27 03:17:39.883669 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 03:17:39.891022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:39.900429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b32a4197-1d24-4d42-816f-3fdda3315160 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:39.906797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b32a4197-1d24-4d42-816f-3fdda3315160 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.457312 Aug 27 03:17:39.915504 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1142/2346] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:39 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 464 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:17:39.921845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e717520-0d6b-48bb-9d37-bb18d1265206 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45795e1f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:40.128092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e717520-0d6b-48bb-9d37-bb18d1265206 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.205778 Aug 27 03:17:40.128748 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1143/2347] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:39 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:40.131360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:40.152011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b465b07d-f729-4a0d-b5f8-dd017ddd08d9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 1.018626 Aug 27 03:17:40.152929 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1205/2348] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:39 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:40.163737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-03945007-fd8a-4d12-8d14-a0f9a409098c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe457baaaf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-318032167", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:40.169958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:40.172764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:40.187930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:40.192852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:40.195132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:40.196132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:40.199034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:40.199670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:40.223029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-03945007-fd8a-4d12-8d14-a0f9a409098c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:40.243661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-03945007-fd8a-4d12-8d14-a0f9a409098c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for user abb5d4d861c3442c803034ec87ae3bff and project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:40.285755 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-03945007-fd8a-4d12-8d14-a0f9a409098c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-03945007-fd8a-4d12-8d14-a0f9a409098c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 2166 Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-318032167", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:40.408770 n-d-852086-5 devstack@n-api.service[122407]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-318032167', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:40.410699 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-03945007-fd8a-4d12-8d14-a0f9a409098c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-03945007-fd8a-4d12-8d14-a0f9a409098c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.276721 Aug 27 03:17:40.413652 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1144/2349] 10.222.0.69 () {60 vars in 1160 bytes} [Sat Aug 27 03:17:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:40.422526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4103fcb3-8f92-464c-8d2c-b4ae8951bad5 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe457bb8280>, body: {"keypair": {"name": "tempest-keypair-597949089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa1yVue1h0qnFGbtBp3fdGdCkkBrE0YCMNSnZDyK6izvFVny1dcOOmB0kid9QSghfRhWg7Ru/uapqnV6tz75GQN2tzlLlHUfTKMztp3bS7FfisKsEVB5QYJnTylIqsGEQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:40.488007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4103fcb3-8f92-464c-8d2c-b4ae8951bad5 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:40.518687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4103fcb3-8f92-464c-8d2c-b4ae8951bad5 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for user abb5d4d861c3442c803034ec87ae3bff and project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:40.585036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:40.599679 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d834f903-a676-42e9-b860-a8318fa167b6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1555 microversion: 2.1 time: 0.445354 Aug 27 03:17:40.604806 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1206/2350] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:40 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1555 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:40.621201 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4103fcb3-8f92-464c-8d2c-b4ae8951bad5 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.202352 Aug 27 03:17:40.622439 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1145/2351] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:40.636309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:40.637341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:40.639593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d9b85fc-c85e-4422-8e90-9e655dd0d2fb tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe457bb8700>, body: {"keypair": {"name": "tempest-keypair-597949089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnzTsiO3lzCaR7QC1PgWuPJYn3l+WRbNPyZ8Z0iXbfxXtfYZmCAGZvZ2cxQPyuT7SXHb6Pf3rv7SApQpVQY/w5zb1tWV3+DAqQgFk1/n+/qy7WVSRS6ToUgxMbOlkyfWQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:40.646582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:40.647611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:40.648321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:40.649553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:40.650294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:40.650924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:40.681510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9d9b85fc-c85e-4422-8e90-9e655dd0d2fb tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:40.737763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9d9b85fc-c85e-4422-8e90-9e655dd0d2fb tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for user abb5d4d861c3442c803034ec87ae3bff and project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:40.807367 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9d9b85fc-c85e-4422-8e90-9e655dd0d2fb tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] HTTP exception thrown: Key pair 'tempest-keypair-597949089' already exists. Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d9b85fc-c85e-4422-8e90-9e655dd0d2fb tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 272 Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: {"keypair": {"name": "tempest-keypair-597949089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnzTsiO3lzCaR7QC1PgWuPJYn3l+WRbNPyZ8Z0iXbfxXtfYZmCAGZvZ2cxQPyuT7SXHb6Pf3rv7SApQpVQY/w5zb1tWV3+DAqQgFk1/n+/qy7WVSRS6ToUgxMbOlkyfWQ=="}} Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: exception: Key pair 'tempest-keypair-597949089' already exists. Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-597949089', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnzTsiO3lzCaR7QC1PgWuPJYn3l+WRbNPyZ8Z0iXbfxXtfYZmCAGZvZ2cxQPyuT7SXHb6Pf3rv7SApQpVQY/w5zb1tWV3+DAqQgFk1/n+/qy7WVSRS6ToUgxMbOlkyfWQ=='}}} Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result.read() Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'abb5d4d861c3442c803034ec87ae3bff-tempest-keypair-597949089' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 03:17:40.816630 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result.read() Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 03:17:40.819857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'abb5d4d861c3442c803034ec87ae3bff-tempest-keypair-597949089' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 3, 17, 40, 792750), 'updated_at': None, 'name': 'tempest-keypair-597949089', 'user_id': 'abb5d4d861c3442c803034ec87ae3bff', 'fingerprint': 'cd:28:90:57:06:63:64:0a:17:c5:54:df:46:f3:02:12', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnzTsiO3lzCaR7QC1PgWuPJYn3l+WRbNPyZ8Z0iXbfxXtfYZmCAGZvZ2cxQPyuT7SXHb6Pf3rv7SApQpVQY/w5zb1tWV3+DAqQgFk1/n+/qy7WVSRS6ToUgxMbOlkyfWQ==', 'type': 'ssh'}] Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi keypair.create() Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._create() Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-597949089' already exists. Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 27 03:17:40.824628 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-597949089' already exists. Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-597949089' already exists. Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d9b85fc-c85e-4422-8e90-9e655dd0d2fb tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 409 to user: Key pair 'tempest-keypair-597949089' already exists. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9d9b85fc-c85e-4422-8e90-9e655dd0d2fb tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.184935 Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1146/2352] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:40 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:17:40.839199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb462696-b581-4dbb-9603-c6eefdd28658 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Calling method '.version_select at 0x7fe457b575e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:40.883664 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb462696-b581-4dbb-9603-c6eefdd28658 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597949089" status: 202 len: 0 microversion: 2.1 time: 0.056017 Aug 27 03:17:40.884624 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1147/2353] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:17:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597949089 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:40.896706 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e66a339-37cc-4fc3-ba8a-054c2f9ed41f tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274945 Aug 27 03:17:40.897797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39eb6fb5-142d-4110-b485-0fe3c26bc11c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe457ba6940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIzvrNFhKkgi7Fn8i8dIroxohAxfm0MaFZYgtb9Mox5UNMf7qedxpw4k1e6S21QHjQN24yBvq6a/X+ZXsNDCyjzbl8MpNqUyLWgDutm14+vUs+eQMNwS6Odr5M7cXk75Q=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39eb6fb5-142d-4110-b485-0fe3c26bc11c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 247 Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIzvrNFhKkgi7Fn8i8dIroxohAxfm0MaFZYgtb9Mox5UNMf7qedxpw4k1e6S21QHjQN24yBvq6a/X+ZXsNDCyjzbl8MpNqUyLWgDutm14+vUs+eQMNwS6Odr5M7cXk75Q=="}} Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIzvrNFhKkgi7Fn8i8dIroxohAxfm0MaFZYgtb9Mox5UNMf7qedxpw4k1e6S21QHjQN24yBvq6a/X+ZXsNDCyjzbl8MpNqUyLWgDutm14+vUs+eQMNwS6Odr5M7cXk75Q=='}}} Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '' Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:40.901596 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:17:40.905603 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:40.906537 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1207/2354] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:17:40 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-interface => generated 285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:17:40.913676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39eb6fb5-142d-4110-b485-0fe3c26bc11c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:40.914818 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39eb6fb5-142d-4110-b485-0fe3c26bc11c tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.021136 Aug 27 03:17:40.922543 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1148/2355] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:40.934306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb100540-43b1-4324-b415-4aa56c0d6f9a tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe45c45e940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-703471355", "public_key": " "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:40.978558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bb100540-43b1-4324-b415-4aa56c0d6f9a tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:40.996947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bb100540-43b1-4324-b415-4aa56c0d6f9a tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for user abb5d4d861c3442c803034ec87ae3bff and project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:41.023374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-bb100540-43b1-4324-b415-4aa56c0d6f9a tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb100540-43b1-4324-b415-4aa56c0d6f9a tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 94 Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-703471355", "public_key": " "}} Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-703471355', 'public_key': ' '}}} Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.027162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb100540-43b1-4324-b415-4aa56c0d6f9a tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb100540-43b1-4324-b415-4aa56c0d6f9a tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.100911 Aug 27 03:17:41.030722 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1208/2356] 10.222.0.69 () {60 vars in 1158 bytes} [Sat Aug 27 03:17:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:41.050609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-582b212e-36a0-4c5f-b798-2911ba159354 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe4578d3ca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8eVcDmzhM44gEzHIBAM2oiYNTC7ksQX4svaQJ7unqSlNc9Vo595U/YK2S0Aojo18I1DgyfI3IhJgzr3O+1s7lLRbHMWwTd1j6SKpa37d7k9qO0KoAcQbtq9CLQUNVlxw=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-582b212e-36a0-4c5f-b798-2911ba159354 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 507 Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8eVcDmzhM44gEzHIBAM2oiYNTC7ksQX4svaQJ7unqSlNc9Vo595U/YK2S0Aojo18I1DgyfI3IhJgzr3O+1s7lLRbHMWwTd1j6SKpa37d7k9qO0KoAcQbtq9CLQUNVlxw=="}} Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8eVcDmzhM44gEzHIBAM2oiYNTC7ksQX4svaQJ7unqSlNc9Vo595U/YK2S0Aojo18I1DgyfI3IhJgzr3O+1s7lLRbHMWwTd1j6SKpa37d7k9qO0KoAcQbtq9CLQUNVlxw=='}}} Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 03:17:41.057188 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-582b212e-36a0-4c5f-b798-2911ba159354 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:41.060455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-582b212e-36a0-4c5f-b798-2911ba159354 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013201 Aug 27 03:17:41.066562 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1149/2357] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:41 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:41.076873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2f54aa2-b78c-4dbd-9bd5-c1088f959f02 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Action: 'create', calling method: .version_select at 0x7fe457d5b0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-222079799", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:41.145759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d2f54aa2-b78c-4dbd-9bd5-c1088f959f02 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:41.150495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1abb607e-04e2-49e2-834a-6aca2980baa4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457c11f70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:41.167547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d2f54aa2-b78c-4dbd-9bd5-c1088f959f02 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Getting quotas for user abb5d4d861c3442c803034ec87ae3bff and project 466c4ab84b1d4808a3f0efa633e147ef. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:41.213700 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d2f54aa2-b78c-4dbd-9bd5-c1088f959f02 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2f54aa2-b78c-4dbd-9bd5-c1088f959f02 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 117 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-222079799", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-222079799', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 03:17:41.221217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.226487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2f54aa2-b78c-4dbd-9bd5-c1088f959f02 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:41.232519 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2f54aa2-b78c-4dbd-9bd5-c1088f959f02 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.162863 Aug 27 03:17:41.233575 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1209/2358] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:17:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:41.244631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:41.251957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:41.256298 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1abb607e-04e2-49e2-834a-6aca2980baa4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.109408 Aug 27 03:17:41.265562 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1150/2359] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:41 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:41.288171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf65a631-d611-47ae-9aa2-cc02fe385d98 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Calling method '.version_select at 0x7fe457a258b0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:41.295795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:41.300488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:41.301150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:41.304446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:41.305615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:41.307392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:41.344463 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-cf65a631-d611-47ae-9aa2-cc02fe385d98 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1202223833 not found for user abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf65a631-d611-47ae-9aa2-cc02fe385d98 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Request method failure captured: Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1202223833 HTTP/1.1 Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzTNFHWM-kulQsHQ-uPFYL9xfqUWV6cypmfMFORIb8pswFON6748e6CmysQEYuCrpzR56DQjQH6F2T-HS-vOFW3VDNPKleT_gx3I03Nqc5CLz2EQAMgQ9AiKPR2aWFB8RhhyZVpyEodA4hRXCAtbQaRB-K7jDGhPkUSsV_AgnMVW2E Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_466c4ab84b1d4808a3f0efa633e147ef", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/466c4ab84b1d4808a3f0efa633e147ef"}]}] Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 466c4ab84b1d4808a3f0efa633e147ef Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-262082452 Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-262082452-project Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: exception: Keypair tempest-keypair-non-existent-1202223833 not found for user abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'tempest-keypair-non-existent-1202223833'} Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1202223833 not found for user abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.347385 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1202223833 not found for user abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1202223833 not found for user abb5d4d861c3442c803034ec87ae3bff Aug 27 03:17:41.351392 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:41.365551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf65a631-d611-47ae-9aa2-cc02fe385d98 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1202223833 not found for user abb5d4d861c3442c803034ec87ae3bff {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:41.366479 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf65a631-d611-47ae-9aa2-cc02fe385d98 tempest-KeyPairsNegativeTestJSON-262082452 tempest-KeyPairsNegativeTestJSON-262082452-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1202223833" status: 404 len: 145 microversion: 2.1 time: 0.097448 Aug 27 03:17:41.367047 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1151/2360] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:17:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1202223833 => generated 145 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:41.816060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:41.833531 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c221006-b383-4005-a3ae-0b6bf8c6fa86 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1403 microversion: 2.1 time: 0.594957 Aug 27 03:17:41.836920 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1210/2361] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:41 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1403 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:42.012494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9e2c142-71ef-4d62-a228-c07691f7454f tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] Calling method '.version_select at 0x7fe457ba6ee0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:42.038448 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9e2c142-71ef-4d62-a228-c07691f7454f tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.570522 Aug 27 03:17:42.039570 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1152/2362] 10.222.0.69 () {60 vars in 1226 bytes} [Sat Aug 27 03:17:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:17:42.055772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-052641f1-1b50-4a33-9b3a-06a0057c487c tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] Action: 'update', calling method: .version_select at 0x7fe45c45eaf0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:42.262768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-052641f1-1b50-4a33-9b3a-06a0057c487c tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.215738 Aug 27 03:17:42.264611 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1211/2363] 10.222.0.69 () {62 vars in 1247 bytes} [Sat Aug 27 03:17:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:17:42.277634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0102e429-5536-46f9-bb72-cf9a066db28d tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] Calling method '.version_select at 0x7fe4578ed160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:42.296614 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0102e429-5536-46f9-bb72-cf9a066db28d tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.024423 Aug 27 03:17:42.297792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36f2fe1d-609f-47fa-b840-ad8a881433c6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457f1d8b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:42.298097 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1153/2364] 10.222.0.69 () {60 vars in 1226 bytes} [Sat Aug 27 03:17:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:17:42.316961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7ca587e-248b-4cd9-b57c-2ecd7d107b6e tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] Action: 'update', calling method: .version_select at 0x7fe4579b9820>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:42.371255 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36f2fe1d-609f-47fa-b840-ad8a881433c6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.085785 Aug 27 03:17:42.372248 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1212/2365] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:42 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:42.443266 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7ca587e-248b-4cd9-b57c-2ecd7d107b6e tempest-QuotaClassesAdmin257Test-852850357 tempest-QuotaClassesAdmin257Test-852850357-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.138458 Aug 27 03:17:42.445702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1154/2366] 10.222.0.69 () {62 vars in 1247 bytes} [Sat Aug 27 03:17:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:17:42.825098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-970980c3-35ff-4a48-a1b7-941b44f204b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1354918711", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "destination_type": "local"}, {"source_type": "volume", "uuid": "4fe374d4-d6e8-42e9-9c41-55f1b77b328e", "destination_type": "invalid"}], "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-970980c3-35ff-4a48-a1b7-941b44f204b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 495 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1354918711", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "destination_type": "local"}, {"source_type": "volume", "uuid": "4fe374d4-d6e8-42e9-9c41-55f1b77b328e", "destination_type": "invalid"}], "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1354918711', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '4fe374d4-d6e8-42e9-9c41-55f1b77b328e', 'destination_type': 'invalid'}], 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:42.832294 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-970980c3-35ff-4a48-a1b7-941b44f204b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:42.835422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-970980c3-35ff-4a48-a1b7-941b44f204b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.014648 Aug 27 03:17:42.838734 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1213/2367] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:42 2022] POST /compute/v2.1/servers => generated 155 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:42.842793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:42.843541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:42.855668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:42.856276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:42.856610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:42.857340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:42.857804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:42.858264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:42.860270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:42.861256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:42.875037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:42.878328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:42.878976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:42.882804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:42.884707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:42.886814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.366019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:43.383175 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb81f102-ad4d-4887-a696-026359ed60fc tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1589 microversion: 2.1 time: 0.528164 Aug 27 03:17:43.389895 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1214/2368] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:42 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1589 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:43.406570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fbdfdc2b-d1cd-4361-8f50-cb60ba9d49a2 req-949f2391-f99a-416a-9ed9-7abd66b62cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8be50aa-b202-4a09-9930-8c1ac65408cd", "name": "network-vif-plugged", "status": "completed", "tag": "b984dc9f-19d1-4b06-87eb-65e952deeb6d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:43.443258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fbdfdc2b-d1cd-4361-8f50-cb60ba9d49a2 req-949f2391-f99a-416a-9ed9-7abd66b62cd1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.448713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fbdfdc2b-d1cd-4361-8f50-cb60ba9d49a2 req-949f2391-f99a-416a-9ed9-7abd66b62cd1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.451383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fbdfdc2b-d1cd-4361-8f50-cb60ba9d49a2 req-949f2391-f99a-416a-9ed9-7abd66b62cd1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.507094 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fbdfdc2b-d1cd-4361-8f50-cb60ba9d49a2 req-949f2391-f99a-416a-9ed9-7abd66b62cd1 service nova] Creating event network-vif-plugged:b984dc9f-19d1-4b06-87eb-65e952deeb6d for instance f8be50aa-b202-4a09-9930-8c1ac65408cd on n-h2-852086-5 Aug 27 03:17:43.525123 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fbdfdc2b-d1cd-4361-8f50-cb60ba9d49a2 req-949f2391-f99a-416a-9ed9-7abd66b62cd1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131673 Aug 27 03:17:43.529308 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1215/2369] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:43.553551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13cdb6f4-e907-4043-bf87-195a3756f38a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4576448b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:43.636742 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13cdb6f4-e907-4043-bf87-195a3756f38a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.101261 Aug 27 03:17:43.637413 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1216/2370] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:43 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:43.655503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:43.658446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:43.679594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.680918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.681114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.682525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.686094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.686563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.690613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:43.699925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eb63db77-0738-48ba-ae21-f60ed288ff4b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.860992 Aug 27 03:17:43.706132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1155/2371] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:42 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:43.730360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:43.732400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:43.740982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.742530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.743434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.744419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.745067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.745679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.835758 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b446b89-f583-4f7b-b45a-4d46be557104 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190197 Aug 27 03:17:43.836780 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1217/2372] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:17:43 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:44.652455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e28710ed-57c4-4b26-a68d-833dbebc5112 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457644040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:44.742608 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e28710ed-57c4-4b26-a68d-833dbebc5112 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.094681 Aug 27 03:17:44.743190 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1218/2373] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:44 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:44.882984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:44.895823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b8f1c7c-4346-4355-bac5-d6bf0e886f9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.170496 Aug 27 03:17:44.896420 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1156/2374] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:43 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:45.216213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-506f2bd7-7eb9-41f4-a1cd-201418c91b22 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716838756", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-506f2bd7-7eb9-41f4-a1cd-201418c91b22 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 491 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716838756", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-716838756', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:45.242894 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 03:17:45.245727 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:45.251368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-506f2bd7-7eb9-41f4-a1cd-201418c91b22 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:45.254550 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-506f2bd7-7eb9-41f4-a1cd-201418c91b22 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.042544 Aug 27 03:17:45.255614 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1219/2375] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:45 2022] POST /compute/v2.1/servers => generated 624 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:45.271751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:45.272655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:45.304363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:45.309378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:45.310020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:45.310939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:45.311541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:45.312118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:45.759120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a39861c-133f-4ef7-9803-e0ba67a1b217 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45c74f670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:45.861348 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a39861c-133f-4ef7-9803-e0ba67a1b217 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.107428 Aug 27 03:17:45.862227 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1220/2376] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:45 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:46.245743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:46.261474 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-582d6e15-1af9-42ea-941e-4c859c29ff4c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.001571 Aug 27 03:17:46.262079 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1157/2377] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:45 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:46.287717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:46.288703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:46.295439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.296255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.296972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.298105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.298939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.299586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:47.201522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ff805fcb-5bc7-4b95-92d7-d83aca3d3674 req-61d47f8a-dd34-47dc-88e7-633e8f1580bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa9a826-8f42-4671-86f6-9ee58104324a", "tag": "daafd905-5453-4802-900a-ba4556bb1f8b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:47.234537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ff805fcb-5bc7-4b95-92d7-d83aca3d3674 req-61d47f8a-dd34-47dc-88e7-633e8f1580bd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:47.235652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ff805fcb-5bc7-4b95-92d7-d83aca3d3674 req-61d47f8a-dd34-47dc-88e7-633e8f1580bd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:47.243266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ff805fcb-5bc7-4b95-92d7-d83aca3d3674 req-61d47f8a-dd34-47dc-88e7-633e8f1580bd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:47.270822 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ff805fcb-5bc7-4b95-92d7-d83aca3d3674 req-61d47f8a-dd34-47dc-88e7-633e8f1580bd service nova] Creating event network-changed:daafd905-5453-4802-900a-ba4556bb1f8b for instance 1fa9a826-8f42-4671-86f6-9ee58104324a on n-h1-852086-5 Aug 27 03:17:47.276538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ff805fcb-5bc7-4b95-92d7-d83aca3d3674 req-61d47f8a-dd34-47dc-88e7-633e8f1580bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.655412 Aug 27 03:17:47.277807 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1158/2378] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:47.295961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02ffab37-2d60-4ddd-8081-ae0940aea2a1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457c5fe50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:47.443338 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02ffab37-2d60-4ddd-8081-ae0940aea2a1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.162443 Aug 27 03:17:47.456560 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1159/2379] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:47 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:47.489367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:47.490278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:47.501791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:47.511122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:47.514389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:47.515457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:47.518890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:47.522778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:47.719945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:47.723136 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4ac3445-02b0-4dbf-84ab-76d1ca0ba290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.439512 Aug 27 03:17:47.726298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1221/2380] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:46 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:47.740068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-059057cb-0a31-48e6-bfd5-2754961be978 req-97edbd5d-62ae-4d04-a563-fa9493c18b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cec7abf-9e6e-4d3d-b51f-e094cc90c757", "tag": "bcbc0986-64a0-4448-ba2f-5fa0fc95e78d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:47.769191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-059057cb-0a31-48e6-bfd5-2754961be978 req-97edbd5d-62ae-4d04-a563-fa9493c18b0c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:47.769907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-059057cb-0a31-48e6-bfd5-2754961be978 req-97edbd5d-62ae-4d04-a563-fa9493c18b0c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:47.772840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-059057cb-0a31-48e6-bfd5-2754961be978 req-97edbd5d-62ae-4d04-a563-fa9493c18b0c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:47.805817 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-059057cb-0a31-48e6-bfd5-2754961be978 req-97edbd5d-62ae-4d04-a563-fa9493c18b0c service nova] Creating event network-changed:bcbc0986-64a0-4448-ba2f-5fa0fc95e78d for instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 on n-h2-852086-5 Aug 27 03:17:47.821956 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-059057cb-0a31-48e6-bfd5-2754961be978 req-97edbd5d-62ae-4d04-a563-fa9493c18b0c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093119 Aug 27 03:17:47.823680 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1222/2381] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:48.065398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88c2cb6e-e2cd-4095-80c8-4625e5724dd6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88c2cb6e-e2cd-4095-80c8-4625e5724dd6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 416 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:48.076764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88c2cb6e-e2cd-4095-80c8-4625e5724dd6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88c2cb6e-e2cd-4095-80c8-4625e5724dd6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018845 Aug 27 03:17:48.080162 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1223/2382] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:48 2022] POST /compute/v2.1/servers => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:17:48.105482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:48.108401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:48.133821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.135211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.136601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.140992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:48.142403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:48.144064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:48.435626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:48.457773 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d3ed8fc6-d8a8-481b-b167-dd29b1bd1319 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1589 microversion: 2.1 time: 0.971475 Aug 27 03:17:48.471052 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1160/2383] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:47 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1589 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:48.484338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aad631f2-dbd9-4887-839b-4a93833432f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457c5f1f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:48.571398 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aad631f2-dbd9-4887-839b-4a93833432f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.103926 Aug 27 03:17:48.582649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1161/2384] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:48 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:49.589771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75fb5c30-5f6c-4bf9-8a5c-1c39a123e508 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4579b9940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:49.733498 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-75fb5c30-5f6c-4bf9-8a5c-1c39a123e508 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.149108 Aug 27 03:17:49.746320 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1162/2385] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:49 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:50.159335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:50.168989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1484ecfa-1d9a-4b70-8931-7eee366dfa2e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 2.083054 Aug 27 03:17:50.174653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1224/2386] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:48 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:50.206608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:50.207659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:50.236583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:50.241360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:50.247861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:50.250633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:50.259041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:50.261650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:50.992381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:51.013245 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21abe526-8900-4281-8017-d8aca03b60b6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.814688 Aug 27 03:17:51.014426 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1163/2387] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:50 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:51.028304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bbab9067-0c90-4fd3-8824-2897edd009d0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457b46310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:51.051803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1414394651", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:51.101965 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bbab9067-0c90-4fd3-8824-2897edd009d0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.086011 Aug 27 03:17:51.103235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1164/2388] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:51 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:51.223354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:51.445753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b504dda-edc6-4a98-ad81-756e7a030025 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1674556578", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": -1, "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:51.482087 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-8b504dda-edc6-4a98-ad81-756e7a030025 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Flavor -1 could not be found. Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b504dda-edc6-4a98-ad81-756e7a030025 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 206 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1674556578", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": -1, "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: exception: Flavor -1 could not be found. Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1674556578', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': -1, 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:51.492489 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 27 03:17:51.497119 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:51.506078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b504dda-edc6-4a98-ad81-756e7a030025 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:51.507866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b504dda-edc6-4a98-ad81-756e7a030025 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.067636 Aug 27 03:17:51.510457 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1165/2389] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:51 2022] POST /compute/v2.1/servers => generated 73 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 27 03:17:51.519639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:51.525772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:51.545331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:51.547031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:51.547031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:51.551359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:51.555211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:51.555211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:51.852379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:51.853091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:51.853732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:51.854335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:51.855188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:51.887816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:51.888561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:51.889194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:51.890120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:51.892128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:51.895476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:51.927132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:51.944260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Getting quotas for project de1329a1582244cc90f93dd4505d8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:51.954355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Getting quotas for user 95f6c82eb1a54e42a0d269ad4974b036 and project de1329a1582244cc90f93dd4505d8d54. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:51.972609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:51.975411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:52.010849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-15ab6c0d-4f1b-4b0d-8adf-e2a33001924e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.495250 Aug 27 03:17:52.023748 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1166/2390] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:51 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:52.056176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:52.057668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:52.071241 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3d4573f-5273-4847-9a98-3181be894a65 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409080 Aug 27 03:17:52.085691 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1225/2391] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:17:52.085910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:52.085910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:52.085910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:52.085910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:52.091710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:52.101792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:52.101948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1292d20a-f3e4-425a-9f61-23b9a3f4b3aa tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:52.101948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1292d20a-f3e4-425a-9f61-23b9a3f4b3aa tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:52.275219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1292d20a-f3e4-425a-9f61-23b9a3f4b3aa tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:52.293159 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1292d20a-f3e4-425a-9f61-23b9a3f4b3aa tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1223 microversion: 2.1 time: 0.202935 Aug 27 03:17:52.299000 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1226/2392] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:52 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1223 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:52.319238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88b470da-9b73-4c26-aae1-68e119affd97 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457662b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:52.416684 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88b470da-9b73-4c26-aae1-68e119affd97 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.116216 Aug 27 03:17:52.417407 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1227/2393] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:52 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:52.443134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:53.145638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:53.171711 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b9b2e7ad-3ab2-4114-a93a-2b37731ca956 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.128418 Aug 27 03:17:53.181536 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1167/2394] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:52 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:53.324587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13903b47-b30a-43ec-889a-2d36106d5d41 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:53.325383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13903b47-b30a-43ec-889a-2d36106d5d41 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:53.359146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a74de5d-e733-4e88-8138-211ae6d3a4ef tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-145372862", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a74de5d-e733-4e88-8138-211ae6d3a4ef tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 172 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-145372862", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-145372862', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi -1 Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:17:53.365002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:53.372371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a74de5d-e733-4e88-8138-211ae6d3a4ef tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:53.376549 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a74de5d-e733-4e88-8138-211ae6d3a4ef tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020245 Aug 27 03:17:53.385938 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1168/2395] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:53 2022] POST /compute/v2.1/servers => generated 145 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:53.396167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:53.399435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:53.423444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:53.427904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:53.428708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:53.429729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:53.431634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:53.436391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:53.993215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13903b47-b30a-43ec-889a-2d36106d5d41 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:54.003147 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13903b47-b30a-43ec-889a-2d36106d5d41 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1223 microversion: 2.1 time: 0.686578 Aug 27 03:17:54.006802 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1228/2396] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:53 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1223 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:54.025763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-952fc274-161f-4b88-b338-ce572dc8f385 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457644430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:54.137830 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-952fc274-161f-4b88-b338-ce572dc8f385 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.129692 Aug 27 03:17:54.140970 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1229/2397] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:54 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:54.255560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:54.270697 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11264658-ff75-42e7-8182-f9b2972bffc8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.879088 Aug 27 03:17:54.274975 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1169/2398] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:53 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:54.299082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:54.299696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:54.320211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:54.330857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:54.331623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:54.332158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:54.332634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:54.340245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:54.899190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:54.917106 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2576ea90-3683-4144-95a9-1d6b36393c10 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.621476 Aug 27 03:17:54.928455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1230/2399] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:54 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:55.046742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.047632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:55.057326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:55.072197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.073837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.076253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.077185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.078608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.080309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.145526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7faecbe-db1e-4a38-bf25-665e946990f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1957678568", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:55.153848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e7faecbe-db1e-4a38-bf25-665e946990f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7faecbe-db1e-4a38-bf25-665e946990f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 216 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1957678568", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1957678568', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:55.163771 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:17:55.167594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7faecbe-db1e-4a38-bf25-665e946990f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:55.168915 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7faecbe-db1e-4a38-bf25-665e946990f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.031185 Aug 27 03:17:55.171573 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1231/2400] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:55 2022] POST /compute/v2.1/servers => generated 123 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:17:55.187596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-425abaf4-dc96-416f-ae97-30ab7347f7f2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45765d790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.293231 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-425abaf4-dc96-416f-ae97-30ab7347f7f2 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.119472 Aug 27 03:17:55.295288 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1232/2401] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:55 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:55.307456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.310481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:55.337536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.339962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.342969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.344681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.346229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.353177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.515238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:55.531573 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b423877b-c40a-49d0-8085-fde91aad0f27 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1275 microversion: 2.1 time: 0.499478 Aug 27 03:17:55.536293 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1170/2402] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:55 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1275 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:56.216942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:56.228665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dab07344-33c8-4dc1-aaef-786d8bc902f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.931204 Aug 27 03:17:56.251594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:56.252670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:56.260083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1233/2403] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:55 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:56.273788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.274842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.275533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.276802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.284316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-552879791", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "c8c11a45-894a-4e37-be1c-506a3648b99f"}, {"uuid": "c779baa2-e544-4d18-8a4d-016c7510c623"}, {"uuid": "c8c11a45-894a-4e37-be1c-506a3648b99f"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:56.285276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.285873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.374565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] validate_networks() for [('c8c11a45-894a-4e37-be1c-506a3648b99f', None, None, None, None, None), ('c779baa2-e544-4d18-8a4d-016c7510c623', None, None, None, None, None), ('c8c11a45-894a-4e37-be1c-506a3648b99f', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:56.509630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:56.525532 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d6ea1fee-eeef-4a83-85be-b862a6e6120e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.279103 Aug 27 03:17:56.552466 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1171/2404] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:56 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:56.561759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eed6b83c-01ca-421c-8599-7628088eb8f4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457cad280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:56.633439 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eed6b83c-01ca-421c-8599-7628088eb8f4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.079360 Aug 27 03:17:56.634411 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1172/2405] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:56 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:56.658849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:56.662526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:56.674294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.675167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.675951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.677741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.678728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.679411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.857159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:56.874312 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-08543163-1d4e-4112-b091-c08ca329a23b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1281 microversion: 2.1 time: 0.222448 Aug 27 03:17:56.875484 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1173/2406] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:56 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:56.889866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7d729cb-7a16-4414-a46a-ecae89b17f59 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-452989021", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-key-2100424632", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:56.991571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-f7d729cb-7a16-4414-a46a-ecae89b17f59 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] validate_networks() for [('543c57a2-cb9a-4ef1-87c5-f860c6ad661a', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:57.422015 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f7d729cb-7a16-4414-a46a-ecae89b17f59 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Invalid key_name provided. Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7d729cb-7a16-4414-a46a-ecae89b17f59 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 246 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-452989021", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-key-2100424632", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid key_name provided. Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-452989021', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'key_name': 'tempest-key-2100424632', 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2100424632 not found for user f573336900c6439d94e03ab2db24a931 Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:57.424243 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 27 03:17:57.428835 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:57.431689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7d729cb-7a16-4414-a46a-ecae89b17f59 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid key_name provided. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:57.441245 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f7d729cb-7a16-4414-a46a-ecae89b17f59 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.563867 Aug 27 03:17:57.442529 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1174/2407] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:56 2022] POST /compute/v2.1/servers => generated 70 bytes in 566 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:57.450403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:57.451240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:57.470863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.471565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.472296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.473167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.473863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.474452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.513478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:57.743762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:57.754968 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83e19d3c-3289-4730-892d-da14f2824388 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.308495 Aug 27 03:17:57.773671 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1175/2408] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:57 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:57.779109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-241bb2b0-228f-4919-b595-5d84bd2c4e9e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457b57430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:57.841623 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-241bb2b0-228f-4919-b595-5d84bd2c4e9e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.066499 Aug 27 03:17:57.851025 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1176/2409] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:57 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:57.856840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:57.859445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:57.873484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.874099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.874575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.875381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.876491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.877098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.125439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:58.148610 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-26c1db29-6033-451e-a4eb-a64fc7af9062 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.296371 Aug 27 03:17:58.149212 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1177/2410] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:57 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:58.193089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:58.193726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:58.202419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.202928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.203374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.204201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.204676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.205114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.401333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:58.432600 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3c8ef620-e055-4ba5-a74e-e119df7fda8f tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1281 microversion: 2.1 time: 0.266183 Aug 27 03:17:58.433232 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1178/2411] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:58 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1281 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:58.438009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d94d9a0b-3ebb-443a-88f1-7120a5ca324f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1002369232", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:58.681900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.security_group_api [None req-d94d9a0b-3ebb-443a-88f1-7120a5ca324f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Neutron security group does_not_exist not found {{(pid=122407) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 27 03:17:58.682507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d94d9a0b-3ebb-443a-88f1-7120a5ca324f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d94d9a0b-3ebb-443a-88f1-7120a5ca324f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 258 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1002369232", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1002369232', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 27 03:17:58.691842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 27 03:17:58.696290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:58.701532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d94d9a0b-3ebb-443a-88f1-7120a5ca324f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:58.702718 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d94d9a0b-3ebb-443a-88f1-7120a5ca324f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.268454 Aug 27 03:17:58.703454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1179/2412] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:17:58.713367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:58.723476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:58.731549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.735914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.739471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.744218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.744807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.749207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.991421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:58.999686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11bf0825-205c-4316-9855-281673737aad tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.291389 Aug 27 03:17:59.000464 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1180/2413] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:58 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:59.005312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5e6645cf-55ba-46ad-b970-f184f7220408 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457b571f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.101422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5e6645cf-55ba-46ad-b970-f184f7220408 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.099657 Aug 27 03:17:59.102218 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1181/2414] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:59.119986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.120405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.132908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.133463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.133916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.134679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.136533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.137276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.467022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:59.478895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6f92d18-f102-4d0d-888e-56e59898a474 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.368357 Aug 27 03:17:59.480306 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1182/2415] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:59.486467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.487340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.504319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.513597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.514387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.516964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.523023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.523835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.659610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:59.676643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad869f61-60d6-4dc7-9965-eb48089155f4 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1281 microversion: 2.1 time: 0.191110 Aug 27 03:17:59.677344 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1183/2416] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:59.703214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5871a4e1-d7c5-45bc-92ba-c294caed29d7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.703656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5871a4e1-d7c5-45bc-92ba-c294caed29d7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 34da721c-9d12-4341-9b98-b12b180c0d93] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.718167 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-5871a4e1-d7c5-45bc-92ba-c294caed29d7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 34da721c-9d12-4341-9b98-b12b180c0d93 could not be found. Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5871a4e1-d7c5-45bc-92ba-c294caed29d7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/34da721c-9d12-4341-9b98-b12b180c0d93 HTTP/1.1 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 34da721c-9d12-4341-9b98-b12b180c0d93 could not be found. Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '34da721c-9d12-4341-9b98-b12b180c0d93'} Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34da721c-9d12-4341-9b98-b12b180c0d93 could not be found. Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34da721c-9d12-4341-9b98-b12b180c0d93 could not be found. Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.721790 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34da721c-9d12-4341-9b98-b12b180c0d93 could not be found. Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:17:59.727345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5871a4e1-d7c5-45bc-92ba-c294caed29d7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 34da721c-9d12-4341-9b98-b12b180c0d93 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:59.728401 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5871a4e1-d7c5-45bc-92ba-c294caed29d7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "DELETE /compute/v2.1/servers/34da721c-9d12-4341-9b98-b12b180c0d93" status: 404 len: 111 microversion: 2.1 time: 0.049595 Aug 27 03:17:59.732034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1184/2417] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:59 2022] DELETE /compute/v2.1/servers/34da721c-9d12-4341-9b98-b12b180c0d93 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:59.751716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.752363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.760635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.764075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.764583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.768285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.768998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.769597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.089913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:00.103074 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5d231e1-3390-48a2-82b4-1e004723587d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.368907 Aug 27 03:18:00.103696 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1185/2418] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:00.118298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5551e9a2-47ff-4c32-97e9-fcff130faa39 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4578ed0d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:00.211791 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5551e9a2-47ff-4c32-97e9-fcff130faa39 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.098037 Aug 27 03:18:00.222383 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1186/2419] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:00 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:00.227638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:00.228450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:00.235309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.236757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.237638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.238596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.239223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.239890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.470238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:00.486007 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2bb3e3d3-61b5-4304-92a5-14f590d699c0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.261940 Aug 27 03:18:00.487043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1187/2420] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:00 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:00.510394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-360f2b6b-d469-4734-8871-5fc742506296 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:00.510891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-360f2b6b-d469-4734-8871-5fc742506296 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:18:00.511571 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-360f2b6b-d469-4734-8871-5fc742506296 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-360f2b6b-d469-4734-8871-5fc742506296 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 9223372036854775808 could not be found. Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '9223372036854775808'} Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:00.513359 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-360f2b6b-d469-4734-8871-5fc742506296 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-360f2b6b-d469-4734-8871-5fc742506296 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009487 Aug 27 03:18:00.518211 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1188/2421] 10.222.0.69 () {58 vars in 1188 bytes} [Sat Aug 27 03:18:00 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:18:00.525089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:00.526280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:00.537039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.537620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.538138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.539020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.539598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.540291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:01.482441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:01.498673 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ce55790-0848-44dc-91a6-39aad6bb0883 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.977168 Aug 27 03:18:01.501733 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1189/2422] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:00 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:01.507996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:01.508796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:01.544978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:01.546601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:01.547079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:01.550721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:01.552720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:01.553251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:01.932422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:02.085315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:18:02.085745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:18:02.086347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:18:02.087485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:18:02.087967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:18:02.114485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.115113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.115568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.116391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.116855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.122617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.176895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=7,nova_api:INSERT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:02.192425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Getting quotas for project 2322c18d287b49b3839208e66ea07871. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:18:02.212843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Getting quotas for user 0be937d33b6d40daba326e75e6eb35b6 and project 2322c18d287b49b3839208e66ea07871. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:18:02.247531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:18:02.257468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:18:02.325700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:02.335843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5fa640b-d7fa-4df5-9703-aea86c9207a7 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 0.831786 Aug 27 03:18:02.341076 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1190/2423] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:01 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:02.347547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-de6e8da0-6c21-4247-b47e-256762ba98d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457b575e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:02.367209 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74bfc520-7b51-45c6-bb96-363562b241f6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.088600 Aug 27 03:18:02.371762 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1234/2424] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 6094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:18:02.387016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:02.389810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:02.404113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.407138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.408788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.409890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.412231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.413403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.453715 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-de6e8da0-6c21-4247-b47e-256762ba98d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.111221 Aug 27 03:18:02.457571 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1191/2425] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:02 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:02.477065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b8d1fed-72e4-4144-a34e-97bf0b24b1cd tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:02.480561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3b8d1fed-72e4-4144-a34e-97bf0b24b1cd tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:02.620278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b8d1fed-72e4-4144-a34e-97bf0b24b1cd tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:02.641578 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b8d1fed-72e4-4144-a34e-97bf0b24b1cd tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1212 microversion: 2.1 time: 0.173492 Aug 27 03:18:02.642209 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1192/2426] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:02 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1212 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:03.371023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:03.373322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:03.413679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.417113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.419793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.421114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.421905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.422789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.619580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:03.640402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09133be9-8d95-4029-a7e1-df714bbb00a8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.265797 Aug 27 03:18:03.649053 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1235/2427] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:02 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:03.689727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e668694-26fd-43df-928e-4734ac73624c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4576621f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:03.796228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e668694-26fd-43df-928e-4734ac73624c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.141996 Aug 27 03:18:03.797007 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1236/2428] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:03.802703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:03.814446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:03.827011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.830454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.831215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.833686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.838628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.841600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.859808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:04.062919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:04.082848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-359451bf-b82c-4dfc-9fde-56704fc4eaff tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1208 microversion: 2.1 time: 0.276754 Aug 27 03:18:04.102201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1237/2429] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1208 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:04.104369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44c2d25b-3bdf-4e66-a862-bc5e78a218f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:04.117199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44c2d25b-3bdf-4e66-a862-bc5e78a218f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Failed to fetch instance by id -1 {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:18:04.117199 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-44c2d25b-3bdf-4e66-a862-bc5e78a218f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance -1 could not be found. Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44c2d25b-3bdf-4e66-a862-bc5e78a218f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance -1 could not be found. Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '-1'} Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:04.121512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:04.125337 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:04.125337 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:04.125337 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 27 03:18:04.125337 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:04.125337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44c2d25b-3bdf-4e66-a862-bc5e78a218f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:04.133509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44c2d25b-3bdf-4e66-a862-bc5e78a218f6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.044748 Aug 27 03:18:04.139283 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1238/2430] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:18:04 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:18:04.155112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:04.157346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:04.178328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.183107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.184620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.186310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.190428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.192279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.545808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:04.578002 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-70ba0041-6273-4517-98c0-42153a524b4c tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 1.216624 Aug 27 03:18:04.584446 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1193/2431] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:04.814649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c4e20711-7786-41d4-9ea2-67a7e7e3c99b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457cfe700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:04.916600 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c4e20711-7786-41d4-9ea2-67a7e7e3c99b tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.107776 Aug 27 03:18:04.917196 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1194/2432] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:04 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:05.124977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:05.125644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:05.160742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.161164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.161863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:05.162647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.163100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.163535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:05.564215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:05.580400 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b789a01d-ee16-44b4-a34f-b89ac040d579 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.438088 Aug 27 03:18:05.584133 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1239/2433] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:04 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:05.609655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:05.629307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:05.637263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.637911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.639122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:05.640141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.641032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.641782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:05.661148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:05.705385 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4bb310b1-2547-4250-a4d8-985031c4b1b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1272 microversion: 2.1 time: 0.584259 Aug 27 03:18:05.721006 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1195/2434] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:05 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1272 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:05.731876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:05.745994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:05.776194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.776704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.777353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:05.782816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.784467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.785126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:06.504667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:06.525081 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-155e5bcf-edd8-45a9-a5c4-8da1b88e81cc tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 0.791632 Aug 27 03:18:06.541578 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1196/2435] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:05 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:06.560858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4a216a6-ce9f-4bb0-9928-76293288d00a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457ceff70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:06.739080 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4a216a6-ce9f-4bb0-9928-76293288d00a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.194760 Aug 27 03:18:06.749352 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1197/2436] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:06 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:06.764438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:06.765101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:06.782856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:06.783259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:06.783911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:06.785812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:06.787500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:06.788876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:06.941850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:06.951380 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-169d16cd-460d-4d58-aaad-12ed3a8e103f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1270 microversion: 2.1 time: 0.200064 Aug 27 03:18:06.960936 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1198/2437] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:06 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:07.205625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-da67db23-b9a0-46cb-b7c9-f5d86004c8ca req-2b922d39-b3c9-42ba-8039-8cc61a1a96f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7457b06d-7a91-474d-9e62-ef9cc23e1532", "tag": "3b56ae7c-2321-45e6-9685-c9f59df3616a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:07.223533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-da67db23-b9a0-46cb-b7c9-f5d86004c8ca req-2b922d39-b3c9-42ba-8039-8cc61a1a96f0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:07.224369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-da67db23-b9a0-46cb-b7c9-f5d86004c8ca req-2b922d39-b3c9-42ba-8039-8cc61a1a96f0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:07.224992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-da67db23-b9a0-46cb-b7c9-f5d86004c8ca req-2b922d39-b3c9-42ba-8039-8cc61a1a96f0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:07.250025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-da67db23-b9a0-46cb-b7c9-f5d86004c8ca req-2b922d39-b3c9-42ba-8039-8cc61a1a96f0 service nova] Creating event network-changed:3b56ae7c-2321-45e6-9685-c9f59df3616a for instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 on n-h1-852086-5 Aug 27 03:18:07.258076 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-da67db23-b9a0-46cb-b7c9-f5d86004c8ca req-2b922d39-b3c9-42ba-8039-8cc61a1a96f0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281874 Aug 27 03:18:07.259025 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1199/2438] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:07.326767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1678805308", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:07.440305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] validate_networks() for [('ee38ca48-4578-40d2-987e-f09e962a43f0', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:18:07.671711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:07.682137 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-037d0429-53e3-4f1b-adea-1800b59a52c6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 2.078539 Aug 27 03:18:07.688402 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1240/2439] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:05 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:07.694925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:07.709614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:07.725637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:07.725637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:07.725637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:07.725637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:07.725637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:07.725637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.295852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:08.315952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78d7c704-2824-40c2-8e5d-3e559add7cc5 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 0.624511 Aug 27 03:18:08.320403 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1241/2440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:07 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:08.328835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7178a4c-2208-45f0-843f-a0e5cac8c7ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:08.329969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7178a4c-2208-45f0-843f-a0e5cac8c7ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 3b9bdabe-a619-4dd3-a2be-335874db4e55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:08.339272 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c7178a4c-2208-45f0-843f-a0e5cac8c7ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 3b9bdabe-a619-4dd3-a2be-335874db4e55 could not be found. Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7178a4c-2208-45f0-843f-a0e5cac8c7ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/3b9bdabe-a619-4dd3-a2be-335874db4e55/action HTTP/1.1 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 19 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: {"forceDelete": {}} Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 3b9bdabe-a619-4dd3-a2be-335874db4e55 could not be found. Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3b9bdabe-a619-4dd3-a2be-335874db4e55', 'body': {'forceDelete': {}}} Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9bdabe-a619-4dd3-a2be-335874db4e55 could not be found. Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9bdabe-a619-4dd3-a2be-335874db4e55 could not be found. Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:08.354816 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:08.359539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:08.359539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:08.359539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9bdabe-a619-4dd3-a2be-335874db4e55 could not be found. Aug 27 03:18:08.359539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.361723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7178a4c-2208-45f0-843f-a0e5cac8c7ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 3b9bdabe-a619-4dd3-a2be-335874db4e55 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:08.363053 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7178a4c-2208-45f0-843f-a0e5cac8c7ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/3b9bdabe-a619-4dd3-a2be-335874db4e55/action" status: 404 len: 111 microversion: 2.1 time: 0.040975 Aug 27 03:18:08.365227 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1242/2441] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:08 2022] POST /compute/v2.1/servers/3b9bdabe-a619-4dd3-a2be-335874db4e55/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:08.369159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:18:08.369800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:18:08.370035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:18:08.370511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:18:08.370954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:18:08.376388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6cc54ed-d1dd-4576-aa22-eb4f8d3aeaa7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45c02d160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:08.403769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.404268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.404712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.405470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.405937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.406437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.456924 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6cc54ed-d1dd-4576-aa22-eb4f8d3aeaa7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.089529 Aug 27 03:18:08.458701 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1243/2442] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:08 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:08.460618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Getting quotas for project d1a1f246bf06452ab64f19476541aa83. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:18:08.467845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Getting quotas for user 76282303a21c4d089663c41ee454febf and project d1a1f246bf06452ab64f19476541aa83. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:18:08.497592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:18:08.504966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:18:08.618453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ab876fd-4d42-4451-8f16-5a9842543718 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Action: 'create', calling method: .version_select at 0x7fe457d0c280>, body: {"keypair": {"name": "tempest-keypair-509894303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiVhJCRttyU/58i9ru9RqjfdLs2hIo/ymxYukEKOlTg0kJ0HtnyNFP/twg9PHzDlM1eWhIQ/WM+GMvUG3LkQbAIRaqKn+foPYJEv1dhg4hUGYBi9cxXJh47qBM3k4VadQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:08.642330 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9dd2b461-f6be-4c4c-a323-f34acbd1fbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381480 Aug 27 03:18:08.655589 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1200/2443] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:18:08.674118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:08.690498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3ab876fd-4d42-4451-8f16-5a9842543718 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Getting quotas for project 9da3b3a423b540d2a9962edeb643056d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:18:08.691609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:08.711413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.713183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.713800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.714754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.715375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.715980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.738052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3ab876fd-4d42-4451-8f16-5a9842543718 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Getting quotas for user 8e7f693d615e4882be652a94ebe25854 and project 9da3b3a423b540d2a9962edeb643056d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:18:08.874582 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ab876fd-4d42-4451-8f16-5a9842543718 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.411842 Aug 27 03:18:08.880368 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1244/2444] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:18:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:08.909137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:08.918702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:08.921347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:08.926577 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2ce45ab3-4fa8-4633-9ba4-e4a300aef99f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1270 microversion: 2.1 time: 0.268313 Aug 27 03:18:08.927173 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1201/2445] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:08 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1270 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:08.944421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.949274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.950454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.951928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.955724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.960657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.961946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62f4b3eb-232d-498f-9d53-ff2f166dcbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:08.962609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62f4b3eb-232d-498f-9d53-ff2f166dcbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:09.162768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-62f4b3eb-232d-498f-9d53-ff2f166dcbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:09.174810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62f4b3eb-232d-498f-9d53-ff2f166dcbd3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1224 microversion: 2.1 time: 0.225037 Aug 27 03:18:09.175405 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1202/2446] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:08 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1224 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:09.339895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:09.340549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:09.359269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.363456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.364334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:09.376847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.377825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.378546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:09.637064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:09.654887 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0255619c-3601-4bdb-9344-746d8a898ac9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.760703 Aug 27 03:18:09.655642 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1245/2447] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:08 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:09.670419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61256443-2c5b-405c-89ed-80e5b1586db1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45c543700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:09.742704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:09.757328 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e09ea24-b534-48d5-b810-fe1c05747338 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 0.421588 Aug 27 03:18:09.764558 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1203/2448] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:09 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:09.782084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:09.783504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:09.802237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.802743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.803212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:09.803938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.804405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.804917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:09.848741 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61256443-2c5b-405c-89ed-80e5b1586db1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.186774 Aug 27 03:18:09.851698 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1246/2449] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:09 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:09.867368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:09.948576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:09.949294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:09.961841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.968288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.969042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:09.977095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.987281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.988308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.196672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:10.213113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a6714ff-019a-4ac3-ba86-3709026266b8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.443522 Aug 27 03:18:10.215005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1204/2450] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:09 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:10.246472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:10.247282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:10.256247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.256857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.257325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.258052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.258536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.258965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.416264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:10.433091 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62d33d40-23f3-4af1-8043-8ab38c1f1e34 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1220 microversion: 2.1 time: 0.202787 Aug 27 03:18:10.434532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1205/2451] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:10 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1220 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:10.442346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6b016ec-f614-4b0a-b22b-2f8a00a3a0c4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:10.445485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f6b016ec-f614-4b0a-b22b-2f8a00a3a0c4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 21dc319c-0c26-434b-83f5-4a8231ae0fe0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:10.456437 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f6b016ec-f614-4b0a-b22b-2f8a00a3a0c4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 21dc319c-0c26-434b-83f5-4a8231ae0fe0 could not be found. Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6b016ec-f614-4b0a-b22b-2f8a00a3a0c4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/21dc319c-0c26-434b-83f5-4a8231ae0fe0/action HTTP/1.1 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 39 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: {"os-getConsoleOutput": {"length": 10}} Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 21dc319c-0c26-434b-83f5-4a8231ae0fe0 could not be found. Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '21dc319c-0c26-434b-83f5-4a8231ae0fe0', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21dc319c-0c26-434b-83f5-4a8231ae0fe0 could not be found. Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21dc319c-0c26-434b-83f5-4a8231ae0fe0 could not be found. Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:10.476347 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:10.482637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:10.482637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:10.482637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:10.482637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:10.482637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21dc319c-0c26-434b-83f5-4a8231ae0fe0 could not be found. Aug 27 03:18:10.482637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:10.482637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6b016ec-f614-4b0a-b22b-2f8a00a3a0c4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 21dc319c-0c26-434b-83f5-4a8231ae0fe0 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:10.488228 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6b016ec-f614-4b0a-b22b-2f8a00a3a0c4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/21dc319c-0c26-434b-83f5-4a8231ae0fe0/action" status: 404 len: 111 microversion: 2.1 time: 0.049316 Aug 27 03:18:10.489899 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1206/2452] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:10 2022] POST /compute/v2.1/servers/21dc319c-0c26-434b-83f5-4a8231ae0fe0/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:10.499739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:10.500678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:10.515930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.521087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.522668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.524696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.527289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.528317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.742582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:10.760141 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f07a842-8fa7-4bed-8e77-61e2603ee0b7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1312 microversion: 2.1 time: 0.816406 Aug 27 03:18:10.774196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1247/2453] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:09 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1312 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:10.789915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:10.794494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:10.800570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:10.809938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.820309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.820585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6adeb7fa-1728-4f28-99fa-9eb1c5444968 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.315982 Aug 27 03:18:10.821233 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1207/2454] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:10 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:10.834356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.834356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.834356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.834356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.858482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:10.864220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:10.885787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.894879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.895718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.896606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:10.897093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:10.897531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:11.358114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:11.367498 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-db288b21-8ac4-442f-9be9-ea1248130a6a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.526718 Aug 27 03:18:11.368295 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1208/2455] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:10 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:11.404838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e92e0bff-83f9-4d6b-b923-b8988f44b899 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4578d3700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:11.484540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e92e0bff-83f9-4d6b-b923-b8988f44b899 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.100649 Aug 27 03:18:11.486226 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1209/2456] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:11 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:11.501611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-034dca43-8a50-403e-b592-90e69c51cf7b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:11.515669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-034dca43-8a50-403e-b592-90e69c51cf7b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: c3829885-c0e9-4ed7-aa8e-65b7ead6556e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:11.557290 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-034dca43-8a50-403e-b592-90e69c51cf7b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance c3829885-c0e9-4ed7-aa8e-65b7ead6556e could not be found. Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-034dca43-8a50-403e-b592-90e69c51cf7b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/c3829885-c0e9-4ed7-aa8e-65b7ead6556e HTTP/1.1 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance c3829885-c0e9-4ed7-aa8e-65b7ead6556e could not be found. Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'c3829885-c0e9-4ed7-aa8e-65b7ead6556e'} Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3829885-c0e9-4ed7-aa8e-65b7ead6556e could not be found. Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3829885-c0e9-4ed7-aa8e-65b7ead6556e could not be found. Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:11.566264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:11.570414 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:11.570414 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:11.570414 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:11.570414 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3829885-c0e9-4ed7-aa8e-65b7ead6556e could not be found. Aug 27 03:18:11.570414 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:11.571566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-034dca43-8a50-403e-b592-90e69c51cf7b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance c3829885-c0e9-4ed7-aa8e-65b7ead6556e could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:11.572601 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-034dca43-8a50-403e-b592-90e69c51cf7b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/c3829885-c0e9-4ed7-aa8e-65b7ead6556e" status: 404 len: 111 microversion: 2.1 time: 0.075691 Aug 27 03:18:11.581062 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1210/2457] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:11 2022] GET /compute/v2.1/servers/c3829885-c0e9-4ed7-aa8e-65b7ead6556e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:11.612001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:11.621216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:11.649447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:11.652238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:11.655675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:11.664264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:11.675101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:11.675756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:11.866469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:11.877404 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c46de333-03c9-4d47-8ba8-7d644387bf7c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1294 microversion: 2.1 time: 0.294784 Aug 27 03:18:11.882996 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1211/2458] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:11 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1294 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:11.894589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:11.911709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:11.941717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:11.942641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:11.943373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:11.944143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:11.953005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:11.953735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:11.978210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:11.992987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-048e2349-7217-4261-afcb-6f50d0afff26 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 1.208102 Aug 27 03:18:11.997098 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1248/2459] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:10 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:12.007708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:12.010094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:12.051445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:12.052728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:12.054605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:12.055893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:12.066447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:12.067493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:12.166987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:12.538224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:12.550844 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b02db82-ec75-4207-9b4a-869d0dc2128b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1312 microversion: 2.1 time: 0.551482 Aug 27 03:18:12.568061 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1249/2460] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:11 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1312 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:12.574419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f21ae3e8-4845-419b-ba4b-33e4a2618a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4576b5d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:12.662140 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f21ae3e8-4845-419b-ba4b-33e4a2618a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1439 microversion: 2.1 time: 0.091796 Aug 27 03:18:12.664805 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1250/2461] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:12 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:12.908712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:12.909769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:12.927402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:12.927903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:12.928342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:12.929069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:12.929524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:12.929948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.230741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:13.247873 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50eac041-aae6-4d77-9f7d-7d1b63833b71 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1282 microversion: 2.1 time: 0.341048 Aug 27 03:18:13.259206 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1251/2462] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:12 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1282 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:13.276907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:13.277814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:13.328339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.330344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.333438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.334804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.336866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.342074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.749371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:13.761633 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8389c00-62d7-43a4-bb3e-3f3866052ac2 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 0.500751 Aug 27 03:18:13.775702 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1252/2463] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:13 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:13.783284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:13.783981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:13.791679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.792172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.793453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.794457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.795119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.796276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.959710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:13.968532 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c21b7a0c-50dc-4211-a661-751594bc3fb0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 2.084064 Aug 27 03:18:13.970359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1212/2464] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:11 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:13.979611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ebf3270-8cb1-46ff-9caa-e0407fd593b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457cf3a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:14.079837 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2ebf3270-8cb1-46ff-9caa-e0407fd593b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1448 microversion: 2.1 time: 0.106426 Aug 27 03:18:14.080466 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1213/2465] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:13 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1448 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:14.091581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:14.093932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:14.116091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:14.119523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:14.120249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:14.124592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:14.126976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:14.129047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:14.331050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:14.343134 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf1d9ca2-0a44-4208-bef7-48a22d6dc6e9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1333 microversion: 2.1 time: 0.564979 Aug 27 03:18:14.343998 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1253/2466] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:13 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1333 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:14.361937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abbe396f-bce5-40e3-b405-1b7d66e8afd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe46039b670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:14.434424 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abbe396f-bce5-40e3-b405-1b7d66e8afd5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 200 len: 1448 microversion: 2.1 time: 0.088430 Aug 27 03:18:14.444068 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1254/2467] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:14 2022] GET /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 1448 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:14.449672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:14.450587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:14.463437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:14.464171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:14.464882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:14.468105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:14.468885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:14.469599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:14.593157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:14.607701 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9a9d572-7c84-47ea-826d-7f06682a9637 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1282 microversion: 2.1 time: 0.162352 Aug 27 03:18:14.608648 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1255/2468] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:14 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:14.614335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a9bb9c7-b922-4e33-854f-aef9a7f6f340 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457d0c5e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:15.103253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:15.115458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e8d87563-f103-4a95-bfc1-b6e69fb2ec5d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.033700 Aug 27 03:18:15.116052 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1214/2469] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:14 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:15.134254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:15.134896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:15.168085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.168590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.169664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.169794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.170261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.185668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.652010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a9bb9c7-b922-4e33-854f-aef9a7f6f340 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 204 len: 0 microversion: 2.1 time: 1.041994 Aug 27 03:18:15.655748 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1256/2470] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:14 2022] DELETE /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:15.662335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5823a849-1d07-4144-a771-3b17fdf4fa14 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1307788420", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5823a849-1d07-4144-a771-3b17fdf4fa14 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 238 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1307788420", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1307788420', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.676533 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 03:18:15.681048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:15.683679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5823a849-1d07-4144-a771-3b17fdf4fa14 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:15.684966 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5823a849-1d07-4144-a771-3b17fdf4fa14 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028009 Aug 27 03:18:15.688502 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1257/2471] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:15 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:18:15.710542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:15.713163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:15.738700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.739535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.740192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.743167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.743956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.744978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.762575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:15.782875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f4cad2f-a282-4928-82b6-c8aead335224 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 0.650668 Aug 27 03:18:15.784865 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1215/2472] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:15 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:15.792784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:15.794129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:15.810007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.810545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.810999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.815600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.817043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.817520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.101240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:16.130278 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-954a6cb9-7847-4709-8e77-44ca47823e08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.436356 Aug 27 03:18:16.132638 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1258/2473] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:15 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:16.151389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:16.151959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:16.178616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.181429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.182096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.183349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.184392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.185027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.216126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:16.246916 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3e8737b5-e7a5-4111-ae23-5b227e505faf tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1324 microversion: 2.1 time: 0.460459 Aug 27 03:18:16.251622 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1216/2474] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:15 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:16.263678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:16.264468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:16.274373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:16.280398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.281127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.284634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.286572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.287622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.289509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.453286 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65e454f1-453f-4942-82a4-47f64933c73c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 204 len: 0 microversion: 2.1 time: 0.317036 Aug 27 03:18:16.455228 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1259/2475] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:16 2022] DELETE /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:16.635552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3c98cda7-2f41-4b8a-ad04-6d0f62be9ddf req-c12a7553-0300-49b4-9a7d-3934e2981168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7457b06d-7a91-474d-9e62-ef9cc23e1532", "name": "network-vif-plugged", "status": "completed", "tag": "3b56ae7c-2321-45e6-9685-c9f59df3616a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:16.649770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3c98cda7-2f41-4b8a-ad04-6d0f62be9ddf req-c12a7553-0300-49b4-9a7d-3934e2981168 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.650622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3c98cda7-2f41-4b8a-ad04-6d0f62be9ddf req-c12a7553-0300-49b4-9a7d-3934e2981168 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.651251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3c98cda7-2f41-4b8a-ad04-6d0f62be9ddf req-c12a7553-0300-49b4-9a7d-3934e2981168 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.661564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:16.665111 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3c98cda7-2f41-4b8a-ad04-6d0f62be9ddf req-c12a7553-0300-49b4-9a7d-3934e2981168 service nova] Creating event network-vif-plugged:3b56ae7c-2321-45e6-9685-c9f59df3616a for instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 on n-h1-852086-5 Aug 27 03:18:16.671180 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3c98cda7-2f41-4b8a-ad04-6d0f62be9ddf req-c12a7553-0300-49b4-9a7d-3934e2981168 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214151 Aug 27 03:18:16.672096 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1260/2476] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:16.680425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-045fb8cf-f8e3-46d3-9950-5e4b3e26e2b2 req-54137f56-d6c1-4c9c-b8ed-69b7c139cc55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "tag": "091c60ec-a371-4312-9342-113cf269c64e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:16.687873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a1ab2ca-0b7c-49d3-b540-ca3f04fe281c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.434371 Aug 27 03:18:16.689750 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1217/2477] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:16 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:16.692474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-045fb8cf-f8e3-46d3-9950-5e4b3e26e2b2 req-54137f56-d6c1-4c9c-b8ed-69b7c139cc55 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.693428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-045fb8cf-f8e3-46d3-9950-5e4b3e26e2b2 req-54137f56-d6c1-4c9c-b8ed-69b7c139cc55 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.694089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-045fb8cf-f8e3-46d3-9950-5e4b3e26e2b2 req-54137f56-d6c1-4c9c-b8ed-69b7c139cc55 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.700863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1126383167", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "9649e43c-11f6-4e3a-856e-10515d640ffa"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:16.742341 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-045fb8cf-f8e3-46d3-9950-5e4b3e26e2b2 req-54137f56-d6c1-4c9c-b8ed-69b7c139cc55 service nova] Creating event network-changed:091c60ec-a371-4312-9342-113cf269c64e for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:16.773601 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-045fb8cf-f8e3-46d3-9950-5e4b3e26e2b2 req-54137f56-d6c1-4c9c-b8ed-69b7c139cc55 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098683 Aug 27 03:18:16.781785 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1261/2478] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:16.806078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] validate_networks() for [('9649e43c-11f6-4e3a-856e-10515d640ffa', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:18:16.807680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:16.809079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:16.827921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.842906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.844173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.848766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.849821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.850849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.885250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:17.574076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:17.586851 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04c60015-276b-43fd-bb0d-0608667b577d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.799099 Aug 27 03:18:17.590318 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1262/2479] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:16 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:17.596399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:17.597029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:17.623366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.627548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.628045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.628822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.632788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.637524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.805598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:18:17.806984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:18:17.806984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:18:17.807652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:18:17.809128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:18:17.827086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.827778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.829292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.830387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.831406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.832383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.860147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:17.868514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:18:17.876828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Getting quotas for user d1e2476870c64964814aabc9c60399cf and project 9c273d054e33423dbc7aad25e6914822. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:18:17.898818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:18:17.903513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:18:17.918013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:17.930330 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e7d7348-9544-49f1-9070-967678932f72 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1323 microversion: 2.1 time: 0.338007 Aug 27 03:18:17.931611 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1263/2480] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:17 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:17.937925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:17.940062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:17.947335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.948187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.948848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.950750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.951341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.952043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.973633 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-272f22d4-7fcc-47a3-9678-4747d7722088 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282570 Aug 27 03:18:17.980060 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1218/2481] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:18:17.984880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:17.986040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:17.994630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.995716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.996430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.997533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.998472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.999382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.199641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:18.213441 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f5f8879-35e7-445e-a4bf-9fd3df6f0f69 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.280537 Aug 27 03:18:18.233817 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1264/2482] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:17 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:18.244003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0228229-996b-4460-8e07-ccd9d5a50596 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1571911328", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0228229-996b-4460-8e07-ccd9d5a50596 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 235 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1571911328", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1571911328', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.261807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0228229-996b-4460-8e07-ccd9d5a50596 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:18.266058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0228229-996b-4460-8e07-ccd9d5a50596 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.030580 Aug 27 03:18:18.268942 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1265/2483] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:18 2022] POST /compute/v2.1/servers => generated 133 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:18:18.285206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-29a9b34d-d835-40d8-8c8e-da5dc6e2d09a req-b4912917-cf96-428c-9321-282eccc226cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a20f82-7dea-4b51-b029-7f7f4ceb98df", "tag": "f47fa10d-9405-4d26-8b2e-aa90449e415c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:18.322132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:18.322496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-29a9b34d-d835-40d8-8c8e-da5dc6e2d09a req-b4912917-cf96-428c-9321-282eccc226cf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.322801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-29a9b34d-d835-40d8-8c8e-da5dc6e2d09a req-b4912917-cf96-428c-9321-282eccc226cf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.323243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-29a9b34d-d835-40d8-8c8e-da5dc6e2d09a req-b4912917-cf96-428c-9321-282eccc226cf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.344736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-29a9b34d-d835-40d8-8c8e-da5dc6e2d09a req-b4912917-cf96-428c-9321-282eccc226cf service nova] Creating event network-changed:f47fa10d-9405-4d26-8b2e-aa90449e415c for instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df on n-h1-852086-5 Aug 27 03:18:18.348358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0522d3d8-215c-4a0e-94c8-54ff662b23a7 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1324 microversion: 2.1 time: 0.368427 Aug 27 03:18:18.349104 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1219/2484] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:17 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1324 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:18.354977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d12a52f-fa86-42b0-aa25-564b633fd234 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:18.355853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9d12a52f-fa86-42b0-aa25-564b633fd234 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:18.374853 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-29a9b34d-d835-40d8-8c8e-da5dc6e2d09a req-b4912917-cf96-428c-9321-282eccc226cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104243 Aug 27 03:18:18.377530 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1266/2485] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:18.383566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:18.384789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:18.396203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.397446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.397975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.398959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.399491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.401509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.467988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9d12a52f-fa86-42b0-aa25-564b633fd234 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:18.490230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9d12a52f-fa86-42b0-aa25-564b633fd234 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1208 microversion: 2.1 time: 0.139505 Aug 27 03:18:18.497785 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1220/2486] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:18 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1208 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:18.694832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ba00cddc-b585-4d06-901d-ae907f815c04 req-2a200d25-4683-48a2-b432-648fb67c98cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8be50aa-b202-4a09-9930-8c1ac65408cd", "name": "network-vif-unplugged", "status": "completed", "tag": "b984dc9f-19d1-4b06-87eb-65e952deeb6d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:18.717458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ba00cddc-b585-4d06-901d-ae907f815c04 req-2a200d25-4683-48a2-b432-648fb67c98cc service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.722628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ba00cddc-b585-4d06-901d-ae907f815c04 req-2a200d25-4683-48a2-b432-648fb67c98cc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.723791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ba00cddc-b585-4d06-901d-ae907f815c04 req-2a200d25-4683-48a2-b432-648fb67c98cc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.758962 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ba00cddc-b585-4d06-901d-ae907f815c04 req-2a200d25-4683-48a2-b432-648fb67c98cc service nova] Creating event network-vif-unplugged:b984dc9f-19d1-4b06-87eb-65e952deeb6d for instance f8be50aa-b202-4a09-9930-8c1ac65408cd on n-h2-852086-5 Aug 27 03:18:18.775185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ba00cddc-b585-4d06-901d-ae907f815c04 req-2a200d25-4683-48a2-b432-648fb67c98cc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086402 Aug 27 03:18:18.777956 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1221/2487] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:18.788833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:18.818537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e33a8939-ed72-48a9-b0b4-63056897e74f req-c080d100-4d01-49ad-8eee-85522e2e6bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "tag": "91ea267b-1f10-4843-821a-486338c959d6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:18.843879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e33a8939-ed72-48a9-b0b4-63056897e74f req-c080d100-4d01-49ad-8eee-85522e2e6bcc service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.846670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e33a8939-ed72-48a9-b0b4-63056897e74f req-c080d100-4d01-49ad-8eee-85522e2e6bcc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.847365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e33a8939-ed72-48a9-b0b4-63056897e74f req-c080d100-4d01-49ad-8eee-85522e2e6bcc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.869505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:18.892030 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce9e89f1-49cd-45f2-a4ae-ff6a0bede3ea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.508677 Aug 27 03:18:18.894658 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1267/2488] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:18 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:18.904267 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e33a8939-ed72-48a9-b0b4-63056897e74f req-c080d100-4d01-49ad-8eee-85522e2e6bcc service nova] Creating event network-changed:91ea267b-1f10-4843-821a-486338c959d6 for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:18.914980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e33a8939-ed72-48a9-b0b4-63056897e74f req-c080d100-4d01-49ad-8eee-85522e2e6bcc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101133 Aug 27 03:18:18.916798 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1222/2489] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:18.921312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:18.923373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:18.934883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.935692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.936334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.937230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.937862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.938904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.960094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:18.960820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:18.989662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.992197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.993913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.994986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:19.004479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:19.007538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:19.435206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:19.450366 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eacb136d-69c4-48ed-a92f-1369e78ce294 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.529037 Aug 27 03:18:19.462343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1268/2490] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:18 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:19.478894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:19.481997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:19.502203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:19.510775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:19.515977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:19.524531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:19.525146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:19.525679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:19.826102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:19.836951 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-168dfac5-22ea-47b6-947b-59e4109cfcb9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.372947 Aug 27 03:18:19.844967 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1269/2491] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:19 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:19.855884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:19.856905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:19.893107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:19.894192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:19.894858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:19.898147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:19.899815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:19.900715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.067552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:20.076977 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8825a1de-1c60-4acc-990e-9e164d7b09ee tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1472 microversion: 2.1 time: 1.122046 Aug 27 03:18:20.092516 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1223/2492] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:18 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1472 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:20.098820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72da528b-d7e2-4497-8ae0-07d6b9ad2d5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:20.099849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72da528b-d7e2-4497-8ae0-07d6b9ad2d5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 20ad4ae7-4376-4306-a208-4bc7f779fc3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:20.116361 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-72da528b-d7e2-4497-8ae0-07d6b9ad2d5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 20ad4ae7-4376-4306-a208-4bc7f779fc3d could not be found. Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72da528b-d7e2-4497-8ae0-07d6b9ad2d5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/20ad4ae7-4376-4306-a208-4bc7f779fc3d/action HTTP/1.1 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 13 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: {"pause": {}} Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 20ad4ae7-4376-4306-a208-4bc7f779fc3d could not be found. Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '20ad4ae7-4376-4306-a208-4bc7f779fc3d', 'body': {'pause': {}}} Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ad4ae7-4376-4306-a208-4bc7f779fc3d could not be found. Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ad4ae7-4376-4306-a208-4bc7f779fc3d could not be found. Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:20.125275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:20.130813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:20.130813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:20.130813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ad4ae7-4376-4306-a208-4bc7f779fc3d could not be found. Aug 27 03:18:20.130813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.133376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72da528b-d7e2-4497-8ae0-07d6b9ad2d5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 20ad4ae7-4376-4306-a208-4bc7f779fc3d could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:20.134525 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-72da528b-d7e2-4497-8ae0-07d6b9ad2d5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/20ad4ae7-4376-4306-a208-4bc7f779fc3d/action" status: 404 len: 111 microversion: 2.1 time: 0.040682 Aug 27 03:18:20.135609 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1224/2493] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:20 2022] POST /compute/v2.1/servers/20ad4ae7-4376-4306-a208-4bc7f779fc3d/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:20.144796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:20.145701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:20.173649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.174582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.174582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.175361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.175829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.176288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.597593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:20.614917 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6eaa29b0-5a0b-49f6-94a0-803b79d0e0b3 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1268 microversion: 2.1 time: 0.476949 Aug 27 03:18:20.632180 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1225/2494] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:20 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1268 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:20.642606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:20.644011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:20.680037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.681075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.682405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.683559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.685994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.686726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.726246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:20.749285 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-644d3c72-b73f-4653-a26b-41d18924a572 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1324 microversion: 2.1 time: 0.902402 Aug 27 03:18:20.764143 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1270/2495] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:19 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1324 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:20.773677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Request method failure captured: Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532/diagnostics HTTP/1.1 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzcMWJvDF81enUfJQqZA0DrZSxY_D_-cOYxbXZfrVz7Xf-tOmgXtDf7EVanBd8mA2BtfgxBu8xzu48yL5V3xr0kcFoNNP6QTjQ4rskyBgdp2EIc8XkZcQd6D8zBGhfkBJMCHCM3ZPD2fOAO36GG9tVt_vRM77vGRfTxF1iOO8KBq8A Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: de1329a1582244cc90f93dd4505d8d54 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-202290993 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/de1329a1582244cc90f93dd4505d8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1329a1582244cc90f93dd4505d8d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_de1329a1582244cc90f93dd4505d8d54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1329a1582244cc90f93dd4505d8d54"}]}] Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-202290993 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: de1329a1582244cc90f93dd4505d8d54 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-202290993 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerDiagnosticsNegativeTest-202290993-project Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 95f6c82eb1a54e42a0d269ad4974b036 Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-202290993-project Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '7457b06d-7a91-474d-9e62-ef9cc23e1532'} Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.779844 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:20.783860 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:20.783860 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:20.783860 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 03:18:20.783860 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 03:18:20.783860 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 03:18:20.783860 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:20.787667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:20.789613 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-23b12101-ba68-4fb3-9fa3-190776235e4e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.155902 Aug 27 03:18:20.793796 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1226/2496] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:18:20 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532/diagnostics => generated 117 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:20.801349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:20.801883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:20.836001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-60c4dd0f-1d45-4757-a7dc-97241d2e2746 req-a711e063-5458-4aa2-9c42-d4f1d06e7fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8be50aa-b202-4a09-9930-8c1ac65408cd", "name": "network-vif-deleted", "tag": "b984dc9f-19d1-4b06-87eb-65e952deeb6d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:20.849190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.852106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.854105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.856151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.857905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.859212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.869954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-60c4dd0f-1d45-4757-a7dc-97241d2e2746 req-a711e063-5458-4aa2-9c42-d4f1d06e7fb1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.872397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-60c4dd0f-1d45-4757-a7dc-97241d2e2746 req-a711e063-5458-4aa2-9c42-d4f1d06e7fb1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.874819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-60c4dd0f-1d45-4757-a7dc-97241d2e2746 req-a711e063-5458-4aa2-9c42-d4f1d06e7fb1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.906280 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-60c4dd0f-1d45-4757-a7dc-97241d2e2746 req-a711e063-5458-4aa2-9c42-d4f1d06e7fb1 service nova] Creating event network-vif-deleted:b984dc9f-19d1-4b06-87eb-65e952deeb6d for instance f8be50aa-b202-4a09-9930-8c1ac65408cd on n-h2-852086-5 Aug 27 03:18:20.921420 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-60c4dd0f-1d45-4757-a7dc-97241d2e2746 req-a711e063-5458-4aa2-9c42-d4f1d06e7fb1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124908 Aug 27 03:18:20.928586 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1227/2497] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:20.939818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:20.943359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:20.962957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.964008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.966868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.969171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.971651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.973359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.051503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:21.182907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:21.245688 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-08909aea-d24c-4991-9e46-f6b85c0e690e tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 204 len: 0 microversion: 2.1 time: 0.313584 Aug 27 03:18:21.247054 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1228/2498] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:20 2022] DELETE /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:21.254447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:21.255153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:21.262480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.262974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.263402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.264275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.264725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.265146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.547334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:21.552064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:21.558879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48e62e68-9687-4e0f-abe0-cedf7873b6ee tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.310530 Aug 27 03:18:21.562231 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1229/2499] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:21 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:21.570462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:21.573420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:21.583766 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95239ba3-4a28-4992-bcf7-8f5c742438b2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.804818 Aug 27 03:18:21.589648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.590188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.590662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.591043 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1271/2500] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:20 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:21.594332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.595717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.596440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.601182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7be641b6-f00e-474d-8fd1-3f913559ca3b req-a50c1659-9b00-4bf7-9a81-f4b845248387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "tag": "d0db8762-2daf-490e-abf9-98c9d4e87d31"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:21.618761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7be641b6-f00e-474d-8fd1-3f913559ca3b req-a50c1659-9b00-4bf7-9a81-f4b845248387 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.619539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7be641b6-f00e-474d-8fd1-3f913559ca3b req-a50c1659-9b00-4bf7-9a81-f4b845248387 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.620131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7be641b6-f00e-474d-8fd1-3f913559ca3b req-a50c1659-9b00-4bf7-9a81-f4b845248387 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.634840 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7be641b6-f00e-474d-8fd1-3f913559ca3b req-a50c1659-9b00-4bf7-9a81-f4b845248387 service nova] Creating event network-changed:d0db8762-2daf-490e-abf9-98c9d4e87d31 for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:21.642839 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7be641b6-f00e-474d-8fd1-3f913559ca3b req-a50c1659-9b00-4bf7-9a81-f4b845248387 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049361 Aug 27 03:18:21.644055 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1272/2501] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:21.655608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:21.657658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:21.673208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.674685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.675315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.676204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.676944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.677761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.089416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:22.093144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:22.114273 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-494f9de3-ea27-4df5-8d75-e4dda66989cb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.466152 Aug 27 03:18:22.115090 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1273/2502] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:21 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:22.123233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:22.124153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:22.124295 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c3b2e15-071d-4e27-9bbf-1f680c70c8bf tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1478 microversion: 2.1 time: 0.560580 Aug 27 03:18:22.127562 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1230/2503] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:21 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1478 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:22.135796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.136562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.137189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.138129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.139505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.140135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.158317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fe8f22d-9ef9-4204-ad85-db554f12af60"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:22.166758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:22.191454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.192126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.198633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.199432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.199932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.200380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.255971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:22.271756 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6fb4d1b-dfbd-49e7-aaa6-a1655a8e8aea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1266 microversion: 2.1 time: 0.152408 Aug 27 03:18:22.273511 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1274/2504] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:22 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:22.284886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:22.285979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:22.293590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.297105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.301970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.302998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.309402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.310114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.631061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:22.644970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-039499c8-c717-4f05-b411-805a014ee700 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1324 microversion: 2.1 time: 0.369746 Aug 27 03:18:22.645709 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1275/2505] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:22 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:22.673965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:22.674821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:22.682632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.683397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.684002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.684900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.685509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.686338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.798259 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9106dab0-283f-45e8-abc4-2bdde3b9703b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.132370 Aug 27 03:18:22.799761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1276/2506] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:22 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:18:22.814899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:22.816054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:22.834242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.835390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.835851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.837494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.838208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.840078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.972998 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c0b78e4-4039-4af0-99af-680b885c1030 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "POST /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.836191 Aug 27 03:18:22.976028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1231/2507] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:18:22 2022] POST /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:22.988572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:22.989383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:23.001879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:23.002721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:23.023531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:23.028379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:23.031638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:23.033046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:23.360113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:23.371162 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab6b089a-9e2f-443b-9b4f-d14a8f6c36a9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.569485 Aug 27 03:18:23.401730 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1277/2508] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:22 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:23.415416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:23.416561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:23.433943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:23.434840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:23.441936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:23.443063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:23.443685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:23.444284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:23.571955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:23.590370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae4743f2-9afc-4859-9652-5a9835cffcba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1511 microversion: 2.1 time: 0.612763 Aug 27 03:18:23.593559 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1232/2509] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:22 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:23.601204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:23.604569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:23.626801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:23.629620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:23.630916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:23.631869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:23.634332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:23.637960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.158020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:24.167012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98e398ec-2b54-4c15-b58a-8449a0a57a31 tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1478 microversion: 2.1 time: 0.763802 Aug 27 03:18:24.177875 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1278/2510] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:23 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1478 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:24.197826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:24.198766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:24.212913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.213699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.214335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.215244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.215859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.216442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.686830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:24.702117 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5424366-4828-4dd0-bcdc-ca995ca74a7d tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1324 microversion: 2.1 time: 0.522846 Aug 27 03:18:24.718225 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1279/2511] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:24 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:24.731448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c241b27b-7728-47f4-a111-11b89e12c53a req-587a6753-2908-446e-92da-7efead810cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a20f82-7dea-4b51-b029-7f7f4ceb98df", "name": "network-vif-plugged", "status": "completed", "tag": "f47fa10d-9405-4d26-8b2e-aa90449e415c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:24.749861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:24.753288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:24.755523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c241b27b-7728-47f4-a111-11b89e12c53a req-587a6753-2908-446e-92da-7efead810cc5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.756245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c241b27b-7728-47f4-a111-11b89e12c53a req-587a6753-2908-446e-92da-7efead810cc5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.756929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c241b27b-7728-47f4-a111-11b89e12c53a req-587a6753-2908-446e-92da-7efead810cc5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.761196 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9a9ad4ab-17d5-416d-8999-f17665515100 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 1.166314 Aug 27 03:18:24.761990 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1233/2512] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:23 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:24.776301 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c241b27b-7728-47f4-a111-11b89e12c53a req-587a6753-2908-446e-92da-7efead810cc5 service nova] Creating event network-vif-plugged:f47fa10d-9405-4d26-8b2e-aa90449e415c for instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df on n-h1-852086-5 Aug 27 03:18:24.783827 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c241b27b-7728-47f4-a111-11b89e12c53a req-587a6753-2908-446e-92da-7efead810cc5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074473 Aug 27 03:18:24.784814 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1280/2513] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:24.800031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:24.804437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:24.807860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:24.808502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:24.821950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.823172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.823948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.824764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.826284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.826997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.830754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.831028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.831427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.832395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.832851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.833472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.843918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:25.310881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:25.320514 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-345f8c1e-306a-45a3-b6ef-9ae59fafb82d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1491 microversion: 2.1 time: 0.533288 Aug 27 03:18:25.321099 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1281/2514] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:24 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1491 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:25.351276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:25.363741 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b874a58-e90f-4a9a-af24-d065dd52559b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.594798 Aug 27 03:18:25.364540 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1234/2515] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:24 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:25.370509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:25.385018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-42a11205-afca-4f96-bc60-845df188891c req-2238c36a-b023-44d8-b1c3-444e8d6f0416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7457b06d-7a91-474d-9e62-ef9cc23e1532", "name": "network-vif-deleted", "tag": "3b56ae7c-2321-45e6-9685-c9f59df3616a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:25.388813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:25.392218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Searching by: {'deleted': False, 'project_id': '7b322d2965a643f7a8ebd754e3891a26'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:18:25.404383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-42a11205-afca-4f96-bc60-845df188891c req-2238c36a-b023-44d8-b1c3-444e8d6f0416 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.407836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-42a11205-afca-4f96-bc60-845df188891c req-2238c36a-b023-44d8-b1c3-444e8d6f0416 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.411435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-42a11205-afca-4f96-bc60-845df188891c req-2238c36a-b023-44d8-b1c3-444e8d6f0416 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.420439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.421224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.421849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.422955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.423653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.424271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.461658 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-42a11205-afca-4f96-bc60-845df188891c req-2238c36a-b023-44d8-b1c3-444e8d6f0416 service nova] Creating event network-vif-deleted:3b56ae7c-2321-45e6-9685-c9f59df3616a for instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 on n-h1-852086-5 Aug 27 03:18:25.473879 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-42a11205-afca-4f96-bc60-845df188891c req-2238c36a-b023-44d8-b1c3-444e8d6f0416 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124110 Aug 27 03:18:25.476651 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1282/2516] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:25.489524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:25.494412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:25.508851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.510215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.512142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.513265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.513900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.517923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.590548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.591333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.591980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.592596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lazy-loading 'fault' on Instance uuid 7457b06d-7a91-474d-9e62-ef9cc23e1532 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:25.624318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:18:25.729472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae6b6bf5-373c-4f08-8829-ff338a45629b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.363423 Aug 27 03:18:25.730697 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1235/2517] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:18:25 2022] GET /compute/v2.1/servers => generated 339 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:25.751201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:25.751889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:25.764536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.765220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.767473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.769298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.772593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.776513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.832216 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Cannot 'pause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state paused Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action HTTP/1.1 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 13 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: {"pause": {}} Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: exception: Cannot 'pause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state paused Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'pause': {}}} Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d in vm_state paused. Cannot pause while the instance is in this state. Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state paused Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:25.834354 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:25.838654 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:25.838654 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:25.838654 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:25.838654 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state paused Aug 27 03:18:25.838654 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:25.842150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 409 to user: Cannot 'pause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state paused {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:25.843688 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0bfdd1f0-6b2e-4c3f-a4fe-f2ff94c9f342 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 409 len: 143 microversion: 2.1 time: 0.111598 Aug 27 03:18:25.845326 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1236/2518] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:25 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 143 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:18:25.851166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:25.852106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:25.861031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.861801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.862423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.863308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.864110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.865113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.048581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f6c82eb1a54e42a0d269ad4974b036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1329a1582244cc90f93dd4505d8d54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:26.065147 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4157d1b0-d4ea-4752-8611-bf63ba58caff tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 200 len: 1313 microversion: 2.1 time: 0.586320 Aug 27 03:18:26.065760 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1283/2519] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:25 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:26.070844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:26.080302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:26.086323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Searching by: {'deleted': False, 'project_id': '7b322d2965a643f7a8ebd754e3891a26'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:18:26.105833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.106613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.107391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.108316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.108960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.109549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.180471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:18:26.259249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:26.268416 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85b0ba90-36e7-4abc-8cf9-3b15a386bacc tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1324 microversion: 2.1 time: 0.421719 Aug 27 03:18:26.269007 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1237/2520] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:25 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:26.280071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:26.280693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:26.285731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:26.294249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.295075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.295756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.296887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.297403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.301487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.304384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.305105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.305560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.634593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:26.644432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff334f0b-8759-48c6-bc85-dad130734ad0 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.374359 Aug 27 03:18:26.661708 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1238/2521] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:26 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:26.663788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:26.664346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:26.680786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.681289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.685747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.687264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.687738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.688771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.693611 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fb57558-9e94-4a10-978a-d2a08af58efd tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.626392 Aug 27 03:18:26.694599 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1284/2522] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:18:26 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:26.700916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:26.701799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:26.721950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.723844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.725114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.727731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.729204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.729863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.881097 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf90c0a6-af75-4651-ad88-daf3028729b0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.229609 Aug 27 03:18:26.886186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1239/2523] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:26 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:18:26.896585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35b3c394-35f4-46ba-aae8-cc8554c32b6a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:26.918318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35b3c394-35f4-46ba-aae8-cc8554c32b6a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029189 Aug 27 03:18:26.928352 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1240/2524] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:18:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:26.935011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:26.936156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:26.945555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.947957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.949651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.952349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.953776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.955162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.059646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:27.073161 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd48a47d-48dd-4ee9-a536-05dae98269e7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.376937 Aug 27 03:18:27.077043 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1285/2525] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:26 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:27.090438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:27.092882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] [instance: 7457b06d-7a91-474d-9e62-ef9cc23e1532] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:27.117064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.118040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.118692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.121138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.123974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.127063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.165532 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] HTTP exception thrown: Instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 could not be found. Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Request method failure captured: Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 HTTP/1.1 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzcMWJvDF81enUfJQqZA0DrZSxY_D_-cOYxbXZfrVz7Xf-tOmgXtDf7EVanBd8mA2BtfgxBu8xzu48yL5V3xr0kcFoNNP6QTjQ4rskyBgdp2EIc8XkZcQd6D8zBGhfkBJMCHCM3ZPD2fOAO36GG9tVt_vRM77vGRfTxF1iOO8KBq8A Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: de1329a1582244cc90f93dd4505d8d54 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-202290993 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/de1329a1582244cc90f93dd4505d8d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1329a1582244cc90f93dd4505d8d54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_de1329a1582244cc90f93dd4505d8d54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/de1329a1582244cc90f93dd4505d8d54"}]}] Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-202290993 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: de1329a1582244cc90f93dd4505d8d54 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-202290993 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerDiagnosticsNegativeTest-202290993-project Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 95f6c82eb1a54e42a0d269ad4974b036 Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-202290993-project Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 could not be found. Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '7457b06d-7a91-474d-9e62-ef9cc23e1532'} Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 could not be found. Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 could not be found. Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.167414 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 could not be found. Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] Returning 404 to user: Instance 7457b06d-7a91-474d-9e62-ef9cc23e1532 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35c94ee4-7456-462f-aa00-771a1052ff1b tempest-ServerDiagnosticsNegativeTest-202290993 tempest-ServerDiagnosticsNegativeTest-202290993-project] 10.222.0.69 "GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532" status: 404 len: 111 microversion: 2.1 time: 0.088231 Aug 27 03:18:27.170975 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1286/2526] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:27 2022] GET /compute/v2.1/servers/7457b06d-7a91-474d-9e62-ef9cc23e1532 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:18:27.229265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:27.239066 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-53f0b611-1331-4992-9e46-2a68ec99d3ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1498 microversion: 2.1 time: 0.308331 Aug 27 03:18:27.267093 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1241/2527] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:26 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1498 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:27.290848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:27.291490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:27.302440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.303277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.303732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.305006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.305668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.306352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.482562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:27.483078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:27.493319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.493820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.494316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.495049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.495466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.495914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.546833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:27.560422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c92443aa-61a7-4f44-8266-bd64cf9b91c3 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1521 microversion: 2.1 time: 0.274659 Aug 27 03:18:27.561641 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1287/2528] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:27 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:27.569581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-416b2411-df5c-4ea2-ac4b-b1d91c7df141 req-9d8f34e5-a8f0-4d2b-8779-a4cc5a174e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19af2224-c625-4fe0-8a7d-025d320fdc60", "tag": "1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:27.574040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:27.585006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-416b2411-df5c-4ea2-ac4b-b1d91c7df141 req-9d8f34e5-a8f0-4d2b-8779-a4cc5a174e2a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.586237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-416b2411-df5c-4ea2-ac4b-b1d91c7df141 req-9d8f34e5-a8f0-4d2b-8779-a4cc5a174e2a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.586859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-416b2411-df5c-4ea2-ac4b-b1d91c7df141 req-9d8f34e5-a8f0-4d2b-8779-a4cc5a174e2a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.603512 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-416b2411-df5c-4ea2-ac4b-b1d91c7df141 req-9d8f34e5-a8f0-4d2b-8779-a4cc5a174e2a service nova] Creating event network-changed:1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f for instance 19af2224-c625-4fe0-8a7d-025d320fdc60 on n-h2-852086-5 Aug 27 03:18:27.611243 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-416b2411-df5c-4ea2-ac4b-b1d91c7df141 req-9d8f34e5-a8f0-4d2b-8779-a4cc5a174e2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047570 Aug 27 03:18:27.616376 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1288/2529] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:27.650686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:27.670883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:27.672010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:27.690479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.691733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.692488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.693406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.695997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.696700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.734985 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04df258b-caff-465a-a211-8ccd57ce262a tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 204 len: 0 microversion: 2.1 time: 0.255979 Aug 27 03:18:27.737111 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1242/2530] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:27 2022] DELETE /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:27.747436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:27.748513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:27.757420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.758361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.759023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.759999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.761057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.761653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.955281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:27.962709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:27.968154 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0464de9-5a31-43c7-9a8e-343c4e4fe521 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.302418 Aug 27 03:18:27.970386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1289/2531] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:27 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:27.978436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cef5a91-d7f4-40fc-85a9-7e2a3180a671 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-285653831", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cef5a91-d7f4-40fc-85a9-7e2a3180a671 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 242 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-285653831", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-285653831', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'ee38ca48-4578-40d2-987e-f09e962a43f0'}]}}} Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:27.985032 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:27.990223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:27.992263 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4560a243-ada7-4de2-b3c5-b0ddbd607a7c tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1714 microversion: 2.1 time: 0.248024 Aug 27 03:18:27.992402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cef5a91-d7f4-40fc-85a9-7e2a3180a671 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:27.993337 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8cef5a91-d7f4-40fc-85a9-7e2a3180a671 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.021709 Aug 27 03:18:27.994246 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1290/2532] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:27 2022] POST /compute/v2.1/servers => generated 175 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:18:27.994981 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1243/2533] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:27 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1714 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:28.007665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ee2e97c-981b-44cf-927a-b85d323a1b63 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.008166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ee2e97c-981b-44cf-927a-b85d323a1b63 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: fd3d20fa-9fbe-4f4c-a135-e5771db2175a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.015657 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-5ee2e97c-981b-44cf-927a-b85d323a1b63 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] HTTP exception thrown: Instance fd3d20fa-9fbe-4f4c-a135-e5771db2175a could not be found. Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ee2e97c-981b-44cf-927a-b85d323a1b63 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/fd3d20fa-9fbe-4f4c-a135-e5771db2175a/metadata HTTP/1.1 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance fd3d20fa-9fbe-4f4c-a135-e5771db2175a could not be found. Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': 'fd3d20fa-9fbe-4f4c-a135-e5771db2175a'} Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3d20fa-9fbe-4f4c-a135-e5771db2175a could not be found. Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3d20fa-9fbe-4f4c-a135-e5771db2175a could not be found. Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.027137 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.033373 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:28.033373 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:28.033373 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3d20fa-9fbe-4f4c-a135-e5771db2175a could not be found. Aug 27 03:18:28.033373 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.033373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ee2e97c-981b-44cf-927a-b85d323a1b63 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 404 to user: Instance fd3d20fa-9fbe-4f4c-a135-e5771db2175a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:28.033373 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ee2e97c-981b-44cf-927a-b85d323a1b63 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/fd3d20fa-9fbe-4f4c-a135-e5771db2175a/metadata" status: 404 len: 111 microversion: 2.1 time: 0.026776 Aug 27 03:18:28.033373 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1291/2534] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/fd3d20fa-9fbe-4f4c-a135-e5771db2175a/metadata => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:28.098684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.099443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.112794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.113801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.114473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.115498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.116239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.116895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.117165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-984c5538-592c-41b9-afc3-7b7699000e64 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-474211286", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-984c5538-592c-41b9-afc3-7b7699000e64 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 498 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-474211286", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-474211286', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee38ca48-4578-40d2-987e-f09e962a43f0'}]}}} Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:18:28.123682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-984c5538-592c-41b9-afc3-7b7699000e64 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-984c5538-592c-41b9-afc3-7b7699000e64 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018214 Aug 27 03:18:28.136144 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1292/2535] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:28 2022] POST /compute/v2.1/servers => generated 687 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:18:28.186448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55461404-35b5-4c44-88cf-33cfab0e4d5c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-809578349", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55461404-35b5-4c44-88cf-33cfab0e4d5c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 499 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-809578349", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-809578349', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee38ca48-4578-40d2-987e-f09e962a43f0'}]}}} Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:18:28.191764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55461404-35b5-4c44-88cf-33cfab0e4d5c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:28.195048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55461404-35b5-4c44-88cf-33cfab0e4d5c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.014104 Aug 27 03:18:28.204402 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1293/2536] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:28 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:18:28.267178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bab9639-1438-471a-b634-5af1f349c556 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-532353740", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bab9639-1438-471a-b634-5af1f349c556 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 753 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-532353740", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-532353740', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee38ca48-4578-40d2-987e-f09e962a43f0'}]}}} Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:28.275819 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:28.278939 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:28.281738 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.281738 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.281738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bab9639-1438-471a-b634-5af1f349c556 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:28.281738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bab9639-1438-471a-b634-5af1f349c556 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.025264 Aug 27 03:18:28.293696 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1294/2537] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:28 2022] POST /compute/v2.1/servers => generated 1197 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 03:18:28.322972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.323598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.345953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.351135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.351511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.352293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.352779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.353221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.455068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:28.465867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9eb58010-6bc1-4b1b-862d-b869caa10024 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.371801 Aug 27 03:18:28.467536 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1244/2538] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:28.476309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e38c63d-dfec-4fec-a7b6-784c46bccaa5 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-500993448", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e38c63d-dfec-4fec-a7b6-784c46bccaa5 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 1265 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-500993448", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee38ca48-4578-40d2-987e-f09e962a43f0"}]}} Aug 27 03:18:28.482251 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-500993448', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee38ca48-4578-40d2-987e-f09e962a43f0'}]}}} Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.484607 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:28.486019 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:28.487927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 03:18:28.487927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.487927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e38c63d-dfec-4fec-a7b6-784c46bccaa5 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:28.487927 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4e38c63d-dfec-4fec-a7b6-784c46bccaa5 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.017122 Aug 27 03:18:28.494253 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1245/2539] 10.222.0.69 () {60 vars in 1148 bytes} [Sat Aug 27 03:18:28 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 03:18:28.504070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4a4ccce-f714-4ed4-b21b-0cc0b253c41b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.504570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4a4ccce-f714-4ed4-b21b-0cc0b253c41b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 10969019-a72a-4010-b8df-545875fe9143] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.511324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:28.513562 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a4a4ccce-f714-4ed4-b21b-0cc0b253c41b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] HTTP exception thrown: Instance 10969019-a72a-4010-b8df-545875fe9143 could not be found. Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4a4ccce-f714-4ed4-b21b-0cc0b253c41b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/10969019-a72a-4010-b8df-545875fe9143/metadata/test2 HTTP/1.1 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 10969019-a72a-4010-b8df-545875fe9143 could not be found. Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '10969019-a72a-4010-b8df-545875fe9143', 'id': 'test2'} Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10969019-a72a-4010-b8df-545875fe9143 could not be found. Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10969019-a72a-4010-b8df-545875fe9143 could not be found. Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.515812 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.520551 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:28.520551 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:28.520551 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10969019-a72a-4010-b8df-545875fe9143 could not be found. Aug 27 03:18:28.520551 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.520551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4a4ccce-f714-4ed4-b21b-0cc0b253c41b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 404 to user: Instance 10969019-a72a-4010-b8df-545875fe9143 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:28.520551 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4a4ccce-f714-4ed4-b21b-0cc0b253c41b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/10969019-a72a-4010-b8df-545875fe9143/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.018361 Aug 27 03:18:28.530872 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1246/2540] 10.222.0.69 () {58 vars in 1281 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/10969019-a72a-4010-b8df-545875fe9143/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:28.545387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.545875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.553583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.554352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.554951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.560224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:28.564867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.565607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.566056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.569425 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-068e83ed-5cb8-4e19-acf3-ef9ae15290ae tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.267981 Aug 27 03:18:28.580650 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1295/2541] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:28.594244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.596005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.604083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.604700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.605236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.606029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.606783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.607280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.626853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:28.858699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:28.869465 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c30b377a-6cd3-4aa8-8f9f-6df38b76feea tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.279779 Aug 27 03:18:28.870633 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1296/2542] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:28.897701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-55fc35cf-ad69-422c-84a9-0ade290ddd89 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "DELETE /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 204 len: 0 microversion: 2.1 time: 0.355805 Aug 27 03:18:28.898767 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1247/2543] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:28 2022] DELETE /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:18:28.904633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:28.909146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.916569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.917387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.918770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.920073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.921018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.922038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.923358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.924349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.929019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.929333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.929774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.930819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.931547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.932155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.941810 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89/action HTTP/1.1 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 28 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: {"reboot": {"type": "SOFT"}} Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'fa627487-0ffe-40a1-9ac1-484acb3b7b89', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:28.943860 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:28.949239 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21630493-e5c5-410a-86b2-07022ce0fcf8 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89/action" status: 404 len: 111 microversion: 2.1 time: 0.052025 Aug 27 03:18:28.950482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1297/2544] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:28 2022] POST /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:18:28.960111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.960742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:28.967236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.967736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.968170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.968878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.969395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.969976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.193590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:29.203486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:29.206475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7dea5947-582f-4daa-b7eb-bf6bb8461164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.250648 Aug 27 03:18:29.208167 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1298/2545] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:29.226057 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a80f5c4e-9caa-4367-b981-7c2b18ec903c tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1527 microversion: 2.1 time: 0.322242 Aug 27 03:18:29.230357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:29.231411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:29.237844 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1248/2546] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1527 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:29.239730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.240333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.240995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.241978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.242829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.242829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.253276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:29.253808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:29.268783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.270179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.270639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.271504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.272128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.273306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.483388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:29.496930 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34ff7082-fcce-49e7-9c2a-c268c7eb247e tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1714 microversion: 2.1 time: 0.256141 Aug 27 03:18:29.516444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1249/2547] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:29 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1714 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:29.523085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:29.523739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:29.543205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.544746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.545465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.546413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.547136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.548383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:29.550597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.557618 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8abb5a9b-fbb8-46c0-bc90-a5730857aa69 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.348194 Aug 27 03:18:29.566973 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1299/2548] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:29 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:29.582199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:29.583452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:29.595899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.597170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.597910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.599220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.599968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.600652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.845630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:29.855331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-105deb7f-d3d3-4797-a428-a983a359901d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.286392 Aug 27 03:18:29.871281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:29.879467 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1300/2549] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:29 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:29.889769 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f9b4781-9080-4f33-ae07-7301be305a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.371571 Aug 27 03:18:29.890676 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1250/2550] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:29 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:29.911978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-614ce853-a476-4010-8830-a2ce3e904a9b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:29.914806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-614ce853-a476-4010-8830-a2ce3e904a9b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: d9de42e1-0359-4bb1-93b6-a91a9a6c838e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:29.921655 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-614ce853-a476-4010-8830-a2ce3e904a9b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance d9de42e1-0359-4bb1-93b6-a91a9a6c838e could not be found. Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-614ce853-a476-4010-8830-a2ce3e904a9b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/d9de42e1-0359-4bb1-93b6-a91a9a6c838e/action HTTP/1.1 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 28 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: {"reboot": {"type": "SOFT"}} Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance d9de42e1-0359-4bb1-93b6-a91a9a6c838e could not be found. Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'd9de42e1-0359-4bb1-93b6-a91a9a6c838e', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9de42e1-0359-4bb1-93b6-a91a9a6c838e could not be found. Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9de42e1-0359-4bb1-93b6-a91a9a6c838e could not be found. Aug 27 03:18:29.923363 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9de42e1-0359-4bb1-93b6-a91a9a6c838e could not be found. Aug 27 03:18:29.927733 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:29.929700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-614ce853-a476-4010-8830-a2ce3e904a9b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance d9de42e1-0359-4bb1-93b6-a91a9a6c838e could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:29.930783 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-614ce853-a476-4010-8830-a2ce3e904a9b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/d9de42e1-0359-4bb1-93b6-a91a9a6c838e/action" status: 404 len: 111 microversion: 2.1 time: 0.023921 Aug 27 03:18:29.934928 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1301/2551] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:29 2022] POST /compute/v2.1/servers/d9de42e1-0359-4bb1-93b6-a91a9a6c838e/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:29.941433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:29.942148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:29.954621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.955230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.956398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.958223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.958699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.959264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.184194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:30.195731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ec8e5a4-4130-46db-aeb2-375882a587ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.258958 Aug 27 03:18:30.197028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1251/2552] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:29 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:30.218877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.219566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.227333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.227829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.228273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.228997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.229459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.229893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.261946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.262792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.272820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.274109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.275837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.279404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.279917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.280433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.445691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:30.461593 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71f918f5-f02f-4f8f-9c44-0b128f93a825 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.246183 Aug 27 03:18:30.462719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1302/2553] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:30.496776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:30.501355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.509218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.511686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.512429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.513419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.514122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.514826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.561548 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89/action HTTP/1.1 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 65 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'fa627487-0ffe-40a1-9ac1-484acb3b7b89', 'body': {'rebuild': {'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e'}}} Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 03:18:30.565426 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:18:30.569882 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:30.573255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:30.575198 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf90e6dc-e5e0-48c1-9d66-0cda37e7859f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89/action" status: 404 len: 111 microversion: 2.1 time: 0.083773 Aug 27 03:18:30.582285 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1303/2554] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:30 2022] POST /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:30.590760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.592657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.601908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.602943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.604073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.605040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.605765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.606373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.822249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:30.834725 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7690c0f8-0744-4fdc-9206-2d8d56cbb340 tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1527 microversion: 2.1 time: 0.579134 Aug 27 03:18:30.835801 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1252/2555] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1527 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:30.841673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.846588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.870627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.871337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.871964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.873314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.874340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.874969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.071410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:31.080290 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c0b3621-b42e-45b7-8878-ba1c0061148b tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1714 microversion: 2.1 time: 0.496222 Aug 27 03:18:31.087011 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1304/2556] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1714 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:31.104921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:31.107030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:31.129879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:31.130568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:31.131015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.132720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:31.138786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:31.138786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.814462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:31.852696 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1926a5d5-e426-4b22-b833-6727a2fedef6 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.749317 Aug 27 03:18:31.853377 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1305/2557] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:31 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:31.878549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:31.884039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:31.912849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:31.917916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:31.918601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.921864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:31.924613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:31.926314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.935386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:31.945988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:31.957437 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17028b12-9f75-41b4-8cb1-f7f652276c1c tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 1.120284 Aug 27 03:18:31.958048 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1253/2558] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:31.970266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8439d04f-32e0-4fb0-ab79-db8d0fba8277 req-eb289315-d86c-461e-a8c3-45736ba65e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a20f82-7dea-4b51-b029-7f7f4ceb98df", "name": "network-vif-deleted", "tag": "f47fa10d-9405-4d26-8b2e-aa90449e415c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:31.991261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:32.003092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8439d04f-32e0-4fb0-ab79-db8d0fba8277 req-eb289315-d86c-461e-a8c3-45736ba65e94 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.015232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8439d04f-32e0-4fb0-ab79-db8d0fba8277 req-eb289315-d86c-461e-a8c3-45736ba65e94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.019973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8439d04f-32e0-4fb0-ab79-db8d0fba8277 req-eb289315-d86c-461e-a8c3-45736ba65e94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.062852 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8439d04f-32e0-4fb0-ab79-db8d0fba8277 req-eb289315-d86c-461e-a8c3-45736ba65e94 service nova] Creating event network-vif-deleted:f47fa10d-9405-4d26-8b2e-aa90449e415c for instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df on n-h1-852086-5 Aug 27 03:18:32.074465 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8439d04f-32e0-4fb0-ab79-db8d0fba8277 req-eb289315-d86c-461e-a8c3-45736ba65e94 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113618 Aug 27 03:18:32.087721 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1254/2559] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:32.093445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.097341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.118300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.121711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.123184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.127290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.128246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.130963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.204323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.205089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.208292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.209052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lazy-loading 'fault' on Instance uuid 62a20f82-7dea-4b51-b029-7f7f4ceb98df {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:32.336237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:32.350518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4405bdb-fda5-475f-a3d8-7065a00212bb tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.494373 Aug 27 03:18:32.351433 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1306/2560] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:31 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:32.359454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.361590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.368673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.369092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.369538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.370277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.370737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.371169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.433974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76282303a21c4d089663c41ee454febf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a1f246bf06452ab64f19476541aa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:32.444296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4eec7392-5978-4605-ab0c-de1e0a8820db tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 200 len: 1314 microversion: 2.1 time: 0.354960 Aug 27 03:18:32.445193 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1255/2561] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:32.450099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.450993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.458276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.458779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.459429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.460371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.460988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.461604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.618799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:32.631570 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ed4ac45-fb9d-41ee-9cd1-a2957a1516b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.279039 Aug 27 03:18:32.638534 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1307/2562] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:32.655286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ebfcfe9-5abf-4784-874a-93d5a7a7a4a5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:32.659036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7ebfcfe9-5abf-4784-874a-93d5a7a7a4a5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: bebd33ab-3148-4c15-8905-664fe83154e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.667041 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7ebfcfe9-5abf-4784-874a-93d5a7a7a4a5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance bebd33ab-3148-4c15-8905-664fe83154e6 could not be found. Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ebfcfe9-5abf-4784-874a-93d5a7a7a4a5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/bebd33ab-3148-4c15-8905-664fe83154e6/action HTTP/1.1 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 65 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance bebd33ab-3148-4c15-8905-664fe83154e6 could not be found. Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'bebd33ab-3148-4c15-8905-664fe83154e6', 'body': {'rebuild': {'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e'}}} Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bebd33ab-3148-4c15-8905-664fe83154e6 could not be found. Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 03:18:32.669900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bebd33ab-3148-4c15-8905-664fe83154e6 could not be found. Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bebd33ab-3148-4c15-8905-664fe83154e6 could not be found. Aug 27 03:18:32.674278 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:32.677736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ebfcfe9-5abf-4784-874a-93d5a7a7a4a5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance bebd33ab-3148-4c15-8905-664fe83154e6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:32.678907 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7ebfcfe9-5abf-4784-874a-93d5a7a7a4a5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/bebd33ab-3148-4c15-8905-664fe83154e6/action" status: 404 len: 111 microversion: 2.1 time: 0.028780 Aug 27 03:18:32.680693 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1308/2563] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:32 2022] POST /compute/v2.1/servers/bebd33ab-3148-4c15-8905-664fe83154e6/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:32.691317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.692290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.701455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.701962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.702442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.703492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.704414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.704948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.872672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:32.882399 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ac8dddf-d3ea-4bb8-b2e5-0fa55461d33d tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1714 microversion: 2.1 time: 0.435949 Aug 27 03:18:32.885816 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1256/2564] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1714 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:32.918725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:32.929405 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd394097-153c-483b-a388-14f094808272 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.243967 Aug 27 03:18:32.942639 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1309/2565] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:32.950727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.951342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.970290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.971012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.971627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.972332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.972954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.977651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.980321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.981159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.991388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.991874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.992304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.993004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.993449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.993865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.190907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:33.199768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-deb90188-edab-4e7f-89b3-9171363ccfe8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.223715 Aug 27 03:18:33.200867 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1310/2566] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:33.371357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:33.372270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:33.382784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.383246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.383696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.384426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.384882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.388867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.673519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:33.682986 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebd173b0-eb88-4eec-82dc-c22ac39bb2c6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.315443 Aug 27 03:18:33.684104 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1311/2567] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:33 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:33.701545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:33.702201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] [instance: 62a20f82-7dea-4b51-b029-7f7f4ceb98df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:33.712037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.712605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.713862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.714621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.715077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.716630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.745233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:33.749897 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] HTTP exception thrown: Instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df could not be found. Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Request method failure captured: Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df HTTP/1.1 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzu8eY_hvpLV74goQSPKQzCY9-knUhPFqFwY8wrLRFWl0b_ECiP57ORITDrl1e3R_HwyxI5k26uLoqVF6NVaQ779sj8FHprTnfJlYAQ4fKYJowpywFqao5DthMDwR_jEc29NrZhhNcO9Tsygi-5WXybs1GNfNUhl39NFK2CwMj3j88 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d1a1f246bf06452ab64f19476541aa83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d1a1f246bf06452ab64f19476541aa83"}]}] Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: d1a1f246bf06452ab64f19476541aa83 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336885566 Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 76282303a21c4d089663c41ee454febf Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336885566-project Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df could not be found. Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '62a20f82-7dea-4b51-b029-7f7f4ceb98df'} Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df could not be found. Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df could not be found. Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.757848 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df could not be found. Aug 27 03:18:33.764343 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.764853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40a3d598-338f-4dba-b163-4cb5ab721374 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.807324 Aug 27 03:18:33.764853 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1257/2568] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:33.765010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] Returning 404 to user: Instance 62a20f82-7dea-4b51-b029-7f7f4ceb98df could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:33.765010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8815f6a-6fa7-4ff6-bfad-9f1f949b190b tempest-ServerMetadataNegativeTestJSON-336885566 tempest-ServerMetadataNegativeTestJSON-336885566-project] 10.222.0.69 "GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df" status: 404 len: 111 microversion: 2.1 time: 0.077137 Aug 27 03:18:33.765010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1312/2569] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:33 2022] GET /compute/v2.1/servers/62a20f82-7dea-4b51-b029-7f7f4ceb98df => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:33.784136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-838e6e71-ff58-481b-bb36-7ab4d755eb3f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:33.784681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-838e6e71-ff58-481b-bb36-7ab4d755eb3f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: d37f1764-6a64-4cc4-9606-7b488b06cc31] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:33.796189 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-838e6e71-ff58-481b-bb36-7ab4d755eb3f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance d37f1764-6a64-4cc4-9606-7b488b06cc31 could not be found. Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-838e6e71-ff58-481b-bb36-7ab4d755eb3f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/d37f1764-6a64-4cc4-9606-7b488b06cc31/action HTTP/1.1 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: {"restore": {}} Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d37f1764-6a64-4cc4-9606-7b488b06cc31 could not be found. Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd37f1764-6a64-4cc4-9606-7b488b06cc31', 'body': {'restore': {}}} Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37f1764-6a64-4cc4-9606-7b488b06cc31 could not be found. Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37f1764-6a64-4cc4-9606-7b488b06cc31 could not be found. Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:33.803208 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:33.807003 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:33.807003 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:33.807003 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37f1764-6a64-4cc4-9606-7b488b06cc31 could not be found. Aug 27 03:18:33.807003 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:33.810058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-838e6e71-ff58-481b-bb36-7ab4d755eb3f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance d37f1764-6a64-4cc4-9606-7b488b06cc31 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:33.815028 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-838e6e71-ff58-481b-bb36-7ab4d755eb3f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/d37f1764-6a64-4cc4-9606-7b488b06cc31/action" status: 404 len: 111 microversion: 2.1 time: 0.034877 Aug 27 03:18:33.820646 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1258/2570] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:33 2022] POST /compute/v2.1/servers/d37f1764-6a64-4cc4-9606-7b488b06cc31/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:33.825855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:33.829586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:33.858196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.859467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.860190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.861743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.866016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.868124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.913811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:33.914391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:33.943466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.944253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.945045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.945968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.948616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.950116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.114107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b17878de5458e8d5a68f59e1ca3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b322d2965a643f7a8ebd754e3891a26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:34.127427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b94ff55-f683-4383-9d4d-1bf74537e209 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 200 len: 1646 microversion: 2.1 time: 0.219098 Aug 27 03:18:34.145222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1259/2571] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:33 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 1646 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:34.200501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:34.222802 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35f3fdc1-2a79-4f0e-ba90-56898a57d5cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.397192 Aug 27 03:18:34.231800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:34.232937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:34.235450 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1313/2572] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:33 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:34.247095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:34.247965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:34.248709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.263002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.263642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.264683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.265388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.266026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.269713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.272405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.272944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.273737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.274239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.274676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.322976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:34.816098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:34.817036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:34.840238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f5518ed-4f4a-4a2d-954f-cc10dd630f71 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.597503 Aug 27 03:18:34.841322 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5976a8de-32a3-4078-b754-e26de99af9f5 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.614861 Aug 27 03:18:34.842590 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1314/2573] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:34 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:34.859818 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1260/2574] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:34 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:34.871431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:34.874833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2bd73d6f-0054-4acd-9e7e-1e3b507cc098 req-0ec143d5-ffe2-4ae4-8c90-fe8cff6b4703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cec7abf-9e6e-4d3d-b51f-e094cc90c757", "name": "network-vif-deleted", "tag": "bcbc0986-64a0-4448-ba2f-5fa0fc95e78d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:34.875857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:34.894868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.895404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.895855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.899158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.900054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.900510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.901106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2bd73d6f-0054-4acd-9e7e-1e3b507cc098 req-0ec143d5-ffe2-4ae4-8c90-fe8cff6b4703 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.901916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2bd73d6f-0054-4acd-9e7e-1e3b507cc098 req-0ec143d5-ffe2-4ae4-8c90-fe8cff6b4703 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.902390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2bd73d6f-0054-4acd-9e7e-1e3b507cc098 req-0ec143d5-ffe2-4ae4-8c90-fe8cff6b4703 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.933224 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2bd73d6f-0054-4acd-9e7e-1e3b507cc098 req-0ec143d5-ffe2-4ae4-8c90-fe8cff6b4703 service nova] Creating event network-vif-deleted:bcbc0986-64a0-4448-ba2f-5fa0fc95e78d for instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 on n-h2-852086-5 Aug 27 03:18:34.947526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2bd73d6f-0054-4acd-9e7e-1e3b507cc098 req-0ec143d5-ffe2-4ae4-8c90-fe8cff6b4703 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085839 Aug 27 03:18:34.950972 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1315/2575] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:34.962603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:34.963245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:34.977485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.977930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.978411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.979710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.980697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.981376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.017815 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Cannot 'restore' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action HTTP/1.1 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 15 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: {"restore": {}} Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'restore' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'restore': {}}} Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d in vm_state active. Cannot restore while the instance is in this state. Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:35.019959 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:35.023647 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:35.023647 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:35.023647 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:35.023647 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:35.023647 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.025880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 409 to user: Cannot 'restore' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:35.027126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-acc0d0f3-239d-4b8a-8b76-fd315cf5c60d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 409 len: 145 microversion: 2.1 time: 0.074899 Aug 27 03:18:35.032938 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1316/2576] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:34 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 145 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:18:35.039817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:35.040880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:35.048958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.049870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.050825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.051813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.052509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.053155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.514907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:35.533798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:35.553849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44f789c5-6607-40cf-8b9b-22098d9cf5d6 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.691963 Aug 27 03:18:35.555394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1261/2577] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:34 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:35.565928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:35.568500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] [instance: 6cec7abf-9e6e-4d3d-b51f-e094cc90c757] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:35.579371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:35.585924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.586802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.587460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.588500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.589179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.590424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.592730 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f7a8d18-c444-4f9d-bced-819efd4d1fd7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.556512 Aug 27 03:18:35.606295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1317/2578] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:35 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:35.622247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:35.623059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:35.629459 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] HTTP exception thrown: Instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 could not be found. Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Request method failure captured: Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 HTTP/1.1 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyyp_BKvJppuPiEZlkB7gvpD8lqAM1p-1Ap1whMRGr31TaHcNT51inH3HkNzPYYZ3g5UeTEshRKO6nsJqFt65hLNL8iPuyWakh2FG-qf0lR_Cd-t8VIvL-SjS0wZvzj5zBvCb6_9KCtv1d_yQ52Jb6VkGhhh-DfqZf1GRZHwqR7jVE Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 7b322d2965a643f7a8ebd754e3891a26 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestManualDisk-1413103690 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7b322d2965a643f7a8ebd754e3891a26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7b322d2965a643f7a8ebd754e3891a26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7b322d2965a643f7a8ebd754e3891a26", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7b322d2965a643f7a8ebd754e3891a26"}]}] Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestManualDisk-1413103690 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 7b322d2965a643f7a8ebd754e3891a26 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestManualDisk-1413103690 Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestManualDisk-1413103690-project Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: b00b17878de5458e8d5a68f59e1ca3fd Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestManualDisk-1413103690-project Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 could not be found. Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6cec7abf-9e6e-4d3d-b51f-e094cc90c757'} Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 could not be found. Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 could not be found. Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:35.631482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.635105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:35.635105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:35.635105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:35.635105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:35.635105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:35.635105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 could not be found. Aug 27 03:18:35.635105 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:35.636193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.636193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.636592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.637269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.637667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.638094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.638561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Returning 404 to user: Instance 6cec7abf-9e6e-4d3d-b51f-e094cc90c757 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:35.639794 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f324aea4-2ce8-48f2-b545-36460ae83531 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757" status: 404 len: 111 microversion: 2.1 time: 0.083020 Aug 27 03:18:35.640971 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1262/2579] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:35 2022] GET /compute/v2.1/servers/6cec7abf-9e6e-4d3d-b51f-e094cc90c757 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:35.650462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2bd82291-68ab-465d-a1d0-9b45cef1e0f9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] Calling method '.version_select at 0x7fe457cad5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:35.711547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2bd82291-68ab-465d-a1d0-9b45cef1e0f9 tempest-ServersTestManualDisk-1413103690 tempest-ServersTestManualDisk-1413103690-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061728819" status: 202 len: 0 microversion: 2.1 time: 0.063696 Aug 27 03:18:35.714542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1263/2580] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:18:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061728819 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:18:35.869337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:35.870116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:35.885076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.885850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.886556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.887485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.888152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.892119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.029727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:36.041177 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8a5ba94-9b7c-46f1-b87b-abc95810aacd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.425689 Aug 27 03:18:36.054234 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1318/2581] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:35 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:36.074916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf709f3a-cfa0-41a4-ae7c-c18aa36bd8eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:36.076774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf709f3a-cfa0-41a4-ae7c-c18aa36bd8eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 726acd1b-2aae-4aae-92a7-c8d420ccace0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:36.096875 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cf709f3a-cfa0-41a4-ae7c-c18aa36bd8eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 726acd1b-2aae-4aae-92a7-c8d420ccace0 could not be found. Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf709f3a-cfa0-41a4-ae7c-c18aa36bd8eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/726acd1b-2aae-4aae-92a7-c8d420ccace0/action HTTP/1.1 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 14 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: {"resume": {}} Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 726acd1b-2aae-4aae-92a7-c8d420ccace0 could not be found. Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '726acd1b-2aae-4aae-92a7-c8d420ccace0', 'body': {'resume': {}}} Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726acd1b-2aae-4aae-92a7-c8d420ccace0 could not be found. Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726acd1b-2aae-4aae-92a7-c8d420ccace0 could not be found. Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:36.106027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:36.110652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:36.110652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:36.110652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726acd1b-2aae-4aae-92a7-c8d420ccace0 could not be found. Aug 27 03:18:36.110652 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:36.111257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf709f3a-cfa0-41a4-ae7c-c18aa36bd8eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 726acd1b-2aae-4aae-92a7-c8d420ccace0 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:36.112238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf709f3a-cfa0-41a4-ae7c-c18aa36bd8eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/726acd1b-2aae-4aae-92a7-c8d420ccace0/action" status: 404 len: 111 microversion: 2.1 time: 0.045019 Aug 27 03:18:36.112932 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1319/2582] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:36 2022] POST /compute/v2.1/servers/726acd1b-2aae-4aae-92a7-c8d420ccace0/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:36.135108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:36.137618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:36.144491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:36.159733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.175263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.175880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.179034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.180256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.181061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.252567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:36.262599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24bb274b-8f3c-4525-9f25-1f0bc407a4df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.398144 Aug 27 03:18:36.278828 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1264/2583] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:35 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:36.280523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:36.568544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-32467440-08fb-4db4-974a-bb744c652236 req-b8b038bb-3264-458b-bd9b-095e1675b967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "name": "network-vif-plugged", "status": "completed", "tag": "091c60ec-a371-4312-9342-113cf269c64e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:36.583031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-32467440-08fb-4db4-974a-bb744c652236 req-b8b038bb-3264-458b-bd9b-095e1675b967 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.586574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-32467440-08fb-4db4-974a-bb744c652236 req-b8b038bb-3264-458b-bd9b-095e1675b967 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.587082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-32467440-08fb-4db4-974a-bb744c652236 req-b8b038bb-3264-458b-bd9b-095e1675b967 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.615372 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-32467440-08fb-4db4-974a-bb744c652236 req-b8b038bb-3264-458b-bd9b-095e1675b967 service nova] Creating event network-vif-plugged:091c60ec-a371-4312-9342-113cf269c64e for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:36.630775 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-32467440-08fb-4db4-974a-bb744c652236 req-b8b038bb-3264-458b-bd9b-095e1675b967 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065103 Aug 27 03:18:36.634600 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1265/2584] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:18:36.646151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:36.647060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:36.668792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.669501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.672269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.676843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.677738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.678588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.772156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:36.780910 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cda7fb8e-962e-4af8-b8a5-86e1399025f1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.660860 Aug 27 03:18:36.794900 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1320/2585] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:36 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:36.807214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:36.807828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:36.837601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.838334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.838940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.839808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.840456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.841022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.387709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:37.396478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c3ffd45-0fba-4507-8c9c-66bf151ec16b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.760307 Aug 27 03:18:37.411507 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1266/2586] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:36 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:37.425549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:37.428547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:37.429456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:37.437201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.437953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.440265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.442503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.446847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.448894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.461862 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a95d3fc-7c7b-4797-80cd-99393f5a6837 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.656008 Aug 27 03:18:37.461862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1321/2587] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:36 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:37.489162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:37.490565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:37.513810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.515157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.517306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.518890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.520226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.521481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.577598 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Cannot 'resume' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action HTTP/1.1 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 14 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: {"resume": {}} Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'resume' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'resume': {}}} Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d in vm_state active. Cannot resume while the instance is in this state. Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:37.581055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:37.585247 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:37.585247 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:37.585247 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:37.585247 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:37.585247 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:37.585247 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:18:37.585247 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:37.586957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 409 to user: Cannot 'resume' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:37.587998 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1df823ed-0adf-44a2-994a-9a0603ae6d91 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 409 len: 144 microversion: 2.1 time: 0.108625 Aug 27 03:18:37.589071 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1322/2588] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:37 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 144 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:18:37.604379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:37.607617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:37.623733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.627618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.630756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.632311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.633215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.634830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.793596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:37.807461 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb191dd5-ce09-4629-80d7-76cbdb2f1c92 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.394012 Aug 27 03:18:37.808331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1267/2589] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:37 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:38.332394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:38.341676 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b984d21b-3acd-4a96-b512-fa495900fabb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.747996 Aug 27 03:18:38.346621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1323/2590] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:37 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:38.373717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:38.374476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:38.397110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.401664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.402442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:38.403951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.406067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.410036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:38.425021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:38.425652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:38.435581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.436074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.436511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:38.442127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.442701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.443154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:38.879742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:38.895440 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-942aefca-9f97-482c-a308-cdacdf0c2da0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.473667 Aug 27 03:18:38.911240 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1324/2591] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:38 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:38.926929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:38.927572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:38.936241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.936737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.937181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:38.937913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.938448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.938903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.245947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:39.257795 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70c667eb-1c85-44b5-9a40-9411b8c727d8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.341714 Aug 27 03:18:39.270736 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1325/2592] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:38 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:39.294220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e55e5dfe-3cbe-4b33-bf7d-2f2846e8f9db req-1dc661ec-94a1-43e1-a80d-46d854c9e5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "name": "network-vif-plugged", "status": "completed", "tag": "91ea267b-1f10-4843-821a-486338c959d6"}, {"server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "name": "network-vif-plugged", "status": "completed", "tag": "d0db8762-2daf-490e-abf9-98c9d4e87d31"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:39.340153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e55e5dfe-3cbe-4b33-bf7d-2f2846e8f9db req-1dc661ec-94a1-43e1-a80d-46d854c9e5eb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.350605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e55e5dfe-3cbe-4b33-bf7d-2f2846e8f9db req-1dc661ec-94a1-43e1-a80d-46d854c9e5eb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.351163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e55e5dfe-3cbe-4b33-bf7d-2f2846e8f9db req-1dc661ec-94a1-43e1-a80d-46d854c9e5eb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.383328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e55e5dfe-3cbe-4b33-bf7d-2f2846e8f9db req-1dc661ec-94a1-43e1-a80d-46d854c9e5eb service nova] Creating event network-vif-plugged:91ea267b-1f10-4843-821a-486338c959d6 for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:39.390767 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e55e5dfe-3cbe-4b33-bf7d-2f2846e8f9db req-1dc661ec-94a1-43e1-a80d-46d854c9e5eb service nova] Creating event network-vif-plugged:d0db8762-2daf-490e-abf9-98c9d4e87d31 for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:39.404579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e55e5dfe-3cbe-4b33-bf7d-2f2846e8f9db req-1dc661ec-94a1-43e1-a80d-46d854c9e5eb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.132192 Aug 27 03:18:39.405494 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1326/2593] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:39.417263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:39.419993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:39.443324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.452401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.456065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.459958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.460752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.463108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.521892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:39.561190 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02ab232d-f41e-4e52-a4c1-1c5f3659b05a tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145851 Aug 27 03:18:39.562869 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1327/2594] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:18:39 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:39.576151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:39.586152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:39.605086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.611943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.612410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.613173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.614408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.618171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.806781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:39.827082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35212d84-8d19-4fde-badc-84370684eef2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.459329 Aug 27 03:18:39.846591 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1268/2595] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:38 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:39.924580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:39.925203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:39.944314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.950212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.953573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.957470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.966865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.968373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.970220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lazy-loading 'services' on Instance uuid 1fa9a826-8f42-4671-86f6-9ee58104324a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:40.220152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-587718ac-7d27-4ef1-aa8c-374449b9f2bb tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments/4fe8f22d-9ef9-4204-ad85-db554f12af60" status: 202 len: 0 microversion: 2.1 time: 0.648753 Aug 27 03:18:40.220780 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1328/2596] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:18:39 2022] DELETE /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments/4fe8f22d-9ef9-4204-ad85-db554f12af60 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:18:40.242017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fccf2ba-0b56-45e3-bf02-7e791db32c2b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fccf2ba-0b56-45e3-bf02-7e791db32c2b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 160 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "543c57a2-cb9a-4ef1-87c5-f860c6ad661a"}]}} Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': '', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'networks': [{'uuid': '543c57a2-cb9a-4ef1-87c5-f860c6ad661a'}]}}} Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi '' Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:18:40.256197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fccf2ba-0b56-45e3-bf02-7e791db32c2b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:40.260768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0fccf2ba-0b56-45e3-bf02-7e791db32c2b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021644 Aug 27 03:18:40.286055 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1329/2597] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:40 2022] POST /compute/v2.1/servers => generated 108 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:18:40.291973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:40.292844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:40.326364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.327996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.329494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:40.330836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.331917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.333066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:40.540620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:40.556078 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f54264f-a358-4c03-8343-bbd7d6e73b44 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.635474 Aug 27 03:18:40.556961 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1269/2598] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:39 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:40.565107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:40.571056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:40.594228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.595881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.596489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:40.601337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.601826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.602306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:40.718032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:40.727735 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c252311-7181-4829-9df8-5b90211c32ba tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.440307 Aug 27 03:18:40.743391 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1330/2599] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:40 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:40.762941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:40.764222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:40.779623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.781024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.781780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:40.783730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:40.784745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:40.785624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.130140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:41.140267 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5a40996-347b-46ee-a149-f82b7cdf1cee tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.382040 Aug 27 03:18:41.141709 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1331/2600] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:40 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:41.154485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:41.172214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb9ff92b-07b8-4515-a0ef-5342e2abb946 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:41.173706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2a05de4-2d2f-426d-93b3-d19b83dbafd4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.615385 Aug 27 03:18:41.174367 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1270/2601] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:40 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:41.177086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb9ff92b-07b8-4515-a0ef-5342e2abb946 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: c6ac7ccc-89b4-4196-8763-550bff55aba2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:41.197350 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fb9ff92b-07b8-4515-a0ef-5342e2abb946 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance c6ac7ccc-89b4-4196-8763-550bff55aba2 could not be found. Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb9ff92b-07b8-4515-a0ef-5342e2abb946 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/c6ac7ccc-89b4-4196-8763-550bff55aba2/action HTTP/1.1 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 14 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: {"shelve": {}} Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance c6ac7ccc-89b4-4196-8763-550bff55aba2 could not be found. Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'c6ac7ccc-89b4-4196-8763-550bff55aba2', 'body': {'shelve': {}}} Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6ac7ccc-89b4-4196-8763-550bff55aba2 could not be found. Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6ac7ccc-89b4-4196-8763-550bff55aba2 could not be found. Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:41.214618 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:41.224562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:41.224562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:41.224562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6ac7ccc-89b4-4196-8763-550bff55aba2 could not be found. Aug 27 03:18:41.224562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.224562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb9ff92b-07b8-4515-a0ef-5342e2abb946 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance c6ac7ccc-89b4-4196-8763-550bff55aba2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:41.224562 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb9ff92b-07b8-4515-a0ef-5342e2abb946 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/c6ac7ccc-89b4-4196-8763-550bff55aba2/action" status: 404 len: 111 microversion: 2.1 time: 0.058888 Aug 27 03:18:41.224562 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1332/2602] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:41 2022] POST /compute/v2.1/servers/c6ac7ccc-89b4-4196-8763-550bff55aba2/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:41.228424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:41.228424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:41.233836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.234366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.234847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.236269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.236738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.237178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.467820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-14d78a68-5e2c-42b4-a303-ef532123ec81 req-57706491-9578-4381-8a1c-6246d49a0263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19af2224-c625-4fe0-8a7d-025d320fdc60", "name": "network-vif-plugged", "status": "completed", "tag": "1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:41.494006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:41.515835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-14d78a68-5e2c-42b4-a303-ef532123ec81 req-57706491-9578-4381-8a1c-6246d49a0263 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.516770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-14d78a68-5e2c-42b4-a303-ef532123ec81 req-57706491-9578-4381-8a1c-6246d49a0263 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.517477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-14d78a68-5e2c-42b4-a303-ef532123ec81 req-57706491-9578-4381-8a1c-6246d49a0263 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.577483 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-14d78a68-5e2c-42b4-a303-ef532123ec81 req-57706491-9578-4381-8a1c-6246d49a0263 service nova] Creating event network-vif-plugged:1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f for instance 19af2224-c625-4fe0-8a7d-025d320fdc60 on n-h2-852086-5 Aug 27 03:18:41.595539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-14d78a68-5e2c-42b4-a303-ef532123ec81 req-57706491-9578-4381-8a1c-6246d49a0263 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130945 Aug 27 03:18:41.596483 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1333/2603] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:18:41.613710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:41.616451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:41.636073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.638364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.640633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.642220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.647800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.648378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.991656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:42.003205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4fe63b20-afac-442b-ba8e-e4b4c8cfccc3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.780575 Aug 27 03:18:42.008103 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1271/2604] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:41 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:42.037081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:42.040896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:42.085609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:42.086512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:42.087131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:42.088296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:42.089108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:42.107158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:42.320094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:42.342749 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-644350e7-c9d8-4a99-bbd0-57957dc9deb8 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1354 microversion: 2.1 time: 0.743618 Aug 27 03:18:42.343706 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1334/2605] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:41 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1354 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:42.366816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:42.370584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:42.397206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:42.397699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:42.398528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:42.399812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:42.410734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:42.427321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:43.005317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:43.024178 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f407d91e-6c71-406e-92df-0038890f81e1 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.668900 Aug 27 03:18:43.025488 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1335/2606] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:42 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:43.264451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:43.279194 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f7894641-04b5-4c75-b021-3df3920bcc52 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.251489 Aug 27 03:18:43.280919 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1272/2607] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:42 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:43.322895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:43.324228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:43.336165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:43.343201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:43.343659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:43.344969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:43.345426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:43.346011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:43.385085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:43.385955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:43.398391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:43.399069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:43.402662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:43.403948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:43.411933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:43.413250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:43.421878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lazy-loading 'flavor' on Instance uuid 45dca35c-d122-40f4-986b-5b77851f6f3d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:44.238759 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68e52a1f-485d-4bc1-a0e9-9659e3a5c74d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.920765 Aug 27 03:18:44.249059 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1336/2608] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:43 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:18:44.303316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:44.304673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:44.359287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:44.367161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:44.370763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:44.372242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:44.379200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:44.383731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:44.670678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:44.690085 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f283e3e9-68b7-45cd-bbc1-17af01ae5c59 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1805 microversion: 2.1 time: 1.309356 Aug 27 03:18:44.691059 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1273/2609] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:43 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1805 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:44.704479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:44.712144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:44.728776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:44.729823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:44.730833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:44.732597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:44.733498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:44.738177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:44.738789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:44.754123 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-955ce7ff-414b-42b9-bc32-a1e94635128a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1308 microversion: 2.1 time: 0.501304 Aug 27 03:18:44.756164 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1337/2610] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:44 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:45.037311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a76968f-e4fa-43b7-b980-d99fb3cefad8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Action: 'create', calling method: .version_select at 0x7fe457500550>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:45.491880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:45.514921 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-063990b3-1378-4252-8287-be7243bc6593 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 0.822394 Aug 27 03:18:45.515548 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1274/2611] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:44 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:45.529549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:45.541687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:45.557963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.562742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.564587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:45.565621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.568396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.569042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:45.637947 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38fd579c-57ad-4dca-8716-8d80afb764d3 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b/ips" status: 200 len: 219 microversion: 2.1 time: 0.114087 Aug 27 03:18:45.652198 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1275/2612] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:18:45 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b/ips => generated 219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:45.664620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:45.665608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:45.685433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.686659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.688277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:45.690088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.691601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.694043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:45.765494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:45.907249 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfc24f9c-2079-4a63-a24a-e6ac652eee9b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 204 len: 0 microversion: 2.1 time: 0.253173 Aug 27 03:18:45.908162 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1276/2613] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:45 2022] DELETE /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:45.915469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:45.927346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:45.934041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.939666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.940522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:45.941564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:45.942460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:45.943406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:46.664363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:46.678936 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc6f9d9f-205c-4dc1-b5d2-8157bbba47df tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1488 microversion: 2.1 time: 0.769311 Aug 27 03:18:46.679528 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1277/2614] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:45 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1488 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:46.684301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:46.695175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:46.702292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:46.703053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:46.715019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:46.716057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:46.717270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:46.717890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:46.723153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:47.154927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:47.169046 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2734e270-7a20-4e7d-8f3d-d191f14fbe24 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1811 microversion: 2.1 time: 0.488136 Aug 27 03:18:47.184573 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1278/2615] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:46 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1811 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:47.197453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:47.211623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:47.231701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:47.243581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:47.244205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:47.245133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:47.245784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:47.246388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:47.695030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:47.720280 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a62e023c-d553-4611-b3ad-353a21eb67ab tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 0.526752 Aug 27 03:18:47.727324 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1279/2616] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:47 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:47.740801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1487410859"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:47.746278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:47.765836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:47.767488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:47.769259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:47.774871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:47.776147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:47.777169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:48.446390 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bb43c939-928f-45a4-87ba-04f0fd38dce4 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "POST /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60/action" status: 202 len: 0 microversion: 2.1 time: 0.717127 Aug 27 03:18:48.449727 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1280/2617] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:18:47 2022] POST /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:18:48.464014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:48.465140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:48.484164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:48.487086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:48.487885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:48.504799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:48.514327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:48.516362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:48.669189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a76968f-e4fa-43b7-b980-d99fb3cefad8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.911375 Aug 27 03:18:48.669777 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1338/2618] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:18:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:48.687769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c09c96ac-5a6a-4f0e-8926-aed70777429a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4575f9670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:48.901632 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c09c96ac-5a6a-4f0e-8926-aed70777429a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538" status: 200 len: 1414 microversion: 2.1 time: 0.229592 Aug 27 03:18:48.912053 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1339/2619] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:48 2022] GET /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 => generated 1414 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:48.929235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-442e1d00-9465-4a5a-bc1a-ed7e9224e910 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Calling method '.version_select at 0x7fe4576295e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:49.383640 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-442e1d00-9465-4a5a-bc1a-ed7e9224e910 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/8750c278-9454-4d71-bf69-d99a4234bd2c" status: 200 len: 142 microversion: 2.1 time: 0.468785 Aug 27 03:18:49.384545 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1340/2620] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:18:48 2022] GET /compute/v2.1/os-floating-ips/8750c278-9454-4d71-bf69-d99a4234bd2c => generated 142 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:49.394973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:49.395617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:49.442905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:49.444561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:49.445036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:49.445969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:49.446832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:49.447334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:49.579916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:49.601062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c250fed-85ff-4dbb-ad94-f286b9835360 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1811 microversion: 2.1 time: 1.149972 Aug 27 03:18:49.628583 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1281/2621] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:48 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1811 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:49.656650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-423ff805-9af2-435a-a09d-bc6a3f064a20 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457f9ca60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:49.753404 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-423ff805-9af2-435a-a09d-bc6a3f064a20 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538" status: 200 len: 1414 microversion: 2.1 time: 0.122888 Aug 27 03:18:49.759910 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1282/2622] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:49 2022] GET /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:49.769605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0d129fe-0988-4977-8ca5-7a0d409496d1 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Calling method '.version_select at 0x7fe457d72670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:49.868495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:49.888860 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc560339-182c-41e9-a4ed-fc210fc7f251 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 0.499229 Aug 27 03:18:49.891824 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1341/2623] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:49 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:49.907460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ae7bfd6-de1e-4646-b4b9-b540b12262b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4574bd040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:50.209006 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ae7bfd6-de1e-4646-b4b9-b540b12262b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538" status: 204 len: 0 microversion: 2.1 time: 0.314007 Aug 27 03:18:50.209401 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1342/2624] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:49 2022] DELETE /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:50.239587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e9f839a-430a-4d1d-8690-2c0798a4b0f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe4574bdaf0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:50.304734 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6e9f839a-430a-4d1d-8690-2c0798a4b0f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Image not found. Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e9f839a-430a-4d1d-8690-2c0798a4b0f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 HTTP/1.1 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '2b3dd22a-d78d-4ff5-abe7-2be1d9f14538'} Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:18:50.309904 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 could not be found. Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e9f839a-430a-4d1d-8690-2c0798a4b0f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:50.313698 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e9f839a-430a-4d1d-8690-2c0798a4b0f8 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538" status: 404 len: 62 microversion: 2.1 time: 0.092655 Aug 27 03:18:50.319904 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1343/2625] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:18:50 2022] GET /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:18:50.329773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:50.334866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:50.367748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:50.368251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:50.369237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:50.370240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:50.370922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:50.371595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:50.569120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0d129fe-0988-4977-8ca5-7a0d409496d1 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.808013 Aug 27 03:18:50.570058 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1283/2626] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:18:49 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:50.582978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea0af457-5576-400e-adce-d66c3592a9b1 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Calling method '.version_select at 0x7fe45c3e3670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:51.192067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:51.218275 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c91d6938-a8b4-4dd8-b6f8-b32eead8073e tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1506 microversion: 2.1 time: 0.894903 Aug 27 03:18:51.223207 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1344/2627] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:50 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1506 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:51.244632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:51.245758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:51.273290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.274232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.274876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.275802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.277376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.278879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.643382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:51.654058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d473098-b2a3-443c-addc-e05716b0ff2b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1790 microversion: 2.1 time: 0.427438 Aug 27 03:18:51.654700 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1345/2628] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:51 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1790 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:51.664962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e677c5a9-798f-4aed-8b14-fd2657c1b1d5 req-767dc29b-06c4-4916-a505-0c0bf506b631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "name": "network-vif-deleted", "tag": "91ea267b-1f10-4843-821a-486338c959d6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:51.682526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e677c5a9-798f-4aed-8b14-fd2657c1b1d5 req-767dc29b-06c4-4916-a505-0c0bf506b631 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.683025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e677c5a9-798f-4aed-8b14-fd2657c1b1d5 req-767dc29b-06c4-4916-a505-0c0bf506b631 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.683436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e677c5a9-798f-4aed-8b14-fd2657c1b1d5 req-767dc29b-06c4-4916-a505-0c0bf506b631 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.707625 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e677c5a9-798f-4aed-8b14-fd2657c1b1d5 req-767dc29b-06c4-4916-a505-0c0bf506b631 service nova] Creating event network-vif-deleted:91ea267b-1f10-4843-821a-486338c959d6 for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:51.716108 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e677c5a9-798f-4aed-8b14-fd2657c1b1d5 req-767dc29b-06c4-4916-a505-0c0bf506b631 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060041 Aug 27 03:18:51.716920 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1346/2629] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:51.728632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:51.732392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:51.742102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.743092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.743753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.744661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.745340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.746126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.805198 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-addaf90c-f812-4299-8f94-0ce963cda9a0 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086781 Aug 27 03:18:51.806062 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1347/2630] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:18:51 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:18:51.812161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:51.813032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:51.821732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.822786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.823596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:51.825466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:51.826104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:51.826719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:52.208431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:52.220189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21b1ce13-8427-409d-9a4a-70cfdb82d6fc tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 0.412417 Aug 27 03:18:52.220781 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1348/2631] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:51 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:52.239240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:52.243047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:52.252762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:52.253606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:52.254428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:52.256559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:52.257274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:52.257914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:52.297715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:52.301245 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-677816b9-363d-4574-803e-5f66848a0784 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078054 Aug 27 03:18:52.302507 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1349/2632] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:18:52 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:18:52.311513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1391263662", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7093704a-78fe-4bac-bdfd-3f9ab389ee32"}], "security_groups": [{"name": "tempest-securitygroup--1430525282"}], "key_name": "tempest-keypair-509894303", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0228915d-15bf-44fd-a10d-8d0540923809", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:52.558350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] validate_networks() for [('7093704a-78fe-4bac-bdfd-3f9ab389ee32', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:18:53.512425 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea0af457-5576-400e-adce-d66c3592a9b1 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/8750c278-9454-4d71-bf69-d99a4234bd2c" status: 202 len: 0 microversion: 2.1 time: 2.930964 Aug 27 03:18:53.514253 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1284/2633] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:18:50 2022] DELETE /compute/v2.1/os-floating-ips/8750c278-9454-4d71-bf69-d99a4234bd2c => generated 0 bytes in 2936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:18:53.538934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:53.542981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:53.565733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:53.566272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:53.566714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:53.573459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:53.573976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:53.574450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:53.637791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Getting quotas for project 9da3b3a423b540d2a9962edeb643056d. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:18:53.649569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Getting quotas for user 8e7f693d615e4882be652a94ebe25854 and project 9da3b3a423b540d2a9962edeb643056d. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:18:53.695529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:18:53.696355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:18:53.697144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:18:53.699054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:18:53.701112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:18:53.726803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:53.727613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:53.728276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:53.729361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:53.730152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:53.731081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:53.764825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Getting quotas for project 9da3b3a423b540d2a9962edeb643056d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:18:53.772528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Getting quotas for user 8e7f693d615e4882be652a94ebe25854 and project 9da3b3a423b540d2a9962edeb643056d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:18:54.018889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:18:54.021603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0228915d-15bf-44fd-a10d-8d0540923809',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:18:54.071381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:54.099335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-557575f7-0112-4720-a43a-b4ecac53247a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1488 microversion: 2.1 time: 0.582675 Aug 27 03:18:54.103957 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1285/2634] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:53 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1488 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:54.116427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:54.119672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:54.153333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.156220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.158973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.160052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.162968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.164352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.232704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:54.409137 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ff9ca1d-b760-46d7-8e91-2f93a4ff2a51 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.105286 Aug 27 03:18:54.410788 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1350/2635] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:18:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 2107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:18:54.423877 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-18fe1e4d-e188-409f-ba36-bd4e77e04896 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 204 len: 0 microversion: 2.1 time: 0.315176 Aug 27 03:18:54.425434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:54.426261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:54.430262 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1286/2636] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:54 2022] DELETE /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:54.443544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:54.444314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.444799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:54.445982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.446495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.448411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.450846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.453997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.475376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.476072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.476530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.477281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.477742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.478209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.562515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.563054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.565362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.566051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lazy-loading 'fault' on Instance uuid d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:54.738457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:54.761399 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4a442ba-407d-4c46-9c09-32353cd9c42d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 200 len: 1302 microversion: 2.1 time: 0.349277 Aug 27 03:18:54.775293 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1351/2637] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:54 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 1302 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:54.802815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:54.812400 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a53150aa-87c9-4d58-810e-93ca25e119aa tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 0.379748 Aug 27 03:18:54.812999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f934cb7a-7868-44ef-93c4-1fdae876a7c3 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Action: 'create', calling method: .version_select at 0x7fe45745b1f0>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:54.813615 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1287/2638] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:54 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:54.818982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-24624eb9-54e6-46c9-b7be-482d881032ec req-4ddf3006-593f-46b3-b0ac-db7d5a8f9315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "name": "network-vif-deleted", "tag": "091c60ec-a371-4312-9342-113cf269c64e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:54.838071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-24624eb9-54e6-46c9-b7be-482d881032ec req-4ddf3006-593f-46b3-b0ac-db7d5a8f9315 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.838645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-24624eb9-54e6-46c9-b7be-482d881032ec req-4ddf3006-593f-46b3-b0ac-db7d5a8f9315 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.839382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-24624eb9-54e6-46c9-b7be-482d881032ec req-4ddf3006-593f-46b3-b0ac-db7d5a8f9315 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.860715 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-24624eb9-54e6-46c9-b7be-482d881032ec req-4ddf3006-593f-46b3-b0ac-db7d5a8f9315 service nova] Creating event network-vif-deleted:091c60ec-a371-4312-9342-113cf269c64e for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:54.868038 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-24624eb9-54e6-46c9-b7be-482d881032ec req-4ddf3006-593f-46b3-b0ac-db7d5a8f9315 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052503 Aug 27 03:18:54.873643 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1288/2639] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:54.894752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:54.895381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:54.928584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.929835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.931965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:54.933065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:54.934225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:54.935246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.004062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:55.249206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-72b55d12-6df3-487f-8c65-f0c7680c9a58 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 204 len: 0 microversion: 2.1 time: 0.373256 Aug 27 03:18:55.252962 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1289/2640] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:54 2022] DELETE /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:55.267487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51870d92-a8ed-445c-9d16-0e8d10849bb6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.268568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51870d92-a8ed-445c-9d16-0e8d10849bb6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:55.347409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51870d92-a8ed-445c-9d16-0e8d10849bb6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:55.356884 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51870d92-a8ed-445c-9d16-0e8d10849bb6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1121 microversion: 2.1 time: 0.101799 Aug 27 03:18:55.357492 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1290/2641] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:55 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1121 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:55.365015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.365351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:55.373650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.374251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.374757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.376709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.377178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.377613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.603207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:55.614534 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35ef3fa3-3d8a-47dc-87e0-8ecefcdeab65 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1680 microversion: 2.1 time: 0.255295 Aug 27 03:18:55.616784 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1291/2642] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:55 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:55.622667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f69fecf0-afe5-4bdf-b250-ee168800e5fe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457d3e160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.654022 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f69fecf0-afe5-4bdf-b250-ee168800e5fe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Image not found. Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f69fecf0-afe5-4bdf-b250-ee168800e5fe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 HTTP/1.1 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '2b3dd22a-d78d-4ff5-abe7-2be1d9f14538'} Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 to delete Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 could not be found. Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.657057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:18:55.661402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.665104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f69fecf0-afe5-4bdf-b250-ee168800e5fe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:55.667461 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f69fecf0-afe5-4bdf-b250-ee168800e5fe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538" status: 404 len: 62 microversion: 2.1 time: 0.049341 Aug 27 03:18:55.668267 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1292/2643] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:55 2022] DELETE /compute/v2.1/images/2b3dd22a-d78d-4ff5-abe7-2be1d9f14538 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:18:55.684280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.684903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:55.705636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.710462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.711735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.713326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.714777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.716059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.787303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:55.916253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.compute.api [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Instance is already in deleting state, ignoring this request Aug 27 03:18:55.917294 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a45e2e31-df0c-4c6f-9107-b8e818558a67 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 204 len: 0 microversion: 2.1 time: 0.243523 Aug 27 03:18:55.921134 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1293/2644] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:55 2022] DELETE /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:55.929172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.929797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:55.937674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.939532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.939532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.939532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.940097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.940442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.963456 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] HTTP exception thrown: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Request method failure captured: Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b HTTP/1.1 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzdYEqZHid7vHr_quxySmiZnomGBr8Vkjs_2h6ugT47-n5zcA2qBwcKY0c2tX1tjTEPNTvnYm-pU11UXjvtVnKMK_o10_IOA1gvhB781zDXjWpToE-L2ROfKqDHJpYp2EEtfZiHLt9_LGD2c9XzSxQhh0hA7I8Vf8eAavYVRvYA5Dc Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2322c18d287b49b3839208e66ea07871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2322c18d287b49b3839208e66ea07871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}] Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestMultiNic-1878987803 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0be937d33b6d40daba326e75e6eb35b6 Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd19e16a4-55b2-42b3-8dc2-ad7c4aa6941b'} Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:55.965376 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Returning 404 to user: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:55.970388 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bdaf8891-5f57-4be5-8cc8-21f54782491b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 404 len: 111 microversion: 2.1 time: 0.044640 Aug 27 03:18:55.971597 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1294/2645] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:55 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:55.979657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:55.980951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:55.993641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.994583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.995645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:55.997019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:55.998344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:55.999129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.008760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:56.790735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:56.801950 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-350f6862-5c69-481e-bda1-86eb80094b28 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 0.829109 Aug 27 03:18:56.819485 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1295/2646] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:55 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:56.833263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:56.834276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:56.838474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:56.853917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.855911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.857315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:56.863189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:56.865461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:56.866265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:57.404606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:57.420740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff505082-6b58-4167-8937-608c3a2080ea tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1494 microversion: 2.1 time: 0.595101 Aug 27 03:18:57.422047 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1296/2647] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:56 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1494 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:57.429574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:57.431760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:57.439441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:57.440810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:57.441518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:57.443601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:57.445270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:57.446105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:57.746051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:57.770700 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10256b9b-d9c2-42e1-9bf9-bc0b40877142 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1237 microversion: 2.1 time: 0.346942 Aug 27 03:18:57.771685 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1297/2648] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:57 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1237 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:57.776497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:57.777691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:57.786504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:57.787064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:57.788100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:57.790507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:57.792332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:57.792782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:58.571636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:58.585703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad86465c-30f7-4fe6-9858-876c1e13e2b9 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1680 microversion: 2.1 time: 0.813035 Aug 27 03:18:58.587840 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1298/2649] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:57 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1680 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:58.617653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-71826231-ab10-42fa-9374-0dc497aad594 req-aede9118-362f-4703-a527-2a636f4a3dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19af2224-c625-4fe0-8a7d-025d320fdc60", "name": "network-vif-plugged", "status": "completed", "tag": "1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:58.650949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-71826231-ab10-42fa-9374-0dc497aad594 req-aede9118-362f-4703-a527-2a636f4a3dae service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:58.652067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-71826231-ab10-42fa-9374-0dc497aad594 req-aede9118-362f-4703-a527-2a636f4a3dae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:58.652768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-71826231-ab10-42fa-9374-0dc497aad594 req-aede9118-362f-4703-a527-2a636f4a3dae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:58.670949 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-71826231-ab10-42fa-9374-0dc497aad594 req-aede9118-362f-4703-a527-2a636f4a3dae service nova] Creating event network-vif-plugged:1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f for instance 19af2224-c625-4fe0-8a7d-025d320fdc60 on n-h2-852086-5 Aug 27 03:18:58.680886 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-71826231-ab10-42fa-9374-0dc497aad594 req-aede9118-362f-4703-a527-2a636f4a3dae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091178 Aug 27 03:18:58.681778 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1299/2650] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:58.687695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d272f9e1-5664-45f2-ba92-e6764ffaeea0 req-76dfb902-a791-4838-b21c-0b04acb31629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b", "name": "network-vif-deleted", "tag": "d0db8762-2daf-490e-abf9-98c9d4e87d31"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:58.705881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d272f9e1-5664-45f2-ba92-e6764ffaeea0 req-76dfb902-a791-4838-b21c-0b04acb31629 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:58.707485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d272f9e1-5664-45f2-ba92-e6764ffaeea0 req-76dfb902-a791-4838-b21c-0b04acb31629 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:58.708188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d272f9e1-5664-45f2-ba92-e6764ffaeea0 req-76dfb902-a791-4838-b21c-0b04acb31629 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:58.726109 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d272f9e1-5664-45f2-ba92-e6764ffaeea0 req-76dfb902-a791-4838-b21c-0b04acb31629 service nova] Creating event network-vif-deleted:d0db8762-2daf-490e-abf9-98c9d4e87d31 for instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b on n-h2-852086-5 Aug 27 03:18:58.737269 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d272f9e1-5664-45f2-ba92-e6764ffaeea0 req-76dfb902-a791-4838-b21c-0b04acb31629 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051254 Aug 27 03:18:58.739873 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1300/2651] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:58.748434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:58.751766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:58.768546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:58.770714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:58.771464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:58.773316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:58.774671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:58.775846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:59.433233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:59.456579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c01a2f2a-8ced-4c66-8796-7877afd285e0 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.704157 Aug 27 03:18:59.459365 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1301/2652] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:58 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:59.468697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:59.475278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:59.490492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:59.491402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:59.492445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:59.496415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:59.497149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:59.497818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:59.743675 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f934cb7a-7868-44ef-93c4-1fdae876a7c3 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.966204 Aug 27 03:18:59.745217 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1352/2653] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:18:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:59.750214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:59.751917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:59.767262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:59.768047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:59.772200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:59.775672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:59.778295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:59.780103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:00.025166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:00.035904 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f57c9e60-09fb-45ec-ba85-4ddc6eb4e507 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1237 microversion: 2.1 time: 0.289273 Aug 27 03:19:00.043623 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1353/2654] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:59 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1237 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:00.061049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:00.070004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:00.088885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:00.101494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:00.102664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:00.103890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:00.104570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:00.111478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:00.469713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:00.499955 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62a149ec-e406-47df-b733-4128398d8ba6 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1613 microversion: 2.1 time: 0.453566 Aug 27 03:19:00.501158 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1354/2655] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:00 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1613 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:00.516278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce2b6ede-50c7-4aee-aee7-1abef0a1d7f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Calling method '.version_select at 0x7fe457569af0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:00.673146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e2476870c64964814aabc9c60399cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c273d054e33423dbc7aad25e6914822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:00.686545 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17826e91-916b-4216-b287-2584f5fbece9 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 200 len: 1494 microversion: 2.1 time: 1.225640 Aug 27 03:19:00.687920 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1302/2656] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:59 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 1494 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:00.701769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:00.702848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:00.719724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:00.720779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:00.722287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:00.724708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:00.727578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:00.729474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:01.499676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:01.553528 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1cd054ef-cf9b-4abc-9ac7-da3aa9e2a2c1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.864173 Aug 27 03:19:01.558432 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1303/2657] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:00 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:01.591484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-51e6bee9-e125-4d35-bb8d-800b3534bc13 req-d244eeb7-7bcf-4dbf-91ff-fbe1e4820368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dca35c-d122-40f4-986b-5b77851f6f3d", "name": "network-vif-plugged", "status": "completed", "tag": "2018ab3e-4e07-4098-b98e-9002dd279856"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:01.616694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-51e6bee9-e125-4d35-bb8d-800b3534bc13 req-d244eeb7-7bcf-4dbf-91ff-fbe1e4820368 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:01.618252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-51e6bee9-e125-4d35-bb8d-800b3534bc13 req-d244eeb7-7bcf-4dbf-91ff-fbe1e4820368 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:01.620432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-51e6bee9-e125-4d35-bb8d-800b3534bc13 req-d244eeb7-7bcf-4dbf-91ff-fbe1e4820368 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:01.652909 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-51e6bee9-e125-4d35-bb8d-800b3534bc13 req-d244eeb7-7bcf-4dbf-91ff-fbe1e4820368 service nova] Creating event network-vif-plugged:2018ab3e-4e07-4098-b98e-9002dd279856 for instance 45dca35c-d122-40f4-986b-5b77851f6f3d on n-h1-852086-5 Aug 27 03:19:01.665870 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-51e6bee9-e125-4d35-bb8d-800b3534bc13 req-d244eeb7-7bcf-4dbf-91ff-fbe1e4820368 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103692 Aug 27 03:19:01.671261 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1304/2658] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:01.681709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-82afa671-b524-499d-b83e-19d6ab442abc req-6452c5c2-f6c2-4e37-aeec-e2ba2857b557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19af2224-c625-4fe0-8a7d-025d320fdc60", "name": "network-vif-deleted", "tag": "1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:01.695807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-82afa671-b524-499d-b83e-19d6ab442abc req-6452c5c2-f6c2-4e37-aeec-e2ba2857b557 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:01.712455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-82afa671-b524-499d-b83e-19d6ab442abc req-6452c5c2-f6c2-4e37-aeec-e2ba2857b557 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:01.713575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-82afa671-b524-499d-b83e-19d6ab442abc req-6452c5c2-f6c2-4e37-aeec-e2ba2857b557 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:01.746481 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-82afa671-b524-499d-b83e-19d6ab442abc req-6452c5c2-f6c2-4e37-aeec-e2ba2857b557 service nova] Creating event network-vif-deleted:1f27db44-e5d9-4c0f-bc3c-3fcbe51beb4f for instance 19af2224-c625-4fe0-8a7d-025d320fdc60 on n-h2-852086-5 Aug 27 03:19:01.763361 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-82afa671-b524-499d-b83e-19d6ab442abc req-6452c5c2-f6c2-4e37-aeec-e2ba2857b557 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090000 Aug 27 03:19:01.764791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1305/2659] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:01.774727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:01.780189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:01.804633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:01.805541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:01.806356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:01.807364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:01.808149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:01.808847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:02.135881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:02.149395 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e8e06c77-9ba8-4960-b2e5-010b066f1f77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1237 microversion: 2.1 time: 0.380950 Aug 27 03:19:02.163609 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1306/2660] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:01 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1237 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:02.176139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:02.176703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:02.211502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:02.222957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:02.223670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:02.224598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:02.225218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:02.225834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:02.441431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522ce101954381b3b0f81bbe7cf207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67836807a0446cac6fa01b909e56f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:02.451135 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ecf41971-22e8-44c1-9f78-97bbce63d55b tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 200 len: 1613 microversion: 2.1 time: 0.286029 Aug 27 03:19:02.466597 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1307/2661] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:02 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 1613 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:02.476999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:02.477171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 19af2224-c625-4fe0-8a7d-025d320fdc60] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:02.519411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:02.519946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:02.520377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:02.521103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:02.521563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:02.537855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:02.648923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Instance 19af2224-c625-4fe0-8a7d-025d320fdc60 could not be found. Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 HTTP/1.1 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 19af2224-c625-4fe0-8a7d-025d320fdc60 could not be found. Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '19af2224-c625-4fe0-8a7d-025d320fdc60'} Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19af2224-c625-4fe0-8a7d-025d320fdc60 could not be found. Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19af2224-c625-4fe0-8a7d-025d320fdc60 could not be found. Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:02.654832 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:02.659776 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:02.659776 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:02.659776 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:02.659776 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:02.659776 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19af2224-c625-4fe0-8a7d-025d320fdc60 could not be found. Aug 27 03:19:02.659776 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:02.659776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Instance 19af2224-c625-4fe0-8a7d-025d320fdc60 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:02.664406 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-66c060bf-f1bd-4e8c-90e6-0a39acd5f374 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60" status: 404 len: 111 microversion: 2.1 time: 0.199772 Aug 27 03:19:02.665246 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1308/2662] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:02 2022] GET /compute/v2.1/servers/19af2224-c625-4fe0-8a7d-025d320fdc60 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:02.675404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:02.676056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:02.691551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:02.692084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:02.692472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:02.693192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:02.697429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:02.698134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:03.301759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:03.315730 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11c15936-dc14-4c00-a8a3-c3c372e41967 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.643530 Aug 27 03:19:03.320962 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1309/2663] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:02 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:03.355458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-147f8644-99f0-403d-bd57-56d0118d4abe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457bc0dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:03.413278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-147f8644-99f0-403d-bd57-56d0118d4abe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Image not found. Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-147f8644-99f0-403d-bd57-56d0118d4abe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 HTTP/1.1 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '85415524-0879-4ac6-86cc-4bf40346cd72'} Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 85415524-0879-4ac6-86cc-4bf40346cd72 to delete Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85415524-0879-4ac6-86cc-4bf40346cd72 could not be found. Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:03.415305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:19:03.419760 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:03.422999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-147f8644-99f0-403d-bd57-56d0118d4abe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:03.424764 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-147f8644-99f0-403d-bd57-56d0118d4abe tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72" status: 404 len: 62 microversion: 2.1 time: 0.093208 Aug 27 03:19:03.430977 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1310/2664] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:03 2022] DELETE /compute/v2.1/images/85415524-0879-4ac6-86cc-4bf40346cd72 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:19:03.459039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:03.460872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:03.495076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:03.497394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:03.507969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:03.513594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:03.515480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:03.516682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:03.755990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:03.785484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:04.064323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:04.084608 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-086b064f-e5c5-4746-8715-59a28a7c9fb8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1305 microversion: 2.1 time: 0.649024 Aug 27 03:19:04.085205 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1311/2665] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:03 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1305 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:04.111450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:04.111956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:04.136341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.136997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.137582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.154785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.155356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.155804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.223378 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd HTTP/1.1 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f8be50aa-b202-4a09-9930-8c1ac65408cd'} Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:04.224984 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:04.230031 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82ace91e-b79e-40f2-8159-680b039a72f6 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 404 len: 111 microversion: 2.1 time: 0.122902 Aug 27 03:19:04.245415 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1312/2666] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:04 2022] DELETE /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:04.263852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:04.264621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:04.287289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.287807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.295064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.303083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.304183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.313352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.349617 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] HTTP exception thrown: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Request method failure captured: Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a HTTP/1.1 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYx1CFDSkFaPGGoHPQ408zvdUAAcDm0udHFWNDDyrv1OosGY7kbqy1KNWpdPkJ7Cssaii-bzR-zP-9IyEwZy_chNKkV52A01rc9lNpTGuI21-WJXNaQx6MN7GHFtMDDsTC0RgY70bkE4m787UWfInnHmvWyhI0pG0xVSF7HfMuNjw0A Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9d67836807a0446cac6fa01b909e56f9 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d67836807a0446cac6fa01b909e56f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d67836807a0446cac6fa01b909e56f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d67836807a0446cac6fa01b909e56f9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d67836807a0446cac6fa01b909e56f9"}]}] Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9d67836807a0446cac6fa01b909e56f9 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachSCSIVolumeTestJSON-1542850421-project Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 75522ce101954381b3b0f81bbe7cf207 Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1542850421-project Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1fa9a826-8f42-4671-86f6-9ee58104324a'} Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:04.355554 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.360329 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.360329 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:04.360329 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:04.360329 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:04.360329 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:04.360329 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:04.360329 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.362898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Returning 404 to user: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:04.366902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-691035b6-eac3-4b20-a455-258ff2f279de tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 404 len: 111 microversion: 2.1 time: 0.117514 Aug 27 03:19:04.369290 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1313/2667] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:04 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:04.378068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7e6c88fc-f862-4596-9709-f3fc7ef50e74 req-a600357d-11c4-4e7e-8f0e-6aa37e1509b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa9a826-8f42-4671-86f6-9ee58104324a", "name": "network-vif-deleted", "tag": "daafd905-5453-4802-900a-ba4556bb1f8b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:04.404353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7e6c88fc-f862-4596-9709-f3fc7ef50e74 req-a600357d-11c4-4e7e-8f0e-6aa37e1509b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.407984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7e6c88fc-f862-4596-9709-f3fc7ef50e74 req-a600357d-11c4-4e7e-8f0e-6aa37e1509b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.410466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7e6c88fc-f862-4596-9709-f3fc7ef50e74 req-a600357d-11c4-4e7e-8f0e-6aa37e1509b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.436544 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7e6c88fc-f862-4596-9709-f3fc7ef50e74 req-a600357d-11c4-4e7e-8f0e-6aa37e1509b8 service nova] Creating event network-vif-deleted:daafd905-5453-4802-900a-ba4556bb1f8b for instance 1fa9a826-8f42-4671-86f6-9ee58104324a on n-h1-852086-5 Aug 27 03:19:04.467643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7e6c88fc-f862-4596-9709-f3fc7ef50e74 req-a600357d-11c4-4e7e-8f0e-6aa37e1509b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096450 Aug 27 03:19:04.468947 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1314/2668] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:04.524386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:04.525159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: f8be50aa-b202-4a09-9930-8c1ac65408cd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:04.556627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.557152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.557590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.558529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.559134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.559735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.594540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd HTTP/1.1 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'f8be50aa-b202-4a09-9930-8c1ac65408cd'} Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.605591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:04.610101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:04.610101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:04.610101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:04.610101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:04.610101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. Aug 27 03:19:04.610101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:04.612420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Instance f8be50aa-b202-4a09-9930-8c1ac65408cd could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:04.614734 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3a17df3-dcf4-486f-9d43-27b86a34e26a tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd" status: 404 len: 111 microversion: 2.1 time: 0.144478 Aug 27 03:19:04.622533 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1315/2669] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:04 2022] GET /compute/v2.1/servers/f8be50aa-b202-4a09-9930-8c1ac65408cd => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:04.635142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:04.636044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:04.647551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.648266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.648875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.649758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.651467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.660352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.955201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:04.968077 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2148258f-e4da-4cd9-9060-d2606593c71a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.344119 Aug 27 03:19:04.978591 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1316/2670] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:04 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:04.998722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-186022ef-16d5-4459-9263-58fe47c31ada tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '.version_select at 0x7fe457d32040>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.061509 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-186022ef-16d5-4459-9263-58fe47c31ada tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62626433" status: 202 len: 0 microversion: 2.1 time: 0.074982 Aug 27 03:19:05.062405 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1317/2671] 10.222.0.69 () {58 vars in 1215 bytes} [Sat Aug 27 03:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62626433 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:19:05.080472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f074664-2b94-4534-9e8c-b94d9aeaa1ee tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe45c2be3a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.120293 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3f074664-2b94-4534-9e8c-b94d9aeaa1ee tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Image not found. Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f074664-2b94-4534-9e8c-b94d9aeaa1ee tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e HTTP/1.1 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7b899ed7-84fc-47b2-baeb-68471c8c049e'} Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7b899ed7-84fc-47b2-baeb-68471c8c049e to delete Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7b899ed7-84fc-47b2-baeb-68471c8c049e could not be found. Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.122103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:19:05.127238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.129775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f074664-2b94-4534-9e8c-b94d9aeaa1ee tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:05.130829 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f074664-2b94-4534-9e8c-b94d9aeaa1ee tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e" status: 404 len: 62 microversion: 2.1 time: 0.066942 Aug 27 03:19:05.134674 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1318/2672] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] DELETE /compute/v2.1/images/7b899ed7-84fc-47b2-baeb-68471c8c049e => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:19:05.143562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.147498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.164888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.173239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.175029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.175959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.176577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.177157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.356903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:05.730499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:05.743658 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-481df9c3-691d-4d80-be71-35efb1aad907 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1305 microversion: 2.1 time: 0.606155 Aug 27 03:19:05.743933 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1319/2673] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1305 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:05.760183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.760684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.772982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.773479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.774096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.775255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.775890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.776327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.816800 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc HTTP/1.1 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5e0fd9cc-6856-4230-a8e8-e8f92c613ccc'} Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:05.819148 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.824236 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.826938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:05.834048 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3679bbf7-4aa3-4ad1-ba48-1e867c84e2b7 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 404 len: 111 microversion: 2.1 time: 0.085787 Aug 27 03:19:05.839790 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1320/2674] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:05 2022] DELETE /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:05.852826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.853903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.869927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.871772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.873066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.874587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.877959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.878983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.916727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc HTTP/1.1 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5e0fd9cc-6856-4230-a8e8-e8f92c613ccc'} Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.919696 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.924953 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.924953 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.924953 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:05.924953 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:05.924953 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. Aug 27 03:19:05.924953 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.926250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Instance 5e0fd9cc-6856-4230-a8e8-e8f92c613ccc could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:05.927343 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56e221ca-cc18-4865-ba50-165aeb80cc98 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc" status: 404 len: 111 microversion: 2.1 time: 0.083896 Aug 27 03:19:05.931022 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1321/2675] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] GET /compute/v2.1/servers/5e0fd9cc-6856-4230-a8e8-e8f92c613ccc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:05.941308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8527b5b-0977-4262-b196-bf21f770c3de tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '.version_select at 0x7fe457cf3940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.987952 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d8527b5b-0977-4262-b196-bf21f770c3de tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Image not found. Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8527b5b-0977-4262-b196-bf21f770c3de tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 HTTP/1.1 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd0b1a3f8-73f5-43c6-8d55-d712ad9f9471'} Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 to delete Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 could not be found. Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.990530 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:19:05.994963 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:05.997015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8527b5b-0977-4262-b196-bf21f770c3de tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:05.998025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d8527b5b-0977-4262-b196-bf21f770c3de tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471" status: 404 len: 62 microversion: 2.1 time: 0.064206 Aug 27 03:19:05.999028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1322/2676] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] DELETE /compute/v2.1/images/d0b1a3f8-73f5-43c6-8d55-d712ad9f9471 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:19:06.006027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:06.007986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:06.023644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.026371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.027042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.027971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.031055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.031889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.041441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:06.455050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:06.471518 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e5733b9c-29f7-4f38-b01a-1884f05e1a3d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.470897 Aug 27 03:19:06.472423 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1323/2677] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:06.490548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:06.492767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:06.517544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.520594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.521208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.529927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.530791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.531503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.571830 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 HTTP/1.1 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '2ab700a6-df98-4f70-b929-c19c3ac0ab95'} Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:06.584625 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.588505 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.592736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:06.593944 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9976891e-c81f-40de-8d1b-37376c05db08 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 404 len: 111 microversion: 2.1 time: 0.113806 Aug 27 03:19:06.595225 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1324/2678] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:06 2022] DELETE /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:06.603423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:06.604454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] [instance: 2ab700a6-df98-4f70-b929-c19c3ac0ab95] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:06.622808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.623879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.624770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.627172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.627957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.628626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.648232 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] HTTP exception thrown: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Request method failure captured: Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 HTTP/1.1 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYwQqpBY-c1k7jKJZs7qNon_1GA1MGZIXJK_obcySjLNINzt0yyZC0Z9Dm4XgbmLy-lNQ6s7IVabw59ub_B1L2WZex5h3Rw6bYQ22hovYz9A7-z83BzG5y-OuLWyvYRkSwngRIz19EI3NmzmVwpJov7o-_Fs3oFMg9_BVSn8Ayu134U Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9c273d054e33423dbc7aad25e6914822", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9c273d054e33423dbc7aad25e6914822"}]}] Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9c273d054e33423dbc7aad25e6914822 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesTestJSON-1805578193 Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d1e2476870c64964814aabc9c60399cf Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesTestJSON-1805578193-project Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '2ab700a6-df98-4f70-b929-c19c3ac0ab95'} Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.650738 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:06.654552 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:06.654552 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:06.654552 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:06.654552 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:06.654552 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. Aug 27 03:19:06.654552 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:06.660442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] Returning 404 to user: Instance 2ab700a6-df98-4f70-b929-c19c3ac0ab95 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:06.661659 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a1a9d16a-2fe2-4cef-97da-47461f9e1134 tempest-ImagesTestJSON-1805578193 tempest-ImagesTestJSON-1805578193-project] 10.222.0.69 "GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95" status: 404 len: 111 microversion: 2.1 time: 0.062356 Aug 27 03:19:06.662870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1325/2679] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:06 2022] GET /compute/v2.1/servers/2ab700a6-df98-4f70-b929-c19c3ac0ab95 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:06.764534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:06.765188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:06.783828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.785598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.786805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.790302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.792752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.792752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:07.998835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:08.014913 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-330d30bf-f9b8-4190-a1a4-7ae8cb780f01 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1305 microversion: 2.1 time: 1.253150 Aug 27 03:19:08.018726 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1326/2680] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:06 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1305 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:08.035330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:08.035962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:08.055318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.062411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.064138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.065181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.065838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.066462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.400597 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce2b6ede-50c7-4aee-aee7-1abef0a1d7f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b" status: 202 len: 0 microversion: 2.1 time: 7.897221 Aug 27 03:19:08.402282 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1355/2681] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:19:00 2022] DELETE /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b => generated 0 bytes in 7899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:19:08.411145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b0aebcd-6dbb-4bb3-93db-cbc1eed24a5a tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Calling method '.version_select at 0x7fe45747df70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:08.481869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-7b0aebcd-6dbb-4bb3-93db-cbc1eed24a5a tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 00b44779-9b12-476e-9a4b-dddd640ee77b could not be found", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:19:08.482620 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7b0aebcd-6dbb-4bb3-93db-cbc1eed24a5a tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] HTTP exception thrown: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b0aebcd-6dbb-4bb3-93db-cbc1eed24a5a tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Request method failure captured: Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b HTTP/1.1 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY0UGxexWo8zlwjJSZL86y0WCwsjlfZHiBD5D0vRuzIAPHczorbppCtWAXaMF20X9RFFrQuWOvL2_0as4gLe9m8nw3UaBvQ0uj17YxB9Hcr-W6Px7A0CMw-yhXMd_8WUpkyMGzlg2wCOdaMooK3p4xvGD2ogxIl86ORbubmLz-VHess Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0945f00c2b8340188b1674cb143eb24e Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsTestJSON-314914912 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0945f00c2b8340188b1674cb143eb24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0945f00c2b8340188b1674cb143eb24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0945f00c2b8340188b1674cb143eb24e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0945f00c2b8340188b1674cb143eb24e"}]}] Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsTestJSON-314914912 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0945f00c2b8340188b1674cb143eb24e Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsTestJSON-314914912 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsTestJSON-314914912-project Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c69b0c91515b408995ccbb0ad2be556a Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsTestJSON-314914912-project Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: exception: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '00b44779-9b12-476e-9a4b-dddd640ee77b'} Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 00b44779-9b12-476e-9a4b-dddd640ee77b could not be found Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d6cc520-c2c5-4014-89a8-417850697ec2'] Aug 27 03:19:08.485154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b. Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b0aebcd-6dbb-4bb3-93db-cbc1eed24a5a tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Returning 404 to user: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b0aebcd-6dbb-4bb3-93db-cbc1eed24a5a tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b" status: 404 len: 111 microversion: 2.1 time: 0.080194 Aug 27 03:19:08.489677 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1356/2682] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:19:08 2022] GET /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:08.499982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa124ef4-b8a4-4e70-87e8-a3559be1f5f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Calling method '.version_select at 0x7fe45745b040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:08.721802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-fa124ef4-b8a4-4e70-87e8-a3559be1f5f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 00b44779-9b12-476e-9a4b-dddd640ee77b could not be found", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:19:08.722547 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fa124ef4-b8a4-4e70-87e8-a3559be1f5f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] HTTP exception thrown: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa124ef4-b8a4-4e70-87e8-a3559be1f5f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Request method failure captured: Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b HTTP/1.1 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY0UGxexWo8zlwjJSZL86y0WCwsjlfZHiBD5D0vRuzIAPHczorbppCtWAXaMF20X9RFFrQuWOvL2_0as4gLe9m8nw3UaBvQ0uj17YxB9Hcr-W6Px7A0CMw-yhXMd_8WUpkyMGzlg2wCOdaMooK3p4xvGD2ogxIl86ORbubmLz-VHess Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0945f00c2b8340188b1674cb143eb24e Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsTestJSON-314914912 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0945f00c2b8340188b1674cb143eb24e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0945f00c2b8340188b1674cb143eb24e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0945f00c2b8340188b1674cb143eb24e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0945f00c2b8340188b1674cb143eb24e"}]}] Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsTestJSON-314914912 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0945f00c2b8340188b1674cb143eb24e Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsTestJSON-314914912 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsTestJSON-314914912-project Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c69b0c91515b408995ccbb0ad2be556a Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsTestJSON-314914912-project Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: exception: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '00b44779-9b12-476e-9a4b-dddd640ee77b'} Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 00b44779-9b12-476e-9a4b-dddd640ee77b could not be found Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dead4c5c-a517-4aa9-a4bf-749ea5355cef'] Aug 27 03:19:08.724377 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b. Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa124ef4-b8a4-4e70-87e8-a3559be1f5f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] Returning 404 to user: Floating IP not found for ID 00b44779-9b12-476e-9a4b-dddd640ee77b {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa124ef4-b8a4-4e70-87e8-a3559be1f5f8 tempest-FloatingIPsTestJSON-314914912 tempest-FloatingIPsTestJSON-314914912-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b" status: 404 len: 111 microversion: 2.1 time: 0.233462 Aug 27 03:19:08.728123 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1357/2683] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:19:08 2022] DELETE /compute/v2.1/os-floating-ips/00b44779-9b12-476e-9a4b-dddd640ee77b => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:19:08.895430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:08.905809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c015d9f2-073d-4291-bb26-9386ca0fffaf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.883352 Aug 27 03:19:08.905994 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1327/2684] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:08 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:09.041098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:09.041841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:09.050778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.062400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.063335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.066711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.073106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.082953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.782523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:09.805565 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee10b7ec-84d0-40f9-9b4f-d2513d246d42 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1305 microversion: 2.1 time: 0.768470 Aug 27 03:19:09.827904 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1358/2685] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:09 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1305 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:09.931395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:09.932071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:09.958526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.959294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.960661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.965641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.969433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.971288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:10.442025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-634260526", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "c6b18560-afd4-45b2-bd19-ca5a702760b7"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:10.627623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] validate_networks() for [('c6b18560-afd4-45b2-bd19-ca5a702760b7', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:10.762176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:10.772679 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6bb504f0-d7bd-4154-9ae2-4573926652c7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.847912 Aug 27 03:19:10.790810 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1328/2686] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:09 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:10.836893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:10.837508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:10.849608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.857367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.857881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:10.858782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.859259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.859822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:11.216545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:11.226573 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d8a0c1e-affc-4c7f-a581-fc932f6c0d67 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 0.393305 Aug 27 03:19:11.239399 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1329/2687] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:10 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:11.254947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e045493a-8007-450e-b665-74e5e1a648c2 req-4c85088a-e53d-4dd5-9146-577fcd5dee5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714c94b7-6302-42cf-a5c9-2ae08b234156", "tag": "846feb27-6db8-4b3a-924c-c792e1285e52"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:11.281291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e045493a-8007-450e-b665-74e5e1a648c2 req-4c85088a-e53d-4dd5-9146-577fcd5dee5c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:11.282062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e045493a-8007-450e-b665-74e5e1a648c2 req-4c85088a-e53d-4dd5-9146-577fcd5dee5c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:11.285091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e045493a-8007-450e-b665-74e5e1a648c2 req-4c85088a-e53d-4dd5-9146-577fcd5dee5c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:11.317403 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e045493a-8007-450e-b665-74e5e1a648c2 req-4c85088a-e53d-4dd5-9146-577fcd5dee5c service nova] Creating event network-changed:846feb27-6db8-4b3a-924c-c792e1285e52 for instance 714c94b7-6302-42cf-a5c9-2ae08b234156 on n-h1-852086-5 Aug 27 03:19:11.335520 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e045493a-8007-450e-b665-74e5e1a648c2 req-4c85088a-e53d-4dd5-9146-577fcd5dee5c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091747 Aug 27 03:19:11.339209 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1330/2688] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:11.806499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:11.807205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:11.824325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:11.824854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:11.825308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:11.835102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:11.849449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:11.850363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.080159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:13.095946 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3022b58-7bdc-4672-a6d6-8a891d591c51 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 1.294228 Aug 27 03:19:13.117356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1331/2689] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:11 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:13.128668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:13.129296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:13.155190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.155969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.160313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.167062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.168148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.169460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.576659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:13.585685 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a79463f2-4b62-410f-9410-da8277383e37 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 0.467123 Aug 27 03:19:13.592547 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1332/2690] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:13 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:14.121143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:14.122770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:14.145727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.149281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.149759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:14.150560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.151038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.151478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.473147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:15.473670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:15.474112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:15.474551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:15.474968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:15.477048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:15.497148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.497657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.498121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.498925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.499388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.499818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.573769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Getting quotas for project 4e84b5dedf954434ac3c421143ab9050. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:15.592686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Getting quotas for user a38411b9dfe148848785b4fa2793b900 and project 4e84b5dedf954434ac3c421143ab9050. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:15.635953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:15.645174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:15.776504 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67370d96-3bb5-47f2-8ab2-7fc0f4ccc53a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 5.623515 Aug 27 03:19:15.781848 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1359/2691] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:19:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 5629 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 03:19:15.787960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:15.788844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:15.815912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.816413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.816846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.817567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.830813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.831793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:16.246100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:16.255874 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-28b3c5a3-c1c0-44b8-ba51-1c8368a1e708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 2.139951 Aug 27 03:19:16.279690 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1333/2692] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:14 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:16.298860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-367320911", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "89d65c9c-0644-4e47-af7e-1b1f0aca8b59"}, {"uuid": "3c050c7a-c663-452a-ad8e-f039cd8610fe"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:16.480111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] validate_networks() for [('89d65c9c-0644-4e47-af7e-1b1f0aca8b59', None, None, None, None, None), ('3c050c7a-c663-452a-ad8e-f039cd8610fe', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:17.582827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:17.592641 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78dbdd6a-2fe2-4c9b-a6b6-33975a18d940 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 1.809550 Aug 27 03:19:17.611756 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1360/2693] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:15 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:17.636529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:17.637160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:17.661684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.662211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.662663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.663647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.670068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.670784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.872671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:17.895205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:17.902668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:17.904416 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30a7ae4c-e92b-48ed-b027-a01efcbfb930 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1313 microversion: 2.26 time: 0.285856 Aug 27 03:19:17.905787 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1361/2694] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:17 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:17.919313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:17.926080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:17.938050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.938695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.939208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.939963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:17.940422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:17.946788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:18.920459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:18.946749 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26052b6b-fea4-4282-84bf-796945ed5c09 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 1.038997 Aug 27 03:19:18.953416 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1362/2695] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:17 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:18.960823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:18.963039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:18.971982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:18.972918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:18.973608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:18.974651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:18.975403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:18.976203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.750054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:20.769902 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f72a8c5-e2a3-446a-96a6-27cb1dba2de1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 1.814795 Aug 27 03:19:20.860975 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1363/2696] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:18 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:20.883048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:20.883751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:20.888755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:20.893046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:20.893963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:20.894919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:20.896744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:20.939485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.940420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.941908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.942654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.943318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.944313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.945098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.945384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.946119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.946825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.951108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.952179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.973429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Getting quotas for project 2322c18d287b49b3839208e66ea07871. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:20.980790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Getting quotas for user 0be937d33b6d40daba326e75e6eb35b6 and project 2322c18d287b49b3839208e66ea07871. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:20.996298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:20.999099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:21.094574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24af31ac-d2fb-4622-8174-8b85101c626c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.813164 Aug 27 03:19:21.118750 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1334/2697] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:19:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:19:21.130886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:21.147659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:21.194282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:21.198280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:21.201676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:21.206064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:21.208805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:21.211676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:21.226950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:21.238107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:21.256176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:21.260774 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d38271c-ea25-48cc-a67f-80d642dd1798 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1319 microversion: 2.26 time: 0.398273 Aug 27 03:19:21.276154 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1364/2698] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:20 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:21.287123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:21.287507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:21.309955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:21.310724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:21.311324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:21.312360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:21.314661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:21.319202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:21.353836 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] HTTP exception thrown: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Request method failure captured: Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a HTTP/1.1 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYx1CFDSkFaPGGoHPQ408zvdUAAcDm0udHFWNDDyrv1OosGY7kbqy1KNWpdPkJ7Cssaii-bzR-zP-9IyEwZy_chNKkV52A01rc9lNpTGuI21-WJXNaQx6MN7GHFtMDDsTC0RgY70bkE4m787UWfInnHmvWyhI0pG0xVSF7HfMuNjw0A Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9d67836807a0446cac6fa01b909e56f9 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d67836807a0446cac6fa01b909e56f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d67836807a0446cac6fa01b909e56f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d67836807a0446cac6fa01b909e56f9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d67836807a0446cac6fa01b909e56f9"}]}] Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9d67836807a0446cac6fa01b909e56f9 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachSCSIVolumeTestJSON-1542850421-project Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 75522ce101954381b3b0f81bbe7cf207 Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1542850421-project Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1fa9a826-8f42-4671-86f6-9ee58104324a'} Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:21.358011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:21.363074 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:21.366974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Returning 404 to user: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:21.376038 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cf65ea2-328f-4ce5-98be-852e6ed329ae tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 404 len: 111 microversion: 2.1 time: 0.092884 Aug 27 03:19:21.377484 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1365/2699] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:21 2022] DELETE /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:21.383874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-083741bc-cf53-4c5b-8149-c59f69788e5d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:21.387320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-083741bc-cf53-4c5b-8149-c59f69788e5d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:21.919165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-083741bc-cf53-4c5b-8149-c59f69788e5d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:21.953418 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-083741bc-cf53-4c5b-8149-c59f69788e5d tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1212 microversion: 2.1 time: 0.574062 Aug 27 03:19:21.966080 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1366/2700] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:21 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1212 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:22.010034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:22.013683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] [instance: 1fa9a826-8f42-4671-86f6-9ee58104324a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:22.033624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.034204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.036951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.037769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.038272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.041211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.073325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] HTTP exception thrown: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Request method failure captured: Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a HTTP/1.1 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYx1CFDSkFaPGGoHPQ408zvdUAAcDm0udHFWNDDyrv1OosGY7kbqy1KNWpdPkJ7Cssaii-bzR-zP-9IyEwZy_chNKkV52A01rc9lNpTGuI21-WJXNaQx6MN7GHFtMDDsTC0RgY70bkE4m787UWfInnHmvWyhI0pG0xVSF7HfMuNjw0A Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9d67836807a0446cac6fa01b909e56f9 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d67836807a0446cac6fa01b909e56f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d67836807a0446cac6fa01b909e56f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d67836807a0446cac6fa01b909e56f9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d67836807a0446cac6fa01b909e56f9"}]}] Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9d67836807a0446cac6fa01b909e56f9 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1542850421 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachSCSIVolumeTestJSON-1542850421-project Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 75522ce101954381b3b0f81bbe7cf207 Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1542850421-project Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1fa9a826-8f42-4671-86f6-9ee58104324a'} Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:22.074998 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:22.083759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] Returning 404 to user: Instance 1fa9a826-8f42-4671-86f6-9ee58104324a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:22.089115 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-451fe055-a6bb-4d4c-a72a-25d079052d85 tempest-AttachSCSIVolumeTestJSON-1542850421 tempest-AttachSCSIVolumeTestJSON-1542850421-project] 10.222.0.69 "GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a" status: 404 len: 111 microversion: 2.1 time: 0.114793 Aug 27 03:19:22.099043 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1367/2701] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:21 2022] GET /compute/v2.1/servers/1fa9a826-8f42-4671-86f6-9ee58104324a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:22.106835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:22.107516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:22.123066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.123572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.124019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.124744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.126935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.127388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.749523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:22.752155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=70 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:22.762566 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7b44b91-e0c0-4dad-90a4-deeff2582cb5 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 0.664477 Aug 27 03:19:22.766320 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1368/2702] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:22 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:22.776415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:22.777244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:22.786024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.786834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.787430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.789348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.790142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.791027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.795499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:22.804404 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-08cfdd27-8995-4768-9ad6-f629d8c0b4ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 1.684167 Aug 27 03:19:22.825080 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1335/2703] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:21 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:22.993537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:22.996538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:23.025679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:23.027216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:23.031337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:23.036924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:23.041739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:23.043745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:23.308831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:23.324960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e56addb-92d0-44c1-a945-08590563e0da tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1264 microversion: 2.1 time: 0.338317 Aug 27 03:19:23.348333 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1336/2704] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:22 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1264 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:23.789067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:23.789979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:23.813896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:23.815203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:23.815835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:23.816749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:23.817367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:23.818019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.570483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:24.584244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:24.592162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:24.594230 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-761dfda4-deae-415c-9ad1-612106d1a759 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1361 microversion: 2.26 time: 1.826316 Aug 27 03:19:24.597738 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1369/2705] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:22 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1361 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:24.625036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:24.626665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:24.640147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.641543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.646852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.647967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.648676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.649337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.733229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:24.747609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c269d92-90e9-427c-89cb-3d3e7ea6ce83 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 0.962758 Aug 27 03:19:24.748788 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1337/2706] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:23 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:24.753589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:24.754219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:24.760734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.761410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.761990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.762887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.763492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.774290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:25.121513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:25.133212 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9cf3230e-f638-4779-9115-4a044246c4f5 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1270 microversion: 2.1 time: 0.383181 Aug 27 03:19:25.134019 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1338/2707] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:24 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1270 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:25.143299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:25.153522 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a7f47e4-53c7-4e74-8014-358e05321b4f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.540159 Aug 27 03:19:25.156101 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1370/2708] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:24 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:25.629555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:25.630225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:25.653252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:25.653755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:25.654221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:25.654952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:25.655416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:25.655850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:25.785467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:25.787542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:25.807835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:25.811410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:25.813039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:25.813956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:25.815158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:25.815997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:25.816618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:26.237972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:26.247338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:26.248639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:26.249807 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-efff2695-e186-4513-b429-f7ff3ae99f15 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1361 microversion: 2.26 time: 0.624930 Aug 27 03:19:26.264789 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1339/2709] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:25 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1361 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:26.276620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:26.283081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:26.349276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:26.349807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:26.350291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:26.361327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:26.363793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:26.370767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:26.494295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:26.519153 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b7806df3-f7b8-41c9-a789-77c9047f0a05 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 0.747658 Aug 27 03:19:26.522891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1371/2710] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:25 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:26.527969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:26.539266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:26.566637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:26.567385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:26.568002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:26.568908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:26.572358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:26.573199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:26.762011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:26.777986 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-71ed7c0b-bc79-4408-889c-b0d837228b08 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1270 microversion: 2.1 time: 0.509268 Aug 27 03:19:26.780427 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1340/2711] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:26 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1270 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:26.792935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d5d2cf26-c179-4e15-8ea1-905848ade6c1 req-4838c6f0-ffb2-4ea9-9761-3d43a1cf6309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714c94b7-6302-42cf-a5c9-2ae08b234156", "name": "network-vif-plugged", "status": "completed", "tag": "846feb27-6db8-4b3a-924c-c792e1285e52"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:26.835870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:26.838144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5d2cf26-c179-4e15-8ea1-905848ade6c1 req-4838c6f0-ffb2-4ea9-9761-3d43a1cf6309 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:26.838721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5d2cf26-c179-4e15-8ea1-905848ade6c1 req-4838c6f0-ffb2-4ea9-9761-3d43a1cf6309 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:26.840364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5d2cf26-c179-4e15-8ea1-905848ade6c1 req-4838c6f0-ffb2-4ea9-9761-3d43a1cf6309 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:26.871691 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d5d2cf26-c179-4e15-8ea1-905848ade6c1 req-4838c6f0-ffb2-4ea9-9761-3d43a1cf6309 service nova] Creating event network-vif-plugged:846feb27-6db8-4b3a-924c-c792e1285e52 for instance 714c94b7-6302-42cf-a5c9-2ae08b234156 on n-h1-852086-5 Aug 27 03:19:26.891062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d5d2cf26-c179-4e15-8ea1-905848ade6c1 req-4838c6f0-ffb2-4ea9-9761-3d43a1cf6309 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104395 Aug 27 03:19:26.894752 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1341/2712] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:26.906076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2f2f242c-79b1-455d-9456-e6c1cabcc94b req-de13c80b-c119-4bdc-a269-db7cc84a908d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "910a0e4f-a7b8-43bc-8808-7befcd354b43", "tag": "54f1b6f1-a396-46b9-8693-38a1260a3489"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:26.944419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2f2f242c-79b1-455d-9456-e6c1cabcc94b req-de13c80b-c119-4bdc-a269-db7cc84a908d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:26.946387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2f2f242c-79b1-455d-9456-e6c1cabcc94b req-de13c80b-c119-4bdc-a269-db7cc84a908d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:26.949769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2f2f242c-79b1-455d-9456-e6c1cabcc94b req-de13c80b-c119-4bdc-a269-db7cc84a908d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:26.982502 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-2f2f242c-79b1-455d-9456-e6c1cabcc94b req-de13c80b-c119-4bdc-a269-db7cc84a908d service nova] Creating event network-changed:54f1b6f1-a396-46b9-8693-38a1260a3489 for instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 on n-h2-852086-5 Aug 27 03:19:26.991229 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2f2f242c-79b1-455d-9456-e6c1cabcc94b req-de13c80b-c119-4bdc-a269-db7cc84a908d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093618 Aug 27 03:19:26.991935 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1342/2713] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:27.276241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1489564169", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:27.325984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:27.351139 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3bf19119-b249-41be-9484-12d24b622df9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.826778 Aug 27 03:19:27.366885 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1372/2714] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:26 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:27.383106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:27.383741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:27.434140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:27.434739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:27.436360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:27.437157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:27.440240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:27.440901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:27.441288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:28.350429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:28.368504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:28.372624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:28.381069 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27871162-93ab-47e1-baaa-f8a07946b4bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1361 microversion: 2.26 time: 1.012887 Aug 27 03:19:28.383279 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1373/2715] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:27 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1361 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:28.393150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:28.394854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:28.409376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:28.410270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:28.411299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:28.412575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:28.414143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:28.415326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:28.943044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:28.945533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:28.946291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:28.946907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:28.948140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:28.972505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:28.976171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:28.976899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:28.977746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:28.981285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:28.983114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:29.050617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Getting quotas for project b0c6598a83274624997da7af158a0d57. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:29.073285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Getting quotas for user 4eb9f9c28d84488caffc8a3e340c1f16 and project b0c6598a83274624997da7af158a0d57. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:29.081516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:29.117430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:29.120778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:29.144753 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d3f98d7-85cc-4130-89d5-dab16bfe05ed tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1293 microversion: 2.1 time: 0.760142 Aug 27 03:19:29.162127 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1374/2716] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:28 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1293 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:29.178601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:29.181644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:29.198767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:29.203074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:29.204332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:29.207055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:29.207801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:29.210692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:29.282690 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4a113c1-0c4c-4a56-9055-cacd38dcc788 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.288421 Aug 27 03:19:29.287284 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1343/2717] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:19:29.299147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:29.303478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:29.317993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:29.322044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:29.325081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:29.327216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:29.327926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:29.329799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:29.420907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:29.699935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:29.713725 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-12786b40-ee47-4014-ab3b-9854656ebf7e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1528 microversion: 2.1 time: 0.424412 Aug 27 03:19:29.715271 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1344/2718] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:29 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1528 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:30.170685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-13031145", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "be792eba-f4b7-46b8-9127-1ca32ef532fe"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:30.334899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] validate_networks() for [('be792eba-f4b7-46b8-9127-1ca32ef532fe', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:30.459357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:30.479755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8397be96-fe14-4501-a0ac-d317d8c1ae00 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1312 microversion: 2.1 time: 1.312907 Aug 27 03:19:30.480846 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1375/2719] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:29 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1312 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:30.502613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:30.503755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:30.522264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:30.524991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:30.539430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:30.543095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:30.543932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:30.544567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:30.780611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:30.809698 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4a89b87-e022-4f36-9bee-5b7180826446 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1213 microversion: 2.1 time: 0.322134 Aug 27 03:19:30.819028 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1376/2720] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:30 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1213 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:30.826189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:30.837017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:30.857690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:30.858220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:30.858672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:30.863252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:30.863728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:30.864178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:31.612559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:31.642818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:31.647932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:31.660167 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b303e17b-e03d-43ff-9bac-162d821cd2c4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1361 microversion: 2.26 time: 0.833918 Aug 27 03:19:31.662734 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1377/2721] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:30 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1361 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:31.693383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:31.715146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:31.740993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:31.741738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:31.742883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:31.745873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:31.746890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:31.752274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:31.932232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:32.157770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:32.171163 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7cc7cdc7-e77d-4337-987f-1c252d96de77 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1484 microversion: 2.1 time: 0.507154 Aug 27 03:19:32.174384 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1378/2722] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:31 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1484 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:32.198742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:32.200368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:32.214735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.215615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.218254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:32.221843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.224132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.224775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:32.717146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:32.730332 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d52d8a7-585d-4aa9-9f58-7e42d6c2be58 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1510 microversion: 2.1 time: 0.554350 Aug 27 03:19:32.731685 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1379/2723] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:32 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:32.738806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:32.739755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:32.758953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.759598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.760323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:32.761627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.762624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.764149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:32.855741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:32.856765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:32.857492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:32.858956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:32.860513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:32.879428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.880253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.880860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:32.881765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.882728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.888084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:32.947204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:32.962471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for user 267cffdb49624ff986aed20fd255b1db and project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:33.006692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:33.009148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:33.099701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d1ac3d1-fe99-422d-a070-5bf3de8a0d3a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.382612 Aug 27 03:19:33.101195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1345/2724] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:19:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:19:33.114266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:33.129794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:33.149182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:33.149684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:33.150127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:33.150874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:33.151330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:33.151755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:33.382813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:33.399112 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a92dbb1f-05c1-44da-9317-ae72fc69a56b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.665591 Aug 27 03:19:33.401969 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1380/2725] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:32 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:33.421067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:33.422650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:33.439109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:33.443413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:33.446831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:33.447668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:33.448885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:33.452059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:33.452964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:33.454406 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-437fdda8-ac2a-4d1c-9409-d0e0c729cc8a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1275 microversion: 2.1 time: 0.343879 Aug 27 03:19:33.455842 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1346/2726] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:33 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:33.461277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:33.462242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:33.477411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:33.478643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:33.481591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:33.487604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:33.498068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:33.499731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:33.869178 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e794173-f265-46d9-a410-7faa190ada54 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.465559 Aug 27 03:19:33.879280 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1381/2727] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:19:33 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156/os-interface => generated 285 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:33.898019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d437f08e-c765-43d5-83dd-a7627cba0c0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:33.904091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d437f08e-c765-43d5-83dd-a7627cba0c0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:34.059607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d437f08e-c765-43d5-83dd-a7627cba0c0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:34.071777 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d437f08e-c765-43d5-83dd-a7627cba0c0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1213 microversion: 2.1 time: 0.190861 Aug 27 03:19:34.072375 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1382/2728] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:33 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:34.091610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-407519ca-ee9d-4bc4-bc3c-c8eb9c16c2c7 req-5f6e3bd2-15b1-4521-8649-dfca7d580cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bffc9f-dda2-4883-9e9b-d05aa9b8f20b", "tag": "8e1f3864-8132-4486-a59a-e232d6af7215"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:34.128667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-407519ca-ee9d-4bc4-bc3c-c8eb9c16c2c7 req-5f6e3bd2-15b1-4521-8649-dfca7d580cf5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.130845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-407519ca-ee9d-4bc4-bc3c-c8eb9c16c2c7 req-5f6e3bd2-15b1-4521-8649-dfca7d580cf5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.136457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-407519ca-ee9d-4bc4-bc3c-c8eb9c16c2c7 req-5f6e3bd2-15b1-4521-8649-dfca7d580cf5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:34.161640 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-407519ca-ee9d-4bc4-bc3c-c8eb9c16c2c7 req-5f6e3bd2-15b1-4521-8649-dfca7d580cf5 service nova] Creating event network-changed:8e1f3864-8132-4486-a59a-e232d6af7215 for instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b on n-h2-852086-5 Aug 27 03:19:34.176587 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-407519ca-ee9d-4bc4-bc3c-c8eb9c16c2c7 req-5f6e3bd2-15b1-4521-8649-dfca7d580cf5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098098 Aug 27 03:19:34.177733 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1383/2729] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:34.188177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:34.192454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:34.208750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.209769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.210464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:34.211541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.212173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.223001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:34.312890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:34.347488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:34.355345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:34.357289 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8354540b-f284-49fd-8796-95de67afc2d8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1361 microversion: 2.26 time: 0.900202 Aug 27 03:19:34.359528 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1347/2730] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:33 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1361 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:34.369789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d1d3b70b-222e-4049-8864-3e5f12a141aa req-df32f59f-d0cf-4a9f-a4f7-a2772d65cc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910a0e4f-a7b8-43bc-8808-7befcd354b43", "name": "network-vif-plugged", "status": "completed", "tag": "54f1b6f1-a396-46b9-8693-38a1260a3489"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:34.395508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d1d3b70b-222e-4049-8864-3e5f12a141aa req-df32f59f-d0cf-4a9f-a4f7-a2772d65cc75 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.396408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d1d3b70b-222e-4049-8864-3e5f12a141aa req-df32f59f-d0cf-4a9f-a4f7-a2772d65cc75 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.397011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d1d3b70b-222e-4049-8864-3e5f12a141aa req-df32f59f-d0cf-4a9f-a4f7-a2772d65cc75 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:34.417030 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d1d3b70b-222e-4049-8864-3e5f12a141aa req-df32f59f-d0cf-4a9f-a4f7-a2772d65cc75 service nova] Creating event network-vif-plugged:54f1b6f1-a396-46b9-8693-38a1260a3489 for instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 on n-h2-852086-5 Aug 27 03:19:34.425695 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d1d3b70b-222e-4049-8864-3e5f12a141aa req-df32f59f-d0cf-4a9f-a4f7-a2772d65cc75 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063536 Aug 27 03:19:34.426940 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1348/2731] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:34.436782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:34.438582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:34.448022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.448905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.449722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:34.451173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.452417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.454143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.236077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:35.244505 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a43f7549-8e5b-4be9-9f1c-c360b9e04d40 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.814594 Aug 27 03:19:35.258974 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1349/2732] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:34 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:35.265083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:35.267859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:35.274555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.275312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.275919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.276812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.277431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.278018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.342392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:35.354644 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83f58396-9309-4cab-acf2-11a8455aeccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1510 microversion: 2.1 time: 1.175273 Aug 27 03:19:35.356404 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1384/2733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:34 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1510 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:35.366793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:35.367607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:35.398604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.399401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.399973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.400843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.401442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.402002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.465668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:35.479766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6a6a9900-42a8-4c88-a077-747193de19d1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1275 microversion: 2.1 time: 0.219356 Aug 27 03:19:35.480579 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1350/2734] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:35 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:35.499502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:35.500930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:35.508022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.508507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.508934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.509673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.510737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.511167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.660291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:35.671199 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80e09399-5305-4d51-851a-3efab459d412 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1271 microversion: 2.1 time: 0.312782 Aug 27 03:19:35.673265 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1385/2735] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:35 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:36.006899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:36.031686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:36.033560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:36.034786 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-251e745d-f1b6-4534-a977-72528af928e5 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1361 microversion: 2.26 time: 0.539170 Aug 27 03:19:36.042556 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1351/2736] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:35 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1361 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:36.272309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:36.273221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:36.289566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.291600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.294271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.295831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.297535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.300396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.377869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:36.378855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:36.393584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.394325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.394943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.395850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.396491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.397075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.743002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:36.752823 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bc85758-b234-42f6-8c49-42e438c75726 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.484849 Aug 27 03:19:36.758225 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1386/2737] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:36 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:36.770295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b557421b-e7e7-4415-9158-549df0ab9610 req-ef82a74c-05cd-4d64-8fd9-5ebcf29c129b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bffc9f-dda2-4883-9e9b-d05aa9b8f20b", "tag": "a87ae983-43b7-45f0-bb31-a14064837541"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:36.782357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b557421b-e7e7-4415-9158-549df0ab9610 req-ef82a74c-05cd-4d64-8fd9-5ebcf29c129b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.783121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b557421b-e7e7-4415-9158-549df0ab9610 req-ef82a74c-05cd-4d64-8fd9-5ebcf29c129b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.783715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b557421b-e7e7-4415-9158-549df0ab9610 req-ef82a74c-05cd-4d64-8fd9-5ebcf29c129b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.802645 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b557421b-e7e7-4415-9158-549df0ab9610 req-ef82a74c-05cd-4d64-8fd9-5ebcf29c129b service nova] Creating event network-changed:a87ae983-43b7-45f0-bb31-a14064837541 for instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b on n-h2-852086-5 Aug 27 03:19:36.806491 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b557421b-e7e7-4415-9158-549df0ab9610 req-ef82a74c-05cd-4d64-8fd9-5ebcf29c129b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048146 Aug 27 03:19:36.809599 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1387/2738] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:36.819786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-899969ce-30af-44e6-8c18-176d13cc8e44 req-133f6838-7177-4523-bf08-a9d3c2259ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dca35c-d122-40f4-986b-5b77851f6f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "2018ab3e-4e07-4098-b98e-9002dd279856"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:36.831905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-899969ce-30af-44e6-8c18-176d13cc8e44 req-133f6838-7177-4523-bf08-a9d3c2259ffb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.832808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-899969ce-30af-44e6-8c18-176d13cc8e44 req-133f6838-7177-4523-bf08-a9d3c2259ffb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.833464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-899969ce-30af-44e6-8c18-176d13cc8e44 req-133f6838-7177-4523-bf08-a9d3c2259ffb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.840730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:36.860449 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-899969ce-30af-44e6-8c18-176d13cc8e44 req-133f6838-7177-4523-bf08-a9d3c2259ffb service nova] Creating event network-vif-unplugged:2018ab3e-4e07-4098-b98e-9002dd279856 for instance 45dca35c-d122-40f4-986b-5b77851f6f3d on n-h1-852086-5 Aug 27 03:19:36.867923 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-899969ce-30af-44e6-8c18-176d13cc8e44 req-133f6838-7177-4523-bf08-a9d3c2259ffb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055087 Aug 27 03:19:36.878274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1388/2739] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:36.884927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:36.886048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:36.898673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.901171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.902320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.903432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.903774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.904185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:37.193286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:37.211573 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-797723ef-a82d-46df-80d9-ccda2c17ebb5 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1510 microversion: 2.1 time: 0.838374 Aug 27 03:19:37.226040 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1352/2740] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:36 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1510 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:37.226040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:37.226040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:37.227382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.227884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.228459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:37.229175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.229682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.230105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:37.412623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:37.426336 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9efa37e-7cb2-45ca-9b15-e46faffa9e34 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.545887 Aug 27 03:19:37.427489 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1389/2741] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:36 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:37.432985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:37.433916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:37.442237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.443061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.443722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:37.444855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.445562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.446239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:37.631823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:37.646082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ca729d5-07cc-4c88-937a-7306a95a3f89 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.431991 Aug 27 03:19:37.655914 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1353/2742] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:37 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:37.781617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:37.782228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:37.818801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.820138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.821177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:37.824651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.828376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.829431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.047587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:38.057765 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5454d95a-0145-4206-ad8a-a94fe8050407 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.285141 Aug 27 03:19:38.070205 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1354/2743] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:37 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:38.070205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:38.070205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:38.075515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.075515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.075515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.075515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.075857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.076233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.117120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:38.127055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:38.133723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:38.139737 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c35f833-da68-4c1f-a9c4-f0c6060f9b2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1545 microversion: 2.26 time: 0.710955 Aug 27 03:19:38.150978 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1390/2744] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:37 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1545 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:38.156823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c30e968e-3d0a-49de-ba96-d0b5a12a3353 req-3640f4bd-cc26-43c2-acee-a59fb51cb584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714c94b7-6302-42cf-a5c9-2ae08b234156", "tag": "846feb27-6db8-4b3a-924c-c792e1285e52"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:38.174195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c30e968e-3d0a-49de-ba96-d0b5a12a3353 req-3640f4bd-cc26-43c2-acee-a59fb51cb584 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.175071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c30e968e-3d0a-49de-ba96-d0b5a12a3353 req-3640f4bd-cc26-43c2-acee-a59fb51cb584 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.175071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c30e968e-3d0a-49de-ba96-d0b5a12a3353 req-3640f4bd-cc26-43c2-acee-a59fb51cb584 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.190973 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c30e968e-3d0a-49de-ba96-d0b5a12a3353 req-3640f4bd-cc26-43c2-acee-a59fb51cb584 service nova] Creating event network-changed:846feb27-6db8-4b3a-924c-c792e1285e52 for instance 714c94b7-6302-42cf-a5c9-2ae08b234156 on n-h1-852086-5 Aug 27 03:19:38.220936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c30e968e-3d0a-49de-ba96-d0b5a12a3353 req-3640f4bd-cc26-43c2-acee-a59fb51cb584 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067947 Aug 27 03:19:38.221797 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1391/2745] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:38.227417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457541c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:38.251993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.256277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.256987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.259360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:38.277767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.279203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.279862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.280823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.282432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.283183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.333092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.333941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.334598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.375822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.376856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.377498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.434589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:38.465880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:38.476833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3af1b0e1-9380-405b-96d8-d5c140775a53 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1484 microversion: 2.1 time: 0.416880 Aug 27 03:19:38.490192 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88bca7af-a526-42bf-83fc-d2821a0dc077 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1432756824" status: 201 len: 0 microversion: 2.26 time: 0.256729 Aug 27 03:19:38.490192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1392/2746] 10.222.0.69 () {62 vars in 1380 bytes} [Sat Aug 27 03:19:38 2022] PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1432756824 => generated 0 bytes in 261 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 03:19:38.491674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:38.492779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:38.502712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1355/2747] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:38 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1484 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:38.507783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:38.513435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:38.519911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.520512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.520955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.521866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.522388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.522885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.542873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.543517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.544058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.544883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.551807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.552405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.778528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:38.793698 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc133c1f-45fc-4da2-b426-59a7bf80a799 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.289537 Aug 27 03:19:38.807178 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1356/2748] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:38 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:38.809712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90e44a70-b191-4ba1-863c-cdfb366dd809 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457e12790>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:38.837734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e44a70-b191-4ba1-863c-cdfb366dd809 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.838249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e44a70-b191-4ba1-863c-cdfb366dd809 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.838976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e44a70-b191-4ba1-863c-cdfb366dd809 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.877088 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90e44a70-b191-4ba1-863c-cdfb366dd809 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1432756824" status: 204 len: 0 microversion: 2.26 time: 0.075172 Aug 27 03:19:38.878088 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1357/2749] 10.222.0.69 () {60 vars in 1361 bytes} [Sat Aug 27 03:19:38 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1432756824 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:19:38.884294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:38.884926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:38.893351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.893859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.894355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.895284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:38.895747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:38.896181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.194912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:39.217660 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a37151b7-96e6-419a-8feb-14a8dc42617a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.338255 Aug 27 03:19:39.219602 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1358/2750] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:38 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:39.224897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe4578cc280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.241969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.242798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.243428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.244136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:39.252790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.253518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.254800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.255803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.256504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.257174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.286969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.287657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.288253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.317773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:39.343864 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f763a574-c4de-4565-ba8b-2dd55822ee84 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 204 len: 0 microversion: 2.26 time: 0.122512 Aug 27 03:19:39.347043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1359/2751] 10.222.0.69 () {60 vars in 1295 bytes} [Sat Aug 27 03:19:39 2022] DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:19:39.352994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.353692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:39.361501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.362095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.362773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.363492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.363951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.364378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.566644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:39.578701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c7ed7a7-5b4f-4462-b089-5eb6d64efa2f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.230054 Aug 27 03:19:39.579760 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1360/2752] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:39 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:39.584918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c116737e-27bf-4e0d-8335-2c468f9486c8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457d3eb80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.602335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c116737e-27bf-4e0d-8335-2c468f9486c8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.602932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c116737e-27bf-4e0d-8335-2c468f9486c8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.603424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c116737e-27bf-4e0d-8335-2c468f9486c8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.616199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c116737e-27bf-4e0d-8335-2c468f9486c8 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 200 len: 12 microversion: 2.26 time: 0.035275 Aug 27 03:19:39.616833 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1361/2753] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 03:19:39 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:39.627733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe4579fc700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.638811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.639497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.639953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.641131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:39.648657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.649410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.649954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.650829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.654199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:39.660995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.661479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.671087 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49bbed2c-8447-4ca9-ae5d-62188a6d7c5f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1453 microversion: 2.1 time: 1.185164 Aug 27 03:19:39.671744 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1393/2754] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:38 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1453 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:39.693731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.694732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:39.701553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.702859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.703695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.704730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.705614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.706362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.713492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.714113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.721173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.730484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:39.735243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.736101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.736542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.777553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:39.801990 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-89fed7e7-5198-4287-b046-b2dcbc70eaaa tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-86466938" status: 201 len: 0 microversion: 2.26 time: 0.178684 Aug 27 03:19:39.803057 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1362/2755] 10.222.0.69 () {62 vars in 1374 bytes} [Sat Aug 27 03:19:39 2022] PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-86466938 => generated 0 bytes in 181 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Aug 27 03:19:39.812872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b48136b-3322-4adc-8b9d-1bf22ffa54bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe4578cc940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.821685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b48136b-3322-4adc-8b9d-1bf22ffa54bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.822188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b48136b-3322-4adc-8b9d-1bf22ffa54bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.822670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b48136b-3322-4adc-8b9d-1bf22ffa54bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.838398 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b48136b-3322-4adc-8b9d-1bf22ffa54bb tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 200 len: 34 microversion: 2.26 time: 0.027948 Aug 27 03:19:39.838398 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1363/2756] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 03:19:39 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 34 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:39.843480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.844648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:39.852492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.852986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.853421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.854245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.854703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.855181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.029583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:40.047040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc96f01a-0e74-4567-94c7-7c31d06f0a00 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.207836 Aug 27 03:19:40.048011 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1364/2757] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:39 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:40.052738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe4578ccaf0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.067605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.068348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.068664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.069161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.075517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.075784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.076381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.079014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.079828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.080503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.106939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.110673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.111271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.141392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:40.162311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d976c400-b8f3-41a6-87e9-fa92ff73a84c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-86466938" status: 204 len: 0 microversion: 2.26 time: 0.112481 Aug 27 03:19:40.167013 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1365/2758] 10.222.0.69 () {60 vars in 1358 bytes} [Sat Aug 27 03:19:40 2022] DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-86466938 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:19:40.172604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-09b33975-099d-487b-bc4d-3b3958d8c358 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457d3eb80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.181655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09b33975-099d-487b-bc4d-3b3958d8c358 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.182521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09b33975-099d-487b-bc4d-3b3958d8c358 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.183367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09b33975-099d-487b-bc4d-3b3958d8c358 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.196455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-09b33975-099d-487b-bc4d-3b3958d8c358 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 200 len: 12 microversion: 2.26 time: 0.027998 Aug 27 03:19:40.201996 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1366/2759] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 03:19:40 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:40.211211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe4578cc940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.220027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.220657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.221225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.221709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.228160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.228466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.228899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.229736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.230259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.230793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.266829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.267313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.267755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.283502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:40.301472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c7b29e07-ec7f-43aa-9aef-3323b7196fb1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 204 len: 0 microversion: 2.26 time: 0.097253 Aug 27 03:19:40.307276 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1367/2760] 10.222.0.69 () {60 vars in 1295 bytes} [Sat Aug 27 03:19:40 2022] DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:19:40.311312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.311924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.319655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.320422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.321067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.321866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.322684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.323231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.490034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:40.501997 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ef2b6389-0bc1-4168-99e4-219948e19ea8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.197300 Aug 27 03:19:40.510280 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1368/2761] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:40 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:40.510280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe4579fc5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.510599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:40.524316 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-209bcc03-7db3-4bc2-aae1-666f12eee002 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1453 microversion: 2.1 time: 0.834516 Aug 27 03:19:40.524959 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1394/2762] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:39 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1453 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:40.537084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.540432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.542310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.543835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.557185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.557862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.558493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.559708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.560420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.561163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.600030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.601307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.604495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.605959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.606572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.615691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.620593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.620593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.620593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.622596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.623280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.624576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.625793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.632062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.655045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:40.679012 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91443649-48a5-4dc8-961c-0471a884c6c0 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-521839747" status: 201 len: 0 microversion: 2.26 time: 0.175274 Aug 27 03:19:40.686490 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1369/2763] 10.222.0.69 () {62 vars in 1377 bytes} [Sat Aug 27 03:19:40 2022] PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-521839747 => generated 0 bytes in 183 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 03:19:40.692544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:40.693089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.700076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.700687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.700999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.701702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.702195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.702624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.735483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lazy-loading 'flavor' on Instance uuid 45dca35c-d122-40f4-986b-5b77851f6f3d {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:40.756836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Cannot 'shelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state shelved_offloaded Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action HTTP/1.1 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 14 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: {"shelve": {}} Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: exception: Cannot 'shelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state shelved_offloaded Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'shelve': {}}} Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:19:40.758853 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state shelved_offloaded Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state shelved_offloaded Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 409 to user: Cannot 'shelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state shelved_offloaded {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-07a2907a-6dba-46c9-bc9b-01e13fd1ff0e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 409 len: 155 microversion: 2.1 time: 0.071941 Aug 27 03:19:40.762870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1370/2764] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:19:40 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:19:40.767389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457df8550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.781867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.782406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.782852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.783799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.791232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:40.792979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.794110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.794733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.795639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.796020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.796474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.849266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.849266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.849675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.860449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.860961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.861875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.899150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:40.916663 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-68b82596-c789-42f6-b15a-b675b8f5213e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1615592878" status: 201 len: 0 microversion: 2.26 time: 0.153677 Aug 27 03:19:40.922830 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1371/2765] 10.222.0.69 () {62 vars in 1380 bytes} [Sat Aug 27 03:19:40 2022] PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1615592878 => generated 0 bytes in 155 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 03:19:40.924391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:40.924391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.931615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.932236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.932762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.933480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.934645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.935347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.987852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122407) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 03:19:41.086638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:41.132810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e970f6ee-b4c3-4f3d-82c9-fcf7537c1b81 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.211872 Aug 27 03:19:41.142921 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1372/2766] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:19:40 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:19:41.151375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:41.162946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457dbaa60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.185115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.185622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.186264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.186793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.191707 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be4383ec-c374-4733-98a5-a71cff8fa14b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.594214 Aug 27 03:19:41.193262 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1395/2767] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:40 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:41.196186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.197158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.197656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.198408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.198903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.199951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.231032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.231718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.231990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.233011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.233348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.256389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:41.257972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.262715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.263256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.264064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.264929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.265393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.278197 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e904b110-6827-4a62-86be-4682773dae67 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 204 len: 0 microversion: 2.26 time: 0.128402 Aug 27 03:19:41.282138 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1373/2768] 10.222.0.69 () {60 vars in 1295 bytes} [Sat Aug 27 03:19:41 2022] DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:19:41.286989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.286989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.298800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.299503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.300175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.301173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.307215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.308035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.512641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:41.525893 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d445d33-8014-4a29-931a-765fc03b01da tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1461 microversion: 2.1 time: 0.245283 Aug 27 03:19:41.537043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1374/2769] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:41 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1461 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:41.544206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-767c30f4-ab46-4c02-8682-bef361d31d2e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457dbad30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.556814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-767c30f4-ab46-4c02-8682-bef361d31d2e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.557377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-767c30f4-ab46-4c02-8682-bef361d31d2e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.557783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-767c30f4-ab46-4c02-8682-bef361d31d2e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.569468 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-767c30f4-ab46-4c02-8682-bef361d31d2e tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 200 len: 12 microversion: 2.26 time: 0.030747 Aug 27 03:19:41.570430 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1375/2770] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 03:19:41 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:41.576209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6da9aebf-b080-439f-ba14-c161374dc328 req-ab34ca6e-ca1f-4fa3-b44d-cbb9f9fa7527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405db88e-88e4-4354-8042-d6bf17f760ce", "tag": "4827f4aa-eb84-4b53-83f0-102a51091895"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:41.587130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6da9aebf-b080-439f-ba14-c161374dc328 req-ab34ca6e-ca1f-4fa3-b44d-cbb9f9fa7527 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.587667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6da9aebf-b080-439f-ba14-c161374dc328 req-ab34ca6e-ca1f-4fa3-b44d-cbb9f9fa7527 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.588035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6da9aebf-b080-439f-ba14-c161374dc328 req-ab34ca6e-ca1f-4fa3-b44d-cbb9f9fa7527 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.603113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6da9aebf-b080-439f-ba14-c161374dc328 req-ab34ca6e-ca1f-4fa3-b44d-cbb9f9fa7527 service nova] Creating event network-changed:4827f4aa-eb84-4b53-83f0-102a51091895 for instance 405db88e-88e4-4354-8042-d6bf17f760ce on n-h1-852086-5 Aug 27 03:19:41.608150 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6da9aebf-b080-439f-ba14-c161374dc328 req-ab34ca6e-ca1f-4fa3-b44d-cbb9f9fa7527 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035783 Aug 27 03:19:41.608988 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1376/2771] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:41.614015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.615014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.621671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.622320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.622657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.623424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.623891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.624316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.772536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:41.782609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aa93e71c-9a1e-489a-80b9-d86856b6b2aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.171510 Aug 27 03:19:41.783707 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1377/2772] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:41 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:41.790051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457a5a160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.798862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.803045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.803540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.804142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.811236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.811812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.812244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.813043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.813496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.813921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.842317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.842731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.843164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.860657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:41.880791 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a235489-dfcf-4a99-a1fd-31401e55d77c tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 204 len: 0 microversion: 2.26 time: 0.094657 Aug 27 03:19:41.885848 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1378/2773] 10.222.0.69 () {60 vars in 1295 bytes} [Sat Aug 27 03:19:41 2022] DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:19:41.892268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe45c3b9820>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.903143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.903648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.904076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.904769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.915089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.915806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.916267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.917220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.917890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.918468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.952577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.952839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.953316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.964207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.964735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.965219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.017627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:42.055192 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c8faa5d-f007-4914-90a5-1c71a7df0d2d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1580930654" status: 201 len: 0 microversion: 2.26 time: 0.167592 Aug 27 03:19:42.061754 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1379/2774] 10.222.0.69 () {62 vars in 1380 bytes} [Sat Aug 27 03:19:41 2022] PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-1580930654 => generated 0 bytes in 175 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 03:19:42.069864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457dba550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.097374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.097739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.098167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.098683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.104590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.105080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.105578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.106284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.106748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.107375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.141846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.142637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.142974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.154046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.154698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.155127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.184588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:42.205852 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9a6ff36-3ed5-4a13-aec3-8c247da029bf tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-212634556" status: 201 len: 0 microversion: 2.26 time: 0.141681 Aug 27 03:19:42.206587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1380/2775] 10.222.0.69 () {62 vars in 1377 bytes} [Sat Aug 27 03:19:42 2022] PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags/tempest-tag-212634556 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 03:19:42.222004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Action: 'update_all', calling method: .version_select at 0x7fe457a05700>, body: {"tags": ["tempest-tag-1743447452", "tempest-tag-1737983629"]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:42.233878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.235567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.236109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.236651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.243711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.244290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.244790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.245503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.246486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.247232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.277518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.277681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.278113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.302874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:42.321331 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-15bbf4a3-6d52-47ec-83a6-c38521c42c49 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 200 len: 62 microversion: 2.26 time: 0.107451 Aug 27 03:19:42.321984 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1381/2776] 10.222.0.69 () {62 vars in 1312 bytes} [Sat Aug 27 03:19:42 2022] PUT /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 62 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:42.327538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.329523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.336907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.337615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.338297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.339101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.339745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.340179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.411225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:42.446856 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62af132c-1fe9-4c80-b543-ff008e7eba6c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 1.247977 Aug 27 03:19:42.460283 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1396/2777] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:41 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:42.468787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c7c2cbc-5926-4346-98af-cc94ecef0b75 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe4574bd0d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.477955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7c2cbc-5926-4346-98af-cc94ecef0b75 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.479176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7c2cbc-5926-4346-98af-cc94ecef0b75 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.479969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7c2cbc-5926-4346-98af-cc94ecef0b75 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.495311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c7c2cbc-5926-4346-98af-cc94ecef0b75 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 200 len: 62 microversion: 2.26 time: 0.032856 Aug 27 03:19:42.497382 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1397/2778] 10.222.0.69 () {60 vars in 1292 bytes} [Sat Aug 27 03:19:42 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 62 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:42.511388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '.version_select at 0x7fe457454dc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.528575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.529346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.530508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.531894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.546464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.548784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.550025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.550790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.551440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.551987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.556553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:42.567427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5086baec-34db-464e-b2d8-e0d157bf7a1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.244305 Aug 27 03:19:42.569102 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1382/2779] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:42 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:42.576473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.577668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.585334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.586789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.587234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.588056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.588609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.589925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.596400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.596981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.597521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.616039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'flavor' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:42.633991 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5491a209-7c01-4b30-b79b-e0185c19580a tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags" status: 204 len: 0 microversion: 2.26 time: 0.130363 Aug 27 03:19:42.634838 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1398/2780] 10.222.0.69 () {60 vars in 1295 bytes} [Sat Aug 27 03:19:42 2022] DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43/tags => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:19:42.644604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.645411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.648832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:42.652420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.653182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.653636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.654570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.655047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.655480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.689539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:19:42.787650 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd4b7f0a-f798-4291-9d2e-854319315d07 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 204 len: 0 microversion: 2.26 time: 0.147093 Aug 27 03:19:42.791566 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1399/2781] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:19:42 2022] DELETE /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 03:19:42.803216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.804615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.815974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.817125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.817842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.817973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:42.821913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.822910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.823617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.827711 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2efee691-5230-4a51-a6bf-2188d9101741 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1461 microversion: 2.1 time: 0.257526 Aug 27 03:19:42.828925 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1383/2782] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:42 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1461 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:42.847517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.848400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.866205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.867193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.868350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.870015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.870721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.871399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.916663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:42.997796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:43.063709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:43.073003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:43.076433 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7ffd2df-e950-42ca-9cb2-9d0e8e2e8a9b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.236788 Aug 27 03:19:43.077180 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1384/2783] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:42 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:43.346989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:43.357954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:43.359986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:43.361365 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccc7ee0f-fcf5-49e7-b0cb-e34b3edef7e4 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1551 microversion: 2.26 time: 0.568130 Aug 27 03:19:43.362008 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1400/2784] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:42 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1551 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:43.472526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:43.474788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:43.483206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.484048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.484591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.491981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.492604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.493565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.591567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:43.592391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:43.601464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.602688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.603447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.604987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.605690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.606580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.749290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:43.758597 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aea1f4bc-a916-4058-ba51-a67f3d7ce5bc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.290449 Aug 27 03:19:43.773091 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1385/2785] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:43 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:43.778886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-50bceaae-af06-49b9-860c-2e136b488968 req-8c29e72e-c7bd-422a-9eb5-71672dd829aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e93809-d503-4674-8eb4-26e2626405e9", "tag": "3306b2ac-2ff2-46a4-8ab8-57157175280a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:43.788560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-50bceaae-af06-49b9-860c-2e136b488968 req-8c29e72e-c7bd-422a-9eb5-71672dd829aa service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.789271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-50bceaae-af06-49b9-860c-2e136b488968 req-8c29e72e-c7bd-422a-9eb5-71672dd829aa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.789980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-50bceaae-af06-49b9-860c-2e136b488968 req-8c29e72e-c7bd-422a-9eb5-71672dd829aa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.803207 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-50bceaae-af06-49b9-860c-2e136b488968 req-8c29e72e-c7bd-422a-9eb5-71672dd829aa service nova] Creating event network-changed:3306b2ac-2ff2-46a4-8ab8-57157175280a for instance 99e93809-d503-4674-8eb4-26e2626405e9 on n-h2-852086-5 Aug 27 03:19:43.809040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-50bceaae-af06-49b9-860c-2e136b488968 req-8c29e72e-c7bd-422a-9eb5-71672dd829aa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034119 Aug 27 03:19:43.810071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1386/2786] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:43.860504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:43.862584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:43.872785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.873532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.874282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:43.875437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:43.876199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:43.876896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.066675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:44.077703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6dae747-4bb2-4e21-af5d-949760a0e475 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.224582 Aug 27 03:19:44.080358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:44.087280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:44.096114 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1387/2787] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:43 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:44.102387 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a61fed61-08f9-425d-9feb-e92dad6d7ae0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.516141 Aug 27 03:19:44.103965 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1401/2788] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:43 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:44.106790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:44.108942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:44.121374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.122051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.122767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.124124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.125879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.125879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.308121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:44.317547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-134d3f80-323c-4040-b485-30fa1227129d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.219875 Aug 27 03:19:44.330937 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1388/2789] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:44 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:44.385266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:44.386199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:44.393938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.394468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.394907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.395622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.396417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.397143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.423776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:44.788433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:44.790139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:44.798049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.799089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.799847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.800756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.801280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.801629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.060530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.077598 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c842d13b-97c2-4317-8c85-26eef2235a3e tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.294346 Aug 27 03:19:45.078659 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1389/2790] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:44 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:45.103780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:45.104406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:45.111797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.112694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.113192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.114140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.114769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.115345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.163743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.183424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.184881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.186327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a622163-2c24-4928-a041-0c16be49949d tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1551 microversion: 2.26 time: 0.805079 Aug 27 03:19:45.187095 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1402/2791] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:44 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1551 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:45.191971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:45.203146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:45.209862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.210689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.211313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.212192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.212853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.213443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.306527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.315241 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c085046d-8757-4fc4-99ad-e0e2bbe2c204 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.215945 Aug 27 03:19:45.329141 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1390/2792] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:45 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:45.340320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:45.340875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:45.348037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.348532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.348964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.349666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.350122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.350574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.511769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.523124 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30be0b9a-a794-4d0c-9783-232889eb537b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.186908 Aug 27 03:19:45.524041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1391/2793] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:45 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:46.113541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:46.115910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:46.134023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.134882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.136236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.138332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.139121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.143551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.186888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:46.197840 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa01615a-2df4-4827-8b32-0b04f0885522 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 1.009396 Aug 27 03:19:46.206311 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1403/2794] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:45 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:46.211562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:46.231148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:46.239630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.242842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.256092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.257191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.257849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.258517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.835930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:46.874132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:46.883610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:46.885011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e53309b-d9e9-4483-9a46-7fb6d72c0c39 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1509 microversion: 2.26 time: 0.677576 Aug 27 03:19:46.893019 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1404/2795] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:46 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1509 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:46.905033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:46.905667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:46.936002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.936507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.936980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.949662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.950847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.960092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:47.050336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:47.081025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ec3a347-c934-46d6-8177-4ca1ecb58038 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.980150 Aug 27 03:19:47.081676 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1392/2796] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:46 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:47.121494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:47.122797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:47.154603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:47.155372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:47.160146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:47.161989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:47.165842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:47.168671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:47.658897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:47.671380 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0dd74612-0c9f-4d7f-a2c3-1e2836086fda tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.560974 Aug 27 03:19:47.673270 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1393/2797] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:47 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:47.684100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:47.684731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:47.702554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:47.706579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:47.708028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:47.710208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:47.711888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:47.713489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.379411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:48.405402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bed04916-cda4-4cde-8577-e60cb453636e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 1.510944 Aug 27 03:19:48.410487 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1405/2798] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:46 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:48.436412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-83474c59-8c5f-406f-9584-15516baf67b9 req-ff608d92-df03-492a-9344-b0c33c0759f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bffc9f-dda2-4883-9e9b-d05aa9b8f20b", "name": "network-vif-plugged", "status": "completed", "tag": "a87ae983-43b7-45f0-bb31-a14064837541"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:48.466594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83474c59-8c5f-406f-9584-15516baf67b9 req-ff608d92-df03-492a-9344-b0c33c0759f9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.468275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83474c59-8c5f-406f-9584-15516baf67b9 req-ff608d92-df03-492a-9344-b0c33c0759f9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.469878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83474c59-8c5f-406f-9584-15516baf67b9 req-ff608d92-df03-492a-9344-b0c33c0759f9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.511359 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-83474c59-8c5f-406f-9584-15516baf67b9 req-ff608d92-df03-492a-9344-b0c33c0759f9 service nova] Creating event network-vif-plugged:a87ae983-43b7-45f0-bb31-a14064837541 for instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b on n-h2-852086-5 Aug 27 03:19:48.549119 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-83474c59-8c5f-406f-9584-15516baf67b9 req-ff608d92-df03-492a-9344-b0c33c0759f9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131660 Aug 27 03:19:48.549850 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1406/2799] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:48.559141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-356d7d4f-a0d1-4bb8-b91e-288a25cdf1fe req-0d504acf-a3ba-4ccb-85b0-8fb724c33903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910a0e4f-a7b8-43bc-8808-7befcd354b43", "name": "network-vif-deleted", "tag": "54f1b6f1-a396-46b9-8693-38a1260a3489"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:48.584984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-356d7d4f-a0d1-4bb8-b91e-288a25cdf1fe req-0d504acf-a3ba-4ccb-85b0-8fb724c33903 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.587087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-356d7d4f-a0d1-4bb8-b91e-288a25cdf1fe req-0d504acf-a3ba-4ccb-85b0-8fb724c33903 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.588066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-356d7d4f-a0d1-4bb8-b91e-288a25cdf1fe req-0d504acf-a3ba-4ccb-85b0-8fb724c33903 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.651065 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-356d7d4f-a0d1-4bb8-b91e-288a25cdf1fe req-0d504acf-a3ba-4ccb-85b0-8fb724c33903 service nova] Creating event network-vif-deleted:54f1b6f1-a396-46b9-8693-38a1260a3489 for instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 on n-h2-852086-5 Aug 27 03:19:48.665490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-356d7d4f-a0d1-4bb8-b91e-288a25cdf1fe req-0d504acf-a3ba-4ccb-85b0-8fb724c33903 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112563 Aug 27 03:19:48.667120 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1407/2800] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:48.679722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:48.680507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:48.699902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.701579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.702138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.706416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.707132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.709956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.897752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:48.920916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.924196 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e88c0f7d-caf2-4d81-acb3-f7c9c0fa497b tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 1.249793 Aug 27 03:19:48.927042 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1394/2801] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:47 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:48.930050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.930611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.936036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lazy-loading 'fault' on Instance uuid 910a0e4f-a7b8-43bc-8808-7befcd354b43 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:19:48.945491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:48.963613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:48.985592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.990335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.991151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.002010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.003358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.004052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.336738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:49.350351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:49.364503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38411b9dfe148848785b4fa2793b900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e84b5dedf954434ac3c421143ab9050', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:49.365769 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f846c7c-5c63-4fc7-ae13-13f7882fb53b tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 200 len: 1351 microversion: 2.26 time: 0.696131 Aug 27 03:19:49.367969 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1408/2802] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:48 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 1351 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:19:49.373145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:49.373951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:49.393830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.395283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.395929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.410955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.411996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.414834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.450397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:49.461419 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-365d03b6-c7d3-48ab-8c5d-6453b3354571 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.530854 Aug 27 03:19:49.472886 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1395/2803] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:48 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:49.480551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:49.481777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:49.499316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.502899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.503572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.504475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.510509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.511431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.780269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:49.793743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0b90b01-9623-4f7b-aa74-180736198a63 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.424448 Aug 27 03:19:49.802120 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1409/2804] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:49 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:49.948406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:49.949218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:49.960486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.961020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.961555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.962271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.967047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.970502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.310150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:50.322434 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1aa62534-d36c-4d83-85fd-0717736634c2 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.378252 Aug 27 03:19:50.326866 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1410/2805] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:49 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:50.336415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:50.350553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a18893ae-f885-4f8b-87f2-14ff63e8f9d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.876021 Aug 27 03:19:50.351075 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1396/2806] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:49 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:50.392902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:50.393532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] [instance: 910a0e4f-a7b8-43bc-8808-7befcd354b43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:50.403832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.407796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.410540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.411510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.414952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.415885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.460612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] HTTP exception thrown: Instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 could not be found. Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Request method failure captured: Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 HTTP/1.1 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY0t7C42JjoQ9JD2Q_5RS0XlH9yegBn7oGyi2NQ6vHJRQZ380Hz5C9qUxwAIBooHcMz9yw5f5LI1fp3yCMOu54F_87DV1PO3KEjAjdCSdSkFseJUIz-6qeBXf2avNfqFrCVkj9O5tMPuTuMMw7Q1AsnZ25_DYa9fRcyzkB6lsR6QgOg Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.26 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4e84b5dedf954434ac3c421143ab9050 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerTagsTestJSON-911505867 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4e84b5dedf954434ac3c421143ab9050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e84b5dedf954434ac3c421143ab9050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4e84b5dedf954434ac3c421143ab9050", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4e84b5dedf954434ac3c421143ab9050"}]}] Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerTagsTestJSON-911505867 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4e84b5dedf954434ac3c421143ab9050 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerTagsTestJSON-911505867 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerTagsTestJSON-911505867-project Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: a38411b9dfe148848785b4fa2793b900 Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerTagsTestJSON-911505867-project Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 could not be found. Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '910a0e4f-a7b8-43bc-8808-7befcd354b43'} Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 could not be found. Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 could not be found. Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:50.467088 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 could not be found. Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] Returning 404 to user: Instance 910a0e4f-a7b8-43bc-8808-7befcd354b43 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:50.477971 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1024e119-1922-47e6-9607-4034ff86d5f1 tempest-ServerTagsTestJSON-911505867 tempest-ServerTagsTestJSON-911505867-project] 10.222.0.69 "GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43" status: 404 len: 111 microversion: 2.26 time: 0.081184 Aug 27 03:19:50.497248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:50.497891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:50.503752 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1411/2807] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:19:50 2022] GET /compute/v2.1/servers/910a0e4f-a7b8-43bc-8808-7befcd354b43 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:19:50.510949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.511514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.513414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.514220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.514675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.515118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.617242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-66bfdaeb-c1a5-446d-b201-b04f9451fecc req-b7d33218-4b8d-4582-9074-c729b1612838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bffc9f-dda2-4883-9e9b-d05aa9b8f20b", "name": "network-vif-plugged", "status": "completed", "tag": "8e1f3864-8132-4486-a59a-e232d6af7215"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:50.642586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-66bfdaeb-c1a5-446d-b201-b04f9451fecc req-b7d33218-4b8d-4582-9074-c729b1612838 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.643505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-66bfdaeb-c1a5-446d-b201-b04f9451fecc req-b7d33218-4b8d-4582-9074-c729b1612838 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.645930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-66bfdaeb-c1a5-446d-b201-b04f9451fecc req-b7d33218-4b8d-4582-9074-c729b1612838 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.674647 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-66bfdaeb-c1a5-446d-b201-b04f9451fecc req-b7d33218-4b8d-4582-9074-c729b1612838 service nova] Creating event network-vif-plugged:8e1f3864-8132-4486-a59a-e232d6af7215 for instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b on n-h2-852086-5 Aug 27 03:19:50.683295 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-66bfdaeb-c1a5-446d-b201-b04f9451fecc req-b7d33218-4b8d-4582-9074-c729b1612838 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075622 Aug 27 03:19:50.688677 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1412/2808] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:50.832848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:50.836513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:50.854003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.855674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.856235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.857403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:50.859485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:50.860832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.408245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:51.429853 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a52d2f1-adfd-4e5f-ad1e-748d40190bad tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.610461 Aug 27 03:19:51.432853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1413/2809] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:50 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:51.462366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:51.464445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:51.486019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.486693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.488487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.489375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.489866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.490395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.655183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:51.669472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f1a0189-109d-451a-8e0f-b7ff1ca517e7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 1.176784 Aug 27 03:19:51.670074 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1397/2810] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:50 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:51.688937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:51.689557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:51.717922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.719191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.719759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.720615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.721078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.721503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:52.381340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:52.395972 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42ea0ddd-f71a-467d-9851-54cbb59efc1c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1333 microversion: 2.1 time: 0.942331 Aug 27 03:19:52.397930 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1414/2811] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:51 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1333 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:52.458808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:52.460362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:52.473008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:52.476967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:52.477864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:52.479055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:52.480052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:52.483626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:52.724218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:52.762234 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d1026bf-9946-4f59-87ba-b06ca91395b4 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 1.078398 Aug 27 03:19:52.764519 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1398/2812] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:51 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:52.788882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:52.790330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:52.821063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:52.826026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:52.827401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:52.831807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:52.833524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:52.835328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.122881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:53.141674 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46f3c11c-6246-47ee-bbfc-8bf192fada04 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.686318 Aug 27 03:19:53.144243 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1415/2813] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:52 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:53.155513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-47dbd0e9-0981-476f-b54e-3cfd0fdaa478 req-a7926989-9d98-474f-8976-efd2a9eccf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405db88e-88e4-4354-8042-d6bf17f760ce", "name": "network-vif-plugged", "status": "completed", "tag": "4827f4aa-eb84-4b53-83f0-102a51091895"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:53.190276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47dbd0e9-0981-476f-b54e-3cfd0fdaa478 req-a7926989-9d98-474f-8976-efd2a9eccf23 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.194932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47dbd0e9-0981-476f-b54e-3cfd0fdaa478 req-a7926989-9d98-474f-8976-efd2a9eccf23 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.195656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47dbd0e9-0981-476f-b54e-3cfd0fdaa478 req-a7926989-9d98-474f-8976-efd2a9eccf23 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.239560 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-47dbd0e9-0981-476f-b54e-3cfd0fdaa478 req-a7926989-9d98-474f-8976-efd2a9eccf23 service nova] Creating event network-vif-plugged:4827f4aa-eb84-4b53-83f0-102a51091895 for instance 405db88e-88e4-4354-8042-d6bf17f760ce on n-h1-852086-5 Aug 27 03:19:53.259720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:53.262152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-47dbd0e9-0981-476f-b54e-3cfd0fdaa478 req-a7926989-9d98-474f-8976-efd2a9eccf23 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111687 Aug 27 03:19:53.264497 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1416/2814] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:53.277785 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d2b684e3-64ac-4c61-9df1-8b73eff2a13f tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1317 microversion: 2.1 time: 0.506574 Aug 27 03:19:53.299665 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1399/2815] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:52 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:53.436399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:53.438719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:53.461278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.462037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.462851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.463786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.464479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.465303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.497915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b183ec1f-4a22-436f-b493-57e5c4e121cb tempest-FloatingIPDetailsNegativeTestJSON-950597906 tempest-FloatingIPDetailsNegativeTestJSON-950597906-project] Calling method '.version_select at 0x7fe45c83d0d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:53.748227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-b183ec1f-4a22-436f-b493-57e5c4e121cb tempest-FloatingIPDetailsNegativeTestJSON-950597906 tempest-FloatingIPDetailsNegativeTestJSON-950597906-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c3e86aed-5ef2-49d6-9f66-31cd3449284f could not be found", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 03:19:53.750435 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-b183ec1f-4a22-436f-b493-57e5c4e121cb tempest-FloatingIPDetailsNegativeTestJSON-950597906 tempest-FloatingIPDetailsNegativeTestJSON-950597906-project] HTTP exception thrown: Floating IP not found for ID c3e86aed-5ef2-49d6-9f66-31cd3449284f Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b183ec1f-4a22-436f-b493-57e5c4e121cb tempest-FloatingIPDetailsNegativeTestJSON-950597906 tempest-FloatingIPDetailsNegativeTestJSON-950597906-project] Request method failure captured: Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-floating-ips/c3e86aed-5ef2-49d6-9f66-31cd3449284f HTTP/1.1 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ZAazJ_yVitMj3pI48dfUSGpkN2Dtic5E-5SjMNfsRnRwEdvR0lH_Z3afftL3uMXa5A4H7Q5XRFPW2z-d6bM_GGnfg_ml9crupCiRcfboZcPNbxhiVnIBaufFvIgVnxouyt2gDMV0VqWCarVSMSQKmWQiaii8lZDLMs6m0YPifdsI Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 29f1173f88de4d31a297ee12315b3131 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-950597906 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/29f1173f88de4d31a297ee12315b3131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/29f1173f88de4d31a297ee12315b3131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_29f1173f88de4d31a297ee12315b3131", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/29f1173f88de4d31a297ee12315b3131"}]}] Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-950597906 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 29f1173f88de4d31a297ee12315b3131 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-950597906 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-950597906-project Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 16a74697675749058fe1c418cf8ca455 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-950597906-project Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: exception: Floating IP not found for ID c3e86aed-5ef2-49d6-9f66-31cd3449284f Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'c3e86aed-5ef2-49d6-9f66-31cd3449284f'} Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c3e86aed-5ef2-49d6-9f66-31cd3449284f could not be found Aug 27 03:19:53.755242 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac5b66c2-18b3-44b2-9dc2-4891a4e93074'] Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c3e86aed-5ef2-49d6-9f66-31cd3449284f. Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c3e86aed-5ef2-49d6-9f66-31cd3449284f Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c3e86aed-5ef2-49d6-9f66-31cd3449284f Aug 27 03:19:53.761157 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:19:53.773142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b183ec1f-4a22-436f-b493-57e5c4e121cb tempest-FloatingIPDetailsNegativeTestJSON-950597906 tempest-FloatingIPDetailsNegativeTestJSON-950597906-project] Returning 404 to user: Floating IP not found for ID c3e86aed-5ef2-49d6-9f66-31cd3449284f {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:19:53.774365 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b183ec1f-4a22-436f-b493-57e5c4e121cb tempest-FloatingIPDetailsNegativeTestJSON-950597906 tempest-FloatingIPDetailsNegativeTestJSON-950597906-project] 10.222.0.69 "GET /compute/v2.1/os-floating-ips/c3e86aed-5ef2-49d6-9f66-31cd3449284f" status: 404 len: 111 microversion: 2.1 time: 0.398321 Aug 27 03:19:53.781159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:53.783960 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1417/2816] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:19:53 2022] GET /compute/v2.1/os-floating-ips/c3e86aed-5ef2-49d6-9f66-31cd3449284f => generated 111 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:19:53.800545 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54f4fbcf-9b1c-42c5-b383-d9e2c88f5d8c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1669 microversion: 2.1 time: 0.372307 Aug 27 03:19:53.800965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:53.801472 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1400/2817] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:53 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1669 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:53.802322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:53.820446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.820952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.821397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.822189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.829513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:53.830017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:53.836992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.837936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.842791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.848398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.849106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.852227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.852971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.853579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.929538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e7cc2856-3f64-42bc-971b-7f7269eb7ec7 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b/ips" status: 200 len: 180 microversion: 2.1 time: 0.104301 Aug 27 03:19:53.934849 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1401/2818] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:19:53 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b/ips => generated 180 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:53.946496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:53.949396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:53.964271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.966907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.970447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.971467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.972147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.972774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.023227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:54.041660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:19:54.208285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04d882d9-dd16-46b2-931d-00b45cc32e10 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "DELETE /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 204 len: 0 microversion: 2.1 time: 0.265504 Aug 27 03:19:54.212660 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1402/2819] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:53 2022] DELETE /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:19:54.228715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:54.229512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:54.243038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.243854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.244512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.245456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.246113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.246732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.458494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:54.491750 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39ca7ac6-abe1-4bf6-9505-f4b004d11b87 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.699576 Aug 27 03:19:54.516153 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1418/2820] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:53 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:54.551534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:54.557217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:54.579561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.585859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.594538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.603368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.604416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.605088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:55.460016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:55.463546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:55.472991 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7b0fa65-0430-42dc-9ab7-1fc4b5e138ef tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1675 microversion: 2.1 time: 0.951596 Aug 27 03:19:55.473856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1419/2821] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:54 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1675 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:55.478845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:55.479734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:55.487454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.488208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.488802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:55.489176 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f0160a7-6bea-4fc0-b707-387e22d0730f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 1.271535 Aug 27 03:19:55.489926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.490731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.491318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:55.493794 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1403/2822] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:54 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:55.528125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:55.548902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:55.579210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.582982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.587888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:55.592807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.596007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.601160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:56.445315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:56.459410 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65c79577-eeed-4266-8e24-dc71106437fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.949020 Aug 27 03:19:56.473347 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1404/2823] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:55 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:56.501093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d6cea079-7413-418e-901a-424242d3d199 req-cd1cc6d1-898e-4197-adee-26eac7254fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e93809-d503-4674-8eb4-26e2626405e9", "name": "network-vif-plugged", "status": "completed", "tag": "3306b2ac-2ff2-46a4-8ab8-57157175280a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:56.516412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d6cea079-7413-418e-901a-424242d3d199 req-cd1cc6d1-898e-4197-adee-26eac7254fbe service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:56.517263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d6cea079-7413-418e-901a-424242d3d199 req-cd1cc6d1-898e-4197-adee-26eac7254fbe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:56.519259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d6cea079-7413-418e-901a-424242d3d199 req-cd1cc6d1-898e-4197-adee-26eac7254fbe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:56.563470 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d6cea079-7413-418e-901a-424242d3d199 req-cd1cc6d1-898e-4197-adee-26eac7254fbe service nova] Creating event network-vif-plugged:3306b2ac-2ff2-46a4-8ab8-57157175280a for instance 99e93809-d503-4674-8eb4-26e2626405e9 on n-h2-852086-5 Aug 27 03:19:56.579020 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d6cea079-7413-418e-901a-424242d3d199 req-cd1cc6d1-898e-4197-adee-26eac7254fbe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087914 Aug 27 03:19:56.585018 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1405/2824] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:56.611032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:56.612197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:56.655715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:56.663711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:56.665224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:56.669141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:56.670740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:56.671376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:57.415960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:57.425499 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4eb11a8c-a46f-4385-95c4-d7354b0db6ae tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1675 microversion: 2.1 time: 0.837283 Aug 27 03:19:57.426097 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1406/2825] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:56 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1675 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:57.454836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:57.455468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:57.475116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.487017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.487679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:57.488426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.492461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.493136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:57.506045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:57.517216 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c75290d-b81c-4457-9347-54cbe630de3b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1466 microversion: 2.1 time: 2.041937 Aug 27 03:19:57.518059 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1420/2826] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:55 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1466 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:57.546603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:57.547534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:57.570927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.571905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.572721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:57.573796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.574485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.576273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.109328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:58.126735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b948b874-b70a-42ba-8883-6b480e9f289e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1313 microversion: 2.1 time: 0.693194 Aug 27 03:19:58.130393 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1407/2827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:57 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1313 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:58.153488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-506600112", "metadata": {"image_type": "test"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:58.160798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:58.181206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.181726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.183596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.197334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.197753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.205394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.333215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:58.355768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-285f8fee-68a9-41fd-9003-cfee8fa4a3e1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.836400 Aug 27 03:19:58.360661 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1421/2828] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:57 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:58.398983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Getting quotas for project b0c6598a83274624997da7af158a0d57. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:58.424603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Getting quotas for user 4eb9f9c28d84488caffc8a3e340c1f16 and project b0c6598a83274624997da7af158a0d57. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:58.454914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:58.458095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:58.469348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:58.477107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.477616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.483467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.484799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.490952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.492377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.941319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:58.950808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab931a76-d7e8-4842-aac6-b58cb4b0111f tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1675 microversion: 2.1 time: 0.505432 Aug 27 03:19:58.969141 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1422/2829] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:58 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1675 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:58.981639 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-97e3304a-7d9a-42ed-a90a-c62152f935e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "POST /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce/action" status: 202 len: 0 microversion: 2.1 time: 0.847197 Aug 27 03:19:58.996561 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1408/2830] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:19:58 2022] POST /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce/action => generated 0 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:19:59.006945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-879dc0b6-f304-451c-a037-79a610d9e628 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457f04b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:59.093059 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-879dc0b6-f304-451c-a037-79a610d9e628 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.089800 Aug 27 03:19:59.105876 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1423/2831] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:19:59 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:59.151500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:59.153225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:59.178389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.179685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.181582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.182622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.183277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.199904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.393942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:59.394656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:59.411472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.414464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.416235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.420459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.421181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.421847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.436342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:59.613953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:59.623708 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a7df5b16-feb0-455e-8388-f510b7ee6649 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1501 microversion: 2.1 time: 0.477694 Aug 27 03:19:59.624307 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1409/2832] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:59 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1501 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:59.653230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:59.654933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:59.667644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.668399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.668848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.669574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.670040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.670502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.713174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:19:59.842458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d92bdba0-9d4c-40c3-bbe0-0fbf82470e53 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 204 len: 0 microversion: 2.1 time: 0.193278 Aug 27 03:19:59.844726 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1410/2833] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:59 2022] DELETE /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:19:59.857092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:59.857825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:59.866465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.867281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.867712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.868442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:59.870015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:59.870015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.079648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:00.090885 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2fa9e4c-262e-4426-a43a-c36ac609a2c4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1507 microversion: 2.1 time: 0.238775 Aug 27 03:20:00.092405 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1411/2834] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:59 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:00.100071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-a9097ce3-c366-4021-b865-6ab708802a35 req-9ae94fbe-8d2f-477e-aaaf-f19c24230e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bffc9f-dda2-4883-9e9b-d05aa9b8f20b", "name": "network-vif-deleted", "tag": "8e1f3864-8132-4486-a59a-e232d6af7215"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:00.111976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:00.117855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9097ce3-c366-4021-b865-6ab708802a35 req-9ae94fbe-8d2f-477e-aaaf-f19c24230e53 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.123130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9097ce3-c366-4021-b865-6ab708802a35 req-9ae94fbe-8d2f-477e-aaaf-f19c24230e53 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.123130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9097ce3-c366-4021-b865-6ab708802a35 req-9ae94fbe-8d2f-477e-aaaf-f19c24230e53 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.139484 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bda52d03-3f8b-40c7-aa19-eee8422240eb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.744477 Aug 27 03:20:00.149841 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-a9097ce3-c366-4021-b865-6ab708802a35 req-9ae94fbe-8d2f-477e-aaaf-f19c24230e53 service nova] Creating event network-vif-deleted:8e1f3864-8132-4486-a59a-e232d6af7215 for instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b on n-h2-852086-5 Aug 27 03:20:00.157035 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1424/2835] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:59 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:00.160585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-a9097ce3-c366-4021-b865-6ab708802a35 req-9ae94fbe-8d2f-477e-aaaf-f19c24230e53 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066709 Aug 27 03:20:00.161721 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1412/2836] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:00.167959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:00.169765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9241f126-3d1b-4afb-aa20-15ccfba05e4a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602f95e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:00.170366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:00.191578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.192088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.193312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.196308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.197830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.198381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.237705 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9241f126-3d1b-4afb-aa20-15ccfba05e4a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.074493 Aug 27 03:20:00.246297 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1413/2837] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:00 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:00.388925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f1a6955f-dccb-4005-a2f8-0419d3e2f5b4 req-2d835d8e-24af-47d2-83b1-f3a591b27573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bffc9f-dda2-4883-9e9b-d05aa9b8f20b", "name": "network-vif-unplugged", "status": "completed", "tag": "a87ae983-43b7-45f0-bb31-a14064837541"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:00.404598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f1a6955f-dccb-4005-a2f8-0419d3e2f5b4 req-2d835d8e-24af-47d2-83b1-f3a591b27573 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.405244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f1a6955f-dccb-4005-a2f8-0419d3e2f5b4 req-2d835d8e-24af-47d2-83b1-f3a591b27573 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.405783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f1a6955f-dccb-4005-a2f8-0419d3e2f5b4 req-2d835d8e-24af-47d2-83b1-f3a591b27573 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.422353 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f1a6955f-dccb-4005-a2f8-0419d3e2f5b4 req-2d835d8e-24af-47d2-83b1-f3a591b27573 service nova] Creating event network-vif-unplugged:a87ae983-43b7-45f0-bb31-a14064837541 for instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b on n-h2-852086-5 Aug 27 03:20:00.429316 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f1a6955f-dccb-4005-a2f8-0419d3e2f5b4 req-2d835d8e-24af-47d2-83b1-f3a591b27573 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044555 Aug 27 03:20:00.430217 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1414/2838] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:20:00.674502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:00.685368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1066788c-cf68-4977-a130-1b49c986d188 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1654 microversion: 2.1 time: 0.526581 Aug 27 03:20:00.686071 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1425/2839] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:00 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1654 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:01.115719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:01.117840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:01.131773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.132931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.134664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.136465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.137532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.138677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.163415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:01.163987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:01.175989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.179361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.180008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.180938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.182735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.183390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.403735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:01.415233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7c30450-7eff-41b4-aab7-b854622902a0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1507 microversion: 2.1 time: 0.304971 Aug 27 03:20:01.416062 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1415/2840] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:01 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:01.422521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59203362-283c-4807-9733-2781fb08cbd5 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602eb700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:01.484993 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59203362-283c-4807-9733-2781fb08cbd5 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.066655 Aug 27 03:20:01.486203 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1416/2841] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:01 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:01.708726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:01.709331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:01.716237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.716725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.717161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.717856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.720204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.720204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.900571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:01.905028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:01.910647 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40f04a12-c5d2-4826-8493-c2b162c6ff76 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1495 microversion: 2.1 time: 0.205774 Aug 27 03:20:01.911358 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1417/2842] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:01 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1495 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:02.195020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:02.208257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f13f283e-c8ea-4b5b-8413-c6fa71b7550b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 1.049224 Aug 27 03:20:02.222800 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1426/2843] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:01 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:02.439751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:02.441264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:02.462271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.464156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.465249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:02.466729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.468173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.471725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:02.502950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-297242f4-5b32-490e-87ec-17ee7a5ee6fa tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c2c1310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:02.603697 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-297242f4-5b32-490e-87ec-17ee7a5ee6fa tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.105671 Aug 27 03:20:02.604998 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1427/2844] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:02 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:02.936748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:02.938025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:02.955294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.959039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.959978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:02.961101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.963051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.964458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.121172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be937d33b6d40daba326e75e6eb35b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322c18d287b49b3839208e66ea07871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:03.137313 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-048c7aff-866f-4812-bbb7-59cb4b6903c9 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 200 len: 1453 microversion: 2.1 time: 0.204979 Aug 27 03:20:03.142901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1428/2845] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:02 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:03.225694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-57a3df78-14c6-4fd1-99c8-48e13502a8a9 req-3ae23404-36ec-4005-9185-50a2da0797f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bffc9f-dda2-4883-9e9b-d05aa9b8f20b", "name": "network-vif-deleted", "tag": "a87ae983-43b7-45f0-bb31-a14064837541"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:03.300939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-57a3df78-14c6-4fd1-99c8-48e13502a8a9 req-3ae23404-36ec-4005-9185-50a2da0797f8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.305982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-57a3df78-14c6-4fd1-99c8-48e13502a8a9 req-3ae23404-36ec-4005-9185-50a2da0797f8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.307689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-57a3df78-14c6-4fd1-99c8-48e13502a8a9 req-3ae23404-36ec-4005-9185-50a2da0797f8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.342865 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-57a3df78-14c6-4fd1-99c8-48e13502a8a9 req-3ae23404-36ec-4005-9185-50a2da0797f8 service nova] Creating event network-vif-deleted:a87ae983-43b7-45f0-bb31-a14064837541 for instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b on n-h2-852086-5 Aug 27 03:20:03.361906 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-57a3df78-14c6-4fd1-99c8-48e13502a8a9 req-3ae23404-36ec-4005-9185-50a2da0797f8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154143 Aug 27 03:20:03.364571 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1429/2846] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:03.378034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:03.381747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:03.440424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.442808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.444561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.450065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.451030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.452320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.871241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:03.883631 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9593329-82da-44e6-b521-a747c515272c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1507 microversion: 2.1 time: 1.450231 Aug 27 03:20:03.888159 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1418/2847] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:02 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1507 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:03.907686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8109ec60-dab2-4ac1-8cc9-c0cdc88f9a5a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602ccca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:03.978152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:04.028480 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b1ef844-4c00-45b6-bcf7-db94b1d0e796 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.650441 Aug 27 03:20:04.036455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1430/2848] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:03 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:04.101423 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8109ec60-dab2-4ac1-8cc9-c0cdc88f9a5a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.211489 Aug 27 03:20:04.110368 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1419/2849] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:03 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:04.170425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:04.171321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:04.190549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:04.193078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:04.194076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:04.202633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:04.203653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:04.204299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:04.244035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] HTTP exception thrown: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Request method failure captured: Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b HTTP/1.1 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzdYEqZHid7vHr_quxySmiZnomGBr8Vkjs_2h6ugT47-n5zcA2qBwcKY0c2tX1tjTEPNTvnYm-pU11UXjvtVnKMK_o10_IOA1gvhB781zDXjWpToE-L2ROfKqDHJpYp2EEtfZiHLt9_LGD2c9XzSxQhh0hA7I8Vf8eAavYVRvYA5Dc Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2322c18d287b49b3839208e66ea07871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2322c18d287b49b3839208e66ea07871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}] Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 0be937d33b6d40daba326e75e6eb35b6 Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '33bffc9f-dda2-4883-9e9b-d05aa9b8f20b'} Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:04.247885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Returning 404 to user: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:04.257574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7dffb01c-71be-42c2-9afd-67249fbe92f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 404 len: 111 microversion: 2.1 time: 0.088328 Aug 27 03:20:04.264599 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1431/2850] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:04 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:04.922370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:04.926980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:04.966950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:04.977324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:04.990476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:04.992723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:04.997308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.005009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.060782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:05.061414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:05.107833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:05.108844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.135242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.136223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:05.136546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.137020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.218120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:05.219214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.219964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.237573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lazy-loading 'fault' on Instance uuid 99e93809-d503-4674-8eb4-26e2626405e9 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:20:05.473759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:05.488396 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c419d8f6-66bd-4a10-bfc6-ebee7bdb03c5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 200 len: 1303 microversion: 2.1 time: 0.574757 Aug 27 03:20:05.496415 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1420/2851] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:04 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 1303 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:05.510550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54bd9436-d23e-4648-a0bf-eb4898547883 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c40fe50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:05.698910 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54bd9436-d23e-4648-a0bf-eb4898547883 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.200945 Aug 27 03:20:05.706257 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1421/2852] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:05 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:05.715916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c97a5bd3-cc33-478b-9e80-2fee5cab6146 req-13ed8904-f547-4496-9e25-ccdcf3013001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e93809-d503-4674-8eb4-26e2626405e9", "name": "network-vif-deleted", "tag": "3306b2ac-2ff2-46a4-8ab8-57157175280a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:05.747773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c97a5bd3-cc33-478b-9e80-2fee5cab6146 req-13ed8904-f547-4496-9e25-ccdcf3013001 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:05.748372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c97a5bd3-cc33-478b-9e80-2fee5cab6146 req-13ed8904-f547-4496-9e25-ccdcf3013001 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.754870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c97a5bd3-cc33-478b-9e80-2fee5cab6146 req-13ed8904-f547-4496-9e25-ccdcf3013001 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.785960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c97a5bd3-cc33-478b-9e80-2fee5cab6146 req-13ed8904-f547-4496-9e25-ccdcf3013001 service nova] Creating event network-vif-deleted:3306b2ac-2ff2-46a4-8ab8-57157175280a for instance 99e93809-d503-4674-8eb4-26e2626405e9 on n-h2-852086-5 Aug 27 03:20:05.803845 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c97a5bd3-cc33-478b-9e80-2fee5cab6146 req-13ed8904-f547-4496-9e25-ccdcf3013001 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096267 Aug 27 03:20:05.805165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1422/2853] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:06.011104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:06.054488 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-465b9690-9590-47a6-be8d-305f9322824f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.994623 Aug 27 03:20:06.066195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1432/2854] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:05 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:06.525547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:06.526588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:06.548792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:06.550873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:06.551461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:06.552302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:06.554898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:06.555365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:06.591515 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 HTTP/1.1 Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '99e93809-d503-4674-8eb4-26e2626405e9'} Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:06.594045 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.597981 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:06.597981 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:06.597981 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:06.597981 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:06.597981 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:06.597981 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:20:06.597981 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.604064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:06.605341 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1da81634-0fc5-4a43-abeb-806d3e580711 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 404 len: 111 microversion: 2.1 time: 0.085056 Aug 27 03:20:06.606635 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1423/2855] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:06 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:06.715373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0aef90cc-912d-4ffa-9beb-3d3130c339ca tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45765dee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:06.819430 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0aef90cc-912d-4ffa-9beb-3d3130c339ca tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.107875 Aug 27 03:20:06.830850 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1433/2856] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:06 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:06.954891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1422175244", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "be792eba-f4b7-46b8-9127-1ca32ef532fe"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:07.059507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] validate_networks() for [('be792eba-f4b7-46b8-9127-1ca32ef532fe', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:20:07.082377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:07.083617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:07.100763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:07.101453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:07.102078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:07.107453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:07.108288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:07.109090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:07.487823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:07.502680 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3548d457-9452-4c16-8599-23d82f0597b7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.421582 Aug 27 03:20:07.516501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1434/2857] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:07 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:07.666860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bbb540aa-0b97-43ce-988f-5aa18dfdc475 req-259552df-964a-4e0a-9c06-d17a83342159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405db88e-88e4-4354-8042-d6bf17f760ce", "name": "network-vif-plugged", "status": "completed", "tag": "4827f4aa-eb84-4b53-83f0-102a51091895"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:07.688815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bbb540aa-0b97-43ce-988f-5aa18dfdc475 req-259552df-964a-4e0a-9c06-d17a83342159 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:07.692827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bbb540aa-0b97-43ce-988f-5aa18dfdc475 req-259552df-964a-4e0a-9c06-d17a83342159 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:07.693627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bbb540aa-0b97-43ce-988f-5aa18dfdc475 req-259552df-964a-4e0a-9c06-d17a83342159 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:07.750226 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bbb540aa-0b97-43ce-988f-5aa18dfdc475 req-259552df-964a-4e0a-9c06-d17a83342159 service nova] Creating event network-vif-plugged:4827f4aa-eb84-4b53-83f0-102a51091895 for instance 405db88e-88e4-4354-8042-d6bf17f760ce on n-h1-852086-5 Aug 27 03:20:07.759720 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bbb540aa-0b97-43ce-988f-5aa18dfdc475 req-259552df-964a-4e0a-9c06-d17a83342159 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095297 Aug 27 03:20:07.761000 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1435/2858] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:20:07.838964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f17090c-6d47-4c67-88c4-98cf1a955d68 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45765d160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:07.963874 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f17090c-6d47-4c67-88c4-98cf1a955d68 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.128692 Aug 27 03:20:07.975006 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1436/2859] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:07 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:08.528578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:08.529704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:08.570454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:08.584586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:08.592228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:08.594888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:08.595743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:08.599718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:09.167581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:09.188780 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00581285-11af-44e8-b619-056435c94bcf tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 0.667268 Aug 27 03:20:09.190023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1437/2860] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:08 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:09.208943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d72284e-4436-4421-b0ef-72c7395e097a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460301a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:09.305154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:20:09.305823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:20:09.306244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:20:09.306733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:20:09.307371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:20:09.330017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:09.330942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:09.331655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:09.333450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:09.336441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:09.338115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:09.438953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:09.455997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for user 267cffdb49624ff986aed20fd255b1db and project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:09.498731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:20:09.504659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:20:09.656497 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f0ad2e9-329e-4414-9cd3-0787e5005448 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.706998 Aug 27 03:20:09.657791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1424/2861] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:20:09.668577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d18e4b4f-8486-44a6-86ae-540880611b60 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:09.670275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d18e4b4f-8486-44a6-86ae-540880611b60 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:09.976190 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d72284e-4436-4421-b0ef-72c7395e097a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.784875 Aug 27 03:20:09.976794 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1438/2862] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:09 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:09.988996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a738ceb2-98fc-4df9-bff3-ed8927f680ab req-0bfac3e8-15ab-48cd-8c5b-86ab864c554f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dca35c-d122-40f4-986b-5b77851f6f3d", "name": "network-vif-plugged", "status": "completed", "tag": "2018ab3e-4e07-4098-b98e-9002dd279856"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:10.033571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a738ceb2-98fc-4df9-bff3-ed8927f680ab req-0bfac3e8-15ab-48cd-8c5b-86ab864c554f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:10.034152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a738ceb2-98fc-4df9-bff3-ed8927f680ab req-0bfac3e8-15ab-48cd-8c5b-86ab864c554f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:10.039527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a738ceb2-98fc-4df9-bff3-ed8927f680ab req-0bfac3e8-15ab-48cd-8c5b-86ab864c554f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:10.075886 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a738ceb2-98fc-4df9-bff3-ed8927f680ab req-0bfac3e8-15ab-48cd-8c5b-86ab864c554f service nova] Creating event network-vif-plugged:2018ab3e-4e07-4098-b98e-9002dd279856 for instance 45dca35c-d122-40f4-986b-5b77851f6f3d on n-h1-852086-5 Aug 27 03:20:10.083782 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a738ceb2-98fc-4df9-bff3-ed8927f680ab req-0bfac3e8-15ab-48cd-8c5b-86ab864c554f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105672 Aug 27 03:20:10.085126 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1439/2863] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:10.091311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc165a63-cbd3-47a3-863e-3f6553749aaf tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe45756f940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:10.200004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc165a63-cbd3-47a3-863e-3f6553749aaf tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85" status: 200 len: 636 microversion: 2.1 time: 0.113444 Aug 27 03:20:10.200898 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1440/2864] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:10 2022] GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85 => generated 636 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:10.228278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:10.229051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:10.249574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:10.250080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:10.255223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:10.260359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:10.260884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:10.261335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:10.434484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d18e4b4f-8486-44a6-86ae-540880611b60 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:10.443888 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d18e4b4f-8486-44a6-86ae-540880611b60 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1215 microversion: 2.1 time: 0.779376 Aug 27 03:20:10.447402 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1425/2865] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:09 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1215 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:10.459204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6c3f7222-8ef6-4ae5-a76b-f5d4a40e5d50 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update_all', calling method: .version_select at 0x7fe460294ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:10.606839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6c3f7222-8ef6-4ae5-a76b-f5d4a40e5d50 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:10.612890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6c3f7222-8ef6-4ae5-a76b-f5d4a40e5d50 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:11.281458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6c3f7222-8ef6-4ae5-a76b-f5d4a40e5d50 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 61 microversion: 2.1 time: 0.832208 Aug 27 03:20:11.286857 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1426/2866] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:20:10 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 61 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:11.292943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-355667af-f546-4ae6-9caf-8b848fe16528 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602a23a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.356659 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-355667af-f546-4ae6-9caf-8b848fe16528 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.068265 Aug 27 03:20:11.358239 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1427/2867] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:11 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:11.368356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.369347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.383552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:11.385705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.386535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.387361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.388888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.389840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.391446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.402002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3e9eb32-0eb4-48ba-bfa1-ee9ddcda3a62 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1519 microversion: 2.1 time: 1.195742 Aug 27 03:20:11.402621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1441/2868] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:10 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1519 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:11.411883 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] HTTP exception thrown: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Request method failure captured: Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b HTTP/1.1 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzdYEqZHid7vHr_quxySmiZnomGBr8Vkjs_2h6ugT47-n5zcA2qBwcKY0c2tX1tjTEPNTvnYm-pU11UXjvtVnKMK_o10_IOA1gvhB781zDXjWpToE-L2ROfKqDHJpYp2EEtfZiHLt9_LGD2c9XzSxQhh0hA7I8Vf8eAavYVRvYA5Dc Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2322c18d287b49b3839208e66ea07871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2322c18d287b49b3839208e66ea07871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}] Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0be937d33b6d40daba326e75e6eb35b6 Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '33bffc9f-dda2-4883-9e9b-d05aa9b8f20b'} Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:11.415185 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.421461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.424530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Returning 404 to user: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:11.425827 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc00a22f-0836-44be-ab6a-07a6f34b6d31 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "DELETE /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 404 len: 111 microversion: 2.1 time: 0.065033 Aug 27 03:20:11.429849 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1428/2869] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:11 2022] DELETE /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:11.435462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.437643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.444778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53b2ec3e-287b-4e07-9971-f1f259eebacf tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe45769aa60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.445038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.445588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.446302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.447346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.448023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.448671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.480337 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] HTTP exception thrown: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Request method failure captured: Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b HTTP/1.1 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzdYEqZHid7vHr_quxySmiZnomGBr8Vkjs_2h6ugT47-n5zcA2qBwcKY0c2tX1tjTEPNTvnYm-pU11UXjvtVnKMK_o10_IOA1gvhB781zDXjWpToE-L2ROfKqDHJpYp2EEtfZiHLt9_LGD2c9XzSxQhh0hA7I8Vf8eAavYVRvYA5Dc Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2322c18d287b49b3839208e66ea07871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2322c18d287b49b3839208e66ea07871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}] Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0be937d33b6d40daba326e75e6eb35b6 Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '33bffc9f-dda2-4883-9e9b-d05aa9b8f20b'} Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.483664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.491587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.491587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.491587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.491587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:11.491587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:11.491587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. Aug 27 03:20:11.491587 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.495969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Returning 404 to user: Instance 33bffc9f-dda2-4883-9e9b-d05aa9b8f20b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:11.500850 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b838506c-be30-4d83-923b-1d4ef096c85c tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b" status: 404 len: 111 microversion: 2.1 time: 0.067400 Aug 27 03:20:11.501755 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1429/2870] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:11 2022] GET /compute/v2.1/servers/33bffc9f-dda2-4883-9e9b-d05aa9b8f20b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:11.515204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.516467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.545371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.546196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.547404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.548447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.549172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.549848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.749098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:11.771095 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9503196f-396a-46f0-8617-a56f5d2afa7f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1267 microversion: 2.1 time: 0.267066 Aug 27 03:20:11.772669 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1430/2871] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:11 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:11.786011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.786900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.804611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.808165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.808935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.809999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.811949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.814440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.846706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] HTTP exception thrown: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Request method failure captured: Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b HTTP/1.1 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzdYEqZHid7vHr_quxySmiZnomGBr8Vkjs_2h6ugT47-n5zcA2qBwcKY0c2tX1tjTEPNTvnYm-pU11UXjvtVnKMK_o10_IOA1gvhB781zDXjWpToE-L2ROfKqDHJpYp2EEtfZiHLt9_LGD2c9XzSxQhh0hA7I8Vf8eAavYVRvYA5Dc Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2322c18d287b49b3839208e66ea07871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2322c18d287b49b3839208e66ea07871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}] Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0be937d33b6d40daba326e75e6eb35b6 Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd19e16a4-55b2-42b3-8dc2-ad7c4aa6941b'} Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:11.848919 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.854173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.861931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Returning 404 to user: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:11.863187 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00adf72c-f045-4242-9104-7339be8ca4f1 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 404 len: 111 microversion: 2.1 time: 0.089277 Aug 27 03:20:11.863981 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1431/2872] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:11 2022] DELETE /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:11.876706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.878820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] [instance: d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.893440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.895760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.896540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.897847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.898810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.902723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.949799 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] HTTP exception thrown: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Request method failure captured: Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b HTTP/1.1 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYzdYEqZHid7vHr_quxySmiZnomGBr8Vkjs_2h6ugT47-n5zcA2qBwcKY0c2tX1tjTEPNTvnYm-pU11UXjvtVnKMK_o10_IOA1gvhB781zDXjWpToE-L2ROfKqDHJpYp2EEtfZiHLt9_LGD2c9XzSxQhh0hA7I8Vf8eAavYVRvYA5Dc Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2322c18d287b49b3839208e66ea07871"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2322c18d287b49b3839208e66ea07871", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2322c18d287b49b3839208e66ea07871"}]}] Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 2322c18d287b49b3839208e66ea07871 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestMultiNic-1878987803 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0be937d33b6d40daba326e75e6eb35b6 Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestMultiNic-1878987803-project Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd19e16a4-55b2-42b3-8dc2-ad7c4aa6941b'} Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:11.956056 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.962390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:11.962390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:11.962390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:11.962390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:11.962390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:11.962390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. Aug 27 03:20:11.962390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:11.964611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] Returning 404 to user: Instance d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:11.965720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82352c9a-13f0-4e30-8a34-11ca246a36b0 tempest-ServersTestMultiNic-1878987803 tempest-ServersTestMultiNic-1878987803-project] 10.222.0.69 "GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b" status: 404 len: 111 microversion: 2.1 time: 0.095445 Aug 27 03:20:11.966883 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1432/2873] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:11 2022] GET /compute/v2.1/servers/d19e16a4-55b2-42b3-8dc2-ad7c4aa6941b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:12.005662 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53b2ec3e-287b-4e07-9971-f1f259eebacf tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "DELETE /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.601927 Aug 27 03:20:12.014715 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1442/2874] 10.222.0.69 () {58 vars in 1296 bytes} [Sat Aug 27 03:20:11 2022] DELETE /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata/os_version => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:20:12.015392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e275049-e0b6-4aa7-b70d-b3259350c78b tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe4602f95e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:12.093738 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4e275049-e0b6-4aa7-b70d-b3259350c78b tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 37 microversion: 2.1 time: 0.081919 Aug 27 03:20:12.095087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1433/2875] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:20:12 2022] GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 37 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:12.106807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efdbc704-0db1-4d06-b71f-843f06a7a51f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update_all', calling method: .version_select at 0x7fe45c845550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:12.210436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-efdbc704-0db1-4d06-b71f-843f06a7a51f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:12.231946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-efdbc704-0db1-4d06-b71f-843f06a7a51f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:12.373560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1d36021a-61bd-4a74-a1cd-d443eaf2dbbc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602f93a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:13.950841 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1d36021a-61bd-4a74-a1cd-d443eaf2dbbc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 1.581357 Aug 27 03:20:13.951754 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1434/2876] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:12 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:13.992851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:14.000291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:14.017507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.018279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.021363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.026777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.027655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.028771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.354984 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efdbc704-0db1-4d06-b71f-843f06a7a51f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 61 microversion: 2.1 time: 2.253120 Aug 27 03:20:14.355585 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1443/2877] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:20:12 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 61 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:14.361557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:14.362435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:14.364667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:14.401112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.402175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.403161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.405347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.406735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.407363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.503755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:14.516380 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-274e5983-0e91-461c-a5cd-fd33ccba6a99 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.549375 Aug 27 03:20:14.518631 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1435/2878] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:13 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:14.528233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7daff3a4-d447-4f1f-b664-278a5f10e723 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe4602a23a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:14.606220 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7daff3a4-d447-4f1f-b664-278a5f10e723 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.086146 Aug 27 03:20:14.606761 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1436/2879] 10.222.0.69 () {58 vars in 1290 bytes} [Sat Aug 27 03:20:14 2022] GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata/os_distro => generated 33 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:14.627993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:14.637400 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b30343db-f090-4a2e-899f-326c120ca7fe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1273 microversion: 2.1 time: 0.280742 Aug 27 03:20:14.637998 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1444/2880] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:14 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:14.657904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:14.658631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fb34be4-3ba0-4956-a886-6ccd4135f20b tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update_all', calling method: .version_select at 0x7fe457662310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:14.659219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:14.677102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.677891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.681354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.682884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.684443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.685202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.730356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-2fb34be4-3ba0-4956-a886-6ccd4135f20b tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:14.743926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-2fb34be4-3ba0-4956-a886-6ccd4135f20b tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:15.072310 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2fb34be4-3ba0-4956-a886-6ccd4135f20b tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 61 microversion: 2.1 time: 0.423085 Aug 27 03:20:15.074298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1445/2881] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:20:14 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 61 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:15.080686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0dfb3b75-6318-46a3-8913-e93d4b6e8dc2 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c845940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:15.181524 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0dfb3b75-6318-46a3-8913-e93d4b6e8dc2 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.104076 Aug 27 03:20:15.182741 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1446/2882] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:15 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:15.191079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2771381e-5ec2-4172-a859-d150f0858706 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe457f048b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:15.255155 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2771381e-5ec2-4172-a859-d150f0858706 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 61 microversion: 2.1 time: 0.070859 Aug 27 03:20:15.256374 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1447/2883] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:20:15 2022] GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:15.267833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be285eb7-6cfc-4edd-8ff0-a147d6689d73 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update_all', calling method: .version_select at 0x7fe45756f160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:15.379030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-be285eb7-6cfc-4edd-8ff0-a147d6689d73 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:15.392084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-be285eb7-6cfc-4edd-8ff0-a147d6689d73 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:15.750649 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be285eb7-6cfc-4edd-8ff0-a147d6689d73 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 61 microversion: 2.1 time: 0.486958 Aug 27 03:20:15.753386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1448/2884] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:20:15 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 61 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:15.757430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:15.764216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:15.774087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Searching by: {'deleted': False, 'project_id': '9da3b3a423b540d2a9962edeb643056d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:20:15.783244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.783733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.784171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:15.784961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.785428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.795297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:15.868559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:20:15.916248 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73223442-ce49-4d62-8f08-a9f4e294c428 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.162993 Aug 27 03:20:15.917200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1449/2885] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:20:15 2022] GET /compute/v2.1/servers => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:15.923151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:15.924506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:15.934413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.935512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.936557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:15.937790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.938539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.939284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:16.119383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:16.128226 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-74fcbd71-5951-4a98-9d11-6a3ebd2228e2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.513543 Aug 27 03:20:16.134826 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1437/2886] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:14 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:16.145596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e16dc550-e111-4665-aeb2-ff6bc333ccda tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update_all', calling method: .version_select at 0x7fe4602f0160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:16.273689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e16dc550-e111-4665-aeb2-ff6bc333ccda tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:16.301128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e16dc550-e111-4665-aeb2-ff6bc333ccda tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:16.898730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:16.915140 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50dfb97b-db9c-4c77-ae13-81aa17bceafd tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 0.995522 Aug 27 03:20:16.917026 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1450/2887] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:15 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:16.947555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:16.969092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:16.970852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Searching by: {'deleted': False, 'project_id': '9da3b3a423b540d2a9962edeb643056d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:20:16.986508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:16.987404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:16.988090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:16.989078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:16.991104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:16.991822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:17.006861 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e16dc550-e111-4665-aeb2-ff6bc333ccda tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 64 microversion: 2.1 time: 0.869412 Aug 27 03:20:17.007554 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1438/2888] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:20:16 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 64 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:17.013522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:17.016562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:17.057365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:17.062071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:17.063757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:17.070184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:17.071041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:17.073068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:17.073407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:20:17.180916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:17.199179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:17.199637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:17.200134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:17.810943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:17.829008 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90e7d61c-8811-47d3-ac8e-aa56ba8d2a27 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.818797 Aug 27 03:20:17.843318 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1439/2889] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:17 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:17.849017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8335c626-ff0a-43d0-b60d-b824c404f5c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c3b93a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:17.960443 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8335c626-ff0a-43d0-b60d-b824c404f5c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.115700 Aug 27 03:20:17.967949 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1440/2890] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:17 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:17.996362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-046445a3-4ef6-4612-b334-1bf417fc6571 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe4602b8a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:18.084953 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-046445a3-4ef6-4612-b334-1bf417fc6571 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 64 microversion: 2.1 time: 0.114443 Aug 27 03:20:18.085520 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1441/2891] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:20:17 2022] GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 64 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:18.115958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2997361c-f3d5-4d1d-a13d-fee056e74f08 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:18.148436 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2997361c-f3d5-4d1d-a13d-fee056e74f08 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 7716d8e0-dba0-40cf-a6b0-644911a5885b has no mapping to a cell. Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2997361c-f3d5-4d1d-a13d-fee056e74f08 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/7716d8e0-dba0-40cf-a6b0-644911a5885b/action HTTP/1.1 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: {"os-stop": {}} Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7716d8e0-dba0-40cf-a6b0-644911a5885b has no mapping to a cell. Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7716d8e0-dba0-40cf-a6b0-644911a5885b', 'body': {'os-stop': {}}} Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7716d8e0-dba0-40cf-a6b0-644911a5885b has no mapping to a cell. Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:18.160848 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7716d8e0-dba0-40cf-a6b0-644911a5885b has no mapping to a cell. Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7716d8e0-dba0-40cf-a6b0-644911a5885b has no mapping to a cell. Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2997361c-f3d5-4d1d-a13d-fee056e74f08 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 7716d8e0-dba0-40cf-a6b0-644911a5885b has no mapping to a cell. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2997361c-f3d5-4d1d-a13d-fee056e74f08 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/7716d8e0-dba0-40cf-a6b0-644911a5885b/action" status: 404 len: 117 microversion: 2.1 time: 0.065788 Aug 27 03:20:18.165906 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1442/2892] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:18 2022] POST /compute/v2.1/servers/7716d8e0-dba0-40cf-a6b0-644911a5885b/action => generated 117 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:18.181746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:18.182405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:18.215416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:18.215966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:18.216418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:18.217308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:18.228229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:18.231953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:18.316080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20a15eaa-5867-43a5-b9de-0e3ced41f2f6 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.396363 Aug 27 03:20:18.316941 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1451/2893] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:20:16 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:18.322008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e647f40e-5823-42b3-96fc-4969e863cf06 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update_all', calling method: .version_select at 0x7fe4575001f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:18.476650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e647f40e-5823-42b3-96fc-4969e863cf06 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:18.493395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e647f40e-5823-42b3-96fc-4969e863cf06 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:19.178278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:19.190077 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-840b76e5-1975-4367-8538-4ecbde414ab9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 1.023807 Aug 27 03:20:19.196966 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1443/2894] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:18 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:19.207996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:19.220647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:19.236411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:19.238995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:19.239828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:19.241885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:19.244297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:19.245024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:19.396365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:19.418386 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e647f40e-5823-42b3-96fc-4969e863cf06 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 61 microversion: 2.1 time: 1.100197 Aug 27 03:20:19.420005 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1452/2895] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:20:18 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 61 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:19.427305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2a66e9d-4ab8-44a6-ae50-701b0ff538b2 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:19.450090 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2a66e9d-4ab8-44a6-ae50-701b0ff538b2 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028738 Aug 27 03:20:19.452156 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1453/2896] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:20:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:19.462306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6543243-50bf-4f53-b603-a2ccde7efdf0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c83d820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:19.589429 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6543243-50bf-4f53-b603-a2ccde7efdf0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.135476 Aug 27 03:20:19.590026 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1454/2897] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:19 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:19.599257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9722739-cd8c-46c4-978e-ad781a8bf6b0 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update', calling method: .version_select at 0x7fe45c83d940>, body: {"meta": {"os_version": "alt"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:19.753189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a9722739-cd8c-46c4-978e-ad781a8bf6b0 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:19.777997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a9722739-cd8c-46c4-978e-ad781a8bf6b0 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:19.976422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:19.985078 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92bd5005-5836-4ac8-a2c0-9b65ab634069 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.784224 Aug 27 03:20:19.985663 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1444/2898] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:19 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:20.009589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:20.028218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:20.088441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.091549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.093762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.117091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.122930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.123773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.235792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:20:20.343042 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9722739-cd8c-46c4-978e-ad781a8bf6b0 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.751862 Aug 27 03:20:20.344880 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1455/2899] 10.222.0.69 () {60 vars in 1313 bytes} [Sat Aug 27 03:20:19 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata/os_version => generated 31 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:20.351075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:20.354630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:20.383302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.389771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.392652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.398756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.399254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.399700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.525322 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-60a8197c-feec-4732-ac18-bb9e45ff50c7 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "DELETE /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 204 len: 0 microversion: 2.1 time: 0.538360 Aug 27 03:20:20.533885 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1445/2900] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:19 2022] DELETE /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:20:20.548242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:20.564648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:20.579828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:20.581705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.582519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.583285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.584574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:20.585576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:20.586184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:20.946344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:20.957948 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2848a932-0dd5-4624-9908-e411c6c40829 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 0.420540 Aug 27 03:20:20.958804 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1446/2901] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:20 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:20.966808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2ee0571-6d56-4d11-ab20-8734207d24f0 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe4602af3a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:21.060030 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2ee0571-6d56-4d11-ab20-8734207d24f0 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 58 microversion: 2.1 time: 0.097755 Aug 27 03:20:21.061846 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1447/2902] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:20:20 2022] GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 58 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:21.073230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:21.075927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:21.095636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.097431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.099744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.102070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.104629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.105263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.438096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:21.446943 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10c4ef40-52bb-4eab-a359-6343ecf1b5a3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1609 microversion: 2.1 time: 0.382959 Aug 27 03:20:21.453326 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1448/2903] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:21 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1609 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:21.467901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:21.472017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0b85278-43e6-4f85-b083-780b7103c4d7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602afca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:21.481406 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53004669-a911-414b-9dc6-41f317031e6f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.134268 Aug 27 03:20:21.484016 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1456/2904] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:20 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:21.499507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6b24da0-96c1-4b98-b467-05a814578785 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'update_all', calling method: .version_select at 0x7fe457644550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:21.597469 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0b85278-43e6-4f85-b083-780b7103c4d7 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.142380 Aug 27 03:20:21.599870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1449/2905] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:21 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:21.637322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8c5ca9a-4fd4-44fa-9721-3d8040ab2bfb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:21.643868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8c5ca9a-4fd4-44fa-9721-3d8040ab2bfb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 7d404b45-fdda-4255-8015-3576fda8f210] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:21.666776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e6b24da0-96c1-4b98-b467-05a814578785 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:21.674261 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b8c5ca9a-4fd4-44fa-9721-3d8040ab2bfb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 7d404b45-fdda-4255-8015-3576fda8f210 could not be found. Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8c5ca9a-4fd4-44fa-9721-3d8040ab2bfb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/7d404b45-fdda-4255-8015-3576fda8f210/action HTTP/1.1 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: {"suspend": {}} Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7d404b45-fdda-4255-8015-3576fda8f210 could not be found. Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7d404b45-fdda-4255-8015-3576fda8f210', 'body': {'suspend': {}}} Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d404b45-fdda-4255-8015-3576fda8f210 could not be found. Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d404b45-fdda-4255-8015-3576fda8f210 could not be found. Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:21.677995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:21.682703 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:21.682703 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:21.682703 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d404b45-fdda-4255-8015-3576fda8f210 could not be found. Aug 27 03:20:21.682703 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.684046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8c5ca9a-4fd4-44fa-9721-3d8040ab2bfb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 7d404b45-fdda-4255-8015-3576fda8f210 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:21.699595 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b8c5ca9a-4fd4-44fa-9721-3d8040ab2bfb tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/7d404b45-fdda-4255-8015-3576fda8f210/action" status: 404 len: 111 microversion: 2.1 time: 0.098336 Aug 27 03:20:21.704132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1450/2906] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:21 2022] POST /compute/v2.1/servers/7d404b45-fdda-4255-8015-3576fda8f210/action => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:21.704313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e6b24da0-96c1-4b98-b467-05a814578785 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:21.725393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:21.730098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:21.760014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.763363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.764903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.769812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.772040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.775278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.142228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:22.155182 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6280ad0b-52cd-4724-8090-72d59c32cccd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.448878 Aug 27 03:20:22.158117 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1451/2907] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:21 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:22.170794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-54826ccb-269f-4394-baf5-a362872d9f3d req-2e1b1a47-d352-4599-a91e-62d2e7845637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7876dd-acea-4450-b47d-fa8125c09808", "tag": "bb4bee08-bb7b-40a8-802d-5c10f50653a8"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:22.188783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-54826ccb-269f-4394-baf5-a362872d9f3d req-2e1b1a47-d352-4599-a91e-62d2e7845637 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.190186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-54826ccb-269f-4394-baf5-a362872d9f3d req-2e1b1a47-d352-4599-a91e-62d2e7845637 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.199061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-54826ccb-269f-4394-baf5-a362872d9f3d req-2e1b1a47-d352-4599-a91e-62d2e7845637 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.211650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:22.247096 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-54826ccb-269f-4394-baf5-a362872d9f3d req-2e1b1a47-d352-4599-a91e-62d2e7845637 service nova] Creating event network-changed:bb4bee08-bb7b-40a8-802d-5c10f50653a8 for instance 7d7876dd-acea-4450-b47d-fa8125c09808 on n-h2-852086-5 Aug 27 03:20:22.258580 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-54826ccb-269f-4394-baf5-a362872d9f3d req-2e1b1a47-d352-4599-a91e-62d2e7845637 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098708 Aug 27 03:20:22.260811 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1452/2908] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:22.274909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:22.275961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:22.294960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.298407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.299011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.300947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.304430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.307116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.441801 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6b24da0-96c1-4b98-b467-05a814578785 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 61 microversion: 2.1 time: 0.956664 Aug 27 03:20:22.442449 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1457/2909] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:20:21 2022] PUT /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 61 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:22.453561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:22.454238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:22.495588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.500760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.503023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.505484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.509467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.510675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.634880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:23.404783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:23.420731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6ca0877-d42d-4cbb-bb4a-a360ceeffc8d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 1.153413 Aug 27 03:20:23.420731 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1453/2910] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:22 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:23.436563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dd1493f6-35cf-4e8d-a921-f5e6ccc1c54f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Action: 'create', calling method: .version_select at 0x7fe4602a3790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:23.601184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-dd1493f6-35cf-4e8d-a921-f5e6ccc1c54f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:23.619598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-dd1493f6-35cf-4e8d-a921-f5e6ccc1c54f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Getting quotas for user 9a5fc99edd054511a43e0752b76530e0 and project 629fb3c916fe42738453470ccaba557c. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:24.433038 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dd1493f6-35cf-4e8d-a921-f5e6ccc1c54f tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "POST /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 85 microversion: 2.1 time: 1.008454 Aug 27 03:20:24.433900 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1454/2911] 10.222.0.69 () {60 vars in 1281 bytes} [Sat Aug 27 03:20:23 2022] POST /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 85 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:24.434257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:24.452057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:24.455004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:24.460388 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66ee77d4-627d-40d9-bda7-7c6a78395791 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 2.011453 Aug 27 03:20:24.461060 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1458/2912] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:22 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:24.487817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:24.488889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd6ee08e-5f52-4f55-86fc-05fae6d741e0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c29ac10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:24.496451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:24.497022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:24.503068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:24.503733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:24.504192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:24.619829 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd6ee08e-5f52-4f55-86fc-05fae6d741e0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.152299 Aug 27 03:20:24.620446 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1459/2913] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:24 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:24.641745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a7ae8e5-2eb4-4725-9856-1ea48e4041f5 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] Calling method '.version_select at 0x7fe45760eb80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:24.754189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a7ae8e5-2eb4-4725-9856-1ea48e4041f5 tempest-ImagesMetadataTestJSON-2085761844 tempest-ImagesMetadataTestJSON-2085761844-project] 10.222.0.69 "GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata" status: 200 len: 85 microversion: 2.1 time: 0.127713 Aug 27 03:20:24.754812 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1460/2914] 10.222.0.69 () {58 vars in 1260 bytes} [Sat Aug 27 03:20:24 2022] GET /compute/v2.1/images/9bc60433-c27c-4dc4-a2e2-600ec654af85/metadata => generated 85 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:20:24.764315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:24.765056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:24.780130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:24.780829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:24.781572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:24.786773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:24.787200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:24.787652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:25.187904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:25.212199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a8d33d76-4ebf-428f-b433-b031559b0dc1 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1609 microversion: 2.1 time: 0.774730 Aug 27 03:20:25.215500 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1455/2915] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:24 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1609 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:25.233304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:25.234507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:25.248831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:25.250768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:25.253004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:25.254020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:25.256238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:25.257010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:25.315059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lazy-loading 'flavor' on Instance uuid 45dca35c-d122-40f4-986b-5b77851f6f3d {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:20:25.481284 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30235ea2-490b-40f3-bd14-274f44182d50 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.261757 Aug 27 03:20:25.485849 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1456/2916] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:25 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:20:25.504718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:25.505707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:25.523853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:25.524609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:25.525233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:25.526121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:25.531866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:25.537493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:27.006701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:27.309865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:27.333882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dd99c1b7-8ac4-4ae1-ae9a-9a0d3c43bb8f tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1514 microversion: 2.1 time: 1.844563 Aug 27 03:20:27.335432 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1457/2917] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:25 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1514 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:27.341569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd3db8a6-81e2-427d-942a-c7dfe6fab43d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602a34c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:27.445464 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd3db8a6-81e2-427d-942a-c7dfe6fab43d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.108137 Aug 27 03:20:27.446065 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1458/2918] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:27 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:27.457325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:27.457955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:27.505900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:27.509451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:27.510071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:27.511014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:27.512725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:27.514561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:27.807884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:27.817720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8acc724d-7a16-4879-a1a8-3fa5ac3d532f tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1541 microversion: 2.1 time: 0.370593 Aug 27 03:20:27.825421 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1459/2919] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:27 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1541 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:28.189317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:28.207787 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8fdd91f-a9a1-4d33-b688-a2ea23cbb343 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 3.450505 Aug 27 03:20:28.223158 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1461/2920] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:24 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 3468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:28.361979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:28.364042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:28.370900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:28.380432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:28.381255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:28.382294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:28.382990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:28.388619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:28.462266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bb28ff9-c52a-48aa-b479-ad1efab10caa tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c725a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:28.546953 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bb28ff9-c52a-48aa-b479-ad1efab10caa tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.089275 Aug 27 03:20:28.547872 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1462/2921] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:28 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:28.851188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:28.852772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:28.865988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:28.872292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:28.873125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:28.874264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:28.875084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:28.875741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:28.926904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:28.942244 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a638e42-c0d2-4bf3-ad51-8d17cefa4290 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1497 microversion: 2.1 time: 0.585892 Aug 27 03:20:28.943134 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1460/2922] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:28 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1497 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:28.959261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-df55c29b-2371-4f79-942c-60bc6f672092 req-3a384175-b3d9-47e9-ac7d-ab88a2056d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714c94b7-6302-42cf-a5c9-2ae08b234156", "name": "network-vif-deleted", "tag": "846feb27-6db8-4b3a-924c-c792e1285e52"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:28.979743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-df55c29b-2371-4f79-942c-60bc6f672092 req-3a384175-b3d9-47e9-ac7d-ab88a2056d1d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:28.980710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-df55c29b-2371-4f79-942c-60bc6f672092 req-3a384175-b3d9-47e9-ac7d-ab88a2056d1d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:28.981377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-df55c29b-2371-4f79-942c-60bc6f672092 req-3a384175-b3d9-47e9-ac7d-ab88a2056d1d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.009403 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-df55c29b-2371-4f79-942c-60bc6f672092 req-3a384175-b3d9-47e9-ac7d-ab88a2056d1d service nova] Creating event network-vif-deleted:846feb27-6db8-4b3a-924c-c792e1285e52 for instance 714c94b7-6302-42cf-a5c9-2ae08b234156 on n-h1-852086-5 Aug 27 03:20:29.024879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-df55c29b-2371-4f79-942c-60bc6f672092 req-3a384175-b3d9-47e9-ac7d-ab88a2056d1d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079881 Aug 27 03:20:29.026117 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1461/2923] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:29.036014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:29.038857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:29.055470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.057917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.060023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.060891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.062849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.064014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.133401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lazy-loading 'flavor' on Instance uuid 45dca35c-d122-40f4-986b-5b77851f6f3d {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:20:29.161823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:29.167386 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Cannot 'suspend' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state suspended Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action HTTP/1.1 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: {"suspend": {}} Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: exception: Cannot 'suspend' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state suspended Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'suspend': {}}} Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d in vm_state suspended. Cannot suspend while the instance is in this state. Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 27 03:20:29.169390 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state suspended Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state suspended Aug 27 03:20:29.174415 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:29.182632 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f3097b1-8f71-4f5d-88a5-c8f011b18ae8 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1541 microversion: 2.1 time: 0.336827 Aug 27 03:20:29.183230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 409 to user: Cannot 'suspend' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state suspended {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:29.184306 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ef2398f-a15b-46e2-b958-4ad063441e41 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 409 len: 148 microversion: 2.1 time: 0.156887 Aug 27 03:20:29.185013 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1463/2924] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:28 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1541 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:29.186070 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1462/2925] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:29 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 148 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:20:29.202713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:29.204053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:29.221991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.223208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.225911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.227072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.231884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.233169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.241678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:29.242990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:29.251778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.256178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.256956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.257975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.258808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.259471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.484866 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5a127d2-77b5-45eb-8e26-a4424f548760 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.277214 Aug 27 03:20:29.489109 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1464/2926] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:29 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:20:29.515673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:29.518673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:29.535572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.536159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.538532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:29.541379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:29.541886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:29.542373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:30.069268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:30.080837 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbea22b7-4cba-4afa-8cad-92142036ca0d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 0.843244 Aug 27 03:20:30.086510 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1463/2927] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:29 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:30.101495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65ede2f1-2c29-4438-9baf-c330dcced861 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602f94c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:30.304579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65ede2f1-2c29-4438-9baf-c330dcced861 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.216907 Aug 27 03:20:30.305424 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1464/2928] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:30 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:30.321699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:30.326563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:30.346059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:30.360745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:30.361417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:30.362398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:30.363047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:30.363832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:30.569550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:30.583507 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64e3e27a-abbb-4a31-9bc4-438ae2fe19b1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1503 microversion: 2.1 time: 1.090554 Aug 27 03:20:30.598821 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1465/2929] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:29 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1503 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:31.105416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:31.106757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:31.117625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:31.123182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:31.124993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:31.125993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:31.135727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:31.139594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:31.396991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:31.431156 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-305efdaf-e81c-4952-a816-83c93cd73789 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1252 microversion: 2.1 time: 1.124344 Aug 27 03:20:31.473390 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1465/2930] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:30 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1252 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:31.526786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc4555c6-8f37-4825-80be-90688ad78940 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457967d30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:31.726308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=26 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:31.757546 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc4555c6-8f37-4825-80be-90688ad78940 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.284610 Aug 27 03:20:31.791136 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1466/2931] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:31 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:31.799197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:31.811065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:31.837068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:31.837981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:31.840214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:31.841261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:31.844623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:31.850665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:32.270090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:32.285026 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbe6d2ad-c64a-4d9d-a175-0b345ac31669 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 1.183895 Aug 27 03:20:32.292954 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1466/2932] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:31 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:33.072012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:33.084978 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b72c99b8-5c73-411d-8c87-c1e134e7133d tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1503 microversion: 2.1 time: 1.292615 Aug 27 03:20:33.097235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1467/2933] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:31 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1503 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:33.114632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.118719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:33.142208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:33.143058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25718f39-38c6-411e-85fc-f6cca01d0611 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'create', calling method: .version_select at 0x7fe460301550>, body: {"keypair": {"name": "tempest-keypair-1124590980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsCHT00y74uzBcbkgFsrcST3hNigb8HRUdKzqZmLocUFq6MfUvLeuaUsFKMeKUPINhplM8V4F7FZioi432GGCeAgY9KHPf6xbQSFlgWyyXYVQb+bhO7Z35LMt9605EEEA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:33.145881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:33.146367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:33.147169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:33.158527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:33.159257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:33.174547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-25718f39-38c6-411e-85fc-f6cca01d0611 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for project f53131cd9e41486b88777602871e8c96. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:33.182842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-25718f39-38c6-411e-85fc-f6cca01d0611 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for user 7ab173f6fa384800afe3fcafea2a628b and project f53131cd9e41486b88777602871e8c96. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:33.238590 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25718f39-38c6-411e-85fc-f6cca01d0611 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.943970 Aug 27 03:20:33.243085 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1467/2934] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:20:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 948 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:20:33.256844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c4c1423-38fa-4381-a3c7-bfdcff02e9dd tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457500dc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.366734 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c4c1423-38fa-4381-a3c7-bfdcff02e9dd tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.122244 Aug 27 03:20:33.372334 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1468/2935] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:33 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:33.490200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:33.503715 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4eabdc05-7112-4a49-afbf-db0fa1f6d8f4 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1252 microversion: 2.1 time: 0.404569 Aug 27 03:20:33.515826 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1468/2936] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:33 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1252 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:33.528995 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba875a25-fa4e-4612-99ba-bf9756797e13 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] 10.222.0.69 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.152811 Aug 27 03:20:33.530274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1469/2937] 10.222.0.69 () {58 vars in 1128 bytes} [Sat Aug 27 03:20:33 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:20:33.544009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.545132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:33.551843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:33.552956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:33.553549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:33.554468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:33.555225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:33.555796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:33.560127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55fc41c4-c00a-4a92-a45d-be15804b36ba tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Calling method '.version_select at 0x7fe457644e50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.628663 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-55fc41c4-c00a-4a92-a45d-be15804b36ba tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] HTTP exception thrown: Image not found. Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55fc41c4-c00a-4a92-a45d-be15804b36ba tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Request method failure captured: Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2Ac6ntue4yG_DPGo-ct--scP7-gWioO9hWjUJxQcUPfRKriTzlIi9CVXSCnoUw5V9kqunlWnlv16NLfpK1CR8mSuEgP7k1Vccu9vBI7ZiZtVlkd4OdXVEQtt5ACmo53jak_mrDMSeFnUnpOcb_IVUKtRi9dzkYFQZ-10PuMIhCWyc Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a28c5fe968334b78848bc5b4152fe552", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}] Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f43f62d4ce4c42ebaf7027b946e288c5 Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '-1'} Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.630881 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:20:33.635969 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.638249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=20 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:33.645671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55fc41c4-c00a-4a92-a45d-be15804b36ba tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:33.648096 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55fc41c4-c00a-4a92-a45d-be15804b36ba tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] 10.222.0.69 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.106063 Aug 27 03:20:33.649265 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1470/2938] 10.222.0.69 () {58 vars in 1134 bytes} [Sat Aug 27 03:20:33 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:20:33.660831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e082db20-f622-48b5-898b-1e8553039c11 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Calling method '.version_select at 0x7fe45c8645e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.704843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e082db20-f622-48b5-898b-1e8553039c11 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] HTTP exception thrown: Image not found. Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e082db20-f622-48b5-898b-1e8553039c11 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Request method failure captured: Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/13dc2d64-57b4-4c48-bae7-018afa877e6j HTTP/1.1 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2Ac6ntue4yG_DPGo-ct--scP7-gWioO9hWjUJxQcUPfRKriTzlIi9CVXSCnoUw5V9kqunlWnlv16NLfpK1CR8mSuEgP7k1Vccu9vBI7ZiZtVlkd4OdXVEQtt5ACmo53jak_mrDMSeFnUnpOcb_IVUKtRi9dzkYFQZ-10PuMIhCWyc Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a28c5fe968334b78848bc5b4152fe552", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}] Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f43f62d4ce4c42ebaf7027b946e288c5 Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '13dc2d64-57b4-4c48-bae7-018afa877e6j'} Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 13dc2d64-57b4-4c48-bae7-018afa877e6j to delete Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13dc2d64-57b4-4c48-bae7-018afa877e6j could not be found. Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.714022 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.719018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e082db20-f622-48b5-898b-1e8553039c11 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:33.726210 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e082db20-f622-48b5-898b-1e8553039c11 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] 10.222.0.69 "DELETE /compute/v2.1/images/13dc2d64-57b4-4c48-bae7-018afa877e6j" status: 404 len: 62 microversion: 2.1 time: 0.065435 Aug 27 03:20:33.726210 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1471/2939] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:33 2022] DELETE /compute/v2.1/images/13dc2d64-57b4-4c48-bae7-018afa877e6j => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:20:33.736903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd54cd0e-65a9-425e-9c5e-6503a42e0330 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Calling method '.version_select at 0x7fe4576440d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.769687 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-bd54cd0e-65a9-425e-9c5e-6503a42e0330 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] HTTP exception thrown: Image not found. Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd54cd0e-65a9-425e-9c5e-6503a42e0330 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Request method failure captured: Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/7433c486-0c92-4416-926e-a1ca8904e5191 HTTP/1.1 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2Ac6ntue4yG_DPGo-ct--scP7-gWioO9hWjUJxQcUPfRKriTzlIi9CVXSCnoUw5V9kqunlWnlv16NLfpK1CR8mSuEgP7k1Vccu9vBI7ZiZtVlkd4OdXVEQtt5ACmo53jak_mrDMSeFnUnpOcb_IVUKtRi9dzkYFQZ-10PuMIhCWyc Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a28c5fe968334b78848bc5b4152fe552", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}] Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f43f62d4ce4c42ebaf7027b946e288c5 Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '7433c486-0c92-4416-926e-a1ca8904e5191'} Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7433c486-0c92-4416-926e-a1ca8904e5191 to delete Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7433c486-0c92-4416-926e-a1ca8904e5191 could not be found. Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.784405 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd54cd0e-65a9-425e-9c5e-6503a42e0330 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd54cd0e-65a9-425e-9c5e-6503a42e0330 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] 10.222.0.69 "DELETE /compute/v2.1/images/7433c486-0c92-4416-926e-a1ca8904e5191" status: 404 len: 62 microversion: 2.1 time: 0.056385 Aug 27 03:20:33.788488 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1472/2940] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:33 2022] DELETE /compute/v2.1/images/7433c486-0c92-4416-926e-a1ca8904e5191 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:20:33.808899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a45c229-dd6c-4597-b5d1-ef7caa9fca32 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Calling method '.version_select at 0x7fe4574bd0d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.858004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0a45c229-dd6c-4597-b5d1-ef7caa9fca32 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] HTTP exception thrown: Image not found. Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a45c229-dd6c-4597-b5d1-ef7caa9fca32 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Request method failure captured: Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/tempest-invalid-1430740783 HTTP/1.1 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2Ac6ntue4yG_DPGo-ct--scP7-gWioO9hWjUJxQcUPfRKriTzlIi9CVXSCnoUw5V9kqunlWnlv16NLfpK1CR8mSuEgP7k1Vccu9vBI7ZiZtVlkd4OdXVEQtt5ACmo53jak_mrDMSeFnUnpOcb_IVUKtRi9dzkYFQZ-10PuMIhCWyc Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a28c5fe968334b78848bc5b4152fe552", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}] Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f43f62d4ce4c42ebaf7027b946e288c5 Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'tempest-invalid-1430740783'} Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1430740783 to delete Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1430740783 could not be found. Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.878991 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:20:33.882989 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.893200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a45c229-dd6c-4597-b5d1-ef7caa9fca32 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:33.894593 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a45c229-dd6c-4597-b5d1-ef7caa9fca32 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] 10.222.0.69 "DELETE /compute/v2.1/images/tempest-invalid-1430740783" status: 404 len: 62 microversion: 2.1 time: 0.100644 Aug 27 03:20:33.895891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1473/2941] 10.222.0.69 () {58 vars in 1206 bytes} [Sat Aug 27 03:20:33 2022] DELETE /compute/v2.1/images/tempest-invalid-1430740783 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:20:33.906878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15388b52-b5d1-4d64-8d8c-5c4865313246 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Calling method '.version_select at 0x7fe45c140e50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:33.951792 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-15388b52-b5d1-4d64-8d8c-5c4865313246 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] HTTP exception thrown: Image not found. Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15388b52-b5d1-4d64-8d8c-5c4865313246 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Request method failure captured: Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/dd9e4675-b0a7-4373-a91a-0ff569504c9c HTTP/1.1 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2Ac6ntue4yG_DPGo-ct--scP7-gWioO9hWjUJxQcUPfRKriTzlIi9CVXSCnoUw5V9kqunlWnlv16NLfpK1CR8mSuEgP7k1Vccu9vBI7ZiZtVlkd4OdXVEQtt5ACmo53jak_mrDMSeFnUnpOcb_IVUKtRi9dzkYFQZ-10PuMIhCWyc Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a28c5fe968334b78848bc5b4152fe552", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a28c5fe968334b78848bc5b4152fe552"}]}] Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a28c5fe968334b78848bc5b4152fe552 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f43f62d4ce4c42ebaf7027b946e288c5 Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1201740464-project Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'dd9e4675-b0a7-4373-a91a-0ff569504c9c'} Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dd9e4675-b0a7-4373-a91a-0ff569504c9c to delete Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dd9e4675-b0a7-4373-a91a-0ff569504c9c could not be found. Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.959862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:20:33.964119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:33.971977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15388b52-b5d1-4d64-8d8c-5c4865313246 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:33.973524 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15388b52-b5d1-4d64-8d8c-5c4865313246 tempest-ImagesDeleteNegativeTestJSON-1201740464 tempest-ImagesDeleteNegativeTestJSON-1201740464-project] 10.222.0.69 "DELETE /compute/v2.1/images/dd9e4675-b0a7-4373-a91a-0ff569504c9c" status: 404 len: 62 microversion: 2.1 time: 0.071135 Aug 27 03:20:33.976398 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1474/2942] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:33 2022] DELETE /compute/v2.1/images/dd9e4675-b0a7-4373-a91a-0ff569504c9c => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:20:34.125090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:34.125744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:34.146920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:34.147586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:34.147840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:34.154934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:34.164507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:34.165582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:34.167199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:34.182810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea90c74c-feae-4b58-b741-db0be0b41372 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 0.665540 Aug 27 03:20:34.184901 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1469/2943] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:33 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:34.385495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d59ac390-c5c1-49ae-b05d-7e2f86d60fba tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460262700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:34.495017 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d59ac390-c5c1-49ae-b05d-7e2f86d60fba tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.113915 Aug 27 03:20:34.496972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1470/2944] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:34 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:34.540430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:34.543686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:34.584692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:34.587353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:34.587944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:34.592708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:34.593383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:34.595731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:34.947886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:34.959000 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33adddb9-050f-409a-8d38-c54ff7639a8b tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1252 microversion: 2.1 time: 0.429770 Aug 27 03:20:34.978651 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1471/2945] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:34 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1252 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:35.210830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:35.212448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:35.221280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.222564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.223283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.224789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:35.225497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:35.226213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:35.349512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:35.362469 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-829c22df-493e-42fa-9e85-1281d45ef281 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1503 microversion: 2.1 time: 1.243594 Aug 27 03:20:35.365091 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1475/2946] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:34 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1503 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:35.512126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-312cb5a3-ee87-4393-90ea-3a79c5b2ccdd tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c749f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:35.609794 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-312cb5a3-ee87-4393-90ea-3a79c5b2ccdd tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.101471 Aug 27 03:20:35.612638 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1476/2947] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:35 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:35.969439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:35.990368 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0695bd7e-7ebd-4291-902c-5954e5f7d2c1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 0.789061 Aug 27 03:20:36.008886 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1472/2948] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:35 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:36.017074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:36.018277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:36.030327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:36.033676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:36.035469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:36.036922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:36.038642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:36.039098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:36.274577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:36.305702 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae7e9218-2007-428b-8499-473fb0385406 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1252 microversion: 2.1 time: 0.294590 Aug 27 03:20:36.306333 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1477/2949] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:36 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1252 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:36.385301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:36.386048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:36.394680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:36.397195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:36.399372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:36.400250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:36.402620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:36.403390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:36.466743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:36.628006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9340527d-6ec4-4cc4-b4d0-05cb6ba86ec4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457f1d9d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:36.699410 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9340527d-6ec4-4cc4-b4d0-05cb6ba86ec4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1423 microversion: 2.1 time: 0.076887 Aug 27 03:20:36.700006 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1478/2950] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:36 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:37.018061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:37.020131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:37.063025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.063549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.064000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.068986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.071137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.072474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.530762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:37.543844 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-409191e7-ac2a-4b7e-a5bb-b37455f79312 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 0.530121 Aug 27 03:20:37.559606 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1479/2951] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:37 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:37.565999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b5f07359-09c2-431a-aaaa-2d3d09c37358 req-b043075a-24e8-4976-8247-1043cc495fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7876dd-acea-4450-b47d-fa8125c09808", "name": "network-vif-plugged", "status": "completed", "tag": "bb4bee08-bb7b-40a8-802d-5c10f50653a8"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:37.585581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b5f07359-09c2-431a-aaaa-2d3d09c37358 req-b043075a-24e8-4976-8247-1043cc495fad service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.587126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b5f07359-09c2-431a-aaaa-2d3d09c37358 req-b043075a-24e8-4976-8247-1043cc495fad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.589886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b5f07359-09c2-431a-aaaa-2d3d09c37358 req-b043075a-24e8-4976-8247-1043cc495fad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.619212 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b5f07359-09c2-431a-aaaa-2d3d09c37358 req-b043075a-24e8-4976-8247-1043cc495fad service nova] Creating event network-vif-plugged:bb4bee08-bb7b-40a8-802d-5c10f50653a8 for instance 7d7876dd-acea-4450-b47d-fa8125c09808 on n-h2-852086-5 Aug 27 03:20:37.634634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b5f07359-09c2-431a-aaaa-2d3d09c37358 req-b043075a-24e8-4976-8247-1043cc495fad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073241 Aug 27 03:20:37.636099 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1480/2952] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:37.646762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:37.649955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:37.657462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:37.677922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6aeb0fe1-db9c-43a3-a909-b7b5e6b62e2a tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.296796 Aug 27 03:20:37.679256 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1473/2953] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:36 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:37.701810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.703285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:37.703693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.704854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.705532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:37.710516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.715132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.715872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.719145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.719955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.720583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.722972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:37.723833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:37.727420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:37.872687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:37.898327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a69f7c03-fd1e-4388-8c03-6f162c9cbbbd tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1252 microversion: 2.1 time: 0.260585 Aug 27 03:20:37.899476 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1481/2954] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:37 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1252 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:37.907647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61c70e97-1b86-4c67-9d76-248755158bcc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c29aa60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:37.999832 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61c70e97-1b86-4c67-9d76-248755158bcc tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1432 microversion: 2.1 time: 0.096951 Aug 27 03:20:38.000788 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1482/2955] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:37 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1432 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:38.018861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd3807f4-d7aa-4bd7-8ffa-f86def3db081 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457500a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:38.104484 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd3807f4-d7aa-4bd7-8ffa-f86def3db081 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 200 len: 1432 microversion: 2.1 time: 0.094337 Aug 27 03:20:38.105617 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1483/2956] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:38 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 1432 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:38.119857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:38.120777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:38.133114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:38.134010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:38.136902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:38.137890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:38.139721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:38.142976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:38.351585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:38.366311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c20838fb-b2fc-429f-acf2-0e55fed453f9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.667285 Aug 27 03:20:38.376547 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1474/2957] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:37 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:38.403129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfb8dc8c-7359-42dc-8547-a3a745ece2ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:38.404417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dfb8dc8c-7359-42dc-8547-a3a745ece2ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 46b576c7-efe8-400d-bc58-8087374f2c86] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:38.424528 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-dfb8dc8c-7359-42dc-8547-a3a745ece2ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 46b576c7-efe8-400d-bc58-8087374f2c86 could not be found. Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfb8dc8c-7359-42dc-8547-a3a745ece2ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/46b576c7-efe8-400d-bc58-8087374f2c86/action HTTP/1.1 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: {"unpause": {}} Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 46b576c7-efe8-400d-bc58-8087374f2c86 could not be found. Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '46b576c7-efe8-400d-bc58-8087374f2c86', 'body': {'unpause': {}}} Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b576c7-efe8-400d-bc58-8087374f2c86 could not be found. Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b576c7-efe8-400d-bc58-8087374f2c86 could not be found. Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:38.430257 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:38.436892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:38.436892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:38.436892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b576c7-efe8-400d-bc58-8087374f2c86 could not be found. Aug 27 03:20:38.436892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:38.436892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfb8dc8c-7359-42dc-8547-a3a745ece2ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 46b576c7-efe8-400d-bc58-8087374f2c86 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:38.436892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dfb8dc8c-7359-42dc-8547-a3a745ece2ac tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/46b576c7-efe8-400d-bc58-8087374f2c86/action" status: 404 len: 111 microversion: 2.1 time: 0.035875 Aug 27 03:20:38.436892 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1475/2958] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:38 2022] POST /compute/v2.1/servers/46b576c7-efe8-400d-bc58-8087374f2c86/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:20:38.443685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:38.450712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:38.485259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:38.485880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:38.486364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:38.487127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:38.487586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:38.488922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:38.860724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:38.872617 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f5c432a-aff9-4c00-80a1-2ee126b97396 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1466 microversion: 2.1 time: 0.755189 Aug 27 03:20:38.873222 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1484/2959] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:38 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1466 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:38.882037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:38.887084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:38.900711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:38.902520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:38.903660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:38.905878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:38.906601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:38.907239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.049008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:39.069809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-86849f1f-37d2-4161-a6cc-0fea20e8d870 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.630634 Aug 27 03:20:39.071954 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1476/2960] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:38 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:39.313787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] Calling method '.version_select at 0x7fe4602a25e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:39.329198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.329934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.330625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.331833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.332492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.333074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.360580 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40592e4c-9f47-448f-8dbd-377b3b11d2ad tempest-AbsoluteLimitsTestJSON-1235830873 tempest-AbsoluteLimitsTestJSON-1235830873-project] 10.222.0.69 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.280805 Aug 27 03:20:39.372953 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1477/2961] 10.222.0.69 () {58 vars in 1122 bytes} [Sat Aug 27 03:20:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:39.380699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2913479e-3ed0-4d9a-aa65-05377a0067f4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602f99d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:39.469251 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2913479e-3ed0-4d9a-aa65-05377a0067f4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/acef3da5-f17c-4877-a77f-8b5440d3d46e" status: 200 len: 784 microversion: 2.1 time: 0.094612 Aug 27 03:20:39.480356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1478/2962] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:39 2022] GET /compute/v2.1/images/acef3da5-f17c-4877-a77f-8b5440d3d46e => generated 784 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:39.495996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:39.496738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:39.516411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.516922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.517371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.518109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.520568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.521023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.821387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:39.834670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:39.840458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58f97b1f-1751-4816-8cc8-eb7ea7e5adb3 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1252 microversion: 2.1 time: 0.358890 Aug 27 03:20:39.844642 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1479/2963] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:39 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1252 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:39.846653 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a7847cb1-b6a1-4f32-80b9-f4f578d7db55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1315 microversion: 2.1 time: 0.968449 Aug 27 03:20:39.848355 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1485/2964] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:38 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:39.857865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:39.861924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:39.862690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-504a4107-ac25-4981-ad47-731c3105ffae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:39.885300 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-504a4107-ac25-4981-ad47-731c3105ffae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033514 Aug 27 03:20:39.887594 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1486/2965] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:20:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:39.899536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c74b583-0dff-4cc6-a38f-a63f195304c5 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460301ca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:39.902787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.903294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.903739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.909055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.909749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.910220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:40.403224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:40.411892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-108fa1a1-713d-4675-969c-4b87263daa3c tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.566144 Aug 27 03:20:40.432892 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1480/2966] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:39 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:40.445721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:40.446293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:40.479047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:40.479709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:40.480238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:40.481531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:40.491657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:40.492920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:40.526388 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Cannot 'unpause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action HTTP/1.1 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: {"unpause": {}} Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: exception: Cannot 'unpause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'unpause': {}}} Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d in vm_state active. Cannot unpause while the instance is in this state. Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:40.528173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:40.532155 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:40.532155 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:40.532155 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:40.532155 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:40.532155 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:40.533415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 409 to user: Cannot 'unpause' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:40.534655 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad579859-93bf-44a8-81d4-1bb734354764 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 409 len: 145 microversion: 2.1 time: 0.097846 Aug 27 03:20:40.535779 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1481/2967] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:40 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 145 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:20:40.551360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1861680458", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfe226ac-cb9c-435c-adb7-920865fa8bea"}], "security_groups": [{"name": "tempest-securitygroup--1994686650"}], "key_name": "tempest-keypair-1124590980", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:40.801470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] validate_networks() for [('bfe226ac-cb9c-435c-adb7-920865fa8bea', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:20:40.980606 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c74b583-0dff-4cc6-a38f-a63f195304c5 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "DELETE /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 204 len: 0 microversion: 2.1 time: 1.085117 Aug 27 03:20:40.982684 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1487/2968] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:39 2022] DELETE /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 0 bytes in 1088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:20:40.989686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:40.990486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:41.018877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.019580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.020566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.022754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.026925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.027646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.509499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:41.542733 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-383ff172-537c-4471-be26-26a164e2f934 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.537361 Aug 27 03:20:41.543428 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1488/2969] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:40 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:41.562600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:20:41.563113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:20:41.563515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:20:41.563934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:20:41.564357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:20:41.571162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:41.571840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:41.582861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.583362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.590000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.590743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.591862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.592313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.592722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.592849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.598864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.599907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.600577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.601205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.631548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for project f53131cd9e41486b88777602871e8c96. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:41.646986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for user 7ab173f6fa384800afe3fcafea2a628b and project f53131cd9e41486b88777602871e8c96. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:41.684648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:20:41.687478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:20:41.702111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.703237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.703856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.704328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lazy-loading 'fault' on Instance uuid 714c94b7-6302-42cf-a5c9-2ae08b234156 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:20:41.804922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5e01fab6-0221-419b-bb69-c87e1ed45df2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.267817 Aug 27 03:20:41.808977 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1482/2970] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:20:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:20:41.819931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:41.820956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:41.829346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.830150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.830781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.831782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.832405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.833017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.107948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7f693d615e4882be652a94ebe25854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da3b3a423b540d2a9962edeb643056d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:42.122120 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a2805ba-9bbd-440d-84c9-966d62af86e9 tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 200 len: 1257 microversion: 2.1 time: 0.571857 Aug 27 03:20:42.122528 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1489/2971] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:41 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 1257 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:42.140505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:42.152489 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91a276f8-25d4-4159-bd8e-0c641b6d7dfe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1502 microversion: 2.1 time: 0.341308 Aug 27 03:20:42.153600 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1483/2972] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:41 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1502 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:42.160466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6a00b52-3cdb-48d5-b251-ac58ffe39048 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460294dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:42.211137 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c6a00b52-3cdb-48d5-b251-ac58ffe39048 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] HTTP exception thrown: Image not found. Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6a00b52-3cdb-48d5-b251-ac58ffe39048 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Request method failure captured: Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 HTTP/1.1 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY0-3xC_KpTeTcbwDqxt7kd1DMsEm6nESob4AnsaycRSGA9YUthFFHPLX7BAIpIxuALkBsYYz64YaM35GUHhNcSTHS6DnOhZiYzFW-LBLpjbHNHszVx5dDrBltWvNqltjTVSopwkaOluIhV9XNfOz66Hv8_qh4qL499TOP-ER8AKFvo Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b0c6598a83274624997da7af158a0d57 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b0c6598a83274624997da7af158a0d57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b0c6598a83274624997da7af158a0d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b0c6598a83274624997da7af158a0d57", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b0c6598a83274624997da7af158a0d57"}]}] Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b0c6598a83274624997da7af158a0d57 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerTestJSON-1443181296-project Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 4eb9f9c28d84488caffc8a3e340c1f16 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerTestJSON-1443181296-project Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: exception: Image not found. Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'aee9dd64-8939-4838-8f64-86f5dc872b84'} Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aee9dd64-8939-4838-8f64-86f5dc872b84 Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 03:20:42.213579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aee9dd64-8939-4838-8f64-86f5dc872b84 could not be found. Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:20:42.219491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:42.228065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6a00b52-3cdb-48d5-b251-ac58ffe39048 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Returning 404 to user: Image not found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:42.231964 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6a00b52-3cdb-48d5-b251-ac58ffe39048 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 404 len: 62 microversion: 2.1 time: 0.070815 Aug 27 03:20:42.239911 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1484/2973] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:42 2022] GET /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:20:42.254923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:42.257460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:42.285354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.285858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.286334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.287060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.287519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.292552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.663663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:42.683390 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1da8e258-8974-4211-be8b-7dbbc0dbc173 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.439496 Aug 27 03:20:42.688408 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1485/2974] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:42 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:42.703375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-851cc4b4-b821-4383-be50-c0f9584a28d2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:42.706920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-851cc4b4-b821-4383-be50-c0f9584a28d2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:42.883924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff129d67-0341-4eba-96a0-b0de26b15d5e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Action: 'create', calling method: .version_select at 0x7fe457500dc0>, body: {"keypair": {"name": "tempest-keypair-375366225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOABisnigFjE6/PHdMRNEdWNBILyWpQml+jyETGl30xirFj2nZjl1jgSaYstFjcgr5/ti5ZSkw5tk3U441+cNXkTZqdTGzQNHKpJm3NVxB2qptTtmWN6p9DgwozNpY92GA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:42.900161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:42.912241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-851cc4b4-b821-4383-be50-c0f9584a28d2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:42.921346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-851cc4b4-b821-4383-be50-c0f9584a28d2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:42.931081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-851cc4b4-b821-4383-be50-c0f9584a28d2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:42.951964 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-851cc4b4-b821-4383-be50-c0f9584a28d2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1282 microversion: 2.20 time: 0.258932 Aug 27 03:20:42.955592 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1486/2975] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:42 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1282 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:20:42.958836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ff129d67-0341-4eba-96a0-b0de26b15d5e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Getting quotas for project f5095940a4e34b8598707e7a6c653dda. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:42.971905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1861929247"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:42.980928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:42.988336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ff129d67-0341-4eba-96a0-b0de26b15d5e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Getting quotas for user f73695cba42d41748ed9d7587cae5f08 and project f5095940a4e34b8598707e7a6c653dda. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:43.021209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.038321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.043623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.047633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.053616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.054328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.094660 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff129d67-0341-4eba-96a0-b0de26b15d5e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.960414 Aug 27 03:20:43.095453 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1490/2976] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:20:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:43.101108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fb0170d-f723-4795-8b12-45ae2b435ef1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:43.101796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fb0170d-f723-4795-8b12-45ae2b435ef1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 2d741fb3-9d3a-46f3-b135-d7562c8e4942] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4fb0170d-f723-4795-8b12-45ae2b435ef1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 2d741fb3-9d3a-46f3-b135-d7562c8e4942 could not be found. Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fb0170d-f723-4795-8b12-45ae2b435ef1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/2d741fb3-9d3a-46f3-b135-d7562c8e4942/action HTTP/1.1 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 18 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: {"unshelve": null} Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 2d741fb3-9d3a-46f3-b135-d7562c8e4942 could not be found. Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '2d741fb3-9d3a-46f3-b135-d7562c8e4942', 'body': {'unshelve': None}} Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d741fb3-9d3a-46f3-b135-d7562c8e4942 could not be found. Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:43.161416 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d741fb3-9d3a-46f3-b135-d7562c8e4942 could not be found. Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d741fb3-9d3a-46f3-b135-d7562c8e4942 could not be found. Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fb0170d-f723-4795-8b12-45ae2b435ef1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 2d741fb3-9d3a-46f3-b135-d7562c8e4942 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4fb0170d-f723-4795-8b12-45ae2b435ef1 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/2d741fb3-9d3a-46f3-b135-d7562c8e4942/action" status: 404 len: 111 microversion: 2.1 time: 0.059383 Aug 27 03:20:43.170755 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1491/2977] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:43 2022] POST /compute/v2.1/servers/2d741fb3-9d3a-46f3-b135-d7562c8e4942/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:43.191789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:43.192433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] [instance: 714c94b7-6302-42cf-a5c9-2ae08b234156] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:43.234673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.235262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.239526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.241679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.245063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.247586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.376525 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] HTTP exception thrown: Instance 714c94b7-6302-42cf-a5c9-2ae08b234156 could not be found. Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Request method failure captured: Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 HTTP/1.1 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYzv71D_6EZYJGnE5jHivElwhIYs36k2xLIHZjMr3uVoKoHInNZY7dINzlvQoNzrDbMX8oNGEtrWlhuf_S-FATa2qHp3n4hZ1NqFgDmS_L2K8Ih7j2bAqlZjK_ZbODvRUmq02tG8TMvQ65dFn3DY3FeAXMPEkSN-Mvpfh42x-Z2ZEHU Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9da3b3a423b540d2a9962edeb643056d Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestBootFromVolume-1735155008 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9da3b3a423b540d2a9962edeb643056d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9da3b3a423b540d2a9962edeb643056d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9da3b3a423b540d2a9962edeb643056d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9da3b3a423b540d2a9962edeb643056d"}]}] Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestBootFromVolume-1735155008 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9da3b3a423b540d2a9962edeb643056d Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1735155008 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestBootFromVolume-1735155008-project Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8e7f693d615e4882be652a94ebe25854 Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestBootFromVolume-1735155008-project Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 714c94b7-6302-42cf-a5c9-2ae08b234156 could not be found. Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '714c94b7-6302-42cf-a5c9-2ae08b234156'} Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714c94b7-6302-42cf-a5c9-2ae08b234156 could not be found. Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714c94b7-6302-42cf-a5c9-2ae08b234156 could not be found. Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:43.392602 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.406257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:43.406257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:43.406257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:43.406257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:43.406257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:43.406257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714c94b7-6302-42cf-a5c9-2ae08b234156 could not be found. Aug 27 03:20:43.406257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:43.415708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Returning 404 to user: Instance 714c94b7-6302-42cf-a5c9-2ae08b234156 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:43.419234 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85971602-9458-460a-bfad-638fe113bd9c tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156" status: 404 len: 111 microversion: 2.1 time: 0.257053 Aug 27 03:20:43.436043 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1492/2978] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:43 2022] GET /compute/v2.1/servers/714c94b7-6302-42cf-a5c9-2ae08b234156 => generated 111 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:43.470428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-cb4a0450-1e4a-43cb-97bc-fdd97c9b3f0e req-e17fe5dd-201d-4266-a9a2-254497f60bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405db88e-88e4-4354-8042-d6bf17f760ce", "name": "network-vif-unplugged", "status": "completed", "tag": "4827f4aa-eb84-4b53-83f0-102a51091895"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:43.555160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cb4a0450-1e4a-43cb-97bc-fdd97c9b3f0e req-e17fe5dd-201d-4266-a9a2-254497f60bf0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.556053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cb4a0450-1e4a-43cb-97bc-fdd97c9b3f0e req-e17fe5dd-201d-4266-a9a2-254497f60bf0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.556835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cb4a0450-1e4a-43cb-97bc-fdd97c9b3f0e req-e17fe5dd-201d-4266-a9a2-254497f60bf0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.596552 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aee350a2-59eb-4e82-a6c2-b848e3f57807 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "POST /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce/action" status: 202 len: 0 microversion: 2.1 time: 0.639465 Aug 27 03:20:43.603114 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1487/2979] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:42 2022] POST /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:20:43.627478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:43.631342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:43.634820 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-cb4a0450-1e4a-43cb-97bc-fdd97c9b3f0e req-e17fe5dd-201d-4266-a9a2-254497f60bf0 service nova] Creating event network-vif-unplugged:4827f4aa-eb84-4b53-83f0-102a51091895 for instance 405db88e-88e4-4354-8042-d6bf17f760ce on n-h1-852086-5 Aug 27 03:20:43.653785 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-cb4a0450-1e4a-43cb-97bc-fdd97c9b3f0e req-e17fe5dd-201d-4266-a9a2-254497f60bf0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.216876 Aug 27 03:20:43.660320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.660960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.661263 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1493/2980] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:43.664812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.670246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:43.670799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:43.673848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.678305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e82b424-e17f-4583-b316-97f73b89bbae tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] Calling method '.version_select at 0x7fe45756fca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:43.805428 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e82b424-e17f-4583-b316-97f73b89bbae tempest-ServersTestBootFromVolume-1735155008 tempest-ServersTestBootFromVolume-1735155008-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509894303" status: 202 len: 0 microversion: 2.1 time: 0.142418 Aug 27 03:20:43.809874 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1494/2981] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509894303 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:20:43.851605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5759bb98-e581-4b0f-a2ad-a69a9613f9ae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c72e790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:43.971366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:43.981967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d105c31d-bb41-4775-92ea-3dd4256eeede tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.376869 Aug 27 03:20:43.983311 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1488/2982] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:43 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:43.988830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:43.989754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:44.003528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:44.004484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:44.005144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:44.009303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:44.009485 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5759bb98-e581-4b0f-a2ad-a69a9613f9ae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.193911 Aug 27 03:20:44.013199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:44.014017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:44.025561 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1495/2983] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:43 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:44.069841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:44.070638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:44.087065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:44.087701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:44.088321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:44.098458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:44.099188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:44.099787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:44.130549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:44.142225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:44.144169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:44.147492 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fae4da5f-62ec-442b-9fbd-26dbe06aee0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1334 microversion: 2.20 time: 0.162359 Aug 27 03:20:44.148649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1489/2984] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:43 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1334 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:20:45.037130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd8a5195-2588-473d-b8ff-3b7a06c4a42a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602a31f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:45.127021 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd8a5195-2588-473d-b8ff-3b7a06c4a42a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.094161 Aug 27 03:20:45.127567 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1490/2985] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:45 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:45.169476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:45.176404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:45.176811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:45.177439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:45.181762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:45.197301 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e62078d-c917-4f1d-80c4-1e19cab1ea9e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.162896 Aug 27 03:20:45.200840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1496/2986] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:44 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:45.207885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.210451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.211708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:45.212662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.214728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.217872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:45.227461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:45.229428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:45.251932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.252661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.253215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:45.257682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.258328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.258852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:45.419110 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Cannot 'unshelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action HTTP/1.1 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 18 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: {"unshelve": null} Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'unshelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'unshelve': None}} Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d in vm_state active. Cannot unshelve while the instance is in this state. Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:20:45.424713 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active Aug 27 03:20:45.429583 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:20:45.430477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 409 to user: Cannot 'unshelve' instance 45dca35c-d122-40f4-986b-5b77851f6f3d while it is in vm_state active {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:45.432061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bce29a6a-cdda-4015-b9a1-d968436661d9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action" status: 409 len: 146 microversion: 2.1 time: 0.210790 Aug 27 03:20:45.434891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1497/2987] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:20:45 2022] POST /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d/action => generated 146 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:20:45.449052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:45.449052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:45.470663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.478142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.478753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:45.479981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.482857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.486470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:46.072391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:46.083925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:46.098741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:46.101297 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-114519df-079a-4bd2-a1eb-24bbb5146b73 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1352 microversion: 2.20 time: 0.929275 Aug 27 03:20:46.105145 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1491/2988] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:45 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1352 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:20:46.141896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-68cf0362-0212-4fe1-ade1-da5f57044c56 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe46024cd30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:46.209064 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-68cf0362-0212-4fe1-ade1-da5f57044c56 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.071990 Aug 27 03:20:46.209690 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1492/2989] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:46 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:46.276748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:46.295853 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-246079ec-797b-4646-86ae-d0891b487bd2 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.850919 Aug 27 03:20:46.297170 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1498/2990] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:45 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:46.324437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:46.325064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:46.332524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:46.333364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:46.334003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:46.334999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:46.335693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:46.336348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:46.654067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ed31773-ea85-4969-af70-a0d5079dfba6"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:46.657447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:46.701546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:46.702043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:46.703253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:46.704195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:46.704655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:46.705083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:46.986868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:47.029531 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8efc89b-2ade-4de2-8940-0a734a4324de tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.709421 Aug 27 03:20:47.034132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1493/2991] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:46 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:47.064590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9498b1e0-7ff8-4034-a11d-05e4d17e1937 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-200498507_updated"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:47.074674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9498b1e0-7ff8-4034-a11d-05e4d17e1937 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 82c573fb-cbca-472e-bf04-8d1b0e4b8cde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:47.111502 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9498b1e0-7ff8-4034-a11d-05e4d17e1937 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 82c573fb-cbca-472e-bf04-8d1b0e4b8cde could not be found. Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9498b1e0-7ff8-4034-a11d-05e4d17e1937 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/servers/82c573fb-cbca-472e-bf04-8d1b0e4b8cde HTTP/1.1 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 80 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-200498507_updated"}} Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 82c573fb-cbca-472e-bf04-8d1b0e4b8cde could not be found. Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '82c573fb-cbca-472e-bf04-8d1b0e4b8cde', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-200498507_updated'}}} Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c573fb-cbca-472e-bf04-8d1b0e4b8cde could not be found. Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 03:20:47.115881 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c573fb-cbca-472e-bf04-8d1b0e4b8cde could not be found. Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c573fb-cbca-472e-bf04-8d1b0e4b8cde could not be found. Aug 27 03:20:47.120664 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:47.123950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9498b1e0-7ff8-4034-a11d-05e4d17e1937 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 82c573fb-cbca-472e-bf04-8d1b0e4b8cde could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:47.126895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9498b1e0-7ff8-4034-a11d-05e4d17e1937 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "PUT /compute/v2.1/servers/82c573fb-cbca-472e-bf04-8d1b0e4b8cde" status: 404 len: 111 microversion: 2.1 time: 0.071092 Aug 27 03:20:47.131076 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1494/2992] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:20:47 2022] PUT /compute/v2.1/servers/82c573fb-cbca-472e-bf04-8d1b0e4b8cde => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:47.148027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:47.149691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:47.171561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.174082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.174869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.176138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.181641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.182855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.338583 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-17298168-1984-4e38-a848-7a9087450ba0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675230 Aug 27 03:20:47.340860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:47.343682 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1499/2993] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:20:46 2022] POST /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:20:47.355796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:47.364818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:47.366050 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-085747a7-5dc8-46a6-9147-dfa023c455e5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1340 microversion: 2.20 time: 0.222474 Aug 27 03:20:47.378526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:47.405333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:47.408831 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1495/2994] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:47 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1340 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:20:47.414027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee1bb846-cfd8-42ff-8e87-14571c18d9e0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602f0160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:47.425132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.434772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.437818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.439516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.441862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.442642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.564667 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee1bb846-cfd8-42ff-8e87-14571c18d9e0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.154201 Aug 27 03:20:47.571063 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1496/2995] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:47 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:48.406416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:48.407493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:48.435852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.436352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.437585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:48.438618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.439089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.439521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:48.500780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:48.515015 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37781ed5-67fd-46ae-9dc0-0257601f0708 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.156249 Aug 27 03:20:48.515964 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1500/2996] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:47 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:48.544697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:48.545331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:48.556614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.557119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.557565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:48.558344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.558812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.559252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:49.708559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:49.723039 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d114fdd6-5700-4075-a26c-b3a5041d7259 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.183629 Aug 27 03:20:49.723887 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1501/2997] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:48 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:49.728761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:49.740691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:49.742131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:49.743282 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-77e575e3-8c8a-491c-97aa-6a3a6a88d0b3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 1.352725 Aug 27 03:20:49.743843 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1497/2998] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:48 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:20:49.751930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a2e4ec1-afdb-4819-94ab-b3967d9852d6 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45747d4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:49.791564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2835869-3da2-43ed-bc11-3fa7b142d4a9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2835869-3da2-43ed-bc11-3fa7b142d4a9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d HTTP/1.1 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 280 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:49.825377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:49.829304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2835869-3da2-43ed-bc11-3fa7b142d4a9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:49.845916 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2835869-3da2-43ed-bc11-3fa7b142d4a9 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "PUT /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 400 len: 619 microversion: 2.1 time: 0.058163 Aug 27 03:20:49.849895 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a2e4ec1-afdb-4819-94ab-b3967d9852d6 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.119645 Aug 27 03:20:49.850756 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1498/2999] 10.222.0.69 () {60 vars in 1257 bytes} [Sat Aug 27 03:20:49 2022] PUT /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 619 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:20:49.854429 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1502/3000] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:49 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:49.866994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:49.868042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:49.879447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:49.880193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:49.880820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:49.881738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:49.882545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:49.883130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.769940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:50.771222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:50.789789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:50.795438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:50.798795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.800393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:50.803182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:50.806016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.902431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:51.201109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:51.221594 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1886601-ced6-4b78-941b-69c0e22880e7 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.358391 Aug 27 03:20:51.222224 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1503/3001] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:49 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:51.248598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48a462de-9ac6-41c1-b7a7-3c3717b85a44 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457e31d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:51.339695 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48a462de-9ac6-41c1-b7a7-3c3717b85a44 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.114264 Aug 27 03:20:51.346785 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1504/3002] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:51 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:51.355204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:51.356122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:51.365891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:51.366911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:51.367587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:51.368769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:51.369818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:51.370437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:51.623160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:52.386975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:52.404719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:52.410464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:52.419540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e05c0be9-1f07-45fc-9f2c-9013df1c8076 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 1.652656 Aug 27 03:20:52.453605 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1499/3003] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:50 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:20:52.462405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ced28186-3dee-4e27-b9de-db2254404a57 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460214dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:52.574420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:52.586744 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfc3b6ac-432c-43bd-bb3e-f7936675a27e tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 1.237515 Aug 27 03:20:52.587459 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1505/3004] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:51 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:52.617574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ced28186-3dee-4e27-b9de-db2254404a57 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.158957 Aug 27 03:20:52.618405 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1500/3005] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:52 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:52.632676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-db942be5-f60c-4afe-a310-a3db5e58b1c6 req-c6f9ffd1-8983-4e39-9fd0-10440037818b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405db88e-88e4-4354-8042-d6bf17f760ce", "name": "network-vif-plugged", "status": "completed", "tag": "4827f4aa-eb84-4b53-83f0-102a51091895"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:52.634149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cce07f6a-4120-41b3-9999-6c8cce9055fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cce07f6a-4120-41b3-9999-6c8cce9055fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d HTTP/1.1 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 24 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": ""}} Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d', 'body': {'server': {'name': ''}}} Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '' Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:20:52.655476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cce07f6a-4120-41b3-9999-6c8cce9055fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cce07f6a-4120-41b3-9999-6c8cce9055fd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "PUT /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 400 len: 108 microversion: 2.1 time: 0.038394 Aug 27 03:20:52.663101 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1501/3006] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:20:52 2022] PUT /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:20:52.663921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db942be5-f60c-4afe-a310-a3db5e58b1c6 req-c6f9ffd1-8983-4e39-9fd0-10440037818b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:52.663921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db942be5-f60c-4afe-a310-a3db5e58b1c6 req-c6f9ffd1-8983-4e39-9fd0-10440037818b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:52.664103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db942be5-f60c-4afe-a310-a3db5e58b1c6 req-c6f9ffd1-8983-4e39-9fd0-10440037818b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:52.671804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:52.673226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:52.721939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:52.722480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:52.722924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:52.725588 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-db942be5-f60c-4afe-a310-a3db5e58b1c6 req-c6f9ffd1-8983-4e39-9fd0-10440037818b service nova] Creating event network-vif-plugged:4827f4aa-eb84-4b53-83f0-102a51091895 for instance 405db88e-88e4-4354-8042-d6bf17f760ce on n-h1-852086-5 Aug 27 03:20:52.726629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:52.727264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:52.731181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:52.736762 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-db942be5-f60c-4afe-a310-a3db5e58b1c6 req-c6f9ffd1-8983-4e39-9fd0-10440037818b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148052 Aug 27 03:20:52.744009 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1506/3007] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:52.916564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:53.454104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:53.455191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:53.457986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:53.475491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:53.475995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:53.476437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:53.477263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:53.477725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:53.478275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:53.544717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:53.573273 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e960e3f6-18e4-4ac7-8f96-aab4f963e247 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1506 microversion: 2.1 time: 0.905787 Aug 27 03:20:53.573784 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1502/3008] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:52 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1506 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:53.633118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd991dd4-cae6-4c06-b505-ea32a1461a22 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602a2310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:53.763174 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd991dd4-cae6-4c06-b505-ea32a1461a22 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.134103 Aug 27 03:20:53.764034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1503/3009] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:53 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:54.135982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fd19129f-8d9a-4e6d-a541-704b76edb941 req-365fcaef-009e-4d15-b7cb-66631835d9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3889386-64a2-4858-af6e-009e8606df9f", "tag": "544e928d-a4d3-43ac-9b2f-854b3810328a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:54.197345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd19129f-8d9a-4e6d-a541-704b76edb941 req-365fcaef-009e-4d15-b7cb-66631835d9dd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:54.197831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd19129f-8d9a-4e6d-a541-704b76edb941 req-365fcaef-009e-4d15-b7cb-66631835d9dd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:54.198289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd19129f-8d9a-4e6d-a541-704b76edb941 req-365fcaef-009e-4d15-b7cb-66631835d9dd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:54.236310 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fd19129f-8d9a-4e6d-a541-704b76edb941 req-365fcaef-009e-4d15-b7cb-66631835d9dd service nova] Creating event network-changed:544e928d-a4d3-43ac-9b2f-854b3810328a for instance b3889386-64a2-4858-af6e-009e8606df9f on n-h1-852086-5 Aug 27 03:20:54.248153 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fd19129f-8d9a-4e6d-a541-704b76edb941 req-365fcaef-009e-4d15-b7cb-66631835d9dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121122 Aug 27 03:20:54.248771 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1504/3010] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:20:54.784183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5500c2fe-e24b-41b5-a1d5-2ed27adb88ba tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602599d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:54.900523 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5500c2fe-e24b-41b5-a1d5-2ed27adb88ba tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.124021 Aug 27 03:20:54.901118 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1505/3011] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:54 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:55.917089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a84e9595-c095-46a0-9f16-c509bf4a04af tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460262550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:56.036394 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a84e9595-c095-46a0-9f16-c509bf4a04af tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.123369 Aug 27 03:20:56.039907 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1506/3012] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:55 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:56.580547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:56.590467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:56.605764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:56.607463 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-669d5346-0f8d-4747-a21b-3b8756cbb71e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 3.159552 Aug 27 03:20:56.611604 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1507/3013] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:53 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 3165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:20:56.696806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-405188247", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "8abff9c1-87e7-4b55-bb9f-ee056f32c79e"}], "security_groups": [{"name": "tempest-securitygroup--299555395"}], "key_name": "tempest-keypair-375366225", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:57.054896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c568fe14-7dbc-42cc-a581-5b5927174eb0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c045f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.154488 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c568fe14-7dbc-42cc-a581-5b5927174eb0 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.102594 Aug 27 03:20:57.155963 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1508/3014] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:57 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:57.165437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] validate_networks() for [('8abff9c1-87e7-4b55-bb9f-ee056f32c79e', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:20:57.643188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.643814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:57.652918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.653434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.653879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.654635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.655124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.655668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:58.628202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:58.640778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:58.649711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:58.651157 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f37dc4e3-edab-47d4-be62-16ad99597feb tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 1.012836 Aug 27 03:20:58.666189 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1509/3015] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:57 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:20:58.666675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a75fedbe-cf51-4579-9b28-673e34dbbe54 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c0454c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:58.723175 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a75fedbe-cf51-4579-9b28-673e34dbbe54 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.066633 Aug 27 03:20:58.723939 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1510/3016] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:58 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:58.980025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:20:58.980602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:20:58.981577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:20:58.982984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:20:58.983664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:20:59.004953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:59.005465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:59.005908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:59.014152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:59.015221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:59.018525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:59.097174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Getting quotas for project f5095940a4e34b8598707e7a6c653dda. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:59.103745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Getting quotas for user f73695cba42d41748ed9d7587cae5f08 and project f5095940a4e34b8598707e7a6c653dda. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:59.119883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:20:59.123156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:20:59.259567 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f661466e-499f-46dd-a495-70caea0bf674 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.564523 Aug 27 03:20:59.267361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1507/3017] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:20:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:20:59.273168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e8e0a0f-1080-4a63-83bb-70e35b9bfbc5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:59.273951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e8e0a0f-1080-4a63-83bb-70e35b9bfbc5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:59.645076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e8e0a0f-1080-4a63-83bb-70e35b9bfbc5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:59.664975 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e8e0a0f-1080-4a63-83bb-70e35b9bfbc5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1240 microversion: 2.1 time: 0.396224 Aug 27 03:20:59.670631 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1511/3018] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:59 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1240 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:59.687131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:59.688837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:59.707293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:59.708332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:59.710623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:59.713995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:59.714747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:59.715687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:59.739483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04e58881-7dab-4f4e-9416-f3e4cf0527e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c045820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:59.883829 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04e58881-7dab-4f4e-9416-f3e4cf0527e3 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.148869 Aug 27 03:20:59.885028 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1512/3019] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:20:59 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:00.941972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1588769414", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "92b90a88-c263-41d2-b684-43f0261ad1f0"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:01.179880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] validate_networks() for [('92b90a88-c263-41d2-b684-43f0261ad1f0', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:21:01.475937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:01.499906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:01.502369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:01.503752 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-da36adb1-a321-4067-bb33-51b547caa6f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 1.824078 Aug 27 03:21:01.504525 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1508/3020] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:20:59 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:21:01.509840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:01.510760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:01.534277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:01.534608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:01.541428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:01.544463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:01.553046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:01.554200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:01.953238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:01.973879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-506341b9-b57f-4649-bd11-fbb908f35e5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1292 microversion: 2.1 time: 0.467891 Aug 27 03:21:02.007049 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1509/3021] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:01 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1292 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:02.040702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31b70c62-6ed6-4c27-838d-0d4401895a0b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460259d30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:02.197093 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-31b70c62-6ed6-4c27-838d-0d4401895a0b tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.177342 Aug 27 03:21:02.201161 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1510/3022] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:02 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:02.546661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:02.547795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:02.597282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:02.601484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:02.602018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:02.602829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:02.603304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:02.603737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:02.777586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:21:02.778265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:21:02.778859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:21:02.779381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:21:02.779924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:21:02.819654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:02.820289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:02.821741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:02.830029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:02.834544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:02.836189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:02.916207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Getting quotas for project c670549bdc2e422186be64a789342395. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:02.940080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Getting quotas for user 6625d9a4f3ea498fb35e0095f4f1ede2 and project c670549bdc2e422186be64a789342395. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:03.010101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Going to run 3 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:21:03.012848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:03.080419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=ee7285e8-4734-40d1-bc79-85aa46626d56,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:03.138447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:03.256182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:03.268506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:03.275163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:03.276646 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-247290c0-dbc9-48b5-a4af-cd1ca5c326b0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 0.751158 Aug 27 03:21:03.290902 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1511/3023] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:02 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:21:03.303455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:03.305593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:03.317849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:03.322144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:03.322851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:03.323771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:03.324403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:03.326123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:03.416596 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c346e9c-420c-41ea-a379-7277c34d1e75 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.847114 Aug 27 03:21:03.417939 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1513/3024] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:21:03.430051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ffe37ca2-43b1-4189-983f-0178827e6df5 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe460301ca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:03.491647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:03.507326 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95651a8a-fe28-4723-92d1-c8bbb4be65b4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1298 microversion: 2.1 time: 0.210732 Aug 27 03:21:03.519384 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1512/3025] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:03 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:03.541387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:03.551089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:03.555529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:03.558346 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ffe37ca2-43b1-4189-983f-0178827e6df5 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.138650 Aug 27 03:21:03.560546 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1514/3026] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:03 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:03.622826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:03.625373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:03.626711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:03.627720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:03.630484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:03.631269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:03.712845 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f349a8b-94d3-43a9-9d8b-42d556462c36 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.184961 Aug 27 03:21:03.717439 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1513/3027] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:21:03 2022] GET /compute/v2.1/servers => generated 1018 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:03.727837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bed64b4-4414-48b5-ba2e-de97b3e7b7da tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:03.728486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bed64b4-4414-48b5-ba2e-de97b3e7b7da tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:04.311126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:04.312671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:04.343177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:04.344150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:04.345727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:04.346789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:04.359624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:04.366394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:04.773457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:04.791333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:04.792902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:04.796919 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eeea1153-cdd4-4abb-a365-27c521456143 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 0.498455 Aug 27 03:21:04.798076 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1514/3028] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:04 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:21:04.823218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:04.825332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:04.844620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:04.863026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:04.863492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:04.864261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:04.864797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:04.865305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:04.890552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bed64b4-4414-48b5-ba2e-de97b3e7b7da tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:04.907570 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bed64b4-4414-48b5-ba2e-de97b3e7b7da tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1223 microversion: 2.1 time: 1.182531 Aug 27 03:21:04.909411 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1515/3029] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:03 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1223 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:04.964070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e19f1644-9a5f-4b96-bf5b-eec72bc3e19d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c7fc940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:05.105184 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e19f1644-9a5f-4b96-bf5b-eec72bc3e19d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.194460 Aug 27 03:21:05.118542 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1516/3030] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:04 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:05.213445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:05.242458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3265ac7c-9322-41b1-b378-6389469605f8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1298 microversion: 2.1 time: 0.440699 Aug 27 03:21:05.255546 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1515/3031] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:04 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1298 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:05.311305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5a45007-310b-466a-9d2f-75ce72aa661f tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Action: 'create', calling method: .version_select at 0x7fe457662550>, body: {"keypair": {"name": "tempest-keypair-1763769222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU9aLdt5VvYYo5UQkYM60rA/evniSWcUfAjEIVzvkMJ/wxcax/Jz6DUkJjJ6fuQSeDgV6U9wTDI0nQhX/lskHlaeqJv3GXTv4UG3TepjiLPmKEGsHYiBlybalfbQbuQvQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:05.364201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d5a45007-310b-466a-9d2f-75ce72aa661f tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Getting quotas for project ce2af32328f04b9b9a34a00ebcead5d0. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:05.390027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d5a45007-310b-466a-9d2f-75ce72aa661f tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Getting quotas for user 931dbcd79dda453aa44db48cb46ea4f5 and project ce2af32328f04b9b9a34a00ebcead5d0. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:05.447890 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5a45007-310b-466a-9d2f-75ce72aa661f tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328050 Aug 27 03:21:05.448466 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1517/3032] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:21:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:05.834498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:05.874443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:05.887170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:05.902419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:05.906830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:05.910533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:05.911788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:05.916161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:05.953137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22fd795c-8d7d-4299-9d67-2920205a0288 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:05.957755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22fd795c-8d7d-4299-9d67-2920205a0288 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:06.818658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-22fd795c-8d7d-4299-9d67-2920205a0288 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:06.831518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22fd795c-8d7d-4299-9d67-2920205a0288 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1223 microversion: 2.1 time: 0.897655 Aug 27 03:21:06.846463 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1518/3033] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:05 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1223 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:06.862316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d45a1f5-eb41-4460-a108-f767849476fe tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457e04a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:06.974086 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d45a1f5-eb41-4460-a108-f767849476fe tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.132506 Aug 27 03:21:06.978274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1519/3034] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:06 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:07.002137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:07.008135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:07.030976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.048521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.052799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.056984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.059355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.060932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.128406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:07.143795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:07.151210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:07.158699 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-217a6acd-8317-47de-bd9c-65a965632f90 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 1.332685 Aug 27 03:21:07.174190 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1516/3035] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:05 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:21:07.181338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:07.190365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:07.214540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.221747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.222472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.228742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.229344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.233738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.324668 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 HTTP/1.1 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'fa627487-0ffe-40a1-9ac1-484acb3b7b89'} Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:07.342078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.349557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.351160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:07.356253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7de004c-eb96-4750-910e-3e77cb025661 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 404 len: 111 microversion: 2.1 time: 0.181340 Aug 27 03:21:07.357363 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1517/3036] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:07 2022] DELETE /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:07.397875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:07.399048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: fa627487-0ffe-40a1-9ac1-484acb3b7b89] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:07.455339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.456214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.458445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.459425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.465434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.469646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.518462 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 HTTP/1.1 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'fa627487-0ffe-40a1-9ac1-484acb3b7b89'} Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:07.530645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.535298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:07.535298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:07.535298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:07.535298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:07.535298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:07.535298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. Aug 27 03:21:07.535298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:07.536883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance fa627487-0ffe-40a1-9ac1-484acb3b7b89 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:07.539476 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fecfa44d-d95f-4773-8128-6a057ee16164 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89" status: 404 len: 111 microversion: 2.1 time: 0.166668 Aug 27 03:21:07.543546 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1518/3037] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:07 2022] GET /compute/v2.1/servers/fa627487-0ffe-40a1-9ac1-484acb3b7b89 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:07.568607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:07.569428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:07.595268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.596070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.596707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.597596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:07.598800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:07.604183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:07.745248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:08.038468 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9232a463-a628-47a9-8b48-e55b24f37d1b tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "DELETE /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 204 len: 0 microversion: 2.1 time: 0.488589 Aug 27 03:21:08.039694 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1519/3038] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:07 2022] DELETE /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:08.048519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:08.049434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:08.056985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.058609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.059415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:08.060383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.061007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.062542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:08.149883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:08.161363 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b45a9b4-b439-432d-8927-ac002af9c740 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 1.181564 Aug 27 03:21:08.187650 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1520/3039] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:06 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:08.196761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:08.214390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:08.248141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.249940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.255020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:08.257891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.263011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.263898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:08.370496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:08.655202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=11,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:08.687375 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08c215dd-fb22-4f6d-9c3c-130c3ff1d1bc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 204 len: 0 microversion: 2.1 time: 0.494630 Aug 27 03:21:08.692453 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1521/3040] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:08 2022] DELETE /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:08.701355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2ca6e3c-b4a9-4419-a693-f07c7456ee85 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457f04700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:08.806903 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2ca6e3c-b4a9-4419-a693-f07c7456ee85 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.114909 Aug 27 03:21:08.807511 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1522/3041] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:08 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:08.835731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:08.841867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:08.860177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:08.872748 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-671fe079-2e0f-465f-8893-8f2f484e23db tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1275 microversion: 2.1 time: 0.830871 Aug 27 03:21:08.875405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.875929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.876378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:08.877117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.878031 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1520/3042] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:08 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1275 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:08.887559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:08.888078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.888713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:08.891319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:08.910426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.914987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.916287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:08.918001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:08.923938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:08.925094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:09.113415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:09.323775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:09.350841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:09.361145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:09.371514 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5cfce713-6674-49f7-830a-21d9b87db5e9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 0.491892 Aug 27 03:21:09.377270 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1521/3043] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:08 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:21:09.397414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-19c89a05-0b60-45f8-9392-526e97af4402 req-e0976fda-5dcb-4cfc-8b73-800e9c3cc8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3889386-64a2-4858-af6e-009e8606df9f", "name": "network-vif-plugged", "status": "completed", "tag": "544e928d-a4d3-43ac-9b2f-854b3810328a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:09.413583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-19c89a05-0b60-45f8-9392-526e97af4402 req-e0976fda-5dcb-4cfc-8b73-800e9c3cc8b5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:09.414092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-19c89a05-0b60-45f8-9392-526e97af4402 req-e0976fda-5dcb-4cfc-8b73-800e9c3cc8b5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:09.422583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-19c89a05-0b60-45f8-9392-526e97af4402 req-e0976fda-5dcb-4cfc-8b73-800e9c3cc8b5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:09.477093 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-19c89a05-0b60-45f8-9392-526e97af4402 req-e0976fda-5dcb-4cfc-8b73-800e9c3cc8b5 service nova] Creating event network-vif-plugged:544e928d-a4d3-43ac-9b2f-854b3810328a for instance b3889386-64a2-4858-af6e-009e8606df9f on n-h1-852086-5 Aug 27 03:21:09.501085 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-19c89a05-0b60-45f8-9392-526e97af4402 req-e0976fda-5dcb-4cfc-8b73-800e9c3cc8b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119296 Aug 27 03:21:09.502546 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1522/3044] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:09.551726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:09.552528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:09.566587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:09.567099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:09.571750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:09.572545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:09.573685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:09.574146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:10.702360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:10.726720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d75bc16-3327-4c1a-9998-209f16024324 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1554 microversion: 2.1 time: 1.222984 Aug 27 03:21:10.735696 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1523/3045] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:09 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1554 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:10.749851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:10.788447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:10.811972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:10.821122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:10.821675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:10.824282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:10.824775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:10.825215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:10.869351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:10.928385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:10.944036 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d670f3c1-fc0d-42fd-8c64-82611c5d51cd tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 2.126894 Aug 27 03:21:10.963108 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1523/3046] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:08 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:10.963108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8970bf78-8c80-4c79-bee3-d1b9a09623b4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4603f3e50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:11.089707 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8970bf78-8c80-4c79-bee3-d1b9a09623b4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.136248 Aug 27 03:21:11.105509 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1524/3047] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:10 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:11.122608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:11.123251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:11.137527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:11.138307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:11.138924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:11.140995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:11.141657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:11.142092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:11.792521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:11.807468 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c63c5ea-c154-454b-830a-6661c29d6901 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1281 microversion: 2.1 time: 0.691690 Aug 27 03:21:11.821686 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1525/3048] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:11 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1281 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:11.838855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:11.841266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:11.865403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:11.867928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:11.869334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:11.874820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:11.875642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:11.876260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:11.885239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:11.901154 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-577de347-bbd3-44b9-8466-b01529dcdcc4 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 1.160005 Aug 27 03:21:11.902087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1524/3049] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:10 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:11.922345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:11.923273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:11.930629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:11.931373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:11.931974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:11.932877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:11.933498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:11.934152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:12.013308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:12.571653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:12.587829 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-01a4f700-0747-4ff4-9a71-c5486a99e49b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1554 microversion: 2.1 time: 0.669752 Aug 27 03:21:12.588518 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1525/3050] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:11 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1554 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:12.600703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:12.602583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:12.620480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:12.620480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:12.621012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:12.623148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:12.626622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:12.628017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:12.878260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:13.561254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:13.574779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-efe1eb9c-1a90-47d1-aed8-6313730bf599 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1512 microversion: 2.1 time: 0.985047 Aug 27 03:21:13.575369 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1526/3051] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:12 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1512 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:13.605538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1dd70cf-0cfd-4e9c-a093-1f8ee586dd6a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602f95e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:13.664283 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1dd70cf-0cfd-4e9c-a093-1f8ee586dd6a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.071554 Aug 27 03:21:13.665168 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1527/3052] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:13 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:13.671467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:13.672778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:13.679711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:13.681801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:13.682688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:13.683415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:13.684391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:13.685030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:13.685695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:13.969007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:13.983720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6dceeca-2cd3-4beb-b6f0-538044dcd715 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1281 microversion: 2.1 time: 0.316175 Aug 27 03:21:14.008305 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1528/3053] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:13 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:14.025829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:14.027666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:14.060461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:14.060989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:14.061670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:14.063082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:14.063706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:14.064146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:14.516485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:14.525324 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6cbe0d92-a17f-4fb8-8d9c-b13c60c87300 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 0.515146 Aug 27 03:21:14.546048 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1529/3054] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:14 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:14.564902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:14.565879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:14.598155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:14.598922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:14.599554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:14.600582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:14.614986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:14.632028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:14.959993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:14.974152 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-463630e0-ac8f-45ce-be5b-1a49f5dfc756 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1554 microversion: 2.1 time: 0.426913 Aug 27 03:21:14.975077 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1530/3055] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:14 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1554 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:14.984639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-94b91c02-45b4-43aa-87fe-d010eef902ad req-0dae5bc4-d1a5-4739-ae27-4affa6ca95b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45dca35c-d122-40f4-986b-5b77851f6f3d", "name": "network-vif-deleted", "tag": "2018ab3e-4e07-4098-b98e-9002dd279856"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:14.994927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-94b91c02-45b4-43aa-87fe-d010eef902ad req-0dae5bc4-d1a5-4739-ae27-4affa6ca95b6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:14.996452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-94b91c02-45b4-43aa-87fe-d010eef902ad req-0dae5bc4-d1a5-4739-ae27-4affa6ca95b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:14.997255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-94b91c02-45b4-43aa-87fe-d010eef902ad req-0dae5bc4-d1a5-4739-ae27-4affa6ca95b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.015052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-94b91c02-45b4-43aa-87fe-d010eef902ad req-0dae5bc4-d1a5-4739-ae27-4affa6ca95b6 service nova] Creating event network-vif-deleted:2018ab3e-4e07-4098-b98e-9002dd279856 for instance 45dca35c-d122-40f4-986b-5b77851f6f3d on n-h1-852086-5 Aug 27 03:21:15.020755 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-94b91c02-45b4-43aa-87fe-d010eef902ad req-0dae5bc4-d1a5-4739-ae27-4affa6ca95b6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043722 Aug 27 03:21:15.028437 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1531/3056] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:15.035582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:15.036994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:15.045015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.046656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.047334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.048520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.049200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.049917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.091728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.092521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.093288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.093913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lazy-loading 'fault' on Instance uuid 45dca35c-d122-40f4-986b-5b77851f6f3d {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:21:15.146270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f573336900c6439d94e03ab2db24a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390e782e0da546d6b4dfc2cc089b4d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:15.166434 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c7ff69c-d495-4deb-bc22-b8540ecd2681 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 200 len: 1307 microversion: 2.1 time: 0.135973 Aug 27 03:21:15.170014 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1532/3057] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:15 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:15.184764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d75415c0-bdbd-43d0-9fd1-98bc36f2c4f4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe46027f160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:15.189952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:15.208665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:15.216379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:15.218050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01a8d707-2140-444d-93c1-568b673e298b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1408 microversion: 2.20 time: 3.393540 Aug 27 03:21:15.224840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1526/3058] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:11 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1408 bytes in 3401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:21:15.237584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:15.238595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:15.264382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.267831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.269681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.271566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.273397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.274082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.314812 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d75415c0-bdbd-43d0-9fd1-98bc36f2c4f4 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.141206 Aug 27 03:21:15.323124 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1533/3059] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:15 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:15.556336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:15.557249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:15.559694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:15.570018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.573313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.574261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.575213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:15.575835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:15.576529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:15.777325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:15.786901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8aa51985-2773-40b7-98ed-8c2157e69751 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 0.237195 Aug 27 03:21:15.790830 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1534/3060] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:15 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:15.996306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:15.997415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:16.005773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.006454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.007048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.008227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.011302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.011302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.026931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:16.070293 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b16342f1-2725-408c-9ab9-60c165492d76 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1281 microversion: 2.1 time: 0.842145 Aug 27 03:21:16.074455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1527/3061] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:15 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1281 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:16.161792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:16.171178 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-493c2d02-d4f5-456b-a935-ebefaf359f44 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1512 microversion: 2.1 time: 0.178178 Aug 27 03:21:16.178893 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1535/3062] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:15 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:16.191988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:16.192714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] [instance: 45dca35c-d122-40f4-986b-5b77851f6f3d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:16.199498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.200196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.200852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.202323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.203084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.203524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.228109 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] HTTP exception thrown: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d could not be found. Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Request method failure captured: Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d HTTP/1.1 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCYyDDs9WPcLNrUEnae9id1Kc82l20hjaiM34y5VSFDNxEjS_sGr_-TY_69sGStH-AM9Cy5zyIbb2nLIoHcfT49XQmwvDZtZtY74jIMPiSGczGtoVqe_B7Yz2IaH_KpbvLtuAJ6p8V1Nbly6tz1voNf_q3zCUIbX0rrX5Rw2V48bDhrY Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_390e782e0da546d6b4dfc2cc089b4d84", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/390e782e0da546d6b4dfc2cc089b4d84"}]}] Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 390e782e0da546d6b4dfc2cc089b4d84 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-137280813 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f573336900c6439d94e03ab2db24a931 Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-137280813-project Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d could not be found. Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '45dca35c-d122-40f4-986b-5b77851f6f3d'} Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d could not be found. Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d could not be found. Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:16.229844 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d could not be found. Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] Returning 404 to user: Instance 45dca35c-d122-40f4-986b-5b77851f6f3d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:16.235427 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32f926ac-bd5b-4495-8973-c671b784bdb3 tempest-ServersNegativeTestJSON-137280813 tempest-ServersNegativeTestJSON-137280813-project] 10.222.0.69 "GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d" status: 404 len: 111 microversion: 2.1 time: 0.043319 Aug 27 03:21:16.249513 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1528/3063] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:16 2022] GET /compute/v2.1/servers/45dca35c-d122-40f4-986b-5b77851f6f3d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:16.266813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:16.267329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:16.271418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-90d552f3-b3c0-45da-ba48-6fe5cf1a3979 req-55244cb2-f79c-4ec4-a029-8d38cc62ba63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7876dd-acea-4450-b47d-fa8125c09808", "name": "network-vif-deleted", "tag": "bb4bee08-bb7b-40a8-802d-5c10f50653a8"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:16.296831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.296977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.302593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-90d552f3-b3c0-45da-ba48-6fe5cf1a3979 req-55244cb2-f79c-4ec4-a029-8d38cc62ba63 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.303313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-90d552f3-b3c0-45da-ba48-6fe5cf1a3979 req-55244cb2-f79c-4ec4-a029-8d38cc62ba63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.303867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-90d552f3-b3c0-45da-ba48-6fe5cf1a3979 req-55244cb2-f79c-4ec4-a029-8d38cc62ba63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.312744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.313606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.316105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.320746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.363002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-90d552f3-b3c0-45da-ba48-6fe5cf1a3979 req-55244cb2-f79c-4ec4-a029-8d38cc62ba63 service nova] Creating event network-vif-deleted:bb4bee08-bb7b-40a8-802d-5c10f50653a8 for instance 7d7876dd-acea-4450-b47d-fa8125c09808 on n-h2-852086-5 Aug 27 03:21:16.398996 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-90d552f3-b3c0-45da-ba48-6fe5cf1a3979 req-55244cb2-f79c-4ec4-a029-8d38cc62ba63 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131759 Aug 27 03:21:16.400301 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1529/3064] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:16.409736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c57b8d78-8b50-4efb-a1a8-72c5db2a7efb tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45c045280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:16.529402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c57b8d78-8b50-4efb-a1a8-72c5db2a7efb tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.126593 Aug 27 03:21:16.530486 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1530/3065] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:16 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:16.809600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:16.810722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:16.822670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.825918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.826667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.829333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:16.831221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:16.831830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:16.833188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:17.180961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:17.194968 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1886591b-b5ea-4c6f-b608-4f65a7e0ad43 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 0.389726 Aug 27 03:21:17.198294 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1531/3066] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:16 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:17.219958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "09f3705e-8070-45df-bb85-5787329770f2"}], "security_groups": [{"name": "tempest-securitygroup--191292741"}], "key_name": "tempest-keypair-1763769222", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:17.441720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:17.458375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:17.461320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:17.470131 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c70b137-a753-43ed-ac0c-385a9e9bfec8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1600 microversion: 2.20 time: 1.210531 Aug 27 03:21:17.477068 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1536/3067] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:16 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1600 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:21:17.520616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:17.523156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:17.551783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:17.557574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:17.558314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:17.574281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:17.574966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:17.575528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:17.865068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:17.876766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc7da818-ee90-43a0-ba8e-0f599dd418b8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1281 microversion: 2.1 time: 0.393632 Aug 27 03:21:17.877417 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1537/3068] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:17 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1281 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:17.892379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:17.893031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:17.906871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:17.907787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:17.908427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:17.909824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:17.912003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:17.914206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:18.088810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] validate_networks() for [('09f3705e-8070-45df-bb85-5787329770f2', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:21:18.388903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:18.409812 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d35e0c4a-5d17-45d4-b22c-9a3505173077 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1346 microversion: 2.1 time: 0.527297 Aug 27 03:21:18.410597 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1538/3069] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:17 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1346 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:18.421902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:18.426844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:18.451329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:18.453223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:18.456879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:18.457995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:18.460480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:18.464215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:18.794526 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b3f51c7-958f-41ea-aac0-838c6384e98c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.380789 Aug 27 03:21:18.807558 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1539/3070] 10.222.0.69 () {60 vars in 1316 bytes} [Sat Aug 27 03:21:18 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-interface => generated 285 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:21:18.814571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f065df63-7c92-4a3d-87e1-f0bce82a8d05 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602af1f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:18.909507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f065df63-7c92-4a3d-87e1-f0bce82a8d05 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.100296 Aug 27 03:21:18.952702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1540/3071] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:18 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:18.952702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:18.952702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:18.969618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:18.971040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:18.971040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:18.972428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:18.972428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:18.973636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:19.490479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:19.518526 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8da498bc-8b4a-47dd-a7f5-dc941517fcaa tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 0.600702 Aug 27 03:21:19.519195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1541/3072] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:18 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:19.531876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fd6c457b-4eff-4ace-8c23-a24bd236f006 req-6cd370f1-2fa9-44fe-9acf-b21fb37bb4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdde2b7a-9f85-47bd-8d86-8f51c40b781d", "tag": "00cace5e-6426-4300-928f-446d3b5e2d5d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:19.596099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd6c457b-4eff-4ace-8c23-a24bd236f006 req-6cd370f1-2fa9-44fe-9acf-b21fb37bb4f0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:19.596863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd6c457b-4eff-4ace-8c23-a24bd236f006 req-6cd370f1-2fa9-44fe-9acf-b21fb37bb4f0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:19.597406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd6c457b-4eff-4ace-8c23-a24bd236f006 req-6cd370f1-2fa9-44fe-9acf-b21fb37bb4f0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:19.644517 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fd6c457b-4eff-4ace-8c23-a24bd236f006 req-6cd370f1-2fa9-44fe-9acf-b21fb37bb4f0 service nova] Creating event network-changed:00cace5e-6426-4300-928f-446d3b5e2d5d for instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d on n-h2-852086-5 Aug 27 03:21:19.655553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fd6c457b-4eff-4ace-8c23-a24bd236f006 req-6cd370f1-2fa9-44fe-9acf-b21fb37bb4f0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134838 Aug 27 03:21:19.660531 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1542/3073] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:19.688745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:19.689883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:19.699172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:19.702617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:19.707009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:19.708016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:19.708640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:19.709304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:20.669227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:20.680723 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4fe48f80-a696-440a-ae42-c03ae966b3f4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 1.016081 Aug 27 03:21:20.687429 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1543/3074] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:19 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:20.692587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:20.694867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:20.713818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:20.714809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:20.715478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:20.716448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:20.717142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:20.718470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:20.850505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:20.866209 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3681d7d9-939b-484c-b3d5-627a5a270cbe tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1346 microversion: 2.1 time: 0.177204 Aug 27 03:21:20.869769 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1544/3075] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:20 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:20.875304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c228c84-ff2b-4b6c-882a-20d24c2a2483 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602f9550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:20.935574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3c228c84-ff2b-4b6c-882a-20d24c2a2483 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1429 microversion: 2.1 time: 0.064414 Aug 27 03:21:20.942249 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1545/3076] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:20 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:20.949026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-54311497-46f5-42f6-9cae-a0c0c8e7d383 req-3d767db6-9658-4fd8-a9b5-ae10dfb90241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee7285e8-4734-40d1-bc79-85aa46626d56", "tag": "8c4c8fba-dd99-42db-ac7c-0a19afc27250"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:20.975360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-54311497-46f5-42f6-9cae-a0c0c8e7d383 req-3d767db6-9658-4fd8-a9b5-ae10dfb90241 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:20.975911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-54311497-46f5-42f6-9cae-a0c0c8e7d383 req-3d767db6-9658-4fd8-a9b5-ae10dfb90241 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:20.976354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-54311497-46f5-42f6-9cae-a0c0c8e7d383 req-3d767db6-9658-4fd8-a9b5-ae10dfb90241 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:20.996753 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-54311497-46f5-42f6-9cae-a0c0c8e7d383 req-3d767db6-9658-4fd8-a9b5-ae10dfb90241 service nova] Creating event network-changed:8c4c8fba-dd99-42db-ac7c-0a19afc27250 for instance ee7285e8-4734-40d1-bc79-85aa46626d56 on n-h1-852086-5 Aug 27 03:21:21.014712 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-54311497-46f5-42f6-9cae-a0c0c8e7d383 req-3d767db6-9658-4fd8-a9b5-ae10dfb90241 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071050 Aug 27 03:21:21.015334 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1546/3077] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:21.025621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:21.034777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:21.046254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.047097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.047743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.049501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.050211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.050861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.057277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:21.208233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:21:21.210109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:21:21.211884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:21:21.213428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:21:21.214436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:21:21.235183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.235973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.236595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.239397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.242848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.243818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.292507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Getting quotas for project ce2af32328f04b9b9a34a00ebcead5d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:21.319455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Getting quotas for user 931dbcd79dda453aa44db48cb46ea4f5 and project ce2af32328f04b9b9a34a00ebcead5d0. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:21.370290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:21:21.376336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:21.494511 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a980c97b-6021-4c62-b426-7c4f3ff6ed14 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.281158 Aug 27 03:21:21.503148 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1532/3078] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:21:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 4290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:21:21.533682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98a2396d-1574-4579-9e4d-8612a3c4f127 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:21.536658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98a2396d-1574-4579-9e4d-8612a3c4f127 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:21.877893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:21.887498 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b85f1ff8-5f79-44fb-b048-3785ca8b02a1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 0.868834 Aug 27 03:21:21.899086 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1547/3079] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:21 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:21.908107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:21.909631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:21.919397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.920237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.921167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.922093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:21.922741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:21.923330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:21.951467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98a2396d-1574-4579-9e4d-8612a3c4f127 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:21.960282 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98a2396d-1574-4579-9e4d-8612a3c4f127 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1226 microversion: 2.1 time: 0.451920 Aug 27 03:21:21.966377 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1533/3080] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:21 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1226 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:21.981055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:21.982593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:22.005525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.006333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.007006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.007983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.008664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.009295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.210527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:22.218518 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0413d0d-ba98-4bf1-b8ea-9f65ac20b7fc tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.318223 Aug 27 03:21:22.222625 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1548/3081] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:21 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:22.234860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:22.246502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6fac016-c352-4806-9d2a-6529c35f6987 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe46020e310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:22.250640 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc125843-d2f1-4aa8-b99a-58b948bb93db tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 200 len: 1346 microversion: 2.1 time: 0.282880 Aug 27 03:21:22.252247 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1534/3082] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:21 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 1346 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:22.326571 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6fac016-c352-4806-9d2a-6529c35f6987 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1438 microversion: 2.1 time: 0.087783 Aug 27 03:21:22.327320 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1549/3083] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:22 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:22.344155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6cf4eb7b-31b0-4b4d-8aa0-c311ef4d467c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe45747d280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:22.415925 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6cf4eb7b-31b0-4b4d-8aa0-c311ef4d467c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 200 len: 1438 microversion: 2.1 time: 0.078920 Aug 27 03:21:22.416865 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1535/3084] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:22 2022] GET /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 1438 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:22.431445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:22.432350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:22.439927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.440879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.441667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.442609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.443214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.444370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.915114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:22.916746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:22.933788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.935024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.935635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.937002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:22.937711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:22.938459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:22.964630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:22.978905 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d41b3c02-f295-411c-ae83-3312058e7cae tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1466 microversion: 2.1 time: 0.550200 Aug 27 03:21:22.980905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1550/3085] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:22 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1466 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:22.989422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:22.995519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:23.012883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:23.013990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:23.015291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:23.016714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:23.017964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:23.018569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:23.481423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:23.496569 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8ca0674-d434-4b5b-96da-f05be73e8165 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1278 microversion: 2.1 time: 0.511569 Aug 27 03:21:23.516190 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1551/3086] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:22 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1278 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:23.521834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-70ed7289-ef58-46a7-89af-8652e23d4942 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe4602cc790>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:24.349249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:24.362711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d4cc97b-8745-4fab-b6af-c277189de1f2 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 1.452061 Aug 27 03:21:24.368322 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1536/3087] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:22 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:24.377513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:24.378562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:24.399910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.402988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.403612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:24.406883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.407384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.408216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:24.601818 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-70ed7289-ef58-46a7-89af-8652e23d4942 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "DELETE /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007" status: 204 len: 0 microversion: 2.1 time: 1.083726 Aug 27 03:21:24.602441 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1552/3088] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:23 2022] DELETE /compute/v2.1/images/7b5ff45b-d5cd-46fc-816b-3115b554a007 => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:24.609526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:24.610177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:24.629816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.630350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.630796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:24.631524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.631987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.632421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:24.664074 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 HTTP/1.1 Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7d7876dd-acea-4450-b47d-fa8125c09808'} Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:24.666110 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44f6cfe6-20ac-4356-85a5-e8516a4c35e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 404 len: 111 microversion: 2.1 time: 0.064199 Aug 27 03:21:24.671495 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1553/3089] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:24 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:24.680624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ec6d1bbd-47eb-4ae8-b45f-05a4372f5eaf req-c431c600-eaca-4a96-b7a0-794a5f06db9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0", "tag": "7b68713a-88f1-4833-9fa2-b30481309020"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:24.703983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ec6d1bbd-47eb-4ae8-b45f-05a4372f5eaf req-c431c600-eaca-4a96-b7a0-794a5f06db9a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.704470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ec6d1bbd-47eb-4ae8-b45f-05a4372f5eaf req-c431c600-eaca-4a96-b7a0-794a5f06db9a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.704912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ec6d1bbd-47eb-4ae8-b45f-05a4372f5eaf req-c431c600-eaca-4a96-b7a0-794a5f06db9a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:24.723506 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ec6d1bbd-47eb-4ae8-b45f-05a4372f5eaf req-c431c600-eaca-4a96-b7a0-794a5f06db9a service nova] Creating event network-changed:7b68713a-88f1-4833-9fa2-b30481309020 for instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 on n-h2-852086-5 Aug 27 03:21:24.740638 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ec6d1bbd-47eb-4ae8-b45f-05a4372f5eaf req-c431c600-eaca-4a96-b7a0-794a5f06db9a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071187 Aug 27 03:21:24.741291 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1554/3090] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:24.752722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:24.753444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:24.760776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.761274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.761991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:24.763005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:24.763802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:24.764694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.147424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:25.157261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc6caf38-900c-4507-8f0d-792d7c5035ab tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.787171 Aug 27 03:21:25.160005 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1537/3091] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:24 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:25.179542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebe2f244-2e5d-4c08-a9da-f062d49e237a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '.version_select at 0x7fe457662670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:25.208809 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ebe2f244-2e5d-4c08-a9da-f062d49e237a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] HTTP exception thrown: Image not found. Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebe2f244-2e5d-4c08-a9da-f062d49e237a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Request method failure captured: Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 HTTP/1.1 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY0-3xC_KpTeTcbwDqxt7kd1DMsEm6nESob4AnsaycRSGA9YUthFFHPLX7BAIpIxuALkBsYYz64YaM35GUHhNcSTHS6DnOhZiYzFW-LBLpjbHNHszVx5dDrBltWvNqltjTVSopwkaOluIhV9XNfOz66Hv8_qh4qL499TOP-ER8AKFvo Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b0c6598a83274624997da7af158a0d57 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b0c6598a83274624997da7af158a0d57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b0c6598a83274624997da7af158a0d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b0c6598a83274624997da7af158a0d57", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b0c6598a83274624997da7af158a0d57"}]}] Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b0c6598a83274624997da7af158a0d57 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerTestJSON-1443181296-project Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 4eb9f9c28d84488caffc8a3e340c1f16 Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerTestJSON-1443181296-project Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: exception: Image not found. Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'aee9dd64-8939-4838-8f64-86f5dc872b84'} Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aee9dd64-8939-4838-8f64-86f5dc872b84 to delete Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aee9dd64-8939-4838-8f64-86f5dc872b84 could not be found. Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.211720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebe2f244-2e5d-4c08-a9da-f062d49e237a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:25.216205 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebe2f244-2e5d-4c08-a9da-f062d49e237a tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "DELETE /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84" status: 404 len: 62 microversion: 2.1 time: 0.049797 Aug 27 03:21:25.220773 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1538/3092] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:25 2022] DELETE /compute/v2.1/images/aee9dd64-8939-4838-8f64-86f5dc872b84 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:21:25.224891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:25.229815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:25.239415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.240355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.241139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.242281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.243040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.243903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.245061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:25.259017 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-065ac937-e9db-4127-8e32-1df6b11fdb68 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1284 microversion: 2.1 time: 0.516450 Aug 27 03:21:25.259615 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1555/3093] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:24 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1284 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:25.262818 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808/os-volume_attachments HTTP/1.1 Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': '7d7876dd-acea-4450-b47d-fa8125c09808'} Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:25.274797 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:21:25.281510 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:25.283054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:25.283054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:25.290862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.291167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:25.291372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.293353 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-894d416c-40fd-46ce-a8ec-bd3ca2125512 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074027 Aug 27 03:21:25.294011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.294985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.301195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1539/3094] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:21:25 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:25.307182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.309130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.344443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:25.384876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:25.386360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:25.399862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.402449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.402856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.408549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.417560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.418221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.515248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-324f3b89-51c1-4b8f-b637-1940bafa17c1 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "DELETE /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 204 len: 0 microversion: 2.1 time: 0.247244 Aug 27 03:21:25.516328 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1556/3095] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:25 2022] DELETE /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:25.555233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:25.558143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:25.575318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.578509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.581612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.584461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:25.584947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:25.587815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:25.893092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:25.931306 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c12ba243-0f94-4fdb-84e7-27b958d1bc28 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 0.533627 Aug 27 03:21:25.931306 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1540/3096] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:25 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:25.931306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1992987750", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "be792eba-f4b7-46b8-9127-1ca32ef532fe"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:26.016073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] validate_networks() for [('be792eba-f4b7-46b8-9127-1ca32ef532fe', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:21:26.072038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:26.086229 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-192fd7b4-ebec-4352-8999-993b27142d9c tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1472 microversion: 2.1 time: 0.563467 Aug 27 03:21:26.100658 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1557/3097] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:25 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1472 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:26.104312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6ee27f7b-8386-4b4c-bd72-3132e2a8496c req-20fd739a-b6f3-4fae-a058-3cc435e26959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdde2b7a-9f85-47bd-8d86-8f51c40b781d", "name": "network-vif-plugged", "status": "completed", "tag": "00cace5e-6426-4300-928f-446d3b5e2d5d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:26.139446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ee27f7b-8386-4b4c-bd72-3132e2a8496c req-20fd739a-b6f3-4fae-a058-3cc435e26959 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:26.140308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ee27f7b-8386-4b4c-bd72-3132e2a8496c req-20fd739a-b6f3-4fae-a058-3cc435e26959 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:26.144577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ee27f7b-8386-4b4c-bd72-3132e2a8496c req-20fd739a-b6f3-4fae-a058-3cc435e26959 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:26.182511 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6ee27f7b-8386-4b4c-bd72-3132e2a8496c req-20fd739a-b6f3-4fae-a058-3cc435e26959 service nova] Creating event network-vif-plugged:00cace5e-6426-4300-928f-446d3b5e2d5d for instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d on n-h2-852086-5 Aug 27 03:21:26.201853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6ee27f7b-8386-4b4c-bd72-3132e2a8496c req-20fd739a-b6f3-4fae-a058-3cc435e26959 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105266 Aug 27 03:21:26.208738 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1558/3098] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:26.218180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:26.218946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:26.227710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:26.228576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:26.229275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:26.230260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:26.231599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:26.232257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:26.746509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:26.782692 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46738b60-717b-4b3b-aea2-4dc9bd4a221a tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.568453 Aug 27 03:21:26.783592 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1559/3099] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:26 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:26.819817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:26.820777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:26.831414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:26.832408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:26.833010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:26.833907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:26.834651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:26.835946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:26.952895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:26.967777 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e6c00215-60d5-4def-bf43-86ce9f26e125 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1284 microversion: 2.1 time: 0.158401 Aug 27 03:21:26.969621 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1560/3100] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:26 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:26.984989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:26.990521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:27.003680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.004744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.005699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.008609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.011123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.012132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.178858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:21:27.179964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:21:27.180622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:21:27.181197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:21:27.181808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:21:27.231273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.231947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.232463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.246884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.247594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.248055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.291149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:27.298276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for user 267cffdb49624ff986aed20fd255b1db and project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:27.317637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:21:27.321334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:27.428390 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce9c51a7-f7e4-4260-8db0-a5af4561d809 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511343 Aug 27 03:21:27.431259 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1541/3101] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:21:27.445485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-feaa1f25-d340-4611-b73c-e7f79adb0a14 req-3b58213c-b283-4178-baa9-5b58bba71084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3889386-64a2-4858-af6e-009e8606df9f", "tag": "544e928d-a4d3-43ac-9b2f-854b3810328a"}, {"name": "network-changed", "server_uuid": "103b34dc-98d7-44fa-b092-70934c1e9662", "tag": "5cdca756-8336-46ca-b93e-d0824812d9ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:27.490728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-feaa1f25-d340-4611-b73c-e7f79adb0a14 req-3b58213c-b283-4178-baa9-5b58bba71084 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.491370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-feaa1f25-d340-4611-b73c-e7f79adb0a14 req-3b58213c-b283-4178-baa9-5b58bba71084 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.491813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-feaa1f25-d340-4611-b73c-e7f79adb0a14 req-3b58213c-b283-4178-baa9-5b58bba71084 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.509885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:27.520796 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f3362c8a-29cd-4876-b663-d695886bc88a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1365 microversion: 2.1 time: 0.549783 Aug 27 03:21:27.533331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1561/3102] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:26 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1365 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:27.538798 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-feaa1f25-d340-4611-b73c-e7f79adb0a14 req-3b58213c-b283-4178-baa9-5b58bba71084 service nova] Creating event network-changed:544e928d-a4d3-43ac-9b2f-854b3810328a for instance b3889386-64a2-4858-af6e-009e8606df9f on n-h1-852086-5 Aug 27 03:21:27.539307 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-feaa1f25-d340-4611-b73c-e7f79adb0a14 req-3b58213c-b283-4178-baa9-5b58bba71084 service nova] Creating event network-changed:5cdca756-8336-46ca-b93e-d0824812d9ea for instance 103b34dc-98d7-44fa-b092-70934c1e9662 on n-h1-852086-5 Aug 27 03:21:27.551257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-feaa1f25-d340-4611-b73c-e7f79adb0a14 req-3b58213c-b283-4178-baa9-5b58bba71084 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118076 Aug 27 03:21:27.552949 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1542/3103] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:27.554476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:27.555108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:27.559301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90f07726-1f5f-4982-b612-c055f89db430 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:27.560738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90f07726-1f5f-4982-b612-c055f89db430 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:27.574932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.575431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.575881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.576637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:27.577277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:27.577719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:27.753650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90f07726-1f5f-4982-b612-c055f89db430 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:27.766324 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90f07726-1f5f-4982-b612-c055f89db430 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9" status: 200 len: 1215 microversion: 2.1 time: 0.212087 Aug 27 03:21:27.770351 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1543/3104] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:27 2022] GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:27.798922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4972a125-cd81-4e4c-be2b-1eb8bfabb5ea tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:27.801054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4972a125-cd81-4e4c-be2b-1eb8bfabb5ea tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:27.837576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4972a125-cd81-4e4c-be2b-1eb8bfabb5ea tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:28.336923 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.scheduler.client.report [None req-4972a125-cd81-4e4c-be2b-1eb8bfabb5ea tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Deleted allocations for instance db8063ab-edcf-4807-8298-eea24ee08ef9 Aug 27 03:21:28.347483 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-4972a125-cd81-4e4c-be2b-1eb8bfabb5ea tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] Instance Mapping does not exist while attempting local delete cleanup. Aug 27 03:21:28.348569 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4972a125-cd81-4e4c-be2b-1eb8bfabb5ea tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9" status: 204 len: 0 microversion: 2.1 time: 0.562166 Aug 27 03:21:28.349691 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1544/3105] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:27 2022] DELETE /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:21:28.359420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:28.366024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:28.377917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:28.382768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:28.384313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:28.387193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:28.387920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:28.391718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:28.715180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:28.743797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-60993af6-4755-4d7c-aab8-8e44c9830115 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1472 microversion: 2.1 time: 1.204418 Aug 27 03:21:28.745101 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1562/3106] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:27 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1472 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:28.798885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:28.813787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:28.831162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:28.832126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:28.834150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:28.837231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:28.838005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:28.838695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:29.112419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:29.130212 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebef7057-f0cb-4122-8455-888c7531c75c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.777625 Aug 27 03:21:29.142887 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1545/3107] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:28 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:29.143176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7b01b3f2-6f6a-4e3e-8e4f-3610f4054a18 req-2d69f187-7502-4ef1-96e2-fff561793313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405db88e-88e4-4354-8042-d6bf17f760ce", "name": "network-vif-unplugged", "status": "completed", "tag": "4827f4aa-eb84-4b53-83f0-102a51091895"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:29.160103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b01b3f2-6f6a-4e3e-8e4f-3610f4054a18 req-2d69f187-7502-4ef1-96e2-fff561793313 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:29.160819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b01b3f2-6f6a-4e3e-8e4f-3610f4054a18 req-2d69f187-7502-4ef1-96e2-fff561793313 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:29.161261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b01b3f2-6f6a-4e3e-8e4f-3610f4054a18 req-2d69f187-7502-4ef1-96e2-fff561793313 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:29.181854 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7b01b3f2-6f6a-4e3e-8e4f-3610f4054a18 req-2d69f187-7502-4ef1-96e2-fff561793313 service nova] Creating event network-vif-unplugged:4827f4aa-eb84-4b53-83f0-102a51091895 for instance 405db88e-88e4-4354-8042-d6bf17f760ce on n-h1-852086-5 Aug 27 03:21:29.193773 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7b01b3f2-6f6a-4e3e-8e4f-3610f4054a18 req-2d69f187-7502-4ef1-96e2-fff561793313 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059509 Aug 27 03:21:29.199284 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1546/3108] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:29.208461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a697777-3eb1-4a28-a39c-47a94c5b782a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:29.209194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a697777-3eb1-4a28-a39c-47a94c5b782a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:29.220207 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7a697777-3eb1-4a28-a39c-47a94c5b782a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a697777-3eb1-4a28-a39c-47a94c5b782a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 HTTP/1.1 Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'db8063ab-edcf-4807-8298-eea24ee08ef9'} Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:29.221945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:29.229325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:29.229325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:29.229325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:29.229325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:21:29.229325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:29.229325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a697777-3eb1-4a28-a39c-47a94c5b782a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:29.229325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a697777-3eb1-4a28-a39c-47a94c5b782a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9" status: 404 len: 111 microversion: 2.1 time: 0.022968 Aug 27 03:21:29.235399 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1547/3109] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:29 2022] GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:29.274517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:29.275143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:29.299973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:29.301027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:29.303209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:29.304077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:29.304554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:29.306392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:29.417279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:29.429528 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9096507-69bd-4ec8-ad08-b70b7b20cf2b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 0.682952 Aug 27 03:21:29.430847 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1563/3110] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:28 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:29.439044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-727976706", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "be792eba-f4b7-46b8-9127-1ca32ef532fe"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:29.516660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] validate_networks() for [('be792eba-f4b7-46b8-9127-1ca32ef532fe', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:21:30.212128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:30.224739 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b70081d-882e-4176-81f7-571418a7b260 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1554 microversion: 2.1 time: 0.962674 Aug 27 03:21:30.225696 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1548/3111] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:29 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1554 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:30.235835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:30.236559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:30.243734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.244309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.245056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:30.246398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.247019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.247617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:30.388015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb9f9c28d84488caffc8a3e340c1f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c6598a83274624997da7af158a0d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:30.396932 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43534595-ba2d-4324-be83-b368790c7856 tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 200 len: 1430 microversion: 2.1 time: 0.169781 Aug 27 03:21:30.411086 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1549/3112] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:30 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 1430 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:30.418450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:30.419574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:30.427507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.428063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.428497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:30.429955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.430194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.430786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:30.689884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:21:30.690491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:21:30.694352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:21:30.696157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:21:30.698487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:21:30.737645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.738407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.739051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:30.740892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:30.741599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:30.742376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:30.793251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:30.809656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for user 267cffdb49624ff986aed20fd255b1db and project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:30.850606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:21:30.853402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:30.996259 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7fabee75-730d-4eba-b2ff-1b425ea65acf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563804 Aug 27 03:21:31.003615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:31.018528 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1564/3113] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:21:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:21:31.021498 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6930734-d9db-4115-9e02-733935e25fd7 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.608907 Aug 27 03:21:31.039765 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1550/3114] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:30 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:31.047615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0aaba3fa-2257-4db5-8465-d21ee1d3a02d req-3e9f7489-d463-41bc-8324-ca2bc7d00156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405db88e-88e4-4354-8042-d6bf17f760ce", "name": "network-vif-deleted", "tag": "4827f4aa-eb84-4b53-83f0-102a51091895"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:31.049543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:31.050114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:31.072473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.075786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.077266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.088159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.088969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.090202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.094814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0aaba3fa-2257-4db5-8465-d21ee1d3a02d req-3e9f7489-d463-41bc-8324-ca2bc7d00156 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.095288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0aaba3fa-2257-4db5-8465-d21ee1d3a02d req-3e9f7489-d463-41bc-8324-ca2bc7d00156 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.097183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0aaba3fa-2257-4db5-8465-d21ee1d3a02d req-3e9f7489-d463-41bc-8324-ca2bc7d00156 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.130271 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0aaba3fa-2257-4db5-8465-d21ee1d3a02d req-3e9f7489-d463-41bc-8324-ca2bc7d00156 service nova] Creating event network-vif-deleted:4827f4aa-eb84-4b53-83f0-102a51091895 for instance 405db88e-88e4-4354-8042-d6bf17f760ce on n-h1-852086-5 Aug 27 03:21:31.146900 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0aaba3fa-2257-4db5-8465-d21ee1d3a02d req-3e9f7489-d463-41bc-8324-ca2bc7d00156 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102661 Aug 27 03:21:31.148626 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1551/3115] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:31.165131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:31.170617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:31.187101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.187780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.188421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.192021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.192503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.192935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.408609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17704588-b602-4b98-887b-94ad44e60924 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.386009 Aug 27 03:21:31.409581 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1565/3116] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:21:31 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-interface => generated 284 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:31.416773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18352b9e-aee4-4b91-81cc-7de79d26760e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:31.417572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18352b9e-aee4-4b91-81cc-7de79d26760e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:31.710538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-18352b9e-aee4-4b91-81cc-7de79d26760e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:31.720585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-18352b9e-aee4-4b91-81cc-7de79d26760e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1214 microversion: 2.1 time: 0.306759 Aug 27 03:21:31.738030 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1566/3117] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:31 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1214 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:31.754894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-27e29255-5f6a-4cf6-9afe-446023fab07d req-71cdaf67-2d35-4147-b9ff-bf6e73bc1009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7285e8-4734-40d1-bc79-85aa46626d56", "name": "network-vif-plugged", "status": "completed", "tag": "8c4c8fba-dd99-42db-ac7c-0a19afc27250"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:31.795190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-27e29255-5f6a-4cf6-9afe-446023fab07d req-71cdaf67-2d35-4147-b9ff-bf6e73bc1009 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.798695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-27e29255-5f6a-4cf6-9afe-446023fab07d req-71cdaf67-2d35-4147-b9ff-bf6e73bc1009 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.799361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-27e29255-5f6a-4cf6-9afe-446023fab07d req-71cdaf67-2d35-4147-b9ff-bf6e73bc1009 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.849510 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-27e29255-5f6a-4cf6-9afe-446023fab07d req-71cdaf67-2d35-4147-b9ff-bf6e73bc1009 service nova] Creating event network-vif-plugged:8c4c8fba-dd99-42db-ac7c-0a19afc27250 for instance ee7285e8-4734-40d1-bc79-85aa46626d56 on n-h1-852086-5 Aug 27 03:21:31.864269 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-27e29255-5f6a-4cf6-9afe-446023fab07d req-71cdaf67-2d35-4147-b9ff-bf6e73bc1009 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123887 Aug 27 03:21:31.865640 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1567/3118] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:31.872585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:31.873012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] [instance: 405db88e-88e4-4354-8042-d6bf17f760ce] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:31.888703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.899050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.904515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.908380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:31.912584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:31.913945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:31.942348 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] HTTP exception thrown: Instance 405db88e-88e4-4354-8042-d6bf17f760ce could not be found. Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Request method failure captured: Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce HTTP/1.1 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY0-3xC_KpTeTcbwDqxt7kd1DMsEm6nESob4AnsaycRSGA9YUthFFHPLX7BAIpIxuALkBsYYz64YaM35GUHhNcSTHS6DnOhZiYzFW-LBLpjbHNHszVx5dDrBltWvNqltjTVSopwkaOluIhV9XNfOz66Hv8_qh4qL499TOP-ER8AKFvo Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b0c6598a83274624997da7af158a0d57 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b0c6598a83274624997da7af158a0d57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b0c6598a83274624997da7af158a0d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b0c6598a83274624997da7af158a0d57", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b0c6598a83274624997da7af158a0d57"}]}] Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b0c6598a83274624997da7af158a0d57 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1443181296 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ImagesOneServerTestJSON-1443181296-project Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 4eb9f9c28d84488caffc8a3e340c1f16 Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ImagesOneServerTestJSON-1443181296-project Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 405db88e-88e4-4354-8042-d6bf17f760ce could not be found. Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '405db88e-88e4-4354-8042-d6bf17f760ce'} Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405db88e-88e4-4354-8042-d6bf17f760ce could not be found. Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405db88e-88e4-4354-8042-d6bf17f760ce could not be found. Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:31.955701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405db88e-88e4-4354-8042-d6bf17f760ce could not be found. Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:31.960263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] Returning 404 to user: Instance 405db88e-88e4-4354-8042-d6bf17f760ce could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:31.971487 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6cd13910-1736-461c-8400-bf126c3a090d tempest-ImagesOneServerTestJSON-1443181296 tempest-ImagesOneServerTestJSON-1443181296-project] 10.222.0.69 "GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce" status: 404 len: 111 microversion: 2.1 time: 0.097582 Aug 27 03:21:31.975863 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1568/3119] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:31 2022] GET /compute/v2.1/servers/405db88e-88e4-4354-8042-d6bf17f760ce => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:32.051586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:32.052212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:32.069850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:32.071138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:32.071606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:32.076060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:32.079494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:32.081250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:32.148677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:32.641992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:32.654504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc4f97b1-f13d-4282-a76f-005890ad764e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.604047 Aug 27 03:21:32.658657 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1569/3120] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:32 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:32.710319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2cf35226-8b52-4cf5-a91c-97558a4de38a req-56a5267d-de5d-4eb4-a2ed-59020d54d307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3313d2b8-a2e8-400e-bc5f-c255af6095af", "tag": "33207100-80c1-4b21-97ac-d1e9c18ef7e5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:32.727703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2cf35226-8b52-4cf5-a91c-97558a4de38a req-56a5267d-de5d-4eb4-a2ed-59020d54d307 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:32.729005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2cf35226-8b52-4cf5-a91c-97558a4de38a req-56a5267d-de5d-4eb4-a2ed-59020d54d307 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:32.729871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2cf35226-8b52-4cf5-a91c-97558a4de38a req-56a5267d-de5d-4eb4-a2ed-59020d54d307 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:32.758628 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-2cf35226-8b52-4cf5-a91c-97558a4de38a req-56a5267d-de5d-4eb4-a2ed-59020d54d307 service nova] Creating event network-changed:33207100-80c1-4b21-97ac-d1e9c18ef7e5 for instance 3313d2b8-a2e8-400e-bc5f-c255af6095af on n-h2-852086-5 Aug 27 03:21:32.777092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2cf35226-8b52-4cf5-a91c-97558a4de38a req-56a5267d-de5d-4eb4-a2ed-59020d54d307 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068465 Aug 27 03:21:32.781823 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1570/3121] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:32.787450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:32.793919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:32.807502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:32.814030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:32.817221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:32.820995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:32.821496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:32.823604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:33.061472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:33.076398 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1266 microversion: 2.1 time: 0.292827 Aug 27 03:21:33.077344 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1571/3122] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:32 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:33.082100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:33.083119 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-22e0e64f-3b00-41df-8fc8-5a3bc84a89b3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004967 Aug 27 03:21:33.086389 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1572/3123] 10.222.0.69 () {56 vars in 886 bytes} [Sat Aug 27 03:21:33 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 03:21:33.188253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:33.197185 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f261fac-8e0c-40b5-8797-6e275dcd5703 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 2.046611 Aug 27 03:21:33.197776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1552/3124] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:31 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:33.682512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:33.686881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:33.701306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:33.708927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:33.709767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:33.711238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:33.718545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:33.720222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:33.947911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d874f089-0e2c-4191-a742-e8e36d99207b req-e1ed223b-0c87-447c-b678-4de30f578af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0", "name": "network-vif-plugged", "status": "completed", "tag": "7b68713a-88f1-4833-9fa2-b30481309020"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:33.968666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d874f089-0e2c-4191-a742-e8e36d99207b req-e1ed223b-0c87-447c-b678-4de30f578af0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:33.977733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d874f089-0e2c-4191-a742-e8e36d99207b req-e1ed223b-0c87-447c-b678-4de30f578af0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:33.979069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d874f089-0e2c-4191-a742-e8e36d99207b req-e1ed223b-0c87-447c-b678-4de30f578af0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:33.998097 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d874f089-0e2c-4191-a742-e8e36d99207b req-e1ed223b-0c87-447c-b678-4de30f578af0 service nova] Creating event network-vif-plugged:7b68713a-88f1-4833-9fa2-b30481309020 for instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 on n-h2-852086-5 Aug 27 03:21:34.004934 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d874f089-0e2c-4191-a742-e8e36d99207b req-e1ed223b-0c87-447c-b678-4de30f578af0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060415 Aug 27 03:21:34.006363 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1553/3125] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:34.105760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:34.106761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:34.110567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:34.126638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:34.127566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:34.128242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:34.129492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:34.130199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:34.132613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:34.433481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:34.453394 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-51cb25e2-fe52-463b-9e2a-fe89086f8f12 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1272 microversion: 2.1 time: 0.353909 Aug 27 03:21:34.453935 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1554/3126] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:34 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:34.495104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:34.495791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:34.520363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:34.520879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:34.524205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:34.531347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:34.533265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:34.534740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:35.080840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:35.092041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-12a0b7e5-4ada-4189-81e2-533c79736026 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 1.413231 Aug 27 03:21:35.107160 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1573/3127] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:33 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:35.490358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:35.491616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:35.522190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:35.525567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:35.527712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:35.529143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:35.531149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:35.531951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:35.686909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:35.696332 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-999e5e40-ea48-4ed4-a507-a4844f9fd4f9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1272 microversion: 2.1 time: 0.219954 Aug 27 03:21:35.697583 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1574/3128] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:35 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:35.803195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:35.807176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:35.819118 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a92ca714-fa06-47cc-bef2-fa568d71b261 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 1.342227 Aug 27 03:21:35.820047 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1555/3129] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:34 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:36.072591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-36c2acf3-91eb-4b07-8129-de4983a3db46 req-8725903b-e767-401b-a683-5f93a15bce42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103b34dc-98d7-44fa-b092-70934c1e9662", "name": "network-vif-plugged", "status": "completed", "tag": "5cdca756-8336-46ca-b93e-d0824812d9ea"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:36.090401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-36c2acf3-91eb-4b07-8129-de4983a3db46 req-8725903b-e767-401b-a683-5f93a15bce42 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.091361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-36c2acf3-91eb-4b07-8129-de4983a3db46 req-8725903b-e767-401b-a683-5f93a15bce42 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.091361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-36c2acf3-91eb-4b07-8129-de4983a3db46 req-8725903b-e767-401b-a683-5f93a15bce42 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:36.114730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:36.115718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:36.124604 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-36c2acf3-91eb-4b07-8129-de4983a3db46 req-8725903b-e767-401b-a683-5f93a15bce42 service nova] Creating event network-vif-plugged:5cdca756-8336-46ca-b93e-d0824812d9ea for instance 103b34dc-98d7-44fa-b092-70934c1e9662 on n-h1-852086-5 Aug 27 03:21:36.133886 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-36c2acf3-91eb-4b07-8129-de4983a3db46 req-8725903b-e767-401b-a683-5f93a15bce42 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064766 Aug 27 03:21:36.135163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.136114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.137235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1575/3130] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:36.146124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:36.147703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.149446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.150323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:36.198695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f9b640b9-182b-4b8b-bc31-0335dbaf241a req-f9ef8657-2728-4238-8500-fff1286d3180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdde2b7a-9f85-47bd-8d86-8f51c40b781d", "tag": "00cace5e-6426-4300-928f-446d3b5e2d5d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:36.221820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f9b640b9-182b-4b8b-bc31-0335dbaf241a req-f9ef8657-2728-4238-8500-fff1286d3180 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.222530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f9b640b9-182b-4b8b-bc31-0335dbaf241a req-f9ef8657-2728-4238-8500-fff1286d3180 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.224671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f9b640b9-182b-4b8b-bc31-0335dbaf241a req-f9ef8657-2728-4238-8500-fff1286d3180 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:36.262292 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f9b640b9-182b-4b8b-bc31-0335dbaf241a req-f9ef8657-2728-4238-8500-fff1286d3180 service nova] Creating event network-changed:00cace5e-6426-4300-928f-446d3b5e2d5d for instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d on n-h2-852086-5 Aug 27 03:21:36.277292 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f9b640b9-182b-4b8b-bc31-0335dbaf241a req-f9ef8657-2728-4238-8500-fff1286d3180 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082885 Aug 27 03:21:36.278552 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1576/3131] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:36.720871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:36.721770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:36.738337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.740967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.742944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:36.752316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.753021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.753547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:36.821157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:36.839900 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93c6c7ef-b2ac-4173-940b-0dc7f2bdd98b tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.720468 Aug 27 03:21:36.840480 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1556/3132] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:36 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:36.861199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:36.867069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:36.877839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.893382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.894472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:36.895270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:36.895752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:36.896184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:37.245518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:37.254512 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-970f6e9d-f794-47ec-ba31-c7e19a0386a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1314 microversion: 2.1 time: 0.539688 Aug 27 03:21:37.258319 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1577/3133] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:36 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:37.278096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:37.484433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d9dd7f9-55a5-4cf6-a3c7-4b65367738ae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457a5ab80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:37.555018 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9d9dd7f9-55a5-4cf6-a3c7-4b65367738ae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/d869ebeb-1326-48ae-95ff-dc83de1160ef" status: 200 len: 661 microversion: 2.1 time: 0.083502 Aug 27 03:21:37.555621 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1578/3134] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:37 2022] GET /compute/v2.1/images/d869ebeb-1326-48ae-95ff-dc83de1160ef => generated 661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:37.581230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-363408fe-6af3-4f0c-b503-e8c2f009f5b4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4602a34c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:37.649626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:37.650886 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-363408fe-6af3-4f0c-b503-e8c2f009f5b4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/d869ebeb-1326-48ae-95ff-dc83de1160ef" status: 200 len: 661 microversion: 2.1 time: 0.079561 Aug 27 03:21:37.660760 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1579/3135] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:37 2022] GET /compute/v2.1/images/d869ebeb-1326-48ae-95ff-dc83de1160ef => generated 661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:37.673639 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46f12c68-69ec-4e6b-b52a-c9019c497fa3 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 0.825566 Aug 27 03:21:37.677190 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1557/3136] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:36 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:37.866818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:37.867719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:37.876660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:37.895936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:37.896456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:37.896912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:37.897647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:37.904778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:37.905398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:38.286112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:38.287568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:38.299942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=18 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:38.306948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:38.307826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:38.309255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:38.310220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:38.311441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:38.312738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:38.330862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:38.343373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a3931a8-5004-4fe8-983b-8749c33a272f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1323 microversion: 2.1 time: 0.483301 Aug 27 03:21:38.346843 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1580/3137] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:37 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:38.648935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-9a304293-dd20-4abd-9beb-26831c26021c req-2e600110-30bf-48e5-8791-07bb736b506f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcdd1cc0-f3df-4014-9d3b-9008281ad483", "tag": "8a35c125-cd0b-43a8-b0a3-e962283922c0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:38.671145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9a304293-dd20-4abd-9beb-26831c26021c req-2e600110-30bf-48e5-8791-07bb736b506f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:38.671540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9a304293-dd20-4abd-9beb-26831c26021c req-2e600110-30bf-48e5-8791-07bb736b506f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:38.672878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9a304293-dd20-4abd-9beb-26831c26021c req-2e600110-30bf-48e5-8791-07bb736b506f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:38.703459 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-9a304293-dd20-4abd-9beb-26831c26021c req-2e600110-30bf-48e5-8791-07bb736b506f service nova] Creating event network-changed:8a35c125-cd0b-43a8-b0a3-e962283922c0 for instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 on n-h1-852086-5 Aug 27 03:21:38.726185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-9a304293-dd20-4abd-9beb-26831c26021c req-2e600110-30bf-48e5-8791-07bb736b506f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079712 Aug 27 03:21:38.730234 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1581/3138] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:38.745960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:38.747217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:38.749442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:38.759887 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d83741ae-fbdd-47a0-89dd-9ce388cd15fc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1314 microversion: 2.1 time: 0.485763 Aug 27 03:21:38.765187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:38.766547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:38.767315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:38.772561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:38.773705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:38.774507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:38.775202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1558/3139] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:38 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:39.306658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:39.341302 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17920080-0c06-4ff2-8b6e-ac3c39eba85e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 0.608223 Aug 27 03:21:39.343008 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1582/3140] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:38 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:39.369702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:39.379739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:39.396098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:39.399085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:39.403080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:39.404745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:39.407468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:39.408498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:39.562916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ba9e1c7-cf96-48f8-9258-800d564ddfc8 tempest-ExtensionsTest-1776741276 tempest-ExtensionsTest-1776741276-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:39.565184 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ba9e1c7-cf96-48f8-9258-800d564ddfc8 tempest-ExtensionsTest-1776741276 tempest-ExtensionsTest-1776741276-project] 10.222.0.69 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.324952 Aug 27 03:21:39.565924 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1559/3141] 10.222.0.69 () {58 vars in 1170 bytes} [Sat Aug 27 03:21:39 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:39.577208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6717f26-b7a6-4456-a01f-6991260dfa91 tempest-ExtensionsTest-1776741276 tempest-ExtensionsTest-1776741276-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:39.585608 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6717f26-b7a6-4456-a01f-6991260dfa91 tempest-ExtensionsTest-1776741276 tempest-ExtensionsTest-1776741276-project] 10.222.0.69 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.014424 Aug 27 03:21:39.586989 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1560/3142] 10.222.0.69 () {58 vars in 1134 bytes} [Sat Aug 27 03:21:39 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:21:39.612996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9294b968-7c15-4301-b505-c5e8e5986343 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460301ca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:39.697494 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9294b968-7c15-4301-b505-c5e8e5986343 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/9bef044c-2245-4231-80dd-d126b03b0136" status: 200 len: 662 microversion: 2.1 time: 0.088955 Aug 27 03:21:39.698138 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1561/3143] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:39 2022] GET /compute/v2.1/images/9bef044c-2245-4231-80dd-d126b03b0136 => generated 662 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:39.715328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60d9acf0-eb2b-4734-a788-040996bb08da tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c045820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:39.782561 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60d9acf0-eb2b-4734-a788-040996bb08da tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/9bef044c-2245-4231-80dd-d126b03b0136" status: 200 len: 662 microversion: 2.1 time: 0.072113 Aug 27 03:21:39.790372 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1562/3144] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:39 2022] GET /compute/v2.1/images/9bef044c-2245-4231-80dd-d126b03b0136 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:39.790372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:39.790372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:39.809074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:39.809644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:39.811480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:39.812237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:39.815630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:39.816118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:39.918478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:39.929378 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b18cddc-415f-4f59-b0c6-36f2653ac051 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 200 len: 1517 microversion: 2.1 time: 0.567076 Aug 27 03:21:39.930535 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1583/3145] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:39 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 1517 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:39.955611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:39.956420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:39.964395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:39.964899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:39.965339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:39.966061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:39.971110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:39.972661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:40.226563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:40.241258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:40.254038 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5693e1e-ead0-4d02-b4ed-3b3dc2b3763a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1314 microversion: 2.1 time: 0.469402 Aug 27 03:21:40.255694 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc1297ca-1b35-400d-820e-410e3e978809 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 200 len: 1516 microversion: 2.1 time: 0.306561 Aug 27 03:21:40.256750 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1563/3146] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:39 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:40.264674 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1584/3147] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:39 2022] GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:40.301504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:40.302450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:40.310130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:40.311998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:40.312740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:40.313741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:40.314506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:40.315115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:40.369141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:40.369751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:40.384766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:40.385266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:40.385705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:40.386512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:40.386888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:40.387307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:40.651497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:40.661031 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15f37d15-17c6-4f8d-bfa4-8216922c42d1 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 200 len: 1516 microversion: 2.1 time: 0.364470 Aug 27 03:21:40.661607 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1564/3148] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:40 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 1516 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:40.682256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:40.682762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:40.693541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:40.694029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:40.695819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:40.697891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:40.698704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:40.699264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:40.769061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:40.772874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:40.778458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0bcf4d18-7b32-49c7-bf9f-0eb7c5e458ee tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 0.415242 Aug 27 03:21:40.778896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:40.779545 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1585/3149] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:40 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:41.010652 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afbe4a39-6a32-4acb-89f8-310819d9204e tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 204 len: 0 microversion: 2.1 time: 0.326395 Aug 27 03:21:41.018058 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1565/3150] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:40 2022] DELETE /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:41.029495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:41.031203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:41.044548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:41.045060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:41.045519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:41.048303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:41.049260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:41.052188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:41.295021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:41.295847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:41.308255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:41.311790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:41.312268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:41.315763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:41.316314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:41.316760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:41.432129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:41.458539 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48f1fd0f-3dac-4100-b4d8-46f4dd8165ea tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 200 len: 1522 microversion: 2.1 time: 0.434326 Aug 27 03:21:41.463042 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1586/3151] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:41 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:41.698787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:41.707243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f5bcdcc2-55db-409b-831b-fc182f9cb4fe req-71c425db-e202-496a-9bdb-b10648081c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3313d2b8-a2e8-400e-bc5f-c255af6095af", "name": "network-vif-plugged", "status": "completed", "tag": "33207100-80c1-4b21-97ac-d1e9c18ef7e5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:41.707855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f9760a2-e07e-4e01-ac51-bd8cea841466 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1314 microversion: 2.1 time: 0.420099 Aug 27 03:21:41.718658 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1566/3152] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:41 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:41.723171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:41.728346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f5bcdcc2-55db-409b-831b-fc182f9cb4fe req-71c425db-e202-496a-9bdb-b10648081c7e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:41.731178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f5bcdcc2-55db-409b-831b-fc182f9cb4fe req-71c425db-e202-496a-9bdb-b10648081c7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:41.731661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f5bcdcc2-55db-409b-831b-fc182f9cb4fe req-71c425db-e202-496a-9bdb-b10648081c7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:41.760301 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f5bcdcc2-55db-409b-831b-fc182f9cb4fe req-71c425db-e202-496a-9bdb-b10648081c7e service nova] Creating event network-vif-plugged:33207100-80c1-4b21-97ac-d1e9c18ef7e5 for instance 3313d2b8-a2e8-400e-bc5f-c255af6095af on n-h2-852086-5 Aug 27 03:21:41.769605 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f5bcdcc2-55db-409b-831b-fc182f9cb4fe req-71c425db-e202-496a-9bdb-b10648081c7e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066576 Aug 27 03:21:41.774523 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1587/3153] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:41.806141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:41.806803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:41.820895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:41.821406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:41.821852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:41.823732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:41.826029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:41.828494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:42.135711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4af7b73c-9cd3-401c-86e2-dcbc046bd48f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460262790>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:42.239472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4af7b73c-9cd3-401c-86e2-dcbc046bd48f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/79619fa5-664f-4b2c-b081-1c3ce22098dc" status: 200 len: 662 microversion: 2.1 time: 0.113296 Aug 27 03:21:42.241702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1588/3154] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:42 2022] GET /compute/v2.1/images/79619fa5-664f-4b2c-b081-1c3ce22098dc => generated 662 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:42.255708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a38ca2e-d9ff-4cd1-a9c9-5c7c482514dc tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46023fee0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:42.352154 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a38ca2e-d9ff-4cd1-a9c9-5c7c482514dc tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/79619fa5-664f-4b2c-b081-1c3ce22098dc" status: 200 len: 662 microversion: 2.1 time: 0.100580 Aug 27 03:21:42.357236 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1589/3155] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:21:42 2022] GET /compute/v2.1/images/79619fa5-664f-4b2c-b081-1c3ce22098dc => generated 662 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:42.422621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:42.432913 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1192e019-db34-4f99-a604-3b6daa14a211 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 0.630672 Aug 27 03:21:42.433515 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1567/3156] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:41 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:42.487366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:42.488925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:42.499240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:42.500058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:42.500713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:42.501916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:42.502696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:42.503992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:42.648888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-60060425", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:42.801577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:21:42.825154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:42.844432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e4ee672-9b91-4ac3-a4d9-0434541d188f tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 200 len: 1522 microversion: 2.1 time: 0.361544 Aug 27 03:21:42.850860 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1590/3157] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:42 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:42.865460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:42.867854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:42.879678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:42.880875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:42.882877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:42.884599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:42.886742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:42.890735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:43.284667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:43.302789 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1314 microversion: 2.1 time: 0.448160 Aug 27 03:21:43.306791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1591/3158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:42 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:43.340796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:43.342141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001505 Aug 27 03:21:43.348897 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1592/3159] 10.222.0.69 () {56 vars in 886 bytes} [Sat Aug 27 03:21:43 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 03:21:43.357184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:43.359023 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001637 Aug 27 03:21:43.359491 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1593/3160] 10.222.0.69 () {54 vars in 1035 bytes} [Sat Aug 27 03:21:43 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 27 03:21:43.367169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:43.369016 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002455 Aug 27 03:21:43.370359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1594/3161] 10.222.0.69 () {54 vars in 1041 bytes} [Sat Aug 27 03:21:43 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:21:43.388863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:43.393267 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb4ceb00-65f0-48c0-b4f8-1999c9d0898b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004716 Aug 27 03:21:43.410534 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1595/3162] 10.222.0.69 () {56 vars in 886 bytes} [Sat Aug 27 03:21:43 2022] GET /compute/ => generated 377 bytes in 22 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 03:21:43.462626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:43.464057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:43.478316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:43.478814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:43.479243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:43.479962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:43.480694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:43.481477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:43.727548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:43.737460 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-75d73c8e-1ac8-4bae-a969-0086c69a4073 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1351 microversion: 2.1 time: 0.285987 Aug 27 03:21:43.738624 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1596/3163] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:43 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1351 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:43.824130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:21:43.834941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:21:43.836892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:21:43.838687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:21:43.840559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:21:43.851417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:43.852405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:43.853251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:43.854348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:43.855300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:43.856101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:43.875742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:43.876733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:43.886047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:43.887228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:43.888341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:43.890420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:43.891948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:43.892781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:43.917406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Getting quotas for project 0ab7129ea5d24ab19be52eba0b3e71f2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:43.943799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Getting quotas for user 4b806f7cf8fa47c797b25ad51429724b and project 0ab7129ea5d24ab19be52eba0b3e71f2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:43.974355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:21:43.977038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:44.053596 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9819fbe8-aa71-4d94-a348-8b244d87e0e7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414239 Aug 27 03:21:44.055124 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1568/3164] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:21:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:21:44.207555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:44.223989 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1637c3c0-a0e1-40dd-ae98-cffb59a3b9ad tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 200 len: 1522 microversion: 2.1 time: 0.353956 Aug 27 03:21:44.244336 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1597/3165] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:43 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:44.335455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:44.336443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:44.358404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:44.359487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:44.361630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:44.364311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:44.365091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:44.369972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:44.399324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-136717792", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:44.552026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:21:44.981199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:44.993605 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a29ae8ae-d504-4f64-91f5-6b6ce7f0a402 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1314 microversion: 2.1 time: 0.663741 Aug 27 03:21:45.003512 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1569/3166] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:44 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:45.015699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-25a7d210-c1cb-4ba6-abf8-def6a7ebd1fb req-72aa085e-b2ae-4e12-ba89-32f3e68d6ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdd1cc0-f3df-4014-9d3b-9008281ad483", "name": "network-vif-plugged", "status": "completed", "tag": "8a35c125-cd0b-43a8-b0a3-e962283922c0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:45.052283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-25a7d210-c1cb-4ba6-abf8-def6a7ebd1fb req-72aa085e-b2ae-4e12-ba89-32f3e68d6ddd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.052710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-25a7d210-c1cb-4ba6-abf8-def6a7ebd1fb req-72aa085e-b2ae-4e12-ba89-32f3e68d6ddd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.053160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-25a7d210-c1cb-4ba6-abf8-def6a7ebd1fb req-72aa085e-b2ae-4e12-ba89-32f3e68d6ddd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.083735 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-25a7d210-c1cb-4ba6-abf8-def6a7ebd1fb req-72aa085e-b2ae-4e12-ba89-32f3e68d6ddd service nova] Creating event network-vif-plugged:8a35c125-cd0b-43a8-b0a3-e962283922c0 for instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 on n-h1-852086-5 Aug 27 03:21:45.095365 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-25a7d210-c1cb-4ba6-abf8-def6a7ebd1fb req-72aa085e-b2ae-4e12-ba89-32f3e68d6ddd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088002 Aug 27 03:21:45.099020 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1570/3167] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:45.108821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:45.109864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:45.127788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.129357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.131841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.133593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.141600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.148677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.495828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:21:45.496878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:21:45.497544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:21:45.498789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:21:45.499387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:21:45.521518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.522407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.523099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.525519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.528886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.539756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.572787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Getting quotas for project 0ab7129ea5d24ab19be52eba0b3e71f2. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:21:45.584348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Getting quotas for user 4b806f7cf8fa47c797b25ad51429724b and project 0ab7129ea5d24ab19be52eba0b3e71f2. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:21:45.601080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:21:45.613086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:21:45.627167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:45.665807 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48780134-44c2-435e-a0b7-128eae6b6149 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1541 microversion: 2.1 time: 0.564397 Aug 27 03:21:45.666773 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1571/3168] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:45 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1541 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:45.697354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:45.699412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:45.714599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.730902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.731742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.736683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.737417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.740360 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-68646b06-baa6-41e1-ba75-3241c6569adb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346101 Aug 27 03:21:45.749400 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1598/3169] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:21:45.751257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.760018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-526c54f6-0382-4776-8c17-b0544e7bec67 req-3265dc30-3a6a-4d1d-8394-b76a65f72e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7285e8-4734-40d1-bc79-85aa46626d56", "name": "network-vif-deleted", "tag": "8c4c8fba-dd99-42db-ac7c-0a19afc27250"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:45.799949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-526c54f6-0382-4776-8c17-b0544e7bec67 req-3265dc30-3a6a-4d1d-8394-b76a65f72e24 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.807270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-526c54f6-0382-4776-8c17-b0544e7bec67 req-3265dc30-3a6a-4d1d-8394-b76a65f72e24 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.807807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-526c54f6-0382-4776-8c17-b0544e7bec67 req-3265dc30-3a6a-4d1d-8394-b76a65f72e24 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.813432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:45.834644 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-526c54f6-0382-4776-8c17-b0544e7bec67 req-3265dc30-3a6a-4d1d-8394-b76a65f72e24 service nova] Creating event network-vif-deleted:8c4c8fba-dd99-42db-ac7c-0a19afc27250 for instance ee7285e8-4734-40d1-bc79-85aa46626d56 on n-h1-852086-5 Aug 27 03:21:45.841764 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-526c54f6-0382-4776-8c17-b0544e7bec67 req-3265dc30-3a6a-4d1d-8394-b76a65f72e24 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084919 Aug 27 03:21:45.849445 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1599/3170] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:45.871756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:45.872347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:45.882864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.883778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.883778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.884869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.885661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.886395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.924694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:45.929419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:45.933171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:45.935837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lazy-loading 'fault' on Instance uuid ee7285e8-4734-40d1-bc79-85aa46626d56 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:21:46.064907 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-268e95b3-e55a-4f90-93a1-e9b89326754a tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211893 Aug 27 03:21:46.065508 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1600/3171] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:21:45 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:46.079961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2eee652d-93eb-4ba8-b83c-70be8c27abf2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:46.080792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2eee652d-93eb-4ba8-b83c-70be8c27abf2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:46.180049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:46.204048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f8e6c25-60ac-4251-ab18-1a2e4c2bbb00 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 200 len: 1313 microversion: 2.1 time: 0.528402 Aug 27 03:21:46.204578 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1572/3172] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:45 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:46.232796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:46.236785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:46.261082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:46.261721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:46.262198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:46.262964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:46.263505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:46.265886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:46.779569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2eee652d-93eb-4ba8-b83c-70be8c27abf2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:46.801216 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2eee652d-93eb-4ba8-b83c-70be8c27abf2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1217 microversion: 2.1 time: 0.725982 Aug 27 03:21:46.808433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1601/3173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:46 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1217 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:47.230491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:47.231227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:47.256693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:47.257364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:47.259047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:47.262561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:47.266361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:47.267196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:47.410248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:47.415930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:47.418990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:47.420425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lazy-loading 'fault' on Instance uuid ee7285e8-4734-40d1-bc79-85aa46626d56 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:21:47.476283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:47.493114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e216e713-7053-490a-8d70-03fc43f6ee13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1314 microversion: 2.1 time: 1.277264 Aug 27 03:21:47.508747 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1573/3174] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:46 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1314 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:47.691913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:47.699729 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc18d162-b2a4-471f-a948-def74ded2e80 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 200 len: 1313 microversion: 2.1 time: 0.473878 Aug 27 03:21:47.700312 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1602/3175] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:47 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:47.826849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:47.826849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:47.836046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:47.839911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:47.840485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:47.843022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:47.843704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:47.844311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.011187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:48.026051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40476fca-2c99-478f-a3bf-1e4e98272854 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1269 microversion: 2.1 time: 0.204837 Aug 27 03:21:48.039401 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1574/3176] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:47 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1269 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:48.211445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-10acf0b0-3ac5-40dc-bd38-f87d5431280f req-9d30a192-748a-4041-8cf5-7f6ce767f01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3313d2b8-a2e8-400e-bc5f-c255af6095af", "tag": "33207100-80c1-4b21-97ac-d1e9c18ef7e5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:48.232185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-10acf0b0-3ac5-40dc-bd38-f87d5431280f req-9d30a192-748a-4041-8cf5-7f6ce767f01d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:48.235496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-10acf0b0-3ac5-40dc-bd38-f87d5431280f req-9d30a192-748a-4041-8cf5-7f6ce767f01d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:48.238592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-10acf0b0-3ac5-40dc-bd38-f87d5431280f req-9d30a192-748a-4041-8cf5-7f6ce767f01d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.273455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-10acf0b0-3ac5-40dc-bd38-f87d5431280f req-9d30a192-748a-4041-8cf5-7f6ce767f01d service nova] Creating event network-changed:33207100-80c1-4b21-97ac-d1e9c18ef7e5 for instance 3313d2b8-a2e8-400e-bc5f-c255af6095af on n-h2-852086-5 Aug 27 03:21:48.290328 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-10acf0b0-3ac5-40dc-bd38-f87d5431280f req-9d30a192-748a-4041-8cf5-7f6ce767f01d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082823 Aug 27 03:21:48.291941 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1603/3177] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:48.517588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:48.518976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:48.552778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:48.553332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:48.553784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.554618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:48.555969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:48.556554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.725538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:48.726654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:48.745925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:48.746788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:48.747425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.748521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:48.752184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:48.753026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.792710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] HTTP exception thrown: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 HTTP/1.1 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ee7285e8-4734-40d1-bc79-85aa46626d56'} Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:48.794752 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:48.800319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:48.806616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 404 to user: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:48.807830 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10dbffc9-75e0-499d-b9cf-7cb55c53fdc0 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 404 len: 111 microversion: 2.1 time: 0.091151 Aug 27 03:21:48.808599 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1604/3178] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:48 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:48.822198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:48.832834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:48.834108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:48.859183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:48.860630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:48.861694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.867570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:48.868777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:48.869923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:48.991443 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34c95044-ffeb-4c18-afae-bfa647953c38 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.177425 Aug 27 03:21:48.993276 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1605/3179] 10.222.0.69 () {58 vars in 1230 bytes} [Sat Aug 27 03:21:48 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 03:21:49.010583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e56ab17f-7538-46f6-bbff-1e29423d4b04 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e56ab17f-7538-46f6-bbff-1e29423d4b04 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: action_args: {} Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 03:21:49.016929 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 03:21:49.021889 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.023306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e56ab17f-7538-46f6-bbff-1e29423d4b04 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:49.024344 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e56ab17f-7538-46f6-bbff-1e29423d4b04 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.021615 Aug 27 03:21:49.025984 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1606/3180] 10.222.0.69 () {58 vars in 1182 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:21:49.050062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.058342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:49.059632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:49.069883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.070724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.071386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.072662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.073427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.074118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.132072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:21:49.193124 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34389359-9a3d-48b0-9fe9-919eacb48297 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.153446 Aug 27 03:21:49.194201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1607/3181] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers => generated 683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:49.205744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.206893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:49.220607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.221936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.229211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.234202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.234326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.235059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.324711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:49.336556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4bf7bd36-1a7c-4926-95d3-87c10e19ae8e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1275 microversion: 2.1 time: 0.141071 Aug 27 03:21:49.350744 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1608/3182] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:49.358717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.368080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:49.368847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.servers [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Removing options 'limit' from query {{(pid=122407) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 03:21:49.371703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:49.381212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.382950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.384282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.385482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.386043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.386642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.426751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:21:49.473745 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d821cb0-e093-4b6e-a808-43f22273d0ef tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.134676 Aug 27 03:21:49.475045 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1609/3183] 10.222.0.69 () {58 vars in 1144 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:49.493375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41c8b701-0be2-46c4-9f2c-2876a76b7460 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41c8b701-0be2-46c4-9f2c-2876a76b7460 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: action_args: {} Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '-1' Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 03:21:49.500102 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 03:21:49.505490 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.506635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:49.510330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:49.511812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41c8b701-0be2-46c4-9f2c-2876a76b7460 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:49.515113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41c8b701-0be2-46c4-9f2c-2876a76b7460 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.028354 Aug 27 03:21:49.518727 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1610/3184] 10.222.0.69 () {58 vars in 1142 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:21:49.530791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e9b29f1-b2d1-4ba8-9ba4-341a0fa8a02d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1502 microversion: 2.1 time: 1.011144 Aug 27 03:21:49.532059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ae4f32c-530a-4354-b2c7-71ec8f1ad070 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.541446 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1575/3185] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:48 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1502 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ae4f32c-530a-4354-b2c7-71ec8f1ad070 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: action_args: {} Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'testing' Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 03:21:49.575898 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ae4f32c-530a-4354-b2c7-71ec8f1ad070 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2ae4f32c-530a-4354-b2c7-71ec8f1ad070 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.054583 Aug 27 03:21:49.584803 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1611/3186] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:21:49.588536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:49.588536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:49.619858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.621090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.621820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.622873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.624305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.625002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.647451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e2ac895-cc5e-455f-9a53-f1875fa3f152 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.698614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e2ac895-cc5e-455f-9a53-f1875fa3f152 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:49.700098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1e2ac895-cc5e-455f-9a53-f1875fa3f152 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:49.719498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.servers [None req-1e2ac895-cc5e-455f-9a53-f1875fa3f152 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Flavor 'non_existing_flavor' could not be found {{(pid=122407) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 27 03:21:49.722712 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e2ac895-cc5e-455f-9a53-f1875fa3f152 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.128615 Aug 27 03:21:49.737825 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1612/3187] 10.222.0.69 () {58 vars in 1178 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:21:49.751429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.756900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:49.762704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:49.785890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.786662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.787440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.789017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.790629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.792120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.842327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d25fd24-c6c0-4d06-8a09-01a74d44f89d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483/action" status: 202 len: 0 microversion: 2.1 time: 0.276618 Aug 27 03:21:49.849668 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1576/3188] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:21:49 2022] POST /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:21:49.860479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:49.861497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:49.889010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.895640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.896422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:49.906052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:49.906842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:49.907486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:50.008687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e7a1f9f8-aaec-4a26-a6b3-392fd8bf16a9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.269099 Aug 27 03:21:50.009454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1613/3189] 10.222.0.69 () {58 vars in 1174 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:21:50.026516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:50.035504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:50.049454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:50.055434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:50.056052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:50.056617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:50.057473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:50.058044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:50.058597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:50.166479 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b315324-d0fd-4736-806e-b8552124f4b9 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.145621 Aug 27 03:21:50.168649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1614/3190] 10.222.0.69 () {58 vars in 1184 bytes} [Sat Aug 27 03:21:50 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:21:50.181037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:50.186007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:50.188345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:50.194097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:50.194734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:50.195252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:50.196067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:50.196601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:50.197030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:50.250944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:21:50.320755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:50.333311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:50.333970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:50.336325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:50.598349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b14f067b-3a8f-493e-a689-e23bb6ab14b6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.420948 Aug 27 03:21:50.599614 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1615/3191] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:21:50 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:50.604964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:50.605893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:50.615156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:50.615977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:50.616773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:50.617777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:50.621723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:50.623212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.227119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:51.241965 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f8aaf75-68db-4d6d-83b3-e0325ed1fc9a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1507 microversion: 2.1 time: 1.387170 Aug 27 03:21:51.244779 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1577/3192] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:49 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1507 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:51.254008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:51.257152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb7c4306-5667-4d84-b02b-6adbc188b4e4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:51.274306 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f744064-d732-4274-8061-3a2e584d6f0b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1275 microversion: 2.1 time: 0.673227 Aug 27 03:21:51.275419 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1616/3193] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:50 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1275 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:51.303351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb7c4306-5667-4d84-b02b-6adbc188b4e4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:51.307021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb7c4306-5667-4d84-b02b-6adbc188b4e4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.060997 Aug 27 03:21:51.307964 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1578/3194] 10.222.0.69 () {58 vars in 1178 bytes} [Sat Aug 27 03:21:51 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:21:51.321916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:51.329541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:51.330285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Searching by: {'deleted': False, 'project_id': 'c670549bdc2e422186be64a789342395'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:21:51.338409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.339665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.340605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.342656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.344979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.347696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.387846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:21:51.439427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a14789e7-0fed-4c2c-9048-04d8e8cd1eb6 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.121705 Aug 27 03:21:51.440898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1617/3195] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:21:51 2022] GET /compute/v2.1/servers => generated 683 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:51.453116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:51.453634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:51.459939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.460440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.461111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.462096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.462755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.463361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.481816 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] HTTP exception thrown: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 HTTP/1.1 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ee7285e8-4734-40d1-bc79-85aa46626d56'} Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:51.485472 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:51.490475 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:51.492205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 404 to user: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:51.493258 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a6d76da-e681-4d57-8c61-3f63b930b134 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 404 len: 111 microversion: 2.1 time: 0.044607 Aug 27 03:21:51.503564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:51.504591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:51.508292 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1579/3196] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:51 2022] DELETE /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:51.511819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.512544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.513331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.514319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.514966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.515569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.593020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:51.832532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:51.833369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:51.851404 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd35262a-07c0-4e14-91e5-1b9b48d324ce tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 204 len: 0 microversion: 2.1 time: 0.349557 Aug 27 03:21:51.852984 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1618/3197] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:51 2022] DELETE /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:51.870283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.871824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:51.872577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.873040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:51.874709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.878428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.879254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.879997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.884784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.885850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.886573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.888131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:51.890979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:51.891938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:51.957689 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88347a2f-a467-46b6-bea1-0729140b7080 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/ips" status: 200 len: 151 microversion: 2.20 time: 0.134156 Aug 27 03:21:51.959355 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1580/3198] 10.222.0.69 () {60 vars in 1289 bytes} [Sat Aug 27 03:21:51 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/ips => generated 151 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:21:51.980037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:52.152610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:52.231026 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eb8247d6-aecf-458d-bc54-21ba47ac6c87 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "DELETE /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 204 len: 0 microversion: 2.1 time: 0.370833 Aug 27 03:21:52.233946 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1619/3199] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:51 2022] DELETE /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:52.245876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:52.249883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: ee7285e8-4734-40d1-bc79-85aa46626d56] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:52.259614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:52.260553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:52.261407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:52.262798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:52.263719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:52.278887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:52.280512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:52.284227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:52.304021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:52.305996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:52.309439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:52.312212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:52.316856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:52.321652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:52.354797 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] HTTP exception thrown: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 HTTP/1.1 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ee7285e8-4734-40d1-bc79-85aa46626d56'} Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:52.358960 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. Aug 27 03:21:52.364295 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:21:52.367033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 404 to user: Instance ee7285e8-4734-40d1-bc79-85aa46626d56 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:52.368310 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9baa8a0-dfd6-4a95-b8fc-23ea98b26e71 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56" status: 404 len: 111 microversion: 2.1 time: 0.129387 Aug 27 03:21:52.371597 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1581/3200] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:52 2022] GET /compute/v2.1/servers/ee7285e8-4734-40d1-bc79-85aa46626d56 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:21:52.381379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:52.387314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:52.414151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:52.414874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:52.418821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:52.424299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:52.426322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:52.429122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:52.990495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:53.018938 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4c22e2f-d3b9-4492-87da-31f65cf0ad23 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1487 microversion: 2.1 time: 0.749917 Aug 27 03:21:53.030210 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1620/3201] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:52 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1487 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:53.034998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:53.039010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:53.049579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:53.050512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:53.050964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:53.051696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:53.052651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:53.053085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:53.313790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:53.336897 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73894ec3-235c-4ce4-9032-16399f7a020c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.956269 Aug 27 03:21:53.342962 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1582/3202] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:52 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:53.357147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:53.358581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:53.371186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:53.371959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:53.372605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:53.374053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:53.375413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:53.375833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:53.396423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:53.419059 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-69261335-c7b4-46aa-97da-f6dfeb641db8 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 200 len: 1522 microversion: 2.1 time: 0.396986 Aug 27 03:21:53.422584 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1621/3203] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:53 2022] GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:53.453371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:21:53.626817 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8dd6253f-106c-425b-954f-3aa6e93b55b0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 204 len: 0 microversion: 2.1 time: 0.281754 Aug 27 03:21:53.627809 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1583/3204] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:21:53 2022] DELETE /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:53.642672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:53.645265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:53.664062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:53.665796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:53.667398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:53.669082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:53.671159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:53.674072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:53.788025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-def6765d-8796-4559-8def-d0735a3d3771 req-8d3eae44-b15e-4a02-a7a1-12e4940418f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db62fb2-3b79-46b8-baec-890abe5107ed", "tag": "ca02f050-9d97-48b8-b99f-d385fa15b569"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:53.837637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-def6765d-8796-4559-8def-d0735a3d3771 req-8d3eae44-b15e-4a02-a7a1-12e4940418f6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:53.840138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-def6765d-8796-4559-8def-d0735a3d3771 req-8d3eae44-b15e-4a02-a7a1-12e4940418f6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:53.840908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-def6765d-8796-4559-8def-d0735a3d3771 req-8d3eae44-b15e-4a02-a7a1-12e4940418f6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:53.866335 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-def6765d-8796-4559-8def-d0735a3d3771 req-8d3eae44-b15e-4a02-a7a1-12e4940418f6 service nova] Creating event network-changed:ca02f050-9d97-48b8-b99f-d385fa15b569 for instance 1db62fb2-3b79-46b8-baec-890abe5107ed on n-h1-852086-5 Aug 27 03:21:53.878551 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-def6765d-8796-4559-8def-d0735a3d3771 req-8d3eae44-b15e-4a02-a7a1-12e4940418f6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119068 Aug 27 03:21:53.879246 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1584/3205] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:54.030916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:54.040300 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7a0a480-c0a6-47db-a574-25427e262d0a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1493 microversion: 2.1 time: 0.407570 Aug 27 03:21:54.042225 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1622/3206] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:53 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1493 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:54.364409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:54.365335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:54.368196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:54.369583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:54.376318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:54.376823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:54.377267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:54.378217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:54.378684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:54.379116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:54.445914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:54.445914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:54.447615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:21:54.452718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:54.453432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:54.454215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:54.455260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:54.457366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:54.458491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:54.751375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:54.761691 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4fe10732-f6ef-433c-80de-43417b6fad2c tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 200 len: 1522 microversion: 2.1 time: 0.323993 Aug 27 03:21:54.762956 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1623/3207] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:54 2022] GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:54.771249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cc333922-d309-485c-b0a3-2c9b5c0f5162 req-2c069e78-8e8d-458f-928c-65484c46e418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e086890c-6209-43d2-a7e7-aa5a748c3479", "tag": "f25d42fc-04e2-4a77-ac61-a04dc1cff23c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:54.787327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc333922-d309-485c-b0a3-2c9b5c0f5162 req-2c069e78-8e8d-458f-928c-65484c46e418 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:54.788527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc333922-d309-485c-b0a3-2c9b5c0f5162 req-2c069e78-8e8d-458f-928c-65484c46e418 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:54.789166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc333922-d309-485c-b0a3-2c9b5c0f5162 req-2c069e78-8e8d-458f-928c-65484c46e418 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:54.813419 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cc333922-d309-485c-b0a3-2c9b5c0f5162 req-2c069e78-8e8d-458f-928c-65484c46e418 service nova] Creating event network-changed:f25d42fc-04e2-4a77-ac61-a04dc1cff23c for instance e086890c-6209-43d2-a7e7-aa5a748c3479 on n-h2-852086-5 Aug 27 03:21:54.830925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cc333922-d309-485c-b0a3-2c9b5c0f5162 req-2c069e78-8e8d-458f-928c-65484c46e418 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064695 Aug 27 03:21:54.836560 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1624/3208] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:54.846312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:54.865815 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f83ae2a9-dfd0-45f3-890d-d8e1f9b647df tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.505789 Aug 27 03:21:54.882363 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1585/3209] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:54 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:55.066551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:55.067334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:55.090120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:55.090659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:55.091109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:55.091890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:55.100809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:55.101379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:55.470073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:55.484490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7cecb47c-d5d5-498e-b5ed-8c2bcef69a19 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1493 microversion: 2.1 time: 0.424031 Aug 27 03:21:55.485145 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1625/3210] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:55 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1493 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:55.554530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:55.556200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:55.575826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:55.576392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:55.577665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:55.579241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:55.579734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:55.580173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:55.641777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lazy-loading 'flavor' on Instance uuid b3889386-64a2-4858-af6e-009e8606df9f {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:21:55.787745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:55.788650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:55.816668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:55.817563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:55.822794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:55.823981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:55.824816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:55.825613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:56.028604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:56.046489 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff0e28f3-f085-44df-a0c4-e224b4001006 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 200 len: 1480 microversion: 2.1 time: 0.262069 Aug 27 03:21:56.049574 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1626/3211] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:55 2022] GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 1480 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:56.059735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:56.066807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:56.084563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:56.085881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:56.087988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:56.090011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:56.091279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:56.095871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:56.117765 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03615adf-7257-4753-8dd1-9fc78ecfdba7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/action" status: 202 len: 0 microversion: 2.20 time: 0.566980 Aug 27 03:21:56.126441 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1586/3212] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:21:55 2022] POST /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:21:56.132497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:56.136284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:56.166846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:56.167719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:56.169035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:56.172939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:56.173676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:56.174226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:56.594543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:56.618367 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39152292-69a3-4601-9b17-796837b57c8c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.565248 Aug 27 03:21:56.620488 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1627/3213] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:56 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:56.631452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6a8ab9fe-8544-49f2-93f5-686d052e4f93 req-4f9629b8-685c-49b7-a0ed-a25055964d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103b34dc-98d7-44fa-b092-70934c1e9662", "name": "network-vif-deleted", "tag": "5cdca756-8336-46ca-b93e-d0824812d9ea"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:56.657931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6a8ab9fe-8544-49f2-93f5-686d052e4f93 req-4f9629b8-685c-49b7-a0ed-a25055964d62 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:56.658590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6a8ab9fe-8544-49f2-93f5-686d052e4f93 req-4f9629b8-685c-49b7-a0ed-a25055964d62 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:56.659303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6a8ab9fe-8544-49f2-93f5-686d052e4f93 req-4f9629b8-685c-49b7-a0ed-a25055964d62 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:56.686901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6a8ab9fe-8544-49f2-93f5-686d052e4f93 req-4f9629b8-685c-49b7-a0ed-a25055964d62 service nova] Creating event network-vif-deleted:5cdca756-8336-46ca-b93e-d0824812d9ea for instance 103b34dc-98d7-44fa-b092-70934c1e9662 on n-h1-852086-5 Aug 27 03:21:56.696282 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6a8ab9fe-8544-49f2-93f5-686d052e4f93 req-4f9629b8-685c-49b7-a0ed-a25055964d62 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068650 Aug 27 03:21:56.701907 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1628/3214] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:56.718854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:56.723755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:56.743265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:56.743894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:56.745090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:56.746022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:56.754847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:56.755764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:57.095793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:57.111585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02b1510f-92cf-4538-ae50-e62e45412f54 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1493 microversion: 2.1 time: 0.408055 Aug 27 03:21:57.112254 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1629/3215] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:56 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1493 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:57.126180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-92ea73d4-da38-416c-868e-e79cb526ed55 req-ca3c4fab-684a-4dae-985b-e1f1117ec4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0", "name": "network-vif-deleted", "tag": "7b68713a-88f1-4833-9fa2-b30481309020"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:57.140528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-92ea73d4-da38-416c-868e-e79cb526ed55 req-ca3c4fab-684a-4dae-985b-e1f1117ec4e0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:57.142814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-92ea73d4-da38-416c-868e-e79cb526ed55 req-ca3c4fab-684a-4dae-985b-e1f1117ec4e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:57.143255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-92ea73d4-da38-416c-868e-e79cb526ed55 req-ca3c4fab-684a-4dae-985b-e1f1117ec4e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:57.206313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-92ea73d4-da38-416c-868e-e79cb526ed55 req-ca3c4fab-684a-4dae-985b-e1f1117ec4e0 service nova] Creating event network-vif-deleted:7b68713a-88f1-4833-9fa2-b30481309020 for instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 on n-h2-852086-5 Aug 27 03:21:57.226080 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-92ea73d4-da38-416c-868e-e79cb526ed55 req-ca3c4fab-684a-4dae-985b-e1f1117ec4e0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109116 Aug 27 03:21:57.227463 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1630/3216] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:57.237375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:57.238347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:57.268886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:57.269381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:57.270008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:57.271282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:57.273233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:57.274894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:57.367906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:57.370689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:57.371181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:57.371643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lazy-loading 'fault' on Instance uuid 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:21:57.411444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:57.437512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:57.440395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:57.454317 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-857c165a-5c9d-4fcf-9c03-c4aa15ff202c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 1.318182 Aug 27 03:21:57.456201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1587/3217] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:56 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:21:57.477544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:57.497014 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7485403c-3090-4f41-9e52-e454b740a978 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 200 len: 1313 microversion: 2.1 time: 0.264697 Aug 27 03:21:57.506588 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1631/3218] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:57 2022] GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:57.655007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:57.656071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:57.665685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:57.667107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:57.667793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:57.668767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:57.670078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:57.670741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.142011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:58.143256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:58.169262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:58.174694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:58.180235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.181437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:58.182519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:58.183290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.338941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:58.339197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:58.368793 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d67b9ee-3e1a-4e14-89e5-590ab256ceae tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.719135 Aug 27 03:21:58.381571 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-779550cd-70e7-42a1-8fc9-8f906a3535ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1451 microversion: 2.1 time: 0.248275 Aug 27 03:21:58.382810 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1588/3219] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:57 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:58.401486 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1632/3220] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:58 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1451 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:21:58.483332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:58.485042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:58.500640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:58.501626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:58.502386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.503599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:58.504350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:58.505047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.533232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:58.534896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:58.570831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:58.572251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:58.574403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.577818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:58.579742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:58.581142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.634055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:58.634837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:58.635434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:58.636723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lazy-loading 'fault' on Instance uuid 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:21:58.711529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6625d9a4f3ea498fb35e0095f4f1ede2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c670549bdc2e422186be64a789342395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:58.725739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91d8ceb5-a86a-48d4-bfb0-1d155d0ebda4 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 200 len: 1313 microversion: 2.1 time: 0.199234 Aug 27 03:21:58.727058 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1633/3221] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:58 2022] GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:58.856315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:58.868795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:58.870433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:58.879831 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7865fa31-beb9-4d41-96fd-8bcb2fea16c9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.402801 Aug 27 03:21:58.880591 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1589/3222] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:58 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:21:59.270405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-62cb556a-eca3-4c2e-9f5c-385b9ade827d req-7ba1a52a-9bea-4639-8396-8ef5892eaaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdd1cc0-f3df-4014-9d3b-9008281ad483", "name": "network-vif-deleted", "tag": "8a35c125-cd0b-43a8-b0a3-e962283922c0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:21:59.293809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-62cb556a-eca3-4c2e-9f5c-385b9ade827d req-7ba1a52a-9bea-4639-8396-8ef5892eaaf7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.294340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-62cb556a-eca3-4c2e-9f5c-385b9ade827d req-7ba1a52a-9bea-4639-8396-8ef5892eaaf7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.294783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-62cb556a-eca3-4c2e-9f5c-385b9ade827d req-7ba1a52a-9bea-4639-8396-8ef5892eaaf7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.313357 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-62cb556a-eca3-4c2e-9f5c-385b9ade827d req-7ba1a52a-9bea-4639-8396-8ef5892eaaf7 service nova] Creating event network-vif-deleted:8a35c125-cd0b-43a8-b0a3-e962283922c0 for instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 on n-h1-852086-5 Aug 27 03:21:59.319743 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-62cb556a-eca3-4c2e-9f5c-385b9ade827d req-7ba1a52a-9bea-4639-8396-8ef5892eaaf7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054946 Aug 27 03:21:59.320998 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1634/3223] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:21:59.398531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:59.400041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:59.421519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.428274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:59.429017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:59.432523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.434085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.435218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.437894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.438954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.440909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.444090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.445072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.447822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.449364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.453029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.630762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:59.647864 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b15e82bb-8879-4ea0-8ab8-12a381722405 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 200 len: 1284 microversion: 2.1 time: 0.224571 Aug 27 03:21:59.651927 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1635/3224] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:59 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 1284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:21:59.755682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:59.756867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:59.765962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.766579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.767075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.767872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.768408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.768882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.815592 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] HTTP exception thrown: Instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 could not be found. Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 HTTP/1.1 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 could not be found. Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0'} Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 could not be found. Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 could not be found. Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.818462 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 could not be found. Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 404 to user: Instance 6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-127d0e76-764a-4ce0-9b51-4c1fecea35aa tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0" status: 404 len: 111 microversion: 2.1 time: 0.069864 Aug 27 03:21:59.827875 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1636/3225] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:59 2022] GET /compute/v2.1/servers/6cc3c6ad-7f75-44f4-a705-5c7ea911cfd0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:21:59.857399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:59.859119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] [instance: 103b34dc-98d7-44fa-b092-70934c1e9662] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:59.869243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.869944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.876845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.876845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.876845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.876845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.907836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] HTTP exception thrown: Instance 103b34dc-98d7-44fa-b092-70934c1e9662 could not be found. Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Request method failure captured: Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 HTTP/1.1 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2ciWHZJ7waOvONCLIERyrW5fljjOOtFbBcuwA9CAGPq-f8lMsZ_dnp_2xL_srZdagJ3DMrCJQFB6iEI2IuMU2GYQvnCYHE0Zyf_uBotgNnBiNkwErP3hcRlv3cUbdm2yPyOppm81z56EUlC5Q1Wic1SSI3qrEagfhH_pG4YfgRv5U Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c670549bdc2e422186be64a789342395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c670549bdc2e422186be64a789342395", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c670549bdc2e422186be64a789342395"}]}] Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c670549bdc2e422186be64a789342395 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1487290488 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6625d9a4f3ea498fb35e0095f4f1ede2 Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListServersNegativeTestJSON-1487290488-project Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 103b34dc-98d7-44fa-b092-70934c1e9662 could not be found. Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '103b34dc-98d7-44fa-b092-70934c1e9662'} Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103b34dc-98d7-44fa-b092-70934c1e9662 could not be found. Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103b34dc-98d7-44fa-b092-70934c1e9662 could not be found. Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.910980 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103b34dc-98d7-44fa-b092-70934c1e9662 could not be found. Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] Returning 404 to user: Instance 103b34dc-98d7-44fa-b092-70934c1e9662 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9f7d3ad4-7283-4d8e-9de6-dc4205e1d7c2 tempest-ListServersNegativeTestJSON-1487290488 tempest-ListServersNegativeTestJSON-1487290488-project] 10.222.0.69 "GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662" status: 404 len: 111 microversion: 2.1 time: 0.081141 Aug 27 03:21:59.918793 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1637/3226] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:59 2022] GET /compute/v2.1/servers/103b34dc-98d7-44fa-b092-70934c1e9662 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:21:59.923256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:21:59.923869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:21:59.947758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.947975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:21:59.948628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.948628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.949375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:21:59.949847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:21:59.950317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:21:59.984249 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e303b7fd-0eef-4f80-8130-81bce15c7d2e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.592678 Aug 27 03:21:59.991127 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1590/3227] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:21:59 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:00.302414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:00.317385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:00.319699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:00.321465 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b43ba88-3d54-4a6a-bb52-6b0e93af5685 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.402038 Aug 27 03:22:00.322994 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1638/3228] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:21:59 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:00.677698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:00.679233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:00.694189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:00.694709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:00.695242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:00.695912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:00.696609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:00.697421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:00.711432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:00.737875 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 HTTP/1.1 Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'dcdd1cc0-f3df-4014-9d3b-9008281ad483'} Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:22:00.739766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:22:00.744030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:00.744030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:22:00.744030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:22:00.744030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:22:00.744030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:22:00.744030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:22:00.744030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:22:00.746275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:22:00.747414 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0655249-54b2-4a9d-b895-318b19cbe150 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 404 len: 111 microversion: 2.1 time: 0.074429 Aug 27 03:22:00.748598 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1591/3229] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:00 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:22:00.893435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-904736868", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "be792eba-f4b7-46b8-9127-1ca32ef532fe"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:00.906876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:00.971679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] validate_networks() for [('be792eba-f4b7-46b8-9127-1ca32ef532fe', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:22:01.024797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:01.025532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:01.039850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:01.041611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:01.042358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:01.047130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:01.048015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:01.048732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:01.369116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=16 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:01.385331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:01.416709 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d55dbb65-ab62-43d6-a03f-f3ebc24ba350 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.395595 Aug 27 03:22:01.420929 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1592/3230] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:01 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:01.445326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:01.447084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:01.483264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:01.486039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:01.486821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:01.491271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:01.492810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:01.493799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:01.757661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:01.772634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:01.775577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:01.776929 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c360cd1-3963-4163-8a20-3beb6c33c68f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.353357 Aug 27 03:22:01.777923 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1593/3231] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:01 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:02.450709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:02.452329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:02.464948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:02.471040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:02.487203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:02.488848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:02.489628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:02.490913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:02.588495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:22:02.593037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:22:02.595232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:22:02.598357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:22:02.599030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:22:02.649414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:02.655171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:02.655748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:02.657452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:02.658599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:02.663390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:02.740300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:22:02.747662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for user 267cffdb49624ff986aed20fd255b1db and project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:22:02.790600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:22:02.794432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:22:02.864989 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50605d7a-0fc0-4368-b74d-1eee5fc83135 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.975609 Aug 27 03:22:02.866116 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1639/3232] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:22:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:22:02.883999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-828c66b8-cf9c-4e93-9e9a-1892970f133e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:02.884933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-828c66b8-cf9c-4e93-9e9a-1892970f133e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:02.907583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:02.918840 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5d863a2-adc7-4b60-b622-23d5e25c1a5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.472653 Aug 27 03:22:02.930749 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1594/3233] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:02 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:02.939139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:02.940180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:02.955531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:02.960575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:02.961610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:02.962820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:02.964792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:02.966268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:02.967907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:03.080131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-828c66b8-cf9c-4e93-9e9a-1892970f133e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:03.094275 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-828c66b8-cf9c-4e93-9e9a-1892970f133e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1214 microversion: 2.1 time: 0.218166 Aug 27 03:22:03.095578 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1640/3234] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:02 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:03.230062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:03.247623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:03.254436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:03.256029 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bdefda8-2063-4d48-b1e4-73abfbed11ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.323664 Aug 27 03:22:03.257521 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1595/3235] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:02 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:03.618589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f1349025-5b59-4c9f-a171-5ab7166c0387 req-cb19df08-64d7-425b-8dbb-3e42ac066388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e086890c-6209-43d2-a7e7-aa5a748c3479", "name": "network-vif-plugged", "status": "completed", "tag": "f25d42fc-04e2-4a77-ac61-a04dc1cff23c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:03.641527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f1349025-5b59-4c9f-a171-5ab7166c0387 req-cb19df08-64d7-425b-8dbb-3e42ac066388 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:03.647623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f1349025-5b59-4c9f-a171-5ab7166c0387 req-cb19df08-64d7-425b-8dbb-3e42ac066388 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:03.648724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f1349025-5b59-4c9f-a171-5ab7166c0387 req-cb19df08-64d7-425b-8dbb-3e42ac066388 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:03.675961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f1349025-5b59-4c9f-a171-5ab7166c0387 req-cb19df08-64d7-425b-8dbb-3e42ac066388 service nova] Creating event network-vif-plugged:f25d42fc-04e2-4a77-ac61-a04dc1cff23c for instance e086890c-6209-43d2-a7e7-aa5a748c3479 on n-h2-852086-5 Aug 27 03:22:03.713930 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f1349025-5b59-4c9f-a171-5ab7166c0387 req-cb19df08-64d7-425b-8dbb-3e42ac066388 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095001 Aug 27 03:22:03.718039 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1641/3236] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:03.942688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:03.943304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:03.959122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:03.959639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:03.962492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:03.964102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:03.964589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:03.966528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:04.144236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:04.145770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:04.173646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:04.174140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:04.174613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:04.175329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:04.175792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:04.176220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:04.234642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:04.327085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:04.335362 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-627f57e8-d380-4bbb-b0d4-f004a1fa4c55 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1266 microversion: 2.1 time: 0.221355 Aug 27 03:22:04.350343 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1642/3237] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:04 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:04.368106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:04.368744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:04.375199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:04.386360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:04.386680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:04.387339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:04.388622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:04.394138 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc16fa27-d3ac-4178-a0fd-5838a4653f4c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.455159 Aug 27 03:22:04.396166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:04.400166 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1596/3238] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:03 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:04.400569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:04.704150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:04.720503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:04.725718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:04.729825 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a81b6fb9-212b-4f93-9870-b9d54c4e60fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.369982 Aug 27 03:22:04.730861 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1643/3239] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:04 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:05.367904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:05.369820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:05.383271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:05.383271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:05.383737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:05.385612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:05.388376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:05.391063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:05.439744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:05.442089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:05.459375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:05.459595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:05.460337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:05.462348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:05.463099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:05.464488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:05.534785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:05.551007 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc5c492b-946c-4835-a918-fa303701cfeb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1272 microversion: 2.1 time: 0.192581 Aug 27 03:22:05.552779 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1597/3240] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:05 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:05.761099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-33a79fd2-bdba-41e4-8e2e-3262359eba73 req-0c2b37cc-29f8-41b6-b3af-3c6e165575ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db62fb2-3b79-46b8-baec-890abe5107ed", "name": "network-vif-plugged", "status": "completed", "tag": "ca02f050-9d97-48b8-b99f-d385fa15b569"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:05.816776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-33a79fd2-bdba-41e4-8e2e-3262359eba73 req-0c2b37cc-29f8-41b6-b3af-3c6e165575ba service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:05.817360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-33a79fd2-bdba-41e4-8e2e-3262359eba73 req-0c2b37cc-29f8-41b6-b3af-3c6e165575ba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:05.821510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-33a79fd2-bdba-41e4-8e2e-3262359eba73 req-0c2b37cc-29f8-41b6-b3af-3c6e165575ba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:05.861857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:05.871987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-33a79fd2-bdba-41e4-8e2e-3262359eba73 req-0c2b37cc-29f8-41b6-b3af-3c6e165575ba service nova] Creating event network-vif-plugged:ca02f050-9d97-48b8-b99f-d385fa15b569 for instance 1db62fb2-3b79-46b8-baec-890abe5107ed on n-h1-852086-5 Aug 27 03:22:05.882273 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b8f6a3a0-9356-4959-90be-24bacc4e42db tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.459544 Aug 27 03:22:05.883121 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1644/3241] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:05 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:05.890052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:05.890379 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-33a79fd2-bdba-41e4-8e2e-3262359eba73 req-0c2b37cc-29f8-41b6-b3af-3c6e165575ba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130106 Aug 27 03:22:05.890911 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1598/3242] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:22:05.891631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:05.903638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:05.905492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:05.907192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:05.908512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:05.909188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:05.909802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:06.168543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:06.179532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:06.181714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:06.183350 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59b0d0ef-ddc8-41c7-8b87-8940c7216f95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.299206 Aug 27 03:22:06.184754 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1645/3243] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:05 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:06.608868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:06.614039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:06.628736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:06.630477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:06.631617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:06.633604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:06.634776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:06.636034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:06.754890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:06.766018 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b3ce38c-59b3-41bd-8740-87e629f03132 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1272 microversion: 2.1 time: 0.176727 Aug 27 03:22:06.767218 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1599/3244] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:06 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:06.921195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:06.922491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:06.949007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:06.950924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:06.956329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:06.958148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:06.959402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:06.961944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:07.239958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:07.240876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:07.291630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:07.294629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:07.295678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:07.297144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:07.298248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:07.299223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:07.624509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:07.726951 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f8eb566-e269-4104-83f6-ee6e598db62f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1317 microversion: 2.1 time: 0.823156 Aug 27 03:22:07.741335 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1646/3245] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:06 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:07.800137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:07.807305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:07.850010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:07.852605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:07.854659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:07.858312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:07.859469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:07.860462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:07.943544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:07.964276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:07.974417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:07.975788 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-54b4bc7b-12d2-43ac-87c9-513b3f3efbb2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.740957 Aug 27 03:22:07.986600 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1600/3246] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:07 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:08.342394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:08.384259 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d8a99838-049c-4837-9195-a08bec75a9ca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1314 microversion: 2.1 time: 0.597401 Aug 27 03:22:08.387589 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1647/3247] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:07 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:08.720701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d0e72c00-7ae9-4bec-b010-0635eeb884d9 req-77be7ec5-db43-422c-b5d8-17cbe8861710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6", "tag": "40aff499-2cc1-4a03-9858-ded77b579266"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:08.733697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0e72c00-7ae9-4bec-b010-0635eeb884d9 req-77be7ec5-db43-422c-b5d8-17cbe8861710 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:08.734496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0e72c00-7ae9-4bec-b010-0635eeb884d9 req-77be7ec5-db43-422c-b5d8-17cbe8861710 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:08.735215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0e72c00-7ae9-4bec-b010-0635eeb884d9 req-77be7ec5-db43-422c-b5d8-17cbe8861710 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:08.752762 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d0e72c00-7ae9-4bec-b010-0635eeb884d9 req-77be7ec5-db43-422c-b5d8-17cbe8861710 service nova] Creating event network-changed:40aff499-2cc1-4a03-9858-ded77b579266 for instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 on n-h1-852086-5 Aug 27 03:22:08.762151 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d0e72c00-7ae9-4bec-b010-0635eeb884d9 req-77be7ec5-db43-422c-b5d8-17cbe8861710 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046600 Aug 27 03:22:08.764458 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1601/3248] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:22:08.769071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:08.771625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:08.788516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:08.789824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:08.790650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:08.792784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:08.794373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:08.795792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.028812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:09.034542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:09.053125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.054251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.060054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.061699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.062664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.063578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.191292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:09.207929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6c4206be-3dac-4230-9d86-a66bf767cce5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1466 microversion: 2.1 time: 0.445918 Aug 27 03:22:09.219303 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1648/3249] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:08 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1466 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:09.247431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:09.249797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:09.262352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.264574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.266251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.267750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.268588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.269265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.533071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:09.547326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:09.550581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:09.552836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:09.554390 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b123b0e-bb09-4b9d-91be-0e40ead69fa7 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.536082 Aug 27 03:22:09.587413 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7eada5f7-d351-4143-ad14-0da9bff385bb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 1466 microversion: 2.1 time: 0.347171 Aug 27 03:22:09.591077 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1602/3250] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:09 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:22:09.600375 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1649/3251] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:09 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 1466 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:09.605936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:09.609912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:09.626031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.627196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.627917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.628940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.629648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.630342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.630483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1557171914"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:09.634765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:09.642556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.643400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.644031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.645095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:09.645715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:09.646316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:09.945173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:09.962396 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e6848ed-e37f-4511-b591-a8e65cbac89c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1314 microversion: 2.1 time: 0.368791 Aug 27 03:22:09.963314 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1603/3252] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:09 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:10.102421 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fe0b9a98-1336-486c-86b2-32dc43ce1ffe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "POST /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479/action" status: 202 len: 0 microversion: 2.1 time: 0.477673 Aug 27 03:22:10.106010 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1650/3253] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:22:09 2022] POST /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:22:10.115567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96247bf1-3218-47b1-8218-169313f9d8c3 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460353dc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:10.187921 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-96247bf1-3218-47b1-8218-169313f9d8c3 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.073855 Aug 27 03:22:10.188830 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1604/3254] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:10 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:10.598081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:10.599208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:10.611307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:10.612084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:10.612609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:10.613927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:10.614694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:10.615222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:10.881298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:10.903480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:10.908093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:10.912025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a64c8636-295a-4cb1-91c4-9e4335968276 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.318259 Aug 27 03:22:10.913707 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1651/3255] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:10 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:22:10.988696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:10.989475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:11.003140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:11.009116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:11.013312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:11.016474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:11.017928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:11.019322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:11.213420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7c29bb4-3813-45ab-8298-59fd71c3e9c2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4602f9700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:11.303872 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7c29bb4-3813-45ab-8298-59fd71c3e9c2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.095098 Aug 27 03:22:11.304454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1652/3256] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:11 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:11.489132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:11.508615 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18ffe779-a00b-42c2-93cd-7931f13eb013 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1314 microversion: 2.1 time: 0.525761 Aug 27 03:22:11.511513 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1605/3257] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:10 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:11.950743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:11.952504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:11.995699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:11.997377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:11.999724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:12.001902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:12.003917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:12.005378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:12.327755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22601d27-48dc-4af3-be90-3ebc8b2a7ef2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460353dc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:12.333862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:12.356459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:12.384773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:12.391091 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bbfc53a7-4b34-46f1-9d40-51a6c05506bd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1745 microversion: 2.20 time: 0.450592 Aug 27 03:22:12.392426 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1653/3258] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:11 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1745 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:22:12.436148 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22601d27-48dc-4af3-be90-3ebc8b2a7ef2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.115764 Aug 27 03:22:12.446037 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1606/3259] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:12 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:12.537594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:12.538713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:12.561353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:12.567887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:12.571149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:12.574799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:12.575843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:12.579043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:12.697127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:12.960084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:12.978463 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-211e1f9a-8be2-444c-a0f2-4cb248d76f62 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1314 microversion: 2.1 time: 0.445288 Aug 27 03:22:12.994361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1654/3260] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:12 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:13.425555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:13.428097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:13.455057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:13.455057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:13.455057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:13.455652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:13.455845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:13.460858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:13.467351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71c492a9-bb41-488f-b5ee-c57efc62a971 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4601c8310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:13.477582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:13.587086 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-71c492a9-bb41-488f-b5ee-c57efc62a971 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.129103 Aug 27 03:22:13.587995 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1655/3261] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:13 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:13.741851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:13.778123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:13.781985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:13.784212 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9041fb0d-ff7e-429f-8d8a-bd9a4c25ad1b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1745 microversion: 2.20 time: 0.370533 Aug 27 03:22:13.786759 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1607/3262] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:13 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1745 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:14.004692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:14.005478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:14.035224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:14.035955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:14.038023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:14.039764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:14.040454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:14.045370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:14.503154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:14.518590 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20345681-01c5-4eb4-8f8b-e0da5ef2b2ef tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1314 microversion: 2.1 time: 0.517774 Aug 27 03:22:14.519213 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1656/3263] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:13 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:14.608887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07d9f96f-976a-4878-866f-1fa05d3cf7e8 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46039b1f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:14.818949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:14.823291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:14.854834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:14.863097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:14.867133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:14.868513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:14.869094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:14.875755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:15.408882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:15.431323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:15.433806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:15.438005 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-680c4527-c199-4a28-bd09-64537d06cd3b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1740 microversion: 2.20 time: 0.626175 Aug 27 03:22:15.445677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1657/3264] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:14 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1740 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:15.590236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:15.591418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:15.646897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:15.649065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:15.653822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:15.656257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:15.662384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:15.663443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:16.761479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:16.781542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62da385d-6c17-403b-86fa-0e2e9e21cf70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1314 microversion: 2.1 time: 1.228820 Aug 27 03:22:16.782902 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1658/3265] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:15 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1314 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:16.789439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:16.790450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:16.798956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:16.800615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:16.801489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:16.802461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:16.803254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:16.804064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:16.838836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:17.245890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:17.273453 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:22:17.273677 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 03:22:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f (ip 10.222.0.69) !!! Aug 27 03:22:17.294085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:17.300679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:17.306261 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44718dd8-c0ef-41e2-bbff-8e0db28fe303 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1740 microversion: 2.20 time: 0.521073 Aug 27 03:22:17.306893 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1659/3266] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:16 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1740 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:17.320119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ed1f2e01-df02-43ce-8c6c-cd992a261c60 req-c674a59f-6b2c-4e85-a9ae-3bd040286fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6", "name": "network-vif-plugged", "status": "completed", "tag": "40aff499-2cc1-4a03-9858-ded77b579266"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:17.362444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ed1f2e01-df02-43ce-8c6c-cd992a261c60 req-c674a59f-6b2c-4e85-a9ae-3bd040286fdb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:17.362975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ed1f2e01-df02-43ce-8c6c-cd992a261c60 req-c674a59f-6b2c-4e85-a9ae-3bd040286fdb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:17.365678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ed1f2e01-df02-43ce-8c6c-cd992a261c60 req-c674a59f-6b2c-4e85-a9ae-3bd040286fdb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:17.410628 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ed1f2e01-df02-43ce-8c6c-cd992a261c60 req-c674a59f-6b2c-4e85-a9ae-3bd040286fdb service nova] Creating event network-vif-plugged:40aff499-2cc1-4a03-9858-ded77b579266 for instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 on n-h1-852086-5 Aug 27 03:22:17.434996 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ed1f2e01-df02-43ce-8c6c-cd992a261c60 req-c674a59f-6b2c-4e85-a9ae-3bd040286fdb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125075 Aug 27 03:22:17.439049 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1660/3267] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:17.819373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:17.820466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:17.841661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:17.842202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:17.842664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:17.848079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:17.851864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:17.852541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:18.564278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:18.594101 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a051d922-fe8d-440c-8f89-1ec8928f57a7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1314 microversion: 2.1 time: 0.788164 Aug 27 03:22:18.610805 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1661/3268] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:17 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:18.624904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:18.635961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:18.663215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:18.663874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:18.664421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:18.673252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:18.673920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:18.674512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:20.199602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:20.210412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:20.216345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:20.220605 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5fbbf14a-39eb-4b7b-a0b7-2fd4ec06c495 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1740 microversion: 2.20 time: 1.608549 Aug 27 03:22:20.222997 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1662/3269] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:18 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1740 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:20.238790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:20.242358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:20.256699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:20.261813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:20.262942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:20.270960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:20.271881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:20.272673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:20.753667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:20.776845 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19511b5a-c1bc-41cb-9cf1-79ab96afc45f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1501 microversion: 2.1 time: 0.549747 Aug 27 03:22:20.796221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1663/3270] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:20 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1501 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:20.829263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b64b6c46-e110-484f-b0d3-169f4a17800b req-04918843-596c-4344-9720-b4d6f1855faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e086890c-6209-43d2-a7e7-aa5a748c3479", "name": "network-vif-plugged", "status": "completed", "tag": "f25d42fc-04e2-4a77-ac61-a04dc1cff23c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:20.848110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b64b6c46-e110-484f-b0d3-169f4a17800b req-04918843-596c-4344-9720-b4d6f1855faa service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:20.849330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b64b6c46-e110-484f-b0d3-169f4a17800b req-04918843-596c-4344-9720-b4d6f1855faa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:20.850385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b64b6c46-e110-484f-b0d3-169f4a17800b req-04918843-596c-4344-9720-b4d6f1855faa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:20.890029 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b64b6c46-e110-484f-b0d3-169f4a17800b req-04918843-596c-4344-9720-b4d6f1855faa service nova] Creating event network-vif-plugged:f25d42fc-04e2-4a77-ac61-a04dc1cff23c for instance e086890c-6209-43d2-a7e7-aa5a748c3479 on n-h2-852086-5 Aug 27 03:22:20.921980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b64b6c46-e110-484f-b0d3-169f4a17800b req-04918843-596c-4344-9720-b4d6f1855faa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123130 Aug 27 03:22:20.928986 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1664/3271] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:20.949286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:20.955592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:20.979530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:20.984850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:20.992771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:20.994131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:20.999156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:21.003459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:21.005004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:21.133912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lazy-loading 'flavor' on Instance uuid 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:22:21.510013 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07d9f96f-976a-4878-866f-1fa05d3cf7e8 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 6.907394 Aug 27 03:22:21.522482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1608/3272] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:14 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 6921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:21.530341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:21.536146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:21.564979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:21.565736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:21.566397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:21.567430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:21.570881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:21.576831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:22.095278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:22.113486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:22.120342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:22.128396 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3681874d-9e37-4427-8967-e31060a70965 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1740 microversion: 2.20 time: 0.604442 Aug 27 03:22:22.129369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1609/3273] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:21 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1740 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:22.140040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a92b3abc-afc8-4d9b-98c7-90af67c910e6"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:22.152410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:22.176393 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1fa3d35-897a-4f4b-bc13-95e7e4e5d1e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6/action" status: 202 len: 0 microversion: 2.1 time: 1.240909 Aug 27 03:22:22.187257 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1665/3274] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:22:20 2022] POST /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6/action => generated 0 bytes in 1257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:22:22.201887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:22.204570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:22.206428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:22.207919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:22.216757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:22.218009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:22.242139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:22.245374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:22.271075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:22.274266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:22.275177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:22.276381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:22.280429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:22.281529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:22.751192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:22.768223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e03a5009-1e27-4a19-b032-1b6a8532dd29 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.574440 Aug 27 03:22:22.787031 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1666/3275] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:22 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:22.803882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b0616b2-5a7f-404f-b6a6-7acf7e4a7212 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4602af160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:23.184090 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7be95fc5-00a5-415b-b841-70880db831bc tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "POST /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.052994 Aug 27 03:22:23.191532 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1610/3276] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:22:22 2022] POST /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 194 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:23.213631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:23.214396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:23.239887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:23.240321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:23.240756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:23.253454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:23.258443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:23.259411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:23.367267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:23.634699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:23.651365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:23.653245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:23.655485 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50f93fb8-440c-49d7-9acf-6f07c7e75060 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1740 microversion: 2.20 time: 0.456218 Aug 27 03:22:23.672358 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1611/3277] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:23 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1740 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:23.691361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-364437c0-4dae-4355-a837-58cb22961156 req-4a994238-d40c-4233-a0b2-0b5d861a2f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3889386-64a2-4858-af6e-009e8606df9f", "name": "network-vif-plugged", "status": "completed", "tag": "544e928d-a4d3-43ac-9b2f-854b3810328a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:23.707302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-364437c0-4dae-4355-a837-58cb22961156 req-4a994238-d40c-4233-a0b2-0b5d861a2f70 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:23.708006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-364437c0-4dae-4355-a837-58cb22961156 req-4a994238-d40c-4233-a0b2-0b5d861a2f70 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:23.708613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-364437c0-4dae-4355-a837-58cb22961156 req-4a994238-d40c-4233-a0b2-0b5d861a2f70 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:23.736035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-364437c0-4dae-4355-a837-58cb22961156 req-4a994238-d40c-4233-a0b2-0b5d861a2f70 service nova] Creating event network-vif-plugged:544e928d-a4d3-43ac-9b2f-854b3810328a for instance b3889386-64a2-4858-af6e-009e8606df9f on n-h1-852086-5 Aug 27 03:22:23.751264 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-364437c0-4dae-4355-a837-58cb22961156 req-4a994238-d40c-4233-a0b2-0b5d861a2f70 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077140 Aug 27 03:22:23.752622 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1612/3278] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:23.809221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:23.810452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:23.821801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:23.822553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:23.823163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:23.824177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:23.824913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:23.825505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:24.245596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:24.275994 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36b49d0e-c891-4daf-ac26-b08ba8917cd6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.472722 Aug 27 03:22:24.284976 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1613/3279] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:23 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:24.690679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:24.692062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:24.710866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:24.712673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:24.714980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:24.716089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:24.718981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:24.722810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:25.391989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:25.408964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:25.412044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:25.426746 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e71a5d4-eea0-41d3-9034-f09f67010f54 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1740 microversion: 2.20 time: 0.743382 Aug 27 03:22:25.429968 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1614/3280] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:24 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1740 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:22:26.008017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1608146959", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "38b456ec-922f-4e54-9383-f912f0fbb425"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:32.270996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:32.764165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:35.402182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:36.046917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:39.065602 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b0616b2-5a7f-404f-b6a6-7acf7e4a7212 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 16.274593 Aug 27 03:22:39.066616 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1667/3281] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:22 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 16279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:39.069749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] validate_networks() for [('38b456ec-922f-4e54-9383-f912f0fbb425', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:22:39.075972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:39.078103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:39.088502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:39.089455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:39.091031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:39.093667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:39.095555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:39.096497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:39.370490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:39.383971 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-848d3b5e-dc3e-4936-80a2-57431fc6eb1b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.315790 Aug 27 03:22:39.385881 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1668/3282] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:39 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:39.399134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:39.401611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:39.423909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:39.426258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:39.426830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:39.427736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:39.431085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:39.431661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:39.809395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:39.835324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:39.840180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:39.851977 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b708387f-88ad-4caa-94b4-723c5cb21824 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1740 microversion: 2.20 time: 0.463515 Aug 27 03:22:39.852678 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1669/3283] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:39 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1740 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:40.083617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f902d0d-173a-4a68-9c4b-38d6c20a94eb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457a05a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:40.181353 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f902d0d-173a-4a68-9c4b-38d6c20a94eb tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.103397 Aug 27 03:22:40.182285 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1670/3284] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:40 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:40.336806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:22:40.337508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:22:40.337853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:22:40.338336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:22:40.338906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:22:40.365505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:40.366958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:40.367415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:40.368184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:40.368648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:40.369070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:40.408941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:40.409607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:40.421392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Getting quotas for project 4d16be1c428c465db77a7ef995249ea6. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:22:40.427841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:40.430633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:40.440028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Getting quotas for user 40559a7f1d984e0692b9056feccdf988 and project 4d16be1c428c465db77a7ef995249ea6. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:22:40.446567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:40.447857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:40.455289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:40.456159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:40.460401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Going to run 2 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:22:40.471013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 2483f213-5faf-4973-9e6a-387f01349f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:22:40.556929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=2483f213-5faf-4973-9e6a-387f01349f30,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:22:40.695726 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5dc94c5d-7121-4066-b126-36e30a207910 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.264305 Aug 27 03:22:40.696840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1615/3285] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 15266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:22:40.709135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:40.717580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:40.735383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Searching by: {'deleted': False, 'project_id': '4d16be1c428c465db77a7ef995249ea6'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:22:40.793343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:40.794577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:40.795487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:40.797136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:40.797857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:40.798544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:40.840838 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8677174-bce1-4c55-806d-003a9e0c636c tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.135432 Aug 27 03:22:40.842622 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1616/3286] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:22:40 2022] GET /compute/v2.1/servers => generated 677 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:22:40.854395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d0a9180-1cc2-4560-b5b5-cb995cda08f6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:40.855452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d0a9180-1cc2-4560-b5b5-cb995cda08f6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:40.979589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d0a9180-1cc2-4560-b5b5-cb995cda08f6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:40.989350 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d0a9180-1cc2-4560-b5b5-cb995cda08f6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1220 microversion: 2.1 time: 0.139118 Aug 27 03:22:41.012742 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1617/3287] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:40 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:41.035692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:41.038915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:41.067203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:41.067705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:41.068211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:41.069020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:41.080304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:41.084249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:41.440763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:41.463183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:41.472088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:41.481524 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c13c16cb-477e-40be-aabe-78577619df60 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1722 microversion: 2.20 time: 0.465344 Aug 27 03:22:41.486318 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1618/3288] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:41 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:41.509164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ad3fcce7-db6b-465a-ad27-8cf1c54353e1 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460353700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:41.564463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:41.580412 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4de354d7-7841-4f5d-8ba7-d40a574e60cc tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 1.175480 Aug 27 03:22:41.581094 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1671/3289] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:40 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:41.620761 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ad3fcce7-db6b-465a-ad27-8cf1c54353e1 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.127398 Aug 27 03:22:41.621259 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1619/3290] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:41 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:42.025782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-09b3a6fd-406b-4919-8fd4-cfa52cfcd844 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:42.029767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-09b3a6fd-406b-4919-8fd4-cfa52cfcd844 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:42.145305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-09b3a6fd-406b-4919-8fd4-cfa52cfcd844 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:42.164010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-09b3a6fd-406b-4919-8fd4-cfa52cfcd844 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1220 microversion: 2.1 time: 0.143567 Aug 27 03:22:42.173867 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1672/3291] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:42 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:42.521617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:42.522589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:42.534873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:42.535721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:42.536359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:42.537473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-93b7e229-de88-4bc2-abcd-063e923c2acd req-be2641c3-6ab4-4094-8383-ef98a2a7c96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3889386-64a2-4858-af6e-009e8606df9f", "name": "network-vif-unplugged", "status": "completed", "tag": "544e928d-a4d3-43ac-9b2f-854b3810328a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:42.538577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:42.539508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:42.550120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:42.574823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93b7e229-de88-4bc2-abcd-063e923c2acd req-be2641c3-6ab4-4094-8383-ef98a2a7c96e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:42.574823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93b7e229-de88-4bc2-abcd-063e923c2acd req-be2641c3-6ab4-4094-8383-ef98a2a7c96e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:42.581469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93b7e229-de88-4bc2-abcd-063e923c2acd req-be2641c3-6ab4-4094-8383-ef98a2a7c96e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:42.611988 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-93b7e229-de88-4bc2-abcd-063e923c2acd req-be2641c3-6ab4-4094-8383-ef98a2a7c96e service nova] Creating event network-vif-unplugged:544e928d-a4d3-43ac-9b2f-854b3810328a for instance b3889386-64a2-4858-af6e-009e8606df9f on n-h1-852086-5 Aug 27 03:22:42.619883 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-93b7e229-de88-4bc2-abcd-063e923c2acd req-be2641c3-6ab4-4094-8383-ef98a2a7c96e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086511 Aug 27 03:22:42.627135 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1673/3292] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:42.636229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:42.637105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:42.657044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:42.657857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:42.658505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:42.659494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:42.660183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:42.660829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:42.927468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:42.945378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:42.946894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:42.948175 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe94fbf9-cd30-4eb8-8b7a-ac557e6c4c81 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1722 microversion: 2.20 time: 0.436083 Aug 27 03:22:42.949759 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1620/3293] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:42 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:42.961173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d43ec714-5ce3-4481-828e-f4d61b5b8533 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457e7e3a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:42.991391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:43.007822 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-454f7f45-881f-4be5-b12d-baf60ff47d83 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.376497 Aug 27 03:22:43.020119 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1674/3294] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:42 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:43.054086 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d43ec714-5ce3-4481-828e-f4d61b5b8533 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.101525 Aug 27 03:22:43.055496 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1621/3295] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:42 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:43.055941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:43.056956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:43.089288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:43.090887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:43.107884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:43.113453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:43.114239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:43.116011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:43.182078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:22:43.196890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:43.198036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:43.211795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:43.212756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:43.213603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:43.215951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:43.217338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:43.218009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:43.352085 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65d3459a-d9ec-4034-8a1a-970081a8614b tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 204 len: 0 microversion: 2.1 time: 0.315410 Aug 27 03:22:43.357542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1675/3296] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:22:43 2022] DELETE /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:22:43.365095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:43.365714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:43.366909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:43.375234 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2cd92569-a179-4ba9-84c3-f112712c85f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1216 microversion: 2.1 time: 0.187768 Aug 27 03:22:43.376667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:43.377529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:43.378229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:43.379376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:43.382426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:43.383942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:43.392586 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1622/3297] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:43 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1216 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:43.641658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:43.657756 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19f725b7-c7bf-41cc-95a5-8310535d879e tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1666 microversion: 2.1 time: 0.296880 Aug 27 03:22:43.658850 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1676/3298] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:43 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1666 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:43.990985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:43.992961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:44.028094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.030407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.034985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.039193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.045589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:44.051354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.051354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.053470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:44.069911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.072396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.074104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.076913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.077697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.081484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.446566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:44.484460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:44.488250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:44.493866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:44.496386 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-982184f1-83dc-47c7-85d6-7f5e6c298ce4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.457879 Aug 27 03:22:44.498514 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1677/3299] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:44 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:44.514556 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a9194da-31f7-4e84-9957-21f17f5de3f6 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1725 microversion: 2.20 time: 0.531886 Aug 27 03:22:44.520972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe0baa55-58b5-412b-abe8-12f3b6f10be9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457a1c3a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:44.526761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1623/3300] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:43 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1725 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:22:44.541039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:44.548203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:44.576282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.576892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.577351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.586857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.590736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.591900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.743747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fe0baa55-58b5-412b-abe8-12f3b6f10be9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.238462 Aug 27 03:22:44.755089 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1678/3301] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:44 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:44.765113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e79a626d-5e97-4cba-b646-fafe15dbfacc"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:44.772289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:44.780893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.781382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.841660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.841660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.841660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.841660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-136d08a7-e95b-4902-9476-ffc632c0ebf2 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1272 microversion: 2.1 time: 0.292039 Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1624/3302] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:44 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:44.853050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:45.285470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:45.296368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ce6c3db-0a35-43de-8d06-ca8990048ae9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1666 microversion: 2.1 time: 0.467636 Aug 27 03:22:45.307106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1625/3303] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:44 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1666 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:45.391589 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-197592e9-7aba-4068-bd3c-c2eb7a899e03 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.635051 Aug 27 03:22:45.399696 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1679/3304] 10.222.0.69 () {62 vars in 1364 bytes} [Sat Aug 27 03:22:44 2022] POST /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 188 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:22:45.546790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:45.547831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:45.558090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:45.563010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:45.564076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:45.565573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:45.569828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:45.570706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:45.768275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:45.770709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:45.792701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:45.794137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:45.798132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:45.799304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:45.800656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:45.801338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:45.902531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122407) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 03:22:46.056040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4caf84d3-72a6-4c64-9c19-44cc4dea2b26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/action" status: 202 len: 0 microversion: 2.20 time: 0.293168 Aug 27 03:22:46.057287 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1680/3305] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:22:45 2022] POST /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:22:46.068067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a5b504b-df49-4857-80b5-14436aec1e29 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457a5a5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:46.144011 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a5b504b-df49-4857-80b5-14436aec1e29 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1455 microversion: 2.1 time: 0.084885 Aug 27 03:22:46.145236 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1681/3306] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:46 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:46.175899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:46.176742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:46.191044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:46.192843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:46.193616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:46.204272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:46.204272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:46.204272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:46.378127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:46.409804 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a65ae4c6-77e5-47f2-8aed-b92d0495b626 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1278 microversion: 2.1 time: 0.262297 Aug 27 03:22:46.410070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:46.411489 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1682/3307] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:46 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:46.443701 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c514d21b-e0ca-4cff-bc54-feeae29cc854 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.919785 Aug 27 03:22:46.448352 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1626/3308] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:45 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:46.464012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:46.464672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:46.481272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:46.482376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:46.483000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:46.483959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:46.484430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:46.484866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.085111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:47.094581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:47.096413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:47.111740 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03e1e187-0dd9-4168-952c-e5731ff8b756 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1751 microversion: 2.20 time: 0.653704 Aug 27 03:22:47.112643 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1627/3309] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:46 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1751 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:47.130860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:47.131694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:47.139849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.140585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.141862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.142705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.143504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.144202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.178492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "450a054c-b08c-4e42-b101-fce5be7f802b"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:47.181720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:47.199322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.199826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.202692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.205088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.207309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.208436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.398600 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] HTTP exception thrown: Volume 450a054c-b08c-4e42-b101-fce5be7f802b could not be found. Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Request method failure captured: Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments/a92b3abc-afc8-4d9b-98c7-90af67c910e6 HTTP/1.1 Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 74 Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2I8JduCeTOjvRARSkkw3pRVOlVp1J0HsMQq8yIMsDHJcIN1k9Pe4QrQ8fkDRXZa-nuSGBeyqsXbOuLbbJVZw_eHIsVz78KIUOXExaLFu70-lc8F5Ij2zJIOPvkPfKXz4toeLy5evq7t-oZqXAt9caeJ_X0eM3nYEKoDnP8_AiY5zs Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 34a4b8293b964598b6feb56d2379ed4f Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesAdminNegativeTest-95102841 Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/34a4b8293b964598b6feb56d2379ed4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/34a4b8293b964598b6feb56d2379ed4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_34a4b8293b964598b6feb56d2379ed4f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/34a4b8293b964598b6feb56d2379ed4f"}]}] Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesAdminNegativeTest-95102841 Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 34a4b8293b964598b6feb56d2379ed4f Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-95102841 Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesAdminNegativeTest-95102841-project-admin Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ff473e7c0367454f824126ae70fece9e Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesAdminNegativeTest-95102841-project-admin Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: {"volumeAttachment": {"volumeId": "450a054c-b08c-4e42-b101-fce5be7f802b"}} Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume 450a054c-b08c-4e42-b101-fce5be7f802b could not be found. Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': 'bdde2b7a-9f85-47bd-8d86-8f51c40b781d', 'id': 'a92b3abc-afc8-4d9b-98c7-90af67c910e6', 'body': {'volumeAttachment': {'volumeId': '450a054c-b08c-4e42-b101-fce5be7f802b'}}} Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 450a054c-b08c-4e42-b101-fce5be7f802b could not be found. (HTTP 404) (Request-ID: req-9d7de146-aca6-4c25-8f7f-ce8156416ce9) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:22:47.438684 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 450a054c-b08c-4e42-b101-fce5be7f802b could not be found. Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 450a054c-b08c-4e42-b101-fce5be7f802b could not be found. Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 450a054c-b08c-4e42-b101-fce5be7f802b could not be found. Aug 27 03:22:47.445402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:47.458898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Returning 400 to user: Volume 450a054c-b08c-4e42-b101-fce5be7f802b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:22:47.460164 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46b52ff2-0a10-450f-929e-d8d880c45819 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] 10.222.0.69 "PUT /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments/a92b3abc-afc8-4d9b-98c7-90af67c910e6" status: 400 len: 107 microversion: 2.1 time: 1.044687 Aug 27 03:22:47.462424 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1683/3310] 10.222.0.69 () {60 vars in 1433 bytes} [Sat Aug 27 03:22:46 2022] PUT /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments/a92b3abc-afc8-4d9b-98c7-90af67c910e6 => generated 107 bytes in 1048 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:22:47.478366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f08d87f-d323-424b-8e37-a59a31b5cd10 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4602dce50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:47.518629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:47.538771 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-713bf915-0c22-45d1-953d-b317b716b654 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1666 microversion: 2.1 time: 0.424804 Aug 27 03:22:47.547180 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1628/3311] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:47 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1666 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:47.567546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:47.568186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:47.585009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.589183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.589654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.590478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.592503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.603075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.610553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f08d87f-d323-424b-8e37-a59a31b5cd10 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1464 microversion: 2.1 time: 0.141504 Aug 27 03:22:47.611142 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1684/3312] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:47 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:47.644801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:47.645426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:47.664734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.665229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.665665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.666818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.666818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.667513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.674605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:47.800311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:47.810931 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cf2f7ff-a343-426e-be3e-0f5fae42c1b6 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1278 microversion: 2.1 time: 0.262461 Aug 27 03:22:47.812095 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1629/3313] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:47 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:47.824288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:47.824787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:47.843856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.844331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.844774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.845502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:47.845962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:47.846407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:47.895608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:47.907952 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-66136f5d-eae1-4957-a027-31aebe3541ff tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.277639 Aug 27 03:22:47.908553 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1685/3314] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:47 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:47.920900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba1c23fa-5248-4cc0-b84f-cafe87f68ee2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457a05a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:47.997299 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba1c23fa-5248-4cc0-b84f-cafe87f68ee2 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 200 len: 1464 microversion: 2.1 time: 0.086831 Aug 27 03:22:47.998247 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1686/3315] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:47 2022] GET /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:48.012538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lazy-loading 'services' on Instance uuid bdde2b7a-9f85-47bd-8d86-8f51c40b781d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:22:48.020801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:48.022803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:48.034389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.041112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.041871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.043164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.047044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.047729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.151778 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb601cb9-fd5f-4560-9db7-f65501320678 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments/a92b3abc-afc8-4d9b-98c7-90af67c910e6" status: 202 len: 0 microversion: 2.1 time: 0.338399 Aug 27 03:22:48.152373 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1630/3316] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:22:47 2022] DELETE /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments/a92b3abc-afc8-4d9b-98c7-90af67c910e6 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:22:48.163017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:48.170276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:48.187324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.190914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.191750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.194857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.195587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.196029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.295908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:48.313779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c515d552-a560-49a6-b630-1d397dc67dff tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 1466 microversion: 2.1 time: 0.301804 Aug 27 03:22:48.315281 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1687/3317] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:48 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 1466 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:48.320827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:48.324360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:48.333725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.334881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.335721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.336675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.337477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.338119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.388506 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00d6450a-37b4-4358-8618-7a240fa1773a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071105 Aug 27 03:22:48.389543 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1688/3318] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:48 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:48.395381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-315079131"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:48.398718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:48.406517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.407312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.408664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.409787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.410454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.411378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.783703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4c6dcae7-7266-4faa-aadb-ab6957cca4cf tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "POST /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed/action" status: 202 len: 0 microversion: 2.1 time: 0.392282 Aug 27 03:22:48.785762 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1689/3319] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:22:48 2022] POST /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:22:48.799091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:48.801968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:48.814066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.815388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.816005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.817946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:48.818617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:48.819242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:48.844352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:48.859118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:48.872757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:48.873926 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7affcc52-b707-461f-8d5a-dbf871a49483 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1751 microversion: 2.20 time: 0.720425 Aug 27 03:22:48.874531 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1631/3320] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:48 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1751 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:48.879314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6534ce94-e672-47d0-83f9-d83dcd2b2808 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4604024c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:49.003870 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6534ce94-e672-47d0-83f9-d83dcd2b2808 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1454 microversion: 2.1 time: 0.122237 Aug 27 03:22:49.004717 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1632/3321] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:48 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:49.009778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:49.018716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:49.033462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.034227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.038967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:49.040088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.040758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.041309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:49.062046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:49.077885 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91261a47-0d6c-4fe3-a9ef-166d9c5887aa tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1599 microversion: 2.1 time: 0.287777 Aug 27 03:22:49.079588 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1690/3322] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:48 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1599 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:49.100213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:49.100872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:49.108506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.109006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.109456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:49.110260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.110668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.111523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:49.348324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:49.363869 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83b2acac-048d-4d82-8720-383366c5b146 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.282579 Aug 27 03:22:49.375147 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1691/3323] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:49 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:49.401344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:49.404362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:49.412020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.412666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.413309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:49.414308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.414911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.416202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:49.466997 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c47b51b-fe0d-49df-9112-bedcec37e2b5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069400 Aug 27 03:22:49.469130 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1692/3324] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:49 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:22:49.614603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:49.623830 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e87ec4c8-19e3-4e29-aa68-0f4ab63c71da tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1278 microversion: 2.1 time: 0.617774 Aug 27 03:22:49.624554 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1633/3325] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:49 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1278 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:49.905852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:49.906774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:49.917522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.918443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.919007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:49.925749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:49.926457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:49.927055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.021396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e309a031-f707-4263-89c6-61c634a0d874 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460402ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:50.099389 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e309a031-f707-4263-89c6-61c634a0d874 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1454 microversion: 2.1 time: 0.082137 Aug 27 03:22:50.102125 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1634/3326] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:50 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:50.114493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:50.115150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:50.152187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.152702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.153155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.154487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.154964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.155408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.201414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:50.217666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:50.219720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:50.224410 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a06c4248-00e9-48aa-8a7d-69a7e3cb2bbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1753 microversion: 2.20 time: 0.323683 Aug 27 03:22:50.227686 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1693/3327] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:49 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1753 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:50.368118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '931dbcd79dda453aa44db48cb46ea4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2af32328f04b9b9a34a00ebcead5d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:50.380415 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2f77546-5753-40be-9cf4-d08aaff19da9 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 200 len: 1599 microversion: 2.1 time: 0.276997 Aug 27 03:22:50.382527 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1635/3328] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:50 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 1599 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:50.398398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:50.399137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:50.408093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.408860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.415867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.420474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.422515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.431531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.439713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-25e7037b-6308-46e0-bbb2-71c80ba0e04f req-8446a3e7-fe67-4f0d-bbde-c15c6c31ccf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3313d2b8-a2e8-400e-bc5f-c255af6095af", "name": "network-vif-deleted", "tag": "33207100-80c1-4b21-97ac-d1e9c18ef7e5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:50.460577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-25e7037b-6308-46e0-bbb2-71c80ba0e04f req-8446a3e7-fe67-4f0d-bbde-c15c6c31ccf1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.461072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-25e7037b-6308-46e0-bbb2-71c80ba0e04f req-8446a3e7-fe67-4f0d-bbde-c15c6c31ccf1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.461720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-25e7037b-6308-46e0-bbb2-71c80ba0e04f req-8446a3e7-fe67-4f0d-bbde-c15c6c31ccf1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.477830 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-25e7037b-6308-46e0-bbb2-71c80ba0e04f req-8446a3e7-fe67-4f0d-bbde-c15c6c31ccf1 service nova] Creating event network-vif-deleted:33207100-80c1-4b21-97ac-d1e9c18ef7e5 for instance 3313d2b8-a2e8-400e-bc5f-c255af6095af on n-h2-852086-5 Aug 27 03:22:50.486904 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-25e7037b-6308-46e0-bbb2-71c80ba0e04f req-8446a3e7-fe67-4f0d-bbde-c15c6c31ccf1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059763 Aug 27 03:22:50.488004 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1636/3329] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 03:22:50.496605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:50.500507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:50.510023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.511157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.511912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.513495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.514219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.514900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.557955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:50.567201 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb5447a7-469a-4a37-af30-76201c171518 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076531 Aug 27 03:22:50.568105 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1637/3330] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:50 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:50.645256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:50.646126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:50.654769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.662990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.663630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.664732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:50.665633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:50.666358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:50.772619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:50.793852 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d12d4f6c-7722-4757-9e8a-276b993f4e6a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.405205 Aug 27 03:22:50.807634 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1694/3331] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:50 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:50.807994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:50.992092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:51.125667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4fb23f6b-a30a-49aa-9c74-54b26bcf10c1 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457df8b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:51.239444 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4fb23f6b-a30a-49aa-9c74-54b26bcf10c1 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1454 microversion: 2.1 time: 0.126868 Aug 27 03:22:51.240438 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1695/3332] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:51 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:51.283303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:51.285057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:51.313714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.318048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.319635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.320888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.329269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.330081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.538340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:51.569887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:51.571685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:51.572562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:51.577893 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eda5256e-f966-4150-8412-82645cab2636 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1753 microversion: 2.20 time: 0.309225 Aug 27 03:22:51.595246 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1696/3333] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:51 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1753 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:51.597238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27d68cc1-0edf-410f-ad7a-d5371cd1e26b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.956071 Aug 27 03:22:51.597841 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1638/3334] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:50 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:51.600764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:51.601691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] [instance: 3313d2b8-a2e8-400e-bc5f-c255af6095af] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:51.602804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:51.605007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:51.619081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.619670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.620190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.621005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.621320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.621633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.621975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.622834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.623218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.629063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.629580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.630027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.643934 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] HTTP exception thrown: Instance 3313d2b8-a2e8-400e-bc5f-c255af6095af could not be found. Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Request method failure captured: Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af HTTP/1.1 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2gT5rAnS9s064282FAhZ9PSoPLXQPGpufXc-uHO9RojOBHQRviedkJH53Xdinv2M3yfM9JgzTiPbR_ZuFrLQz5vUuf7pitr9-xTxhJmWG0Jf0Iv9UCWrvwXu2OH_GfNFAis2tIDB_dy3t2S4QZdO8wl2q8iEE3mfYnQnjgB4KW_7I Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: ce2af32328f04b9b9a34a00ebcead5d0 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestFqdnHostnames-852024881 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ce2af32328f04b9b9a34a00ebcead5d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ce2af32328f04b9b9a34a00ebcead5d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ce2af32328f04b9b9a34a00ebcead5d0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ce2af32328f04b9b9a34a00ebcead5d0"}]}] Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestFqdnHostnames-852024881 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: ce2af32328f04b9b9a34a00ebcead5d0 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-852024881 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestFqdnHostnames-852024881-project Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 931dbcd79dda453aa44db48cb46ea4f5 Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestFqdnHostnames-852024881-project Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 3313d2b8-a2e8-400e-bc5f-c255af6095af could not be found. Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '3313d2b8-a2e8-400e-bc5f-c255af6095af'} Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3313d2b8-a2e8-400e-bc5f-c255af6095af could not be found. Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3313d2b8-a2e8-400e-bc5f-c255af6095af could not be found. Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:22:51.645725 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3313d2b8-a2e8-400e-bc5f-c255af6095af could not be found. Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Returning 404 to user: Instance 3313d2b8-a2e8-400e-bc5f-c255af6095af could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5786cdd3-898e-4156-9eb6-8a1bd6af44c0 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af" status: 404 len: 111 microversion: 2.1 time: 0.050899 Aug 27 03:22:51.652069 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1697/3335] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:51 2022] GET /compute/v2.1/servers/3313d2b8-a2e8-400e-bc5f-c255af6095af => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:22:51.660618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0c9b618-7c6e-408e-9d59-3b37d6a2e115 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] Calling method '.version_select at 0x7fe4602dcc10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:51.702005 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0c9b618-7c6e-408e-9d59-3b37d6a2e115 tempest-ServersTestFqdnHostnames-852024881 tempest-ServersTestFqdnHostnames-852024881-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763769222" status: 202 len: 0 microversion: 2.1 time: 0.045642 Aug 27 03:22:51.705927 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-032bc20e-cfe8-4aac-aca5-f26d65dcc85e tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104261 Aug 27 03:22:51.706116 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1698/3336] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763769222 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:22:51.709746 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1639/3337] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:51 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:51.746976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d7d79463-dae9-45a6-b5bd-bf2c37b79479 req-06399c5d-fac6-4d4f-ad9b-08a4ae564db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e086890c-6209-43d2-a7e7-aa5a748c3479", "name": "network-vif-unplugged", "status": "completed", "tag": "f25d42fc-04e2-4a77-ac61-a04dc1cff23c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:51.789406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d7d79463-dae9-45a6-b5bd-bf2c37b79479 req-06399c5d-fac6-4d4f-ad9b-08a4ae564db5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.789905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d7d79463-dae9-45a6-b5bd-bf2c37b79479 req-06399c5d-fac6-4d4f-ad9b-08a4ae564db5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.790392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d7d79463-dae9-45a6-b5bd-bf2c37b79479 req-06399c5d-fac6-4d4f-ad9b-08a4ae564db5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.819426 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d7d79463-dae9-45a6-b5bd-bf2c37b79479 req-06399c5d-fac6-4d4f-ad9b-08a4ae564db5 service nova] Creating event network-vif-unplugged:f25d42fc-04e2-4a77-ac61-a04dc1cff23c for instance e086890c-6209-43d2-a7e7-aa5a748c3479 on n-h2-852086-5 Aug 27 03:22:51.820981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:51.822027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:51.832245 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d7d79463-dae9-45a6-b5bd-bf2c37b79479 req-06399c5d-fac6-4d4f-ad9b-08a4ae564db5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089525 Aug 27 03:22:51.833184 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1699/3338] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:51.839240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.840160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.842379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:51.843794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:51.845760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:51.849932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:52.128578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:52.137188 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d6771a75-fbc8-4e0e-a8e3-f2e026a6da71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.320841 Aug 27 03:22:52.137819 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1640/3339] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:51 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:52.251733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:52.260093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c67be5f6-9661-48d2-a94a-9b0ea058246d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4579fc4c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:52.349591 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c67be5f6-9661-48d2-a94a-9b0ea058246d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1454 microversion: 2.1 time: 0.098690 Aug 27 03:22:52.350509 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1700/3340] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:52 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:52.527593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-75371ef7-7c99-4063-834c-a07c8689d751 req-8676cbb2-11e3-414a-b6b8-a4b5e55806f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2483f213-5faf-4973-9e6a-387f01349f30", "tag": "28b93c94-7685-4da2-8121-036b44f27cd1"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:52.559514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75371ef7-7c99-4063-834c-a07c8689d751 req-8676cbb2-11e3-414a-b6b8-a4b5e55806f9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:52.560323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75371ef7-7c99-4063-834c-a07c8689d751 req-8676cbb2-11e3-414a-b6b8-a4b5e55806f9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:52.560917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-75371ef7-7c99-4063-834c-a07c8689d751 req-8676cbb2-11e3-414a-b6b8-a4b5e55806f9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:52.609878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:52.610668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:52.616158 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-75371ef7-7c99-4063-834c-a07c8689d751 req-8676cbb2-11e3-414a-b6b8-a4b5e55806f9 service nova] Creating event network-changed:28b93c94-7685-4da2-8121-036b44f27cd1 for instance 2483f213-5faf-4973-9e6a-387f01349f30 on n-h2-852086-5 Aug 27 03:22:52.620447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:52.620950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:52.621387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:52.628493 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-75371ef7-7c99-4063-834c-a07c8689d751 req-8676cbb2-11e3-414a-b6b8-a4b5e55806f9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105178 Aug 27 03:22:52.628854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:52.632783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:52.633803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:52.634691 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1641/3341] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:52.651032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:52.652665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:52.667372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:52.669324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:52.670203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:52.673412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:52.674405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:52.679320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:53.105051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:53.126301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:53.128577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:53.151205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2e8cb4e-9a75-42be-9f87-4380bcee13ea tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1753 microversion: 2.20 time: 0.530344 Aug 27 03:22:53.159071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1701/3342] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:52 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1753 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:53.174593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:53.177298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:53.196917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:53.199553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:53.204356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:53.205427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:53.206092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:53.206763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:53.306965 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8fede1b1-2472-4376-b786-7013acbd9999 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144445 Aug 27 03:22:53.307940 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1702/3343] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:53 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:53.345540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:53.347832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:53.353241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:53.366649 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cbb0599e-b8c4-452b-8bbb-a7a3d68e5ba5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.726981 Aug 27 03:22:53.381530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:53.381530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:53.381530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:53.381530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:53.381530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:53.381530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:53.382897 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1642/3344] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:52 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:53.395703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2728653f-ab98-4c4d-b46a-0c37fbf97e6b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46039bf70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:53.508248 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2728653f-ab98-4c4d-b46a-0c37fbf97e6b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1454 microversion: 2.1 time: 0.123747 Aug 27 03:22:53.508850 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1643/3345] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:53 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:53.934247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:53.952256 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aaa50833-3e1d-4930-9ef0-0a128d1b08aa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1507 microversion: 2.1 time: 0.618257 Aug 27 03:22:53.973384 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1703/3346] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:53 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1507 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:54.193394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:54.193993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:54.216220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.216734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.217187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.217931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.218425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.218863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.321458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:54.327575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:54.352201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.352969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.354113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.357083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.359161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.362978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.474692 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf8d0934-992a-42be-aa93-1ec8412b6fe6 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157052 Aug 27 03:22:54.482290 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1704/3347] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:54 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:54.482290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:54.483937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:54.490077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.490835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.491476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.492632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.493253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.494623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.525073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:54.558495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:54.561465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:54.576878 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8738cdc3-6568-46de-8e84-4d47af894248 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1753 microversion: 2.20 time: 0.388364 Aug 27 03:22:54.579297 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1644/3348] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:54 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1753 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:54.646311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d7ae37b-0660-4bb9-8ccf-2dcc30aaa79d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46039bd30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:54.985506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:54.992232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:55.002652 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e41fc788-8758-4401-8158-82f82294de63 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.525858 Aug 27 03:22:55.011121 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1705/3349] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:54 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:55.033611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-aaa1c54c-3c76-4192-b252-ae9efefa0b17 req-682b7ca4-0434-40df-8a1a-8b698341a14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4e53a2-729d-4bc1-94be-b67de7e32747", "tag": "073a1ea7-b113-4d9f-9a40-40121014676a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:55.071612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-aaa1c54c-3c76-4192-b252-ae9efefa0b17 req-682b7ca4-0434-40df-8a1a-8b698341a14d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:55.074881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-aaa1c54c-3c76-4192-b252-ae9efefa0b17 req-682b7ca4-0434-40df-8a1a-8b698341a14d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:55.077797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-aaa1c54c-3c76-4192-b252-ae9efefa0b17 req-682b7ca4-0434-40df-8a1a-8b698341a14d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.111960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-aaa1c54c-3c76-4192-b252-ae9efefa0b17 req-682b7ca4-0434-40df-8a1a-8b698341a14d service nova] Creating event network-changed:073a1ea7-b113-4d9f-9a40-40121014676a for instance 1d4e53a2-729d-4bc1-94be-b67de7e32747 on n-h1-852086-5 Aug 27 03:22:55.133036 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-aaa1c54c-3c76-4192-b252-ae9efefa0b17 req-682b7ca4-0434-40df-8a1a-8b698341a14d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120322 Aug 27 03:22:55.135543 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1706/3350] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:55.151649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:55.152783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:55.171173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:55.172090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:55.173941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.175792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:55.180683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:55.181718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.431804 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d7ae37b-0660-4bb9-8ccf-2dcc30aaa79d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1454 microversion: 2.1 time: 0.850176 Aug 27 03:22:55.432560 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1645/3351] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:54 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1454 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:55.494791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:55.506789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:55.534991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:55.543121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:55.544850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.546374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:55.549347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:55.550404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.685946 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e7ce0d1-4c9f-40f9-aa63-a927ed769a1a tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197961 Aug 27 03:22:55.690598 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1646/3352] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:55 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:55.712357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:55.716784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:55.741559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:55.748977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:55.750397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.751695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:55.752518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:55.753219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.958845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:55.981641 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20c2ec7e-4a23-49e3-a541-a4081df7b9e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1528 microversion: 2.1 time: 0.838450 Aug 27 03:22:55.982466 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1707/3353] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:55 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1528 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:56.054966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:56.055993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:56.087132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:56.095048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:56.096216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:56.097726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:56.100408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:56.109768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:56.599368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:56.610140 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee72ff1b-c348-46fc-85ac-93a4fc65c035 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.560133 Aug 27 03:22:56.611457 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1708/3354] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:56 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:56.616394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-26b57e37-97f6-4300-a9a2-ad0a5e856165 req-df37fb19-c147-4885-96b3-98ebd9b0bbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db62fb2-3b79-46b8-baec-890abe5107ed", "name": "network-vif-plugged", "status": "completed", "tag": "ca02f050-9d97-48b8-b99f-d385fa15b569"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:56.628048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26b57e37-97f6-4300-a9a2-ad0a5e856165 req-df37fb19-c147-4885-96b3-98ebd9b0bbe5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:56.628902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26b57e37-97f6-4300-a9a2-ad0a5e856165 req-df37fb19-c147-4885-96b3-98ebd9b0bbe5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:56.629609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26b57e37-97f6-4300-a9a2-ad0a5e856165 req-df37fb19-c147-4885-96b3-98ebd9b0bbe5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:56.655638 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-26b57e37-97f6-4300-a9a2-ad0a5e856165 req-df37fb19-c147-4885-96b3-98ebd9b0bbe5 service nova] Creating event network-vif-plugged:ca02f050-9d97-48b8-b99f-d385fa15b569 for instance 1db62fb2-3b79-46b8-baec-890abe5107ed on n-h1-852086-5 Aug 27 03:22:56.661780 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-26b57e37-97f6-4300-a9a2-ad0a5e856165 req-df37fb19-c147-4885-96b3-98ebd9b0bbe5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048863 Aug 27 03:22:56.663646 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1709/3355] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:56.671018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a921dadd-803c-4374-9a9b-7e147246f00c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4601c8ee0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:56.681573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:56.693727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:56.703427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:56.712642 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3e42c62-40bb-4722-aa39-30083227891c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1753 microversion: 2.20 time: 1.020115 Aug 27 03:22:56.718345 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1647/3356] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:55 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1753 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:56.735215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:56.737427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:56.774669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:56.775426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:56.776073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:56.776982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:56.777609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:56.778230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:56.846752 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00631491-83df-4dbe-bfa2-bbe4a196010f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127087 Aug 27 03:22:56.847433 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1648/3357] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:56 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:56.899046 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a921dadd-803c-4374-9a9b-7e147246f00c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1454 microversion: 2.1 time: 0.233776 Aug 27 03:22:56.900480 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1710/3358] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:56 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:57.025728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:57.026715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:57.041530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.043471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.046604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.049556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.050730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.054535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.648693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:57.649441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:57.669968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.670511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.671592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.671891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.672363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.674000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.891494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:57.907053 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd04f556-e801-4575-9f32-2c25e12b781a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1523 microversion: 2.1 time: 0.880435 Aug 27 03:22:57.910779 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1649/3359] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:57 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1523 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:57.927029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:57.943375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:57.957632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.959042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.963468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.966575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.967288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.971664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:58.377809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:58.396356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:58.401702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:58.406401 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-630a5f91-28fa-4646-8060-590b3546bf65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1753 microversion: 2.20 time: 0.492530 Aug 27 03:22:58.407023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1650/3360] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:22:57 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1753 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:22:58.420926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:58.431264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:58.458804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:58.459575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:58.460478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:58.461601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:58.466701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:58.469778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:58.607492 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55747b5f-e913-4171-9f64-763b8afef7f5 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.188289 Aug 27 03:22:58.608425 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1651/3361] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:22:58 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d/os-volume_attachments => generated 25 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:22:58.629662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-326bbf39-f052-4908-8acb-0f535150a28c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c140ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:59.311951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:59.332571 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9d42524-be4a-47a9-bbd7-b20a7c4a6a32 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 1.688148 Aug 27 03:22:59.337068 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1711/3362] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:57 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:59.357731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:59.358837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:59.393644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:59.399149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:59.400504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:59.409242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:59.412223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:59.413709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:00.434954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:00.454716 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-990be8ca-5f48-4f1a-994d-0120e2284632 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1523 microversion: 2.1 time: 1.113716 Aug 27 03:23:00.457690 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1712/3363] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:59 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1523 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:00.483796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1377509965", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "8abff9c1-87e7-4b55-bb9f-ee056f32c79e"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:08.454820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:08.583145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=68 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:10.440442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=28 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:10.583764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:18.875513 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-326bbf39-f052-4908-8acb-0f535150a28c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1463 microversion: 2.1 time: 20.265613 Aug 27 03:23:18.882880 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1652/3364] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:22:58 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1463 bytes in 20270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:18.896784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:18.900389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:18.905255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] validate_networks() for [('8abff9c1-87e7-4b55-bb9f-ee056f32c79e', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:23:18.916537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:18.922589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:18.922589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:18.923028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:18.923539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:18.923993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.081920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:19.092182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:19.096650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:19.108509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bacca4f2-a96e-499d-af97-204ce9d2db8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.226008 Aug 27 03:23:19.109784 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1653/3365] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:18 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:19.434951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-80f8eaae-52ed-429c-b373-6d1e5c3db954 req-ab12b56b-5362-4747-b67e-6501874f3f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6", "name": "network-vif-plugged", "status": "completed", "tag": "40aff499-2cc1-4a03-9858-ded77b579266"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:19.455995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80f8eaae-52ed-429c-b373-6d1e5c3db954 req-ab12b56b-5362-4747-b67e-6501874f3f78 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.458974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80f8eaae-52ed-429c-b373-6d1e5c3db954 req-ab12b56b-5362-4747-b67e-6501874f3f78 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.459425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80f8eaae-52ed-429c-b373-6d1e5c3db954 req-ab12b56b-5362-4747-b67e-6501874f3f78 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.494218 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-80f8eaae-52ed-429c-b373-6d1e5c3db954 req-ab12b56b-5362-4747-b67e-6501874f3f78 service nova] Creating event network-vif-plugged:40aff499-2cc1-4a03-9858-ded77b579266 for instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 on n-h1-852086-5 Aug 27 03:23:19.508885 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-80f8eaae-52ed-429c-b373-6d1e5c3db954 req-ab12b56b-5362-4747-b67e-6501874f3f78 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396827 Aug 27 03:23:19.510296 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1654/3366] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:19.519476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:19.520189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:19.532060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:23:19.532348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:23:19.533380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:23:19.534296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:23:19.535341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:23:19.551935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.552783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.553505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.555452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.556138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.557164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.557356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.557512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.557955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.558727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.559718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.560165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.586129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Getting quotas for project f5095940a4e34b8598707e7a6c653dda. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:19.602289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Getting quotas for user f73695cba42d41748ed9d7587cae5f08 and project f5095940a4e34b8598707e7a6c653dda. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:19.624945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:23:19.627702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:19.755272 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c354d452-ad8f-4615-9442-a71cf0385242 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 19.296150 Aug 27 03:23:19.771753 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1713/3367] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 19313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:23:19.786458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:19.787083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:19.797378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.798246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.799780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.801572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.802268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.802856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:20.148537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:20.150797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:20.160363 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa43eee3-aaa3-4e80-893d-ffc62431f304 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.648810 Aug 27 03:23:20.164566 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-12280073-1d21-49a1-bc2e-517f16173fc1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1523 microversion: 2.1 time: 0.389445 Aug 27 03:23:20.166666 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1655/3368] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:19 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:20.177352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-289f8463-df6e-4381-b54b-a19d3eadc7d3 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Action: 'create', calling method: .version_select at 0x7fe46026a280>, body: {"keypair": {"name": "tempest-keypair-1522112289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7/DHZX8crwEnzB4eUqy33hdLwObbzm0f6qd+71Cr9xraHHqGAvzaxnKv3kr55nkux7VTE8ddYKZZSKKb3hrcuNKaPYaecVxn7nMKYa1+sRPCLXyd7Sq9/d3D5H4IiBPg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:20.194083 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1714/3369] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:19 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:20.203067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38198972-eec0-482c-a973-b855ba69b3a4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457a05c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:20.239406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-289f8463-df6e-4381-b54b-a19d3eadc7d3 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Getting quotas for project 9f8f558929244e14a1be6a10a440112a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:20.248418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-289f8463-df6e-4381-b54b-a19d3eadc7d3 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Getting quotas for user 29b67f8082c2419098485d8b4d4b357d and project 9f8f558929244e14a1be6a10a440112a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:20.284541 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-289f8463-df6e-4381-b54b-a19d3eadc7d3 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.116377 Aug 27 03:23:20.286283 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1656/3370] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:23:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:23:20.315430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f1b4c040-e7b8-4e13-98fc-82abf83f3cd9 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:20.318254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f1b4c040-e7b8-4e13-98fc-82abf83f3cd9 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:20.339267 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38198972-eec0-482c-a973-b855ba69b3a4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 200 len: 1463 microversion: 2.1 time: 0.125808 Aug 27 03:23:20.346116 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1715/3371] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:20 2022] GET /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:20.352843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:20.376300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:20.402738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:20.406966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:20.407671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:20.408997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:20.412354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:20.414385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:20.685349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1b4c040-e7b8-4e13-98fc-82abf83f3cd9 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:20.706633 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f1b4c040-e7b8-4e13-98fc-82abf83f3cd9 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1218 microversion: 2.1 time: 0.416101 Aug 27 03:23:20.708343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1657/3372] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:20 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1218 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:20.722823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:20.730181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:20.748513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:20.749318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:20.750733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:20.751815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:20.752450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:20.753053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.178731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:21.208368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:21.210202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:21.219885 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f398b98e-96e2-4392-bca0-07182851c96f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.871322 Aug 27 03:23:21.222797 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1716/3373] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:20 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:21.236572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:21.237682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:21.253156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:21.253637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:21.255196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.257179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:21.258415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:21.261396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.549530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:21.563002 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-63226ac4-7a09-4fb5-be98-b9b8fc6a41f9 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.336852 Aug 27 03:23:21.563998 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1717/3374] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:21 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:21.591430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:21.592480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:21.605393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:21.606301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:21.607019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.612102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:21.614693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:21.615335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.859607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:21.874010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a33d155-9b03-4736-9f42-4336b5607dc3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1505 microversion: 2.1 time: 0.289007 Aug 27 03:23:21.877924 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1718/3375] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:21 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:21.886649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3d41f412-d4cc-447a-a74c-005e5745a103 req-9a9c3544-4e5b-44a5-b17c-3cd90d7ee1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4e53a2-729d-4bc1-94be-b67de7e32747", "name": "network-vif-plugged", "status": "completed", "tag": "073a1ea7-b113-4d9f-9a40-40121014676a"}, {"server_uuid": "2483f213-5faf-4973-9e6a-387f01349f30", "name": "network-vif-plugged", "status": "completed", "tag": "28b93c94-7685-4da2-8121-036b44f27cd1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:21.913310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3d41f412-d4cc-447a-a74c-005e5745a103 req-9a9c3544-4e5b-44a5-b17c-3cd90d7ee1e5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:21.914129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3d41f412-d4cc-447a-a74c-005e5745a103 req-9a9c3544-4e5b-44a5-b17c-3cd90d7ee1e5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:21.914779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3d41f412-d4cc-447a-a74c-005e5745a103 req-9a9c3544-4e5b-44a5-b17c-3cd90d7ee1e5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.950747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3d41f412-d4cc-447a-a74c-005e5745a103 req-9a9c3544-4e5b-44a5-b17c-3cd90d7ee1e5 service nova] Creating event network-vif-plugged:073a1ea7-b113-4d9f-9a40-40121014676a for instance 1d4e53a2-729d-4bc1-94be-b67de7e32747 on n-h1-852086-5 Aug 27 03:23:21.955714 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3d41f412-d4cc-447a-a74c-005e5745a103 req-9a9c3544-4e5b-44a5-b17c-3cd90d7ee1e5 service nova] Creating event network-vif-plugged:28b93c94-7685-4da2-8121-036b44f27cd1 for instance 2483f213-5faf-4973-9e6a-387f01349f30 on n-h2-852086-5 Aug 27 03:23:21.971614 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3d41f412-d4cc-447a-a74c-005e5745a103 req-9a9c3544-4e5b-44a5-b17c-3cd90d7ee1e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092026 Aug 27 03:23:21.976105 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1719/3376] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:21.988299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:21.990109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:22.006197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.007088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.011418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:22.013672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.016844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.017561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:22.210372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:22.221493 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-337fc737-63f4-4c2b-bb9b-fc75f1b6addf tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1270 microversion: 2.1 time: 0.243630 Aug 27 03:23:22.222127 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1720/3377] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:21 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:22.251625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:22.252522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:22.266977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.267886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.270897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:22.272718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.276680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.278343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:22.569114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:22.585986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:22.593747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:22.598574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40007404-6548-4886-a042-7862e1250e31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.350446 Aug 27 03:23:22.600519 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1721/3378] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:22 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:23:22.612402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:22.615624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:22.645952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.648703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.651070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:22.660219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.661722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.663892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:22.738948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:22.752910 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c47a3da-af10-45e1-9d8f-13f1f8998624 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1466 microversion: 2.1 time: 2.043140 Aug 27 03:23:22.755397 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1658/3379] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:20 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1466 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:22.794142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-668955257"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:22.806076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:22.816510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.821515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.822593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:22.823730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:22.824449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:22.827926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:23.059332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:23.072050 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7902253b-ca2d-414b-846d-4f3f829837ad tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.469799 Aug 27 03:23:23.092713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1722/3380] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:22 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:23.105386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:23.111306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:23.128021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:23.131169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:23.133662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:23.134802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:23.137374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:23.138295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:23.449304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15979256-acea-486c-a060-c40fba229c00 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "POST /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479/action" status: 202 len: 0 microversion: 2.1 time: 0.658237 Aug 27 03:23:23.453377 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1659/3381] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:23:22 2022] POST /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 03:23:23.467244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:23.468339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:23.486326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:23.486909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:23.489200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:23.490317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:23.491025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:23.493253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:23.781041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:23.806481 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9bb2fb92-3d2e-4c07-a452-5675c6436592 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1505 microversion: 2.1 time: 0.708184 Aug 27 03:23:23.822776 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1723/3382] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:23 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1505 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:23.850764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-78b56f1e-a065-44c5-918f-196eab0511c9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c4f2c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:23.879239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:23.899800 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35f95608-1a24-4c6f-92bd-5528d5821da1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1288 microversion: 2.1 time: 0.444779 Aug 27 03:23:23.914872 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1660/3383] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:23 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1288 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:23.926846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:23.927902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:23.948210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:23.957930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:23.961090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:23.963016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:23.972618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:23.984000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:24.072223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-78b56f1e-a065-44c5-918f-196eab0511c9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1454 microversion: 2.1 time: 0.236863 Aug 27 03:23:24.074407 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1724/3384] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:23 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1454 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:24.105994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:24.114673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:24.133979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:24.139526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:24.141035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:24.143976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:24.147352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:24.149655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:24.568832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:24.589064 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aacce1a9-d6e6-4a86-9cc7-a59120b2c0dd tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1320 microversion: 2.1 time: 0.495090 Aug 27 03:23:24.598791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1725/3385] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:24 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:24.613533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f6e25b85-ca01-4e7d-8ab1-dc04080da99f req-837d8043-61c2-4e9b-a734-5857d9e65da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6", "name": "network-vif-unplugged", "status": "completed", "tag": "40aff499-2cc1-4a03-9858-ded77b579266"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:24.626777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6e25b85-ca01-4e7d-8ab1-dc04080da99f req-837d8043-61c2-4e9b-a734-5857d9e65da2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:24.627879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6e25b85-ca01-4e7d-8ab1-dc04080da99f req-837d8043-61c2-4e9b-a734-5857d9e65da2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:24.628587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6e25b85-ca01-4e7d-8ab1-dc04080da99f req-837d8043-61c2-4e9b-a734-5857d9e65da2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:24.653960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f6e25b85-ca01-4e7d-8ab1-dc04080da99f req-837d8043-61c2-4e9b-a734-5857d9e65da2 service nova] Creating event network-vif-unplugged:40aff499-2cc1-4a03-9858-ded77b579266 for instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 on n-h1-852086-5 Aug 27 03:23:24.666023 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f6e25b85-ca01-4e7d-8ab1-dc04080da99f req-837d8043-61c2-4e9b-a734-5857d9e65da2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065538 Aug 27 03:23:24.667833 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1726/3386] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:24.863839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:24.867754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:24.891136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:24.895310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:24.901670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:24.913396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:24.914546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:24.915787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:25.489947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:25.507791 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-601af4e1-6c74-401a-9c35-a178e081de4f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1505 microversion: 2.1 time: 0.663259 Aug 27 03:23:25.535649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1727/3387] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:24 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:25.550683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:25.556632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:25.573467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:25.576135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:25.577744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:25.578636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:25.582246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:25.582974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:25.804822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:25.816603 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec4327cc-4d31-43f1-b0b6-48783ed40bf1 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1276 microversion: 2.1 time: 0.277317 Aug 27 03:23:25.820316 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1728/3388] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:25 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1276 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:25.827048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-06ef28bb-faa8-4486-a49e-c5ee4b9d675c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457e29a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:25.932406 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-06ef28bb-faa8-4486-a49e-c5ee4b9d675c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1454 microversion: 2.1 time: 0.110379 Aug 27 03:23:25.937071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1729/3389] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:25 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:25.948974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:25.954929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:25.984204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:25.986060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:25.988183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:25.991276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:25.994594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:25.998616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:26.022255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:26.040879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:26.054581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:26.056594 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c0ebc2a-0079-4a4d-932b-ba1550ea44ce tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 2.140100 Aug 27 03:23:26.057861 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1661/3390] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:23 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:26.072214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1292524577", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e56392fa-d241-49aa-bf65-8a8434469e0c"}, {"port": "0c491876-95d6-4d38-82f0-b30e9d00b1de", "tag": "port-1"}, {"port": "0e1b377f-5c08-4c5c-809b-9437d5e3c209", "tag": "port-2"}, {"uuid": "049e16db-eb28-4fcd-8d39-2001b305aaff", "tag": "net-1"}, {"uuid": "049e16db-eb28-4fcd-8d39-2001b305aaff"}, {"uuid": "ac5ebcc4-5097-4aa2-a884-6ff68584e5da", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ac5ebcc4-5097-4aa2-a884-6ff68584e5da", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "654d6f55-dc39-4416-ad10-0bc5bae2c44a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "97703dcc-2bf8-4b65-8d78-03355a36a2ca", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f9cb2996-84d9-4f1e-9953-18b3920c480d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2109704973"}], "key_name": "tempest-keypair-1522112289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:26.462783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:26.484867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2259e5fb-88e2-471e-b017-c60773bd4a29 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 200 len: 1508 microversion: 2.1 time: 0.546084 Aug 27 03:23:26.486504 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1730/3391] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:25 2022] GET /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 1508 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:26.514225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:26.515149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 2483f213-5faf-4973-9e6a-387f01349f30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:26.532932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:26.555377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:26.556022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:26.556961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:26.557597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:26.558237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:27.112293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:27.133240 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aab8c740-c093-4a33-b720-11edf6fa3d98 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/2483f213-5faf-4973-9e6a-387f01349f30" status: 200 len: 1507 microversion: 2.1 time: 0.625328 Aug 27 03:23:27.138907 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1731/3392] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:26 2022] GET /compute/v2.1/servers/2483f213-5faf-4973-9e6a-387f01349f30 => generated 1507 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:27.152064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:27.152689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:27.175609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:27.176454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:27.177149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:27.178664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:27.180194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:27.189705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:27.645664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:27.663758 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b006fe89-8fff-4d23-8990-561548844c95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1505 microversion: 2.1 time: 0.520803 Aug 27 03:23:27.664634 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1732/3393] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:27 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:27.690997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:27.691842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:27.711453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:27.711966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:27.712423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:27.719964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:27.720606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:27.721416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:27.912404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] validate_networks() for [('e56392fa-d241-49aa-bf65-8a8434469e0c', None, None, None, None, None), (None, None, '0c491876-95d6-4d38-82f0-b30e9d00b1de', None, None, None), (None, None, '0e1b377f-5c08-4c5c-809b-9437d5e3c209', None, None, None), ('049e16db-eb28-4fcd-8d39-2001b305aaff', None, None, None, None, None), ('049e16db-eb28-4fcd-8d39-2001b305aaff', None, None, None, None, None), ('ac5ebcc4-5097-4aa2-a884-6ff68584e5da', '10.2.2.100', None, None, None, None), ('ac5ebcc4-5097-4aa2-a884-6ff68584e5da', '10.2.2.200', None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:23:27.962455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:27.973296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff40238d-e99c-4bfd-aaeb-b0cc205cd5c0 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1276 microversion: 2.1 time: 0.292806 Aug 27 03:23:27.974017 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1733/3394] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:27 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:27.989375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95558792-35f1-4555-b1cb-b22be5fd1a37 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457e03430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.071156 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95558792-35f1-4555-b1cb-b22be5fd1a37 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1454 microversion: 2.1 time: 0.087403 Aug 27 03:23:28.071846 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1734/3395] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:27 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:28.085188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.086243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:28.093350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:28.094272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:28.094907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:28.095799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:28.096455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:28.097056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:28.134692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:28.515193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:28.546666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:28.548236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:28.556162 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5e919bd-8291-4535-bed0-736231134d93 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.475607 Aug 27 03:23:28.556774 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1735/3396] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:28 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:28.569983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b0108f1a-4a17-4947-a0c6-5ba0c0019dae req-2765084f-1f01-4a49-bd95-1fae289554e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db62fb2-3b79-46b8-baec-890abe5107ed", "name": "network-vif-unplugged", "status": "completed", "tag": "ca02f050-9d97-48b8-b99f-d385fa15b569"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:28.588240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0108f1a-4a17-4947-a0c6-5ba0c0019dae req-2765084f-1f01-4a49-bd95-1fae289554e1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:28.591155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0108f1a-4a17-4947-a0c6-5ba0c0019dae req-2765084f-1f01-4a49-bd95-1fae289554e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:28.592293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0108f1a-4a17-4947-a0c6-5ba0c0019dae req-2765084f-1f01-4a49-bd95-1fae289554e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:28.621969 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b0108f1a-4a17-4947-a0c6-5ba0c0019dae req-2765084f-1f01-4a49-bd95-1fae289554e1 service nova] Creating event network-vif-unplugged:ca02f050-9d97-48b8-b99f-d385fa15b569 for instance 1db62fb2-3b79-46b8-baec-890abe5107ed on n-h1-852086-5 Aug 27 03:23:28.633623 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b0108f1a-4a17-4947-a0c6-5ba0c0019dae req-2765084f-1f01-4a49-bd95-1fae289554e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075551 Aug 27 03:23:28.634594 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1736/3397] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:28.645148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.645755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 2483f213-5faf-4973-9e6a-387f01349f30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:28.664696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:28.665195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:28.665657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:28.666385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:28.666843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:28.667270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:28.741730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 2483f213-5faf-4973-9e6a-387f01349f30] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:23:28.950876 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-942b316e-55e9-4ab8-8842-5c849c2db996 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2483f213-5faf-4973-9e6a-387f01349f30" status: 204 len: 0 microversion: 2.1 time: 0.314217 Aug 27 03:23:28.951330 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1737/3398] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:23:28 2022] DELETE /compute/v2.1/servers/2483f213-5faf-4973-9e6a-387f01349f30 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:23:28.970879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:28.973681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:28.995164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:28.995992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:28.997920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:28.999019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:29.002817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:29.005263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:29.447251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:29.487127 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b26b73f-2212-42fa-9d51-f93cf29dff98 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1505 microversion: 2.1 time: 0.530997 Aug 27 03:23:29.501325 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1738/3399] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:28 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:29.507436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:29.507950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:29.518820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:29.519405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:29.520186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:29.520949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:29.521418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:29.521856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:29.587493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:29.618971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:29.635794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 1d4e53a2-729d-4bc1-94be-b67de7e32747] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:23:29.996545 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b4f63ef-f129-4c85-bfd1-464d84d3ba18 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747" status: 204 len: 0 microversion: 2.1 time: 0.492579 Aug 27 03:23:29.999410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1739/3400] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:23:29 2022] DELETE /compute/v2.1/servers/1d4e53a2-729d-4bc1-94be-b67de7e32747 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:23:30.007327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:30.008359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:30.020889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:30.021693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:30.022549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:30.023501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:30.024141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:30.024755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:30.315364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:30.326955 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95411190-3e60-4909-9b67-97a08bffa29b tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1318 microversion: 2.1 time: 0.325476 Aug 27 03:23:30.327760 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1740/3401] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:30 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:30.345449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d5afe34-4ef4-4885-a689-2778493cf42d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457a05c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:30.428833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d5afe34-4ef4-4885-a689-2778493cf42d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1454 microversion: 2.1 time: 0.099292 Aug 27 03:23:30.432980 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1741/3402] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:30 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:30.455980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:30.458040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:30.487779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:30.488381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:30.488903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:30.489739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:30.490408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:30.491141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:30.703244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:30.800883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:30.815249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:30.818891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:30.822459 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0b2ab5e-4bc8-4149-82c7-56392430f378 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.386107 Aug 27 03:23:30.823653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1742/3403] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:30 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:30.832113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-894484178", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "38b456ec-922f-4e54-9383-f912f0fbb425"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:36.039521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:40.730976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] validate_networks() for [('38b456ec-922f-4e54-9383-f912f0fbb425', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:23:40.746509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:23:40.747462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:23:40.748038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:23:40.748539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:23:40.749035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:23:40.760459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:40.761327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:40.763780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:40.764807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:40.766634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:40.768095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:40.805447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:40.807963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Getting quotas for project 9f8f558929244e14a1be6a10a440112a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:40.823860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Getting quotas for user 29b67f8082c2419098485d8b4d4b357d and project 9f8f558929244e14a1be6a10a440112a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:40.860864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:41.078126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:23:41.081256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='654d6f55-dc39-4416-ad10-0bc5bae2c44a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='97703dcc-2bf8-4b65-8d78-03355a36a2ca',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9cb2996-84d9-4f1e-9953-18b3920c480d',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:41.807736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-386e42ec-bc76-459a-b964-46a516131e85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 15.748144 Aug 27 03:23:41.820209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1662/3404] 10.222.0.69 () {62 vars in 1189 bytes} [Sat Aug 27 03:23:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 15761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:23:41.827500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:41.828398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:41.835427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.838517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.839320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:41.841049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:41.841973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:41.842857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.173369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:42.186798 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6de6259e-6f0e-4b3d-88b6-9936364aa27f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 200 len: 1448 microversion: 2.1 time: 0.362460 Aug 27 03:23:42.206544 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1663/3405] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:41 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 1448 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:42.220473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d7a67cec-bf95-452b-87f7-d85ead16f379 req-c66bd914-2e86-4c63-9772-502758013da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e086890c-6209-43d2-a7e7-aa5a748c3479", "name": "network-vif-plugged", "status": "completed", "tag": "f25d42fc-04e2-4a77-ac61-a04dc1cff23c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:42.244558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d7a67cec-bf95-452b-87f7-d85ead16f379 req-c66bd914-2e86-4c63-9772-502758013da0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.247281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d7a67cec-bf95-452b-87f7-d85ead16f379 req-c66bd914-2e86-4c63-9772-502758013da0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.247832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d7a67cec-bf95-452b-87f7-d85ead16f379 req-c66bd914-2e86-4c63-9772-502758013da0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.278966 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d7a67cec-bf95-452b-87f7-d85ead16f379 req-c66bd914-2e86-4c63-9772-502758013da0 service nova] Creating event network-vif-plugged:f25d42fc-04e2-4a77-ac61-a04dc1cff23c for instance e086890c-6209-43d2-a7e7-aa5a748c3479 on n-h2-852086-5 Aug 27 03:23:42.294349 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d7a67cec-bf95-452b-87f7-d85ead16f379 req-c66bd914-2e86-4c63-9772-502758013da0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081625 Aug 27 03:23:42.295643 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1664/3406] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:42.301607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:42.311486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:42.324617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.325303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.326445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.333894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.334511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.335049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.656073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:23:42.656575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:23:42.656974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:23:42.657393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:23:42.658262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:23:42.674969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.675750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.676206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.677614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.678089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.678707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.686184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:42.703217 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9923129d-e088-421c-a782-3c670b51756d tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1318 microversion: 2.1 time: 0.405840 Aug 27 03:23:42.717952 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1665/3407] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:42 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:42.723464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37440ffd-3ce9-4196-8210-ae9d5197368b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46039bd30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:42.724153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Getting quotas for project 4d16be1c428c465db77a7ef995249ea6. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:42.734341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Getting quotas for user 40559a7f1d984e0692b9056feccdf988 and project 4d16be1c428c465db77a7ef995249ea6. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:42.749532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Going to run 2 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:23:42.756894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:42.831028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=8443d4c1-1589-49d3-9fe7-d6edea43b9de,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:42.868807 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37440ffd-3ce9-4196-8210-ae9d5197368b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1454 microversion: 2.1 time: 0.149538 Aug 27 03:23:42.869747 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1666/3408] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:42 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:42.881315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:42.882432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:42.898059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.898999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.899458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:42.904026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:42.905849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:42.911388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.010146 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a683633-0266-4a13-9c68-3bcde51c9736 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 12.182505 Aug 27 03:23:43.015277 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1743/3409] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:23:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 12191 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 03:23:43.289421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:43.307508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:43.311058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:43.313385 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b632d0eb-5c71-4848-beea-1174207b5887 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.442107 Aug 27 03:23:43.315369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1667/3410] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:42 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:43.342226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-93d49578-b814-4a64-a0ea-cbc5aea52a1d req-92c0f84f-6169-4d73-8b7f-4758cfdabe4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2483f213-5faf-4973-9e6a-387f01349f30", "name": "network-vif-deleted", "tag": "28b93c94-7685-4da2-8121-036b44f27cd1"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:43.349225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-929424ad-4d4d-46f5-a458-370893405e89 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:43.350842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-929424ad-4d4d-46f5-a458-370893405e89 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:43.365708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93d49578-b814-4a64-a0ea-cbc5aea52a1d req-92c0f84f-6169-4d73-8b7f-4758cfdabe4a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.366437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93d49578-b814-4a64-a0ea-cbc5aea52a1d req-92c0f84f-6169-4d73-8b7f-4758cfdabe4a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.368023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93d49578-b814-4a64-a0ea-cbc5aea52a1d req-92c0f84f-6169-4d73-8b7f-4758cfdabe4a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.388561 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-93d49578-b814-4a64-a0ea-cbc5aea52a1d req-92c0f84f-6169-4d73-8b7f-4758cfdabe4a service nova] Creating event network-vif-deleted:28b93c94-7685-4da2-8121-036b44f27cd1 for instance 2483f213-5faf-4973-9e6a-387f01349f30 on n-h2-852086-5 Aug 27 03:23:43.400161 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-93d49578-b814-4a64-a0ea-cbc5aea52a1d req-92c0f84f-6169-4d73-8b7f-4758cfdabe4a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380698 Aug 27 03:23:43.400998 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1744/3411] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:43.415557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:43.420233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:43.433356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.435197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.435824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.436907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.437647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.438385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.474784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:23:43.483717 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.compute.api [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Working on deleting snapshot ff64c6f4-c3b1-4415-86d8-374ab612cde2 from shelved instance... Aug 27 03:23:43.619298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-929424ad-4d4d-46f5-a458-370893405e89 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:43.631713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-929424ad-4d4d-46f5-a458-370893405e89 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:43.637113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-929424ad-4d4d-46f5-a458-370893405e89 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:43.640229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-929424ad-4d4d-46f5-a458-370893405e89 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1286 microversion: 2.42 time: 0.324521 Aug 27 03:23:43.643754 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1668/3412] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:43 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1286 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:43.662865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:43.672784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:43.675937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Searching by: {'deleted': False, 'project_id': '4d16be1c428c465db77a7ef995249ea6'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:23:43.714527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.716443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.724514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.726927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.728451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.729264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.796235 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-426e2bf0-d0bc-48e4-9d6a-44d09cf6501b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.150993 Aug 27 03:23:43.810421 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1669/3413] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:23:43 2022] GET /compute/v2.1/servers => generated 671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:43.819034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:43.820020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:43.828159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.828917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.829585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:43.830548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:43.831240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:43.831934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:44.013542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:44.026263 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18206442-675f-4974-8707-7becbb52c6f7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1318 microversion: 2.1 time: 0.213549 Aug 27 03:23:44.044639 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1670/3414] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:43 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:44.063152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57050042-83c1-42b3-bd20-5cd802bf7dce tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:44.063819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57050042-83c1-42b3-bd20-5cd802bf7dce tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:44.184891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57050042-83c1-42b3-bd20-5cd802bf7dce tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:44.193871 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57050042-83c1-42b3-bd20-5cd802bf7dce tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1217 microversion: 2.1 time: 0.147232 Aug 27 03:23:44.197294 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1671/3415] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:44 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:44.202974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-17aa758d-13e5-4f4b-b576-55076b3c81c7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4603afca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:45.743766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Doing local delete in cell c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=122407) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 03:23:45.749262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:45.750135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:45.750757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:45.751314 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.compute.api [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 03:23:45.754448 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-17aa758d-13e5-4f4b-b576-55076b3c81c7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1454 microversion: 2.1 time: 1.555688 Aug 27 03:23:45.756764 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1672/3416] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:44 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1454 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:45.766605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] deallocate_for_instance() {{(pid=122407) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 03:23:45.772959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:45.781469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:45.834127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:45.842388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:45.847050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:45.867998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:45.868535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:45.868993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:48.037868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:48.096198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:48.103489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:48.107879 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6e47e85-85a9-4d30-8ad0-d8e5d8c31577 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 2.346931 Aug 27 03:23:48.111770 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1673/3417] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:45 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:48.128768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f240d1e8-f54d-4206-9385-c44b0cc2aed5 req-656457f4-2f91-457d-9d92-095471375504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4e53a2-729d-4bc1-94be-b67de7e32747", "name": "network-vif-unplugged", "status": "completed", "tag": "073a1ea7-b113-4d9f-9a40-40121014676a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:48.177104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f240d1e8-f54d-4206-9385-c44b0cc2aed5 req-656457f4-2f91-457d-9d92-095471375504 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:48.183025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f240d1e8-f54d-4206-9385-c44b0cc2aed5 req-656457f4-2f91-457d-9d92-095471375504 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:48.184673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f240d1e8-f54d-4206-9385-c44b0cc2aed5 req-656457f4-2f91-457d-9d92-095471375504 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:48.243323 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f240d1e8-f54d-4206-9385-c44b0cc2aed5 req-656457f4-2f91-457d-9d92-095471375504 service nova] Creating event network-vif-unplugged:073a1ea7-b113-4d9f-9a40-40121014676a for instance 1d4e53a2-729d-4bc1-94be-b67de7e32747 on n-h1-852086-5 Aug 27 03:23:48.263914 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f240d1e8-f54d-4206-9385-c44b0cc2aed5 req-656457f4-2f91-457d-9d92-095471375504 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147657 Aug 27 03:23:48.266782 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1674/3418] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:48.289959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:48.292689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:48.314819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:48.316486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:48.317545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:48.321503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:48.322896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:48.329070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:49.471163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:49.515435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:49.519579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:49.523127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Updating instance_info_cache with network_info: [] {{(pid=122407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:23:49.526464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1c7e624-860c-4598-8d63-867377650c75 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1662 microversion: 2.42 time: 1.254637 Aug 27 03:23:49.551201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1675/3419] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:48 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1662 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:49.572539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:49.576902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:49.610223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:49.625636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:49.627692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:49.629560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:49.632762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:49.636726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:49.638199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:50.627613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:50.638262 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e55bf106-ada8-4f69-9386-3c856d662e05 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1318 microversion: 2.1 time: 1.084357 Aug 27 03:23:50.643268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1676/3420] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:49 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1318 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:50.658498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:50.660767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:50.691427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:50.695522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:50.696283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:50.700243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:50.704044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:50.704699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:50.738031 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b62fbbc-7c45-4255-9365-1b825b636162 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 204 len: 0 microversion: 2.1 time: 7.331926 Aug 27 03:23:50.743875 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1745/3421] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:23:43 2022] DELETE /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 0 bytes in 7341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:23:50.764661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-555215d5-7f79-4e09-bcf4-c366c3f1d960 req-efcbe9db-d450-47bb-9602-f37454514704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4e53a2-729d-4bc1-94be-b67de7e32747", "name": "network-vif-deleted", "tag": "073a1ea7-b113-4d9f-9a40-40121014676a"}, {"name": "network-changed", "server_uuid": "24fe1268-fde3-4f2d-95b1-9f92b1ea1380", "tag": "4ab7c7f2-cbc5-4432-97a7-2242d221e278"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:50.800889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-555215d5-7f79-4e09-bcf4-c366c3f1d960 req-efcbe9db-d450-47bb-9602-f37454514704 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:50.804160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-555215d5-7f79-4e09-bcf4-c366c3f1d960 req-efcbe9db-d450-47bb-9602-f37454514704 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:50.804832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-555215d5-7f79-4e09-bcf4-c366c3f1d960 req-efcbe9db-d450-47bb-9602-f37454514704 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:50.823851 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-555215d5-7f79-4e09-bcf4-c366c3f1d960 req-efcbe9db-d450-47bb-9602-f37454514704 service nova] Creating event network-vif-deleted:073a1ea7-b113-4d9f-9a40-40121014676a for instance 1d4e53a2-729d-4bc1-94be-b67de7e32747 on n-h1-852086-5 Aug 27 03:23:50.825251 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-555215d5-7f79-4e09-bcf4-c366c3f1d960 req-efcbe9db-d450-47bb-9602-f37454514704 service nova] Creating event network-changed:4ab7c7f2-cbc5-4432-97a7-2242d221e278 for instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 on n-h2-852086-5 Aug 27 03:23:50.850221 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-555215d5-7f79-4e09-bcf4-c366c3f1d960 req-efcbe9db-d450-47bb-9602-f37454514704 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.104539 Aug 27 03:23:50.859225 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1746/3422] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:50.870255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7673d77-70d1-4538-aa12-2c2f5258c325 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457d32670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:51.159571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:51.186021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c5def05-b0dd-4dec-aa52-654044060c75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1275 microversion: 2.1 time: 0.541638 Aug 27 03:23:51.189650 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1677/3423] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:50 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1275 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:51.211230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:51.214092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:51.247917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:51.248845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:51.249674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:51.252600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:51.253740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:51.254415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:51.426643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7673d77-70d1-4538-aa12-2c2f5258c325 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1463 microversion: 2.1 time: 0.564775 Aug 27 03:23:51.427143 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1747/3424] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:50 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1463 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:51.859736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-87adf7cb-9ed4-43d2-8ce0-fcd1d3924f16 req-990d4fd9-2179-4c5f-815f-6a94f8a960e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6", "name": "network-vif-deleted", "tag": "40aff499-2cc1-4a03-9858-ded77b579266"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:51.906143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-87adf7cb-9ed4-43d2-8ce0-fcd1d3924f16 req-990d4fd9-2179-4c5f-815f-6a94f8a960e8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:51.908805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-87adf7cb-9ed4-43d2-8ce0-fcd1d3924f16 req-990d4fd9-2179-4c5f-815f-6a94f8a960e8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:51.910859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-87adf7cb-9ed4-43d2-8ce0-fcd1d3924f16 req-990d4fd9-2179-4c5f-815f-6a94f8a960e8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:51.939051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.server_external_events [req-87adf7cb-9ed4-43d2-8ce0-fcd1d3924f16 req-990d4fd9-2179-4c5f-815f-6a94f8a960e8 service nova] Unable to find a host for instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6. Dropping event network-vif-deleted {{(pid=122407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 03:23:51.941730 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-87adf7cb-9ed4-43d2-8ce0-fcd1d3924f16 req-990d4fd9-2179-4c5f-815f-6a94f8a960e8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.513552 Aug 27 03:23:51.947820 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1748/3425] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 519 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 03:23:51.955320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-1f52440d-ea67-4006-bc1c-d112b17d5328 req-b8b984cb-20a4-490d-8156-59a86fb512fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fe1268-fde3-4f2d-95b1-9f92b1ea1380", "name": "network-vif-plugged", "status": "completed", "tag": "4ab7c7f2-cbc5-4432-97a7-2242d221e278"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:51.983558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-1f52440d-ea67-4006-bc1c-d112b17d5328 req-b8b984cb-20a4-490d-8156-59a86fb512fb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:51.986107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-1f52440d-ea67-4006-bc1c-d112b17d5328 req-b8b984cb-20a4-490d-8156-59a86fb512fb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:51.986662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-1f52440d-ea67-4006-bc1c-d112b17d5328 req-b8b984cb-20a4-490d-8156-59a86fb512fb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.017787 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-1f52440d-ea67-4006-bc1c-d112b17d5328 req-b8b984cb-20a4-490d-8156-59a86fb512fb service nova] Creating event network-vif-plugged:4ab7c7f2-cbc5-4432-97a7-2242d221e278 for instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 on n-h2-852086-5 Aug 27 03:23:52.036599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-1f52440d-ea67-4006-bc1c-d112b17d5328 req-b8b984cb-20a4-490d-8156-59a86fb512fb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082094 Aug 27 03:23:52.037586 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1749/3426] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:52.059962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:52.061215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:52.097436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.097956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.098443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.099197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.099670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.103032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.586985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:52.611572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:52.613624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:52.616047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d693cc5-89e1-414b-8054-ce40f9cb07c2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 1.423421 Aug 27 03:23:52.617250 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1678/3427] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:51 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:52.634928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:52.636454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:52.652293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.654873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.655517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.656998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.657644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.658391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.686010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 HTTP/1.1 Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6'} Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:23:52.692712 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:23:52.698197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:52.698197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:23:52.698197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:23:52.698197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:23:52.698197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:23:52.698197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:23:52.698197 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:23:52.703445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:23:52.705431 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb00e6d0-e041-4fc3-90c4-c21d37502051 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 404 len: 111 microversion: 2.1 time: 0.086880 Aug 27 03:23:52.710224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:52.717617 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1679/3428] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:52 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:23:52.743362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:52.760454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a0bb9cf3-b5c5-4dc9-a7b4-c01627a29f85 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46026fc10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:52.866102 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a0bb9cf3-b5c5-4dc9-a7b4-c01627a29f85 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 200 len: 1463 microversion: 2.1 time: 0.146606 Aug 27 03:23:52.868120 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1680/3429] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:23:52 2022] GET /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:52.875802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:52.876948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:52.897429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.898993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.900307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:52.902072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:52.908082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:52.908788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:53.060956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:53.071775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:53.089512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:53.091651 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-484b008a-bf25-4f7a-8af1-8da3a8349409 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1662 microversion: 2.42 time: 1.037951 Aug 27 03:23:53.092263 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1750/3430] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:52 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1662 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:53.114221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:53.114857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:53.144938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:53.145467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:53.145923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:53.146690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:53.147154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:53.147587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:53.565901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:53.619432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58433a75-864a-4316-8139-fc97b5abddb5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1317 microversion: 2.1 time: 0.526018 Aug 27 03:23:53.629407 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1751/3431] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:53 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:53.644906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:53.652102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:53.659586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:53.660682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5412b907-5398-4b23-ad92-d13554938044 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1318 microversion: 2.1 time: 0.790564 Aug 27 03:23:53.661279 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1681/3432] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:52 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1318 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:53.691355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:53.691854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:53.696913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-30175029", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "be792eba-f4b7-46b8-9127-1ca32ef532fe"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:53.697517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:53.698320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:53.698799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:53.701732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:53.776505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:53.921691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] validate_networks() for [('be792eba-f4b7-46b8-9127-1ca32ef532fe', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:23:54.193293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:54.931075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:54.968707 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45e0f547-daf1-49df-b9b8-fcf729339d40 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 1466 microversion: 2.1 time: 1.330315 Aug 27 03:23:54.985860 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1752/3433] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:53 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 1466 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:55.024595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:55.025991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:55.050810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:55.054328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:55.061068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:55.067088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:55.067866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:55.069708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:56.704837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:56.725055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:56.733682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:56.735863 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-385ff2e1-6a5f-4ae3-86f7-25a56a7cdd4f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 1.744902 Aug 27 03:23:56.740509 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1753/3434] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:54 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:56.753750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:56.754714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:56.771156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:56.772075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:56.774874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:56.775914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:56.776687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:56.781879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:57.269449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:57.290666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:57.293338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:57.299294 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-893cb843-15e0-4ad7-ba10-c209c0aa7747 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1709 microversion: 2.42 time: 0.556891 Aug 27 03:23:57.305668 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1754/3435] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:56 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1709 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:57.313181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-39fd992c-06c3-4fd5-a843-4de228d7b9b9 req-eb1f7759-528e-4604-a8f3-c8f445550b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3889386-64a2-4858-af6e-009e8606df9f", "name": "network-vif-plugged", "status": "completed", "tag": "544e928d-a4d3-43ac-9b2f-854b3810328a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:57.338974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-39fd992c-06c3-4fd5-a843-4de228d7b9b9 req-eb1f7759-528e-4604-a8f3-c8f445550b68 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:57.341398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-39fd992c-06c3-4fd5-a843-4de228d7b9b9 req-eb1f7759-528e-4604-a8f3-c8f445550b68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:57.346745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-39fd992c-06c3-4fd5-a843-4de228d7b9b9 req-eb1f7759-528e-4604-a8f3-c8f445550b68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:57.369749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:23:57.370547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:23:57.371096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:23:57.371770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:23:57.372203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:23:57.378369 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-39fd992c-06c3-4fd5-a843-4de228d7b9b9 req-eb1f7759-528e-4604-a8f3-c8f445550b68 service nova] Creating event network-vif-plugged:544e928d-a4d3-43ac-9b2f-854b3810328a for instance b3889386-64a2-4858-af6e-009e8606df9f on n-h1-852086-5 Aug 27 03:23:57.404139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:57.404706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:57.405535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-39fd992c-06c3-4fd5-a843-4de228d7b9b9 req-eb1f7759-528e-4604-a8f3-c8f445550b68 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097883 Aug 27 03:23:57.406132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:57.406937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:57.407385 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1755/3436] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:57.408483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:57.411695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:57.422613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:57.423733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:57.437275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:57.453654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:57.454538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:57.457703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:57.460010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:57.461011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:57.532744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:57.565146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for user 267cffdb49624ff986aed20fd255b1db and project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:57.589769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:23:57.601913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:57.755127 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-295cb9a8-4fff-407a-8933-7d6e126ac6c9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.092579 Aug 27 03:23:57.764058 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1682/3437] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:23:57.770030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:57.771043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:57.779202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:57.780882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:57.782016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:57.784132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:57.784883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:57.785944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:58.566095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:58.580846 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e74f709-5513-425a-950a-10e0266a5249 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1508 microversion: 2.1 time: 0.815248 Aug 27 03:23:58.583347 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1683/3438] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:57 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1508 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:58.598463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f948d093-1df2-47c4-8d5f-61dedc70c1ae req-888ad48b-6825-455a-9166-35f04c70c001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53561119-0301-4a16-9ad2-124e2a297c81", "tag": "7e8d340a-f775-4c3f-9d00-b0bae421e830"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:58.627863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f948d093-1df2-47c4-8d5f-61dedc70c1ae req-888ad48b-6825-455a-9166-35f04c70c001 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:58.628350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f948d093-1df2-47c4-8d5f-61dedc70c1ae req-888ad48b-6825-455a-9166-35f04c70c001 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:58.628995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f948d093-1df2-47c4-8d5f-61dedc70c1ae req-888ad48b-6825-455a-9166-35f04c70c001 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:58.671452 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f948d093-1df2-47c4-8d5f-61dedc70c1ae req-888ad48b-6825-455a-9166-35f04c70c001 service nova] Creating event network-changed:7e8d340a-f775-4c3f-9d00-b0bae421e830 for instance 53561119-0301-4a16-9ad2-124e2a297c81 on n-h1-852086-5 Aug 27 03:23:58.682988 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f948d093-1df2-47c4-8d5f-61dedc70c1ae req-888ad48b-6825-455a-9166-35f04c70c001 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097186 Aug 27 03:23:58.685515 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1684/3439] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:58.696241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-487db9fb-0657-4b75-9155-9e6c09977ff9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4602843a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:58.824913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:58.856372 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-791bae69-eb31-45cd-b4ee-a8dcde13d34f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1317 microversion: 2.1 time: 1.447588 Aug 27 03:23:58.866357 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1756/3440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:57 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1317 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:58.899274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c359c165-c677-4095-b5e5-2a9e9ac94312 req-03773113-7084-4746-8a9c-60ccbab16e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8443d4c1-1589-49d3-9fe7-d6edea43b9de", "tag": "972ebbe5-d1f5-44bd-94b0-77a9f863b869"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:58.917501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c359c165-c677-4095-b5e5-2a9e9ac94312 req-03773113-7084-4746-8a9c-60ccbab16e82 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:58.918691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c359c165-c677-4095-b5e5-2a9e9ac94312 req-03773113-7084-4746-8a9c-60ccbab16e82 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:58.924709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c359c165-c677-4095-b5e5-2a9e9ac94312 req-03773113-7084-4746-8a9c-60ccbab16e82 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:58.947135 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c359c165-c677-4095-b5e5-2a9e9ac94312 req-03773113-7084-4746-8a9c-60ccbab16e82 service nova] Creating event network-changed:972ebbe5-d1f5-44bd-94b0-77a9f863b869 for instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de on n-h1-852086-5 Aug 27 03:23:58.975152 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c359c165-c677-4095-b5e5-2a9e9ac94312 req-03773113-7084-4746-8a9c-60ccbab16e82 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106591 Aug 27 03:23:58.976964 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1757/3441] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:23:58.992986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:59.000682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-487db9fb-0657-4b75-9155-9e6c09977ff9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?changes-since=2022-08-27T03%3A21%3A40Z" status: 200 len: 2375 microversion: 2.1 time: 0.312966 Aug 27 03:23:59.005110 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1685/3442] 10.222.0.69 () {58 vars in 1199 bytes} [Sat Aug 27 03:23:58 2022] GET /compute/v2.1/images?changes-since=2022-08-27T03%3A21%3A40Z => generated 2375 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:59.014810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:59.017576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:59.018933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:59.037305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.038226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.038924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.042354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.045882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.048940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.049766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.052233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.052703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.053659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.054184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.054744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.412528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:59.429979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba5173f6-fcf6-44ac-a987-275a9246eeb6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1217 microversion: 2.1 time: 0.423690 Aug 27 03:23:59.430608 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1686/3443] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:59 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1217 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:59.467511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:59.468153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:59.501735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.502280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.510354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.514063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:59.517668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:59.518408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:59.860977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:59.870316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:59.892437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:59.904629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:59.906651 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8580785e-812d-4ed5-882e-893c7bbf2f40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.927949 Aug 27 03:23:59.907879 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1758/3444] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:58 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:23:59.945199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f16008a0-f16b-4117-a110-0969b71bd0d7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4602f9e50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:00.033435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f16008a0-f16b-4117-a110-0969b71bd0d7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-907899472" status: 200 len: 484 microversion: 2.1 time: 0.111121 Aug 27 03:24:00.034787 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1759/3445] 10.222.0.69 () {58 vars in 1229 bytes} [Sat Aug 27 03:23:59 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-907899472 => generated 484 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:00.040710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6ea496ef-f6f0-4cd7-a587-f27d93318321 req-707fe16b-7307-421f-957c-212ed9d59b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e086890c-6209-43d2-a7e7-aa5a748c3479", "name": "network-vif-unplugged", "status": "completed", "tag": "f25d42fc-04e2-4a77-ac61-a04dc1cff23c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:00.054502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ea496ef-f6f0-4cd7-a587-f27d93318321 req-707fe16b-7307-421f-957c-212ed9d59b22 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.055357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ea496ef-f6f0-4cd7-a587-f27d93318321 req-707fe16b-7307-421f-957c-212ed9d59b22 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.056036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ea496ef-f6f0-4cd7-a587-f27d93318321 req-707fe16b-7307-421f-957c-212ed9d59b22 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.077829 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6ea496ef-f6f0-4cd7-a587-f27d93318321 req-707fe16b-7307-421f-957c-212ed9d59b22 service nova] Creating event network-vif-unplugged:f25d42fc-04e2-4a77-ac61-a04dc1cff23c for instance e086890c-6209-43d2-a7e7-aa5a748c3479 on n-h2-852086-5 Aug 27 03:24:00.084183 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6ea496ef-f6f0-4cd7-a587-f27d93318321 req-707fe16b-7307-421f-957c-212ed9d59b22 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047232 Aug 27 03:24:00.086878 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1760/3446] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:00.096241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:00.097335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:00.108258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.109237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.110090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.111971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.112714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.113755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.169515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:00.223788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:00.237471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:00.248783 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-797f4738-0406-4495-abde-869c2a6e81bd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1756 microversion: 2.42 time: 0.812137 Aug 27 03:24:00.253815 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1687/3447] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:23:59 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1756 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:00.271306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7045db6-8a6e-4735-ae95-c4235958950c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4604021f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:00.560279 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7045db6-8a6e-4735-ae95-c4235958950c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?server=e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 957 microversion: 2.1 time: 0.301434 Aug 27 03:24:00.562484 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1688/3448] 10.222.0.69 () {58 vars in 1209 bytes} [Sat Aug 27 03:24:00 2022] GET /compute/v2.1/images?server=e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 957 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:00.579432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:00.580942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:00.596098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.597093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.597783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.601631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.604122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.606700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.845825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:00.858095 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5dd5a76-8904-44cb-b11e-3bf35344b81a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1283 microversion: 2.1 time: 0.292722 Aug 27 03:24:00.859066 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1689/3449] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:00 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1283 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:00.864942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-205834c3-6be6-4166-9101-a6107b2131fe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460402d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:00.903839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:00.919565 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e7b00372-d7dd-4bbe-b055-737e260abaa1 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1317 microversion: 2.1 time: 0.830252 Aug 27 03:24:00.927808 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1761/3450] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:00 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1317 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:00.948514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:00.952846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:00.971404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.972007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.973866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:00.975087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:00.977861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:00.984096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:01.014107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-205834c3-6be6-4166-9101-a6107b2131fe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 484 microversion: 2.1 time: 0.153177 Aug 27 03:24:01.016532 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1690/3451] 10.222.0.69 () {58 vars in 1317 bytes} [Sat Aug 27 03:24:00 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed => generated 484 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:01.056696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d2aa9eb-0a57-4613-9571-5895e4311bba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe4575008b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:01.155528 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d2aa9eb-0a57-4613-9571-5895e4311bba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 484 microversion: 2.1 time: 0.122367 Aug 27 03:24:01.158200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1691/3452] 10.222.0.69 () {58 vars in 1303 bytes} [Sat Aug 27 03:24:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed => generated 484 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:24:01.173409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5ea5c27-51ba-4ce4-bc46-b14679c4ec82 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46037ac10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:01.910074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:01.923645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:01.925116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:01.936141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-585e9ea1-da03-4650-9e95-68cbb6be227d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1809 microversion: 2.20 time: 0.998162 Aug 27 03:24:01.958150 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1762/3453] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:00 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1809 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:01.963150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:01.963656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:02.006121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.006819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.007083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.008012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.014368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.014866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.425327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:02.442997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:02.447500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:02.453238 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5f990193-a1b6-41fa-b0c9-3535f925e54d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1756 microversion: 2.42 time: 0.494076 Aug 27 03:24:02.456217 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1763/3454] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:01 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1756 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:02.464109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d4a4eaeb-63e7-4e51-bf04-61c972e10f15"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:02.467926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:02.507879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.508390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.508846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.509899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.510322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.514321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.647095 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5ea5c27-51ba-4ce4-bc46-b14679c4ec82 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 1.479802 Aug 27 03:24:02.651888 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1692/3455] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:24:01 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:02.658214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:02.659487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:02.670285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] HTTP exception thrown: Volume 0b41d89c-df24-499a-b3a8-06de1672a31f could not be found. Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Request method failure captured: Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380/os-volume_attachments/0b41d89c-df24-499a-b3a8-06de1672a31f HTTP/1.1 Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 74 Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY2I8JduCeTOjvRARSkkw3pRVOlVp1J0HsMQq8yIMsDHJcIN1k9Pe4QrQ8fkDRXZa-nuSGBeyqsXbOuLbbJVZw_eHIsVz78KIUOXExaLFu70-lc8F5Ij2zJIOPvkPfKXz4toeLy5evq7t-oZqXAt9caeJ_X0eM3nYEKoDnP8_AiY5zs Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 34a4b8293b964598b6feb56d2379ed4f Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesAdminNegativeTest-95102841 Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/34a4b8293b964598b6feb56d2379ed4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/34a4b8293b964598b6feb56d2379ed4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_34a4b8293b964598b6feb56d2379ed4f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/34a4b8293b964598b6feb56d2379ed4f"}]}] Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesAdminNegativeTest-95102841 Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 34a4b8293b964598b6feb56d2379ed4f Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-95102841 Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesAdminNegativeTest-95102841-project-admin Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ff473e7c0367454f824126ae70fece9e Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesAdminNegativeTest-95102841-project-admin Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: {"volumeAttachment": {"volumeId": "d4a4eaeb-63e7-4e51-bf04-61c972e10f15"}} Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume 0b41d89c-df24-499a-b3a8-06de1672a31f could not be found. Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '24fe1268-fde3-4f2d-95b1-9f92b1ea1380', 'id': '0b41d89c-df24-499a-b3a8-06de1672a31f', 'body': {'volumeAttachment': {'volumeId': 'd4a4eaeb-63e7-4e51-bf04-61c972e10f15'}}} Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b41d89c-df24-499a-b3a8-06de1672a31f could not be found. (HTTP 404) (Request-ID: req-0a7e1a72-e4d6-4c95-af72-a397c425dc26) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:24:02.672710 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b41d89c-df24-499a-b3a8-06de1672a31f could not be found. Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b41d89c-df24-499a-b3a8-06de1672a31f could not be found. Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b41d89c-df24-499a-b3a8-06de1672a31f could not be found. Aug 27 03:24:02.677172 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:02.681557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.681557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.681557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.681557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.681557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.681557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.686540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] Returning 404 to user: Volume 0b41d89c-df24-499a-b3a8-06de1672a31f could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:02.686745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:02.687648 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95c3edc4-f9cd-41fa-81a0-22b2d2f37643 tempest-VolumesAdminNegativeTest-95102841 tempest-VolumesAdminNegativeTest-95102841-project-admin] 10.222.0.69 "PUT /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380/os-volume_attachments/0b41d89c-df24-499a-b3a8-06de1672a31f" status: 404 len: 109 microversion: 2.1 time: 0.230054 Aug 27 03:24:02.694043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1764/3456] 10.222.0.69 () {60 vars in 1433 bytes} [Sat Aug 27 03:24:02 2022] PUT /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380/os-volume_attachments/0b41d89c-df24-499a-b3a8-06de1672a31f => generated 109 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:24:02.706708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:02.707689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:02.726850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.727691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.728327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:02.729424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:02.732458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:02.733173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:03.093314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:03.129980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31ae45a6-c3a4-4bc6-aa28-dbefd0ee840a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1271 microversion: 2.1 time: 0.476158 Aug 27 03:24:03.133831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1693/3457] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:02 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1271 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:03.149042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28b86c28-83d3-4681-8b9a-05caed3c1472 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe46033c9d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:03.270629 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28b86c28-83d3-4681-8b9a-05caed3c1472 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.133727 Aug 27 03:24:03.273310 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1694/3458] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:24:03 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:03.284612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:03.291289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:03.308916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:03.313497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:03.314517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:03.315480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:03.316129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:03.317018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:03.701806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:03.711772 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a14a03a-ea4b-46f5-88c3-0da4ab861bfb tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1317 microversion: 2.1 time: 1.016243 Aug 27 03:24:03.723328 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1765/3459] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:02 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1317 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:03.728679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-281478c0-5d54-4e9d-b4d8-6b6fa9449e54 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457d32940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:03.799615 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-281478c0-5d54-4e9d-b4d8-6b6fa9449e54 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.074569 Aug 27 03:24:03.800221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1766/3460] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:24:03 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:03.819074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:03.826197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:03.847807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:03.849786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:03.850538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:03.852249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:03.855495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:03.859467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:04.355888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:04.378887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:04.380584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:04.381798 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f139e8e8-3507-4c7e-af6a-9dadcf65147e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1803 microversion: 2.42 time: 0.579005 Aug 27 03:24:04.382397 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1767/3461] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:03 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1803 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:04.403803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e1cf9e02-069c-44b2-b95c-f81a1adee6f7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457cf3790>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:04.550689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:04.567018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:04.575595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:04.586392 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5cc007bc-9edc-435f-9fe2-5005cbf69d65 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1796 microversion: 2.20 time: 1.311620 Aug 27 03:24:04.591201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1695/3462] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:03 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1796 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:04.597447 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e1cf9e02-069c-44b2-b95c-f81a1adee6f7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/detail?changes-since=2022-08-27T03%3A21%3A35Z" status: 200 len: 6333 microversion: 2.1 time: 0.198100 Aug 27 03:24:04.606717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:04.613122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1768/3463] 10.222.0.69 () {58 vars in 1220 bytes} [Sat Aug 27 03:24:04 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-27T03%3A21%3A35Z => generated 6333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:04.615558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:04.629138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f8048063-ed63-4582-b56c-de15f08d8e70 req-9d3664ff-140e-4cb9-a0c5-b8ab533c3f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53561119-0301-4a16-9ad2-124e2a297c81", "name": "network-vif-plugged", "status": "completed", "tag": "7e8d340a-f775-4c3f-9d00-b0bae421e830"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:04.640612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:04.641993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:04.643262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:04.646334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:04.647016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:04.649294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:04.651284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8048063-ed63-4582-b56c-de15f08d8e70 req-9d3664ff-140e-4cb9-a0c5-b8ab533c3f93 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:04.651770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8048063-ed63-4582-b56c-de15f08d8e70 req-9d3664ff-140e-4cb9-a0c5-b8ab533c3f93 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:04.652757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8048063-ed63-4582-b56c-de15f08d8e70 req-9d3664ff-140e-4cb9-a0c5-b8ab533c3f93 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:04.677242 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f8048063-ed63-4582-b56c-de15f08d8e70 req-9d3664ff-140e-4cb9-a0c5-b8ab533c3f93 service nova] Creating event network-vif-plugged:7e8d340a-f775-4c3f-9d00-b0bae421e830 for instance 53561119-0301-4a16-9ad2-124e2a297c81 on n-h1-852086-5 Aug 27 03:24:04.683053 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f8048063-ed63-4582-b56c-de15f08d8e70 req-9d3664ff-140e-4cb9-a0c5-b8ab533c3f93 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067978 Aug 27 03:24:04.684473 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1769/3464] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:04.707094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eb43d4cc-e36e-492e-b8c9-99133c4995e3 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c4f2940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:04.817286 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eb43d4cc-e36e-492e-b8c9-99133c4995e3 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-907899472" status: 200 len: 664 microversion: 2.1 time: 0.131305 Aug 27 03:24:04.817957 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1770/3465] 10.222.0.69 () {58 vars in 1250 bytes} [Sat Aug 27 03:24:04 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-907899472 => generated 664 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:04.840510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:04.841939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:04.849758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:04.853135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:04.853893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:04.854938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:04.855692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:04.856362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:05.172587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:05.185984 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-857e1b75-abcc-4db4-9e6d-edc31a245051 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1317 microversion: 2.1 time: 0.362052 Aug 27 03:24:05.186970 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1771/3466] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:04 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:05.196712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5be8b0d-18ed-4019-9677-0fe536716570 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c4f2c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:05.327819 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5be8b0d-18ed-4019-9677-0fe536716570 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1466 microversion: 2.1 time: 0.139448 Aug 27 03:24:05.331325 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1772/3467] 10.222.0.69 () {58 vars in 1338 bytes} [Sat Aug 27 03:24:05 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fv2.1%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:05.346137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21aba04e-3cba-445e-a003-1a28c01a0888 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457cc0940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:05.446640 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21aba04e-3cba-445e-a003-1a28c01a0888 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1466 microversion: 2.1 time: 0.103417 Aug 27 03:24:05.447696 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1773/3468] 10.222.0.69 () {58 vars in 1324 bytes} [Sat Aug 27 03:24:05 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.69%2Fcompute%2Fservers%2F1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1466 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:05.457748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:05.460883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:05.478757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:05.484353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:05.484950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:05.485819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:05.486435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:05.486960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:06.006909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:06.023690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:06.025141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:06.045832 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-67cb53ee-246d-4c96-aaca-2c63cb741190 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1803 microversion: 2.42 time: 0.577600 Aug 27 03:24:06.048933 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1774/3469] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:05 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1803 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:06.064588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4db023e-83db-482b-920e-3bb6cf61e834 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457c5f1f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:06.080395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:06.109424 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fa30268-c711-4011-be38-3881ee762471 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 1.514667 Aug 27 03:24:06.112252 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1696/3470] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:04 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:06.215334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:06.216040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:06.226915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:06.227418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:06.227866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:06.232518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:06.233952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:06.235737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:06.333168 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4db023e-83db-482b-920e-3bb6cf61e834 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.279790 Aug 27 03:24:06.338237 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1775/3471] 10.222.0.69 () {58 vars in 1170 bytes} [Sat Aug 27 03:24:06 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:06.359303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45ea95f2-38ae-4c43-b915-9b52e229072d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c40fe50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:06.539733 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45ea95f2-38ae-4c43-b915-9b52e229072d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.182506 Aug 27 03:24:06.554402 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1776/3472] 10.222.0.69 () {58 vars in 1170 bytes} [Sat Aug 27 03:24:06 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:06.566194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a86de01-11e8-4edc-b724-8769e727c1f9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457cef940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:06.639709 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a86de01-11e8-4edc-b724-8769e727c1f9 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/acef3da5-f17c-4877-a77f-8b5440d3d46e" status: 200 len: 784 microversion: 2.1 time: 0.083496 Aug 27 03:24:06.643501 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1777/3473] 10.222.0.69 () {58 vars in 1233 bytes} [Sat Aug 27 03:24:06 2022] GET /compute/v2.1/images/acef3da5-f17c-4877-a77f-8b5440d3d46e => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:06.658504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0f946bd-5d0a-4d0f-868a-9038bedaac28 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457ce44c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:06.760354 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0f946bd-5d0a-4d0f-868a-9038bedaac28 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.105694 Aug 27 03:24:06.761051 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1778/3474] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:24:06 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:06.778616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6a58026b-4e83-4c0a-a4ac-2b5e35b78c49 req-1a59c469-b985-43ee-b79b-2836dd0fa8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8443d4c1-1589-49d3-9fe7-d6edea43b9de", "name": "network-vif-plugged", "status": "completed", "tag": "972ebbe5-d1f5-44bd-94b0-77a9f863b869"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:06.794367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6a58026b-4e83-4c0a-a4ac-2b5e35b78c49 req-1a59c469-b985-43ee-b79b-2836dd0fa8ca service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:06.795441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6a58026b-4e83-4c0a-a4ac-2b5e35b78c49 req-1a59c469-b985-43ee-b79b-2836dd0fa8ca service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:06.796820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6a58026b-4e83-4c0a-a4ac-2b5e35b78c49 req-1a59c469-b985-43ee-b79b-2836dd0fa8ca service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:06.811378 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6a58026b-4e83-4c0a-a4ac-2b5e35b78c49 req-1a59c469-b985-43ee-b79b-2836dd0fa8ca service nova] Creating event network-vif-plugged:972ebbe5-d1f5-44bd-94b0-77a9f863b869 for instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de on n-h1-852086-5 Aug 27 03:24:06.818148 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6a58026b-4e83-4c0a-a4ac-2b5e35b78c49 req-1a59c469-b985-43ee-b79b-2836dd0fa8ca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055238 Aug 27 03:24:06.819549 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1779/3475] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:06.826720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-89b101ec-6838-4fc0-846d-0465e810e977 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457c89b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:07.288085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:07.300161 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18d5185c-8bb8-4c3e-bdd4-36d3c4ea106f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1317 microversion: 2.1 time: 1.093960 Aug 27 03:24:07.305226 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1697/3476] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:06 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1317 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:07.320411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:07.337265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:07.352867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:07.354070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:07.358503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:07.362537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:07.364693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:07.368201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:07.458429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:07.578469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:07.840428 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-89b101ec-6838-4fc0-846d-0465e810e977 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6" status: 204 len: 0 microversion: 2.1 time: 1.019442 Aug 27 03:24:07.842096 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1780/3477] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:06 2022] DELETE /compute/v2.1/images/35934f7a-bb23-489f-8797-154eaa7590e6 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:07.853543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:07.854947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:07.880131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:07.881036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:07.881986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:07.884934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:07.885685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:07.886830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:08.003353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:08.030919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:08.039240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:08.048287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd806886-c265-4097-8bf7-c0ebcdd48048 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1803 microversion: 2.42 time: 0.735805 Aug 27 03:24:08.049348 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1698/3478] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:07 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1803 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:08.067291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae43a3f0-aa23-4fd2-a7ba-c20da31d92a5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c471d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:08.609819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:08.629278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2df2f77-519e-4d69-ba2d-cfd32beb09b5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.778708 Aug 27 03:24:08.642708 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1781/3479] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:07 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:08.693289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:08.703811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:08.729020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:08.737787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:08.739413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:08.740508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:08.741388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:08.743259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:09.095801 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae43a3f0-aa23-4fd2-a7ba-c20da31d92a5 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d" status: 204 len: 0 microversion: 2.1 time: 1.044471 Aug 27 03:24:09.096386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1699/3480] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:08 2022] DELETE /compute/v2.1/images/6664edce-1de9-46fb-bf57-a576e15ee14d => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:09.103851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:09.104735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:09.118700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:09.119753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:09.121005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:09.123625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:09.124789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:09.125426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:09.174140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:09.365232 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94f4c04b-04fb-4f92-a380-357deaf69c5f tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "DELETE /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 204 len: 0 microversion: 2.1 time: 0.267481 Aug 27 03:24:09.366515 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1700/3481] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:24:09 2022] DELETE /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:09.374305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:09.375328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:09.378895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:09.382978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:09.383751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:09.384372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:09.385291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:09.386183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:09.387701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:09.395366 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb35f13b-d4ce-42ef-956f-4a51a2b22f75 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 200 len: 1504 microversion: 2.1 time: 0.750782 Aug 27 03:24:09.396517 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1782/3482] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:08 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 1504 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:09.413897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4250a9c2-de91-4477-94ba-e97fa8bb7a98 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe460214ca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:10.231126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:10.244748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:10.254925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:10.260051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9929028e-b03c-4b81-b464-a58b4968a23d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1850 microversion: 2.42 time: 0.891991 Aug 27 03:24:10.260927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1701/3483] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:09 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1850 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:10.279304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:10.280241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:10.296380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:10.298668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:10.300066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:10.301112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:10.303461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:10.307126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:10.402361 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4250a9c2-de91-4477-94ba-e97fa8bb7a98 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151" status: 204 len: 0 microversion: 2.1 time: 1.004390 Aug 27 03:24:10.403282 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1783/3484] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:09 2022] DELETE /compute/v2.1/images/743c2de6-53ee-4606-88c5-9e27493e2151 => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:10.416271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:10.419418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:10.453108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:10.454941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:10.456470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:10.458372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:10.460608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:10.461988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:10.953941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:10.962427 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2fa5631c-1de2-4a85-8cc8-e9c2386e6069 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1514 microversion: 2.1 time: 0.694738 Aug 27 03:24:10.963405 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1702/3485] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:10 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1514 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:10.995348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:10.996194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:11.016428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.017246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.017868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.023597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.024337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.024955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.039570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:11.061364 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d892bdd6-cdb7-4c48-abbe-dce7e7a47d82 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 200 len: 1504 microversion: 2.1 time: 0.654040 Aug 27 03:24:11.062441 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1784/3486] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:10 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 1504 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:11.085099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-77f5db6e-11df-43e4-8554-66e18cc4d7d6 req-e433a041-e813-4d23-8e4d-bf116a333ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3985591f-9a52-4bb4-9dd7-564d21a56880", "tag": "59b4626b-537e-468e-9d29-aaae43db4419"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:11.117060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:11.119282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-77f5db6e-11df-43e4-8554-66e18cc4d7d6 req-e433a041-e813-4d23-8e4d-bf116a333ec9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.119938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-77f5db6e-11df-43e4-8554-66e18cc4d7d6 req-e433a041-e813-4d23-8e4d-bf116a333ec9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.120379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-77f5db6e-11df-43e4-8554-66e18cc4d7d6 req-e433a041-e813-4d23-8e4d-bf116a333ec9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.155454 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-77f5db6e-11df-43e4-8554-66e18cc4d7d6 req-e433a041-e813-4d23-8e4d-bf116a333ec9 service nova] Creating event network-changed:59b4626b-537e-468e-9d29-aaae43db4419 for instance 3985591f-9a52-4bb4-9dd7-564d21a56880 on n-h2-852086-5 Aug 27 03:24:11.163585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-77f5db6e-11df-43e4-8554-66e18cc4d7d6 req-e433a041-e813-4d23-8e4d-bf116a333ec9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099400 Aug 27 03:24:11.164542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1785/3487] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:11.170346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:11.170956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:11.179669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.180201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.180642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.181361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.181824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.192620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.256718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:11.430349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-98eed270-162c-42f2-a5c3-60bdac1df7ad tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 204 len: 0 microversion: 2.1 time: 0.263951 Aug 27 03:24:11.431140 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1786/3488] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:24:11 2022] DELETE /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:11.442387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:11.444587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:11.447344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:11.451255 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01f341e4-bb0f-40a0-9d06-0f24a9fa0370 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.459856 Aug 27 03:24:11.455896 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1703/3489] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:10 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:11.461660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:11.462549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:11.467831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.469684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.473744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.474923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.475641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.475841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.476384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.477074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.477863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.479064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.479693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.480826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.529977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:11.578515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:11.671830 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b8b90fb2-a2a3-4c55-930d-d2160cd028a0 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 204 len: 0 microversion: 2.1 time: 0.239549 Aug 27 03:24:11.672821 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1787/3490] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:24:11 2022] DELETE /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:11.685469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:11.688362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:11.696603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.697401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.698061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:11.699852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:11.700760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:11.701383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.051993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:12.077687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:12.081116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:12.083073 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8843b4d-1fc6-4ac9-ab13-9328d4923d55 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1850 microversion: 2.42 time: 0.626156 Aug 27 03:24:12.084501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1704/3491] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:11 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1850 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:12.090456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:12.091358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:12.099175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.100062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.100939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.101918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.102825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.103850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.181975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:12.244956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:12.255193 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9dbd701a-c6ba-4be8-b541-fb066dcf8383 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1472 microversion: 2.1 time: 0.575518 Aug 27 03:24:12.267962 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1788/3492] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:11 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:12.267962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:12.267962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:12.285061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.285372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.286987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.288068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.289728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.291178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.370723 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-206786da-84ff-4854-bc92-56d970112f77 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "DELETE /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 204 len: 0 microversion: 2.1 time: 0.283314 Aug 27 03:24:12.374041 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1705/3493] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:24:12 2022] DELETE /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:12.385070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:12.386501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:12.393547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.394568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.395540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.397039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.397869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.398647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.451034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:12.463205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d53ec677-2713-4556-9d67-3a72f0ef5b65 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1472 microversion: 2.1 time: 0.199738 Aug 27 03:24:12.464126 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1789/3494] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:12 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:12.483262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:12.484192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:12.503740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.504531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.505125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.506052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:12.507120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:12.507711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:12.834041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:12.848067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5aaa3d0-5ca9-4446-8835-8db81696e515 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 200 len: 1510 microversion: 2.1 time: 0.469656 Aug 27 03:24:12.848890 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1706/3495] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:12 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 1510 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:12.946082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:12.962980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7377cb06-6a4c-468e-b0d5-c7fc964e7198 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.487125 Aug 27 03:24:12.963582 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1790/3496] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:12 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:13.112128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:13.114205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:13.123579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.125213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.126849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.128352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.129387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.130561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.275785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:13.276416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:13.288449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.289416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.290685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.291962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.293776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.295199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.354355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:13.367168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:13.368710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:13.369906 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5641e2a4-7581-4624-96de-b210c9cba711 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1850 microversion: 2.42 time: 0.262896 Aug 27 03:24:13.370557 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1707/3497] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:13 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1850 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:13.375790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7b5db46b-cf7e-47b3-8b93-ce057f3874fc req-c0e8a937-5dc5-4a5a-95f9-84308238eb87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "5483ccb2-45f0-4bdd-9b3b-a9b357359a2f"}, {"server_uuid": "24fe1268-fde3-4f2d-95b1-9f92b1ea1380", "name": "network-vif-deleted", "tag": "4ab7c7f2-cbc5-4432-97a7-2242d221e278"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:13.388384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b5db46b-cf7e-47b3-8b93-ce057f3874fc req-c0e8a937-5dc5-4a5a-95f9-84308238eb87 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.388873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b5db46b-cf7e-47b3-8b93-ce057f3874fc req-c0e8a937-5dc5-4a5a-95f9-84308238eb87 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.390064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b5db46b-cf7e-47b3-8b93-ce057f3874fc req-c0e8a937-5dc5-4a5a-95f9-84308238eb87 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.407994 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7b5db46b-cf7e-47b3-8b93-ce057f3874fc req-c0e8a937-5dc5-4a5a-95f9-84308238eb87 service nova] Creating event network-changed:5483ccb2-45f0-4bdd-9b3b-a9b357359a2f for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:24:13.407994 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7b5db46b-cf7e-47b3-8b93-ce057f3874fc req-c0e8a937-5dc5-4a5a-95f9-84308238eb87 service nova] Creating event network-vif-deleted:4ab7c7f2-cbc5-4432-97a7-2242d221e278 for instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 on n-h2-852086-5 Aug 27 03:24:13.416593 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7b5db46b-cf7e-47b3-8b93-ce057f3874fc req-c0e8a937-5dc5-4a5a-95f9-84308238eb87 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044290 Aug 27 03:24:13.418680 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1708/3498] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:13.487048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:13.487763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:13.497730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.498431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.498880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.499605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.500057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.500795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.506823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:13.550717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.551420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.552023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.552645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lazy-loading 'fault' on Instance uuid 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:24:13.603950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:13.617227 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6665e2e9-8d16-4303-a7a0-a5b525e03165 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 200 len: 1308 microversion: 2.1 time: 0.132909 Aug 27 03:24:13.619328 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1709/3499] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:13 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 1308 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:13.634003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:13.653633 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d396e02f-ca6a-4167-bc6b-30fc64bc2fba tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1472 microversion: 2.1 time: 0.381679 Aug 27 03:24:13.654740 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1791/3500] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:13 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1472 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:13.874616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:13.876897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:13.900378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.900905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.903431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.904421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:13.905068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:13.905669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:13.986017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:13.989336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:14.004990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.006823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.007616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.008739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.009373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.009980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.147784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:14.162713 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-448105e1-21bb-4639-a793-408e0e2cfa0a tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 200 len: 1510 microversion: 2.1 time: 0.296800 Aug 27 03:24:14.164497 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1710/3501] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:13 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:14.401051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:14.402188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:14.415384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.416898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.417614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.429917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:14.435636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.436412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.439228 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8a29026e-c672-4997-a7a9-1d94807932b9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.457094 Aug 27 03:24:14.439473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.442478 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1792/3502] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:13 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:14.645439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:14.646891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: 24fe1268-fde3-4f2d-95b1-9f92b1ea1380] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:14.655907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.656927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.657648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.658736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.659487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.660732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.682538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] HTTP exception thrown: Instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 could not be found. Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Request method failure captured: Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 HTTP/1.1 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY10f1Lnwt3h2H3yXcaotsS7y-XUGisTwbjNJ6nfETmEJFi9K9AxuZejUK1d1AT843CFErcX1tpqkQqlk785VaeLYeqP5ztGkF1uxvlkE9Vif9gcEffmK9IvZJxcWj6Nyb6KD3_KwlAueM2mSuTmdA73op20lSCCH52oa-ndI2TDG5E Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f5095940a4e34b8598707e7a6c653dda Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesAdminNegativeTest-1244288600 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5095940a4e34b8598707e7a6c653dda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5095940a4e34b8598707e7a6c653dda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5095940a4e34b8598707e7a6c653dda", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5095940a4e34b8598707e7a6c653dda"}]}] Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesAdminNegativeTest-1244288600 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f5095940a4e34b8598707e7a6c653dda Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1244288600 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesAdminNegativeTest-1244288600-project Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f73695cba42d41748ed9d7587cae5f08 Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesAdminNegativeTest-1244288600-project Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 could not be found. Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '24fe1268-fde3-4f2d-95b1-9f92b1ea1380'} Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 could not be found. Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 could not be found. Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:14.687880 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:14.692768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:14.692768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:14.692768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:14.692768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:14.692768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:14.692768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 could not be found. Aug 27 03:24:14.692768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:14.698811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Returning 404 to user: Instance 24fe1268-fde3-4f2d-95b1-9f92b1ea1380 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:14.700350 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6dc57608-0024-4a28-863c-1d66fd6ea8a7 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380" status: 404 len: 111 microversion: 2.1 time: 0.060821 Aug 27 03:24:14.704405 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1793/3503] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:14 2022] GET /compute/v2.1/servers/24fe1268-fde3-4f2d-95b1-9f92b1ea1380 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:24:14.712198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:14.713081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:14.721445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.722337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.723025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.723965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:14.724736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:14.725432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:14.772243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:14.793536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:14.796286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:14.805402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-615417f1-fc42-4647-a862-b658eaa8ce6a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1850 microversion: 2.42 time: 0.413367 Aug 27 03:24:14.809090 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1711/3504] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:14 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1850 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:15.186293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:15.187727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:15.201149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:15.210666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:15.212128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:15.215629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:15.216440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:15.218016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:15.219941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:15.234388 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d7fa92b-6b2f-4c37-b71b-4ba58a21ccfe tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1472 microversion: 2.1 time: 0.528572 Aug 27 03:24:15.237625 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1794/3505] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:14 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1472 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:15.469131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:15.470013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:15.477713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:15.478463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:15.479142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:15.480560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:15.481588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:15.482501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:15.629500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:15.638073 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd621603-d3fd-4b67-b356-70539a1703f5 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 200 len: 1510 microversion: 2.1 time: 0.456891 Aug 27 03:24:15.639184 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1712/3506] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:15 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:15.829374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:15.830054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:15.844022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:15.851307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:15.851600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:15.852381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:15.852859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:15.853298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:15.875282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:15.888997 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc80ef44-f162-4b9f-8bd6-088617fab559 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.425395 Aug 27 03:24:15.889595 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1795/3507] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:15 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:16.257830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:16.258484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:16.271177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:16.271681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:16.272126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:16.278105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:16.278631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:16.279238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:16.817830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:16.831220 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56c45b2f-bbf4-4baa-a6be-145969c42d1e tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1472 microversion: 2.1 time: 0.577321 Aug 27 03:24:16.859237 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1796/3508] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:16 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1472 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:16.864458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:16.865337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:16.881095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:16.882396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:16.883018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:16.883932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:16.884570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:16.885174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.426786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:17.444599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37a3f50c-8b9a-4bf7-b79b-d89ebded480f tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 200 len: 1510 microversion: 2.1 time: 0.579750 Aug 27 03:24:17.445331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1797/3509] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:16 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:17.482190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:17.485209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:17.509579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.510080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.519572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:17.532719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:17.533250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:17.541186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:18.000671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:18.034408 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-822348df-e71c-4070-9e43-e33128b31f8c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.567892 Aug 27 03:24:18.046202 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1798/3510] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:17 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:18.046202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:18.046202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:18.049358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:18.061520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:18.065169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:18.070753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:18.071280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:18.071692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:18.598341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:18.614194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:18.624198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:18.625980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60cd2534-705f-4368-baa1-40f9cfbcbf76 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1850 microversion: 2.42 time: 2.800888 Aug 27 03:24:18.633757 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1713/3511] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:15 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1850 bytes in 2809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:24:18.640418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-327ec974-ec7f-4892-a5b0-09d247364ce6 req-066396a9-19ae-4ecf-8f34-0170d1e994d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53561119-0301-4a16-9ad2-124e2a297c81", "name": "network-vif-deleted", "tag": "7e8d340a-f775-4c3f-9d00-b0bae421e830"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:18.677136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-327ec974-ec7f-4892-a5b0-09d247364ce6 req-066396a9-19ae-4ecf-8f34-0170d1e994d6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:18.682278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-327ec974-ec7f-4892-a5b0-09d247364ce6 req-066396a9-19ae-4ecf-8f34-0170d1e994d6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:18.682898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-327ec974-ec7f-4892-a5b0-09d247364ce6 req-066396a9-19ae-4ecf-8f34-0170d1e994d6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:18.725862 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-327ec974-ec7f-4892-a5b0-09d247364ce6 req-066396a9-19ae-4ecf-8f34-0170d1e994d6 service nova] Creating event network-vif-deleted:7e8d340a-f775-4c3f-9d00-b0bae421e830 for instance 53561119-0301-4a16-9ad2-124e2a297c81 on n-h1-852086-5 Aug 27 03:24:18.732236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-327ec974-ec7f-4892-a5b0-09d247364ce6 req-066396a9-19ae-4ecf-8f34-0170d1e994d6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096750 Aug 27 03:24:18.733960 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1714/3512] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:18.739586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:18.740631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:18.749028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:18.749803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:18.750446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:18.751373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:18.752010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:18.752622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.194675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:19.206025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c7c8432-c7c7-44d4-8b3d-3f68cdb9839c tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 200 len: 1472 microversion: 2.1 time: 1.169563 Aug 27 03:24:19.207353 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1799/3513] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:18 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 1472 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:19.227956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cd361d5b-cb1f-4d4a-ba8b-03f9128b70a1 req-cf6f4c8e-c5b6-4df1-ba3d-b94e51c60083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db62fb2-3b79-46b8-baec-890abe5107ed", "name": "network-vif-deleted", "tag": "ca02f050-9d97-48b8-b99f-d385fa15b569"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:19.246550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cd361d5b-cb1f-4d4a-ba8b-03f9128b70a1 req-cf6f4c8e-c5b6-4df1-ba3d-b94e51c60083 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.247406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cd361d5b-cb1f-4d4a-ba8b-03f9128b70a1 req-cf6f4c8e-c5b6-4df1-ba3d-b94e51c60083 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:19.248054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cd361d5b-cb1f-4d4a-ba8b-03f9128b70a1 req-cf6f4c8e-c5b6-4df1-ba3d-b94e51c60083 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.269187 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cd361d5b-cb1f-4d4a-ba8b-03f9128b70a1 req-cf6f4c8e-c5b6-4df1-ba3d-b94e51c60083 service nova] Creating event network-vif-deleted:ca02f050-9d97-48b8-b99f-d385fa15b569 for instance 1db62fb2-3b79-46b8-baec-890abe5107ed on n-h1-852086-5 Aug 27 03:24:19.296825 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cd361d5b-cb1f-4d4a-ba8b-03f9128b70a1 req-cf6f4c8e-c5b6-4df1-ba3d-b94e51c60083 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078678 Aug 27 03:24:19.298235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1800/3514] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:19.320207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:19.321173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:19.329907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.330936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:19.331703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.332729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.333411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:19.334528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.717526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:19.729111 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1c24f51-27bc-41ab-a51a-0557d9caaaf8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.429384 Aug 27 03:24:19.732587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1801/3515] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:19 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:19.744305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:19.745131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:19.757987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.762763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:19.763172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.763955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.764435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:19.765013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:19.916203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:19.932866 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87fce486-13b6-46ce-9d6a-999b24557f9b tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 200 len: 1510 microversion: 2.1 time: 1.196903 Aug 27 03:24:19.934933 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1715/3516] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:18 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 1510 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:19.952893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ccf9d43b-469f-4c5c-b167-e5da5c741c7b req-e6537308-33ab-4c8f-bf29-d231916780e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8443d4c1-1589-49d3-9fe7-d6edea43b9de", "name": "network-vif-unplugged", "status": "completed", "tag": "972ebbe5-d1f5-44bd-94b0-77a9f863b869"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:19.987078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:19.992225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ccf9d43b-469f-4c5c-b167-e5da5c741c7b req-e6537308-33ab-4c8f-bf29-d231916780e0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:19.997293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ccf9d43b-469f-4c5c-b167-e5da5c741c7b req-e6537308-33ab-4c8f-bf29-d231916780e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.000500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ccf9d43b-469f-4c5c-b167-e5da5c741c7b req-e6537308-33ab-4c8f-bf29-d231916780e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.053797 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ccf9d43b-469f-4c5c-b167-e5da5c741c7b req-e6537308-33ab-4c8f-bf29-d231916780e0 service nova] Creating event network-vif-unplugged:972ebbe5-d1f5-44bd-94b0-77a9f863b869 for instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de on n-h1-852086-5 Aug 27 03:24:20.070325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ccf9d43b-469f-4c5c-b167-e5da5c741c7b req-e6537308-33ab-4c8f-bf29-d231916780e0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129103 Aug 27 03:24:20.072792 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1716/3517] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:20.193054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:20.207219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:20.210757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:20.212786 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48a0b5a7-de80-46bd-baa5-16448cac5c5c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1871 microversion: 2.42 time: 0.477244 Aug 27 03:24:20.216702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1802/3518] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:19 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1871 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:20.242784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:20.243601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: 1db62fb2-3b79-46b8-baec-890abe5107ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:20.250894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.251643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.252382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.253327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.253951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.254683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.288454 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] HTTP exception thrown: Instance 1db62fb2-3b79-46b8-baec-890abe5107ed could not be found. Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Request method failure captured: Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed HTTP/1.1 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2_LR2n1BU4u-cyEZz7Dcn2Qf474OJTMqr-XHiZLtDjGN_g4cIVvET8ozV0b2QvmdE2pFndNK4sm0CSw1g6kAKU-bY7urTmRAdLr2GHKJXO5Rx31ai-fAYxab8FvGGithgsJdIpcr8aQMedJPwhm3sJCodk4wYvJBf9hgD7qBHnrfQ Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0ab7129ea5d24ab19be52eba0b3e71f2 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ListImageFiltersTestJSON-1535619399 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ab7129ea5d24ab19be52eba0b3e71f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ab7129ea5d24ab19be52eba0b3e71f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ab7129ea5d24ab19be52eba0b3e71f2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ab7129ea5d24ab19be52eba0b3e71f2"}]}] Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ListImageFiltersTestJSON-1535619399 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0ab7129ea5d24ab19be52eba0b3e71f2 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1535619399 Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ListImageFiltersTestJSON-1535619399-project Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 4b806f7cf8fa47c797b25ad51429724b Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ListImageFiltersTestJSON-1535619399-project Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 1db62fb2-3b79-46b8-baec-890abe5107ed could not be found. Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1db62fb2-3b79-46b8-baec-890abe5107ed'} Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db62fb2-3b79-46b8-baec-890abe5107ed could not be found. Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db62fb2-3b79-46b8-baec-890abe5107ed could not be found. Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:20.290214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db62fb2-3b79-46b8-baec-890abe5107ed could not be found. Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:20.296527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Returning 404 to user: Instance 1db62fb2-3b79-46b8-baec-890abe5107ed could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:20.298464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9512115-74f3-41e5-9cce-a8bf1f726279 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed" status: 404 len: 111 microversion: 2.1 time: 0.061710 Aug 27 03:24:20.306237 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1717/3519] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:20 2022] GET /compute/v2.1/servers/1db62fb2-3b79-46b8-baec-890abe5107ed => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:24:20.308220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:20.308949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:20.323369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.323902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.324466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.327269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.327759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.328205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.406009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:20.523356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:20.620515 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-643806bd-9e1f-4141-b1c0-4beb8e3ea35d tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 204 len: 0 microversion: 2.1 time: 0.315792 Aug 27 03:24:20.622318 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1803/3520] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:24:20 2022] DELETE /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:24:20.631442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:20.632259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:20.647807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.648384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.649289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.649766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.650291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.650807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.755225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:20.756444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:20.773681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.774799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.788010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:20.789437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:20.792829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:20.793608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.177695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:21.193156 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-588058ba-e876-4f4e-b521-c69ed7921fa6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.444151 Aug 27 03:24:21.204306 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1804/3521] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:20 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:21.204306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.204306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:21.209350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.225351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.226275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.227479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.228811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.230688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.309124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.311233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.312551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.312994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lazy-loading 'fault' on Instance uuid 8443d4c1-1589-49d3-9fe7-d6edea43b9de {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:24:21.401699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40559a7f1d984e0692b9056feccdf988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16be1c428c465db77a7ef995249ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:21.404046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:21.412545 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5780c0ca-9c1d-4fe6-ab20-8302453a587b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 1472 microversion: 2.1 time: 0.785507 Aug 27 03:24:21.422999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85547d49-90e9-4b56-b33b-89b1fbcca907 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 200 len: 1307 microversion: 2.1 time: 0.227452 Aug 27 03:24:21.423788 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1718/3522] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:20 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 1472 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:21.425695 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1805/3523] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:21 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:21.432931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-250ab5ee-4743-4a31-8625-81bbefa54f8c req-7edf9925-0101-43a9-86b4-f5726108009e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "0c491876-95d6-4d38-82f0-b30e9d00b1de"}, {"server_uuid": "8443d4c1-1589-49d3-9fe7-d6edea43b9de", "name": "network-vif-deleted", "tag": "972ebbe5-d1f5-44bd-94b0-77a9f863b869"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:21.441648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.453408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:21.458551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-250ab5ee-4743-4a31-8625-81bbefa54f8c req-7edf9925-0101-43a9-86b4-f5726108009e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.472053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.473108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-250ab5ee-4743-4a31-8625-81bbefa54f8c req-7edf9925-0101-43a9-86b4-f5726108009e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.473770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-250ab5ee-4743-4a31-8625-81bbefa54f8c req-7edf9925-0101-43a9-86b4-f5726108009e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.478963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.480764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.484122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.484744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.485350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.528450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-250ab5ee-4743-4a31-8625-81bbefa54f8c req-7edf9925-0101-43a9-86b4-f5726108009e service nova] Creating event network-changed:0c491876-95d6-4d38-82f0-b30e9d00b1de for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:24:21.531564 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-250ab5ee-4743-4a31-8625-81bbefa54f8c req-7edf9925-0101-43a9-86b4-f5726108009e service nova] Creating event network-vif-deleted:972ebbe5-d1f5-44bd-94b0-77a9f863b869 for instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de on n-h1-852086-5 Aug 27 03:24:21.559233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-250ab5ee-4743-4a31-8625-81bbefa54f8c req-7edf9925-0101-43a9-86b4-f5726108009e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.131156 Aug 27 03:24:21.575787 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1806/3524] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:21.716371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:21.717652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:21.728542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.733001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.733721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.736526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:21.740157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:21.740991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:21.801228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:21.985185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-598b14ed-4657-4d6a-b7d5-6f9500f795ed tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 204 len: 0 microversion: 2.1 time: 0.273688 Aug 27 03:24:21.990823 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1807/3525] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:24:21 2022] DELETE /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:24:22.003993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:22.005122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:22.013556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.014375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.015089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.016009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.016700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.017343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.278713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:22.300053 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91d7bfbf-cbb6-4085-a085-9e3b06638648 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1679 microversion: 2.1 time: 0.304317 Aug 27 03:24:22.304440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1808/3526] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:21 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1679 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:22.325449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-617b226f-5c31-4ca8-bae7-742f70814a09 req-df59800c-e244-4712-8495-b6c36fd87a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3985591f-9a52-4bb4-9dd7-564d21a56880", "name": "network-vif-plugged", "status": "completed", "tag": "59b4626b-537e-468e-9d29-aaae43db4419"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:22.349100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-617b226f-5c31-4ca8-bae7-742f70814a09 req-df59800c-e244-4712-8495-b6c36fd87a33 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.349660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-617b226f-5c31-4ca8-bae7-742f70814a09 req-df59800c-e244-4712-8495-b6c36fd87a33 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.376971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-617b226f-5c31-4ca8-bae7-742f70814a09 req-df59800c-e244-4712-8495-b6c36fd87a33 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.409999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-617b226f-5c31-4ca8-bae7-742f70814a09 req-df59800c-e244-4712-8495-b6c36fd87a33 service nova] Creating event network-vif-plugged:59b4626b-537e-468e-9d29-aaae43db4419 for instance 3985591f-9a52-4bb4-9dd7-564d21a56880 on n-h2-852086-5 Aug 27 03:24:22.421858 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-617b226f-5c31-4ca8-bae7-742f70814a09 req-df59800c-e244-4712-8495-b6c36fd87a33 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116439 Aug 27 03:24:22.425327 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1809/3527] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:22.432954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:22.434525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:22.461727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.462377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.462900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.466636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.468920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.470640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.607833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:22.630295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:22.639529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:22.640783 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8118d0eb-1b3c-4662-859c-4733c81e47e1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1871 microversion: 2.42 time: 1.203052 Aug 27 03:24:22.641555 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1719/3528] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:21 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1871 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:22.646597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:22.663282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:22.688279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.688795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.689245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:22.689977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:22.690479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:22.690979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.201026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:23.216815 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d6213bb-65f3-45be-9905-7e342ace1f71 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 0.787085 Aug 27 03:24:23.218001 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1810/3529] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:22 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:23.239132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:23.239552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 8443d4c1-1589-49d3-9fe7-d6edea43b9de] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:23.264352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.270678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.272512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.279520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.280760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.281445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.284681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:23.298964 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1261a2a-adec-48f3-ab0e-d346bf9b9e5b tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 1472 microversion: 2.1 time: 0.655955 Aug 27 03:24:23.313532 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1720/3530] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:22 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 1472 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:23.327485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:23.328402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:23.331599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] HTTP exception thrown: Instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de could not be found. Aug 27 03:24:23.337613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.341101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Request method failure captured: Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de HTTP/1.1 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY3wrVUXROkImqRXOsNxqmxVtXvYgzLab-3_3Gb5AiTzc-WnF4-9ezAwtecVTGcgQQrIMJfOFto01Y5bFLLwPL2M_u-ivXbhJ160QvZ6LFyy4MR5k2Jsd0y17zGnUBgL9UQgWuBrRjbxPNPGz5XQjxhlK67pojmYNUSkoYacguZYFGc Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4d16be1c428c465db77a7ef995249ea6 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MultipleCreateTestJSON-952335365 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4d16be1c428c465db77a7ef995249ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4d16be1c428c465db77a7ef995249ea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4d16be1c428c465db77a7ef995249ea6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4d16be1c428c465db77a7ef995249ea6"}]}] Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MultipleCreateTestJSON-952335365 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4d16be1c428c465db77a7ef995249ea6 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MultipleCreateTestJSON-952335365 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MultipleCreateTestJSON-952335365-project Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 40559a7f1d984e0692b9056feccdf988 Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MultipleCreateTestJSON-952335365-project Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de could not be found. Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '8443d4c1-1589-49d3-9fe7-d6edea43b9de'} Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de could not be found. Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de could not be found. Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:23.341346 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de could not be found. Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.346834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Returning 404 to user: Instance 8443d4c1-1589-49d3-9fe7-d6edea43b9de could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:23.347515 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a28fa74-c985-4e62-ab14-460d1ae34632 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de" status: 404 len: 111 microversion: 2.1 time: 0.127998 Aug 27 03:24:23.348521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.350679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.351892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.353538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.356224 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1811/3531] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:23 2022] GET /compute/v2.1/servers/8443d4c1-1589-49d3-9fe7-d6edea43b9de => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:24:23.385958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:23.388564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] [instance: 53561119-0301-4a16-9ad2-124e2a297c81] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:23.408212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.410916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.412550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.415293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.416039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.419132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.464490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] HTTP exception thrown: Instance 53561119-0301-4a16-9ad2-124e2a297c81 could not be found. Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Request method failure captured: Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 HTTP/1.1 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY3wrVUXROkImqRXOsNxqmxVtXvYgzLab-3_3Gb5AiTzc-WnF4-9ezAwtecVTGcgQQrIMJfOFto01Y5bFLLwPL2M_u-ivXbhJ160QvZ6LFyy4MR5k2Jsd0y17zGnUBgL9UQgWuBrRjbxPNPGz5XQjxhlK67pojmYNUSkoYacguZYFGc Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4d16be1c428c465db77a7ef995249ea6 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MultipleCreateTestJSON-952335365 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4d16be1c428c465db77a7ef995249ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4d16be1c428c465db77a7ef995249ea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4d16be1c428c465db77a7ef995249ea6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4d16be1c428c465db77a7ef995249ea6"}]}] Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MultipleCreateTestJSON-952335365 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4d16be1c428c465db77a7ef995249ea6 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MultipleCreateTestJSON-952335365 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MultipleCreateTestJSON-952335365-project Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 40559a7f1d984e0692b9056feccdf988 Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MultipleCreateTestJSON-952335365-project Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 53561119-0301-4a16-9ad2-124e2a297c81 could not be found. Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '53561119-0301-4a16-9ad2-124e2a297c81'} Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53561119-0301-4a16-9ad2-124e2a297c81 could not be found. Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53561119-0301-4a16-9ad2-124e2a297c81 could not be found. Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:23.466181 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53561119-0301-4a16-9ad2-124e2a297c81 could not be found. Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] Returning 404 to user: Instance 53561119-0301-4a16-9ad2-124e2a297c81 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:23.471986 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39434c9a-019a-4821-9d04-a91039702f74 tempest-MultipleCreateTestJSON-952335365 tempest-MultipleCreateTestJSON-952335365-project] 10.222.0.69 "GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81" status: 404 len: 111 microversion: 2.1 time: 0.093363 Aug 27 03:24:23.481050 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1812/3532] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:23 2022] GET /compute/v2.1/servers/53561119-0301-4a16-9ad2-124e2a297c81 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:24:23.627759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-36db8d24-7085-48d2-aac9-a0b3955c8f45 req-e51ccea1-accf-4beb-9211-fc2088bd9701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "0e1b377f-5c08-4c5c-809b-9437d5e3c209"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:23.644930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-36db8d24-7085-48d2-aac9-a0b3955c8f45 req-e51ccea1-accf-4beb-9211-fc2088bd9701 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.649083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-36db8d24-7085-48d2-aac9-a0b3955c8f45 req-e51ccea1-accf-4beb-9211-fc2088bd9701 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.649675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-36db8d24-7085-48d2-aac9-a0b3955c8f45 req-e51ccea1-accf-4beb-9211-fc2088bd9701 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.674691 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-36db8d24-7085-48d2-aac9-a0b3955c8f45 req-e51ccea1-accf-4beb-9211-fc2088bd9701 service nova] Creating event network-changed:0e1b377f-5c08-4c5c-809b-9437d5e3c209 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:24:23.688382 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-36db8d24-7085-48d2-aac9-a0b3955c8f45 req-e51ccea1-accf-4beb-9211-fc2088bd9701 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064293 Aug 27 03:24:23.693266 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1813/3533] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:24:23.705899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:23.708821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:23.727796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.728814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.729603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:23.734481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:23.735322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:23.736002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:24.788997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:24.803884 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a688ffad-5c2c-47f7-ac1e-c61a06471075 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1679 microversion: 2.1 time: 1.478928 Aug 27 03:24:24.821984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1721/3534] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:23 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1679 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:24.830367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:24.831320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:24.843305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:24.844316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:24.845156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:24.846464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:24.847160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:24.848308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:25.165960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:25.182017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:25.188669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:25.202695 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2979641c-78b9-4077-a2d9-a89f25f31242 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1892 microversion: 2.42 time: 1.504603 Aug 27 03:24:25.209382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1814/3535] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:23 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1892 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:25.223570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:25.227105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:25.245471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:25.246866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:25.247485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:25.248856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:25.250622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:25.251388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:25.771561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:25.785873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4c03c2e6-0b1c-44b0-83cb-10237d51cfa7 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 1472 microversion: 2.1 time: 0.574641 Aug 27 03:24:25.786836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1815/3536] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:25 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 1472 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:25.829131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:25.829764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:25.843077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:25.843597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:25.846735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:25.847511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:25.847994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:25.848438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:26.176695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:26.188196 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f35fd27-d730-4c6e-b18c-070ce5f7fbf8 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1679 microversion: 2.1 time: 0.363129 Aug 27 03:24:26.188805 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1816/3537] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:25 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1679 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:26.227679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:26.228300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:26.242473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:26.243253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:26.243879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:26.244643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:26.245101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:26.246476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:26.328084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:26.342823 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c9dd2393-0197-40ad-8b81-bc1839198d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1313 microversion: 2.1 time: 1.518445 Aug 27 03:24:26.344061 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1722/3538] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:24 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1313 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:26.811042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:26.812804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:26.847854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:26.857007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:26.857462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:26.862326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:26.862836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:26.863265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:26.953248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:26.964091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:26.966110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:26.967788 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-72cab6f8-2f3d-4bff-94ac-9a69719ab427 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1892 microversion: 2.42 time: 0.743970 Aug 27 03:24:26.968854 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1817/3539] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:26 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1892 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:24:27.211792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:27.212855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:27.224584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.225470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.226409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.227489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.228068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.228601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.314559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b806f7cf8fa47c797b25ad51429724b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab7129ea5d24ab19be52eba0b3e71f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:27.336181 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a163997-513a-4ec2-adb0-50aba8cd03d4 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 200 len: 1472 microversion: 2.1 time: 0.531701 Aug 27 03:24:27.354993 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1723/3540] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:26 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:27.366143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:27.366963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:27.373741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.374621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.375120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.376278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.377026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.377523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.820921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:27.836890 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6c6de72-cbb7-475f-ab34-9dc682038b3b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1500 microversion: 2.1 time: 0.474614 Aug 27 03:24:27.838093 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1724/3541] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:27 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1500 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:27.845301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-69f0466f-ac6b-4faa-b3b9-67857a6723a9 req-e3c23c4f-b610-47b5-b207-23d1f664b07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e086890c-6209-43d2-a7e7-aa5a748c3479", "name": "network-vif-deleted", "tag": "f25d42fc-04e2-4a77-ac61-a04dc1cff23c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:27.868109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-69f0466f-ac6b-4faa-b3b9-67857a6723a9 req-e3c23c4f-b610-47b5-b207-23d1f664b07e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.869213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-69f0466f-ac6b-4faa-b3b9-67857a6723a9 req-e3c23c4f-b610-47b5-b207-23d1f664b07e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.870874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-69f0466f-ac6b-4faa-b3b9-67857a6723a9 req-e3c23c4f-b610-47b5-b207-23d1f664b07e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.890633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:27.900403 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17ec9726-fccf-406b-8bde-dfd04c21db24 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1679 microversion: 2.1 time: 0.694086 Aug 27 03:24:27.900999 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1818/3542] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:27 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1679 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:27.928323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a05d3f1-a8f2-4d73-aece-60eed0c57ba3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:27.940827 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-69f0466f-ac6b-4faa-b3b9-67857a6723a9 req-e3c23c4f-b610-47b5-b207-23d1f664b07e service nova] Creating event network-vif-deleted:f25d42fc-04e2-4a77-ac61-a04dc1cff23c for instance e086890c-6209-43d2-a7e7-aa5a748c3479 on n-h2-852086-5 Aug 27 03:24:27.941666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a05d3f1-a8f2-4d73-aece-60eed0c57ba3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:27.942197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a05d3f1-a8f2-4d73-aece-60eed0c57ba3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:27.945728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a05d3f1-a8f2-4d73-aece-60eed0c57ba3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:27.972985 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-69f0466f-ac6b-4faa-b3b9-67857a6723a9 req-e3c23c4f-b610-47b5-b207-23d1f664b07e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132410 Aug 27 03:24:27.977147 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1725/3543] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:27.998410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:27.999671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:28.015469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.016243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.017170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.020031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.020717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.021480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.045478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4a05d3f1-a8f2-4d73-aece-60eed0c57ba3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Going to try to stop instance {{(pid=122407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:24:28.145359 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a05d3f1-a8f2-4d73-aece-60eed0c57ba3 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880/action" status: 202 len: 0 microversion: 2.1 time: 0.233582 Aug 27 03:24:28.147047 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1819/3544] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:24:27 2022] POST /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:24:28.165254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:28.166065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:28.175280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.175882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.176397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.177540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.178084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.178682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.209671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:28.706271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:28.716739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:28.718582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:28.720025 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78243e2f-8f1f-4606-8978-3e11550f1539 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.726558 Aug 27 03:24:28.721268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1726/3545] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:27 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:28.726103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:28.726969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] [instance: e086890c-6209-43d2-a7e7-aa5a748c3479] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:28.734314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.735045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.735694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.736613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.737249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.737850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.738325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:28.749416 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-88e8fc14-5673-46cf-84df-070461b12b42 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.597867 Aug 27 03:24:28.750028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1820/3546] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:28 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:28.756698 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] HTTP exception thrown: Instance e086890c-6209-43d2-a7e7-aa5a748c3479 could not be found. Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Request method failure captured: Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 HTTP/1.1 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY2_LR2n1BU4u-cyEZz7Dcn2Qf474OJTMqr-XHiZLtDjGN_g4cIVvET8ozV0b2QvmdE2pFndNK4sm0CSw1g6kAKU-bY7urTmRAdLr2GHKJXO5Rx31ai-fAYxab8FvGGithgsJdIpcr8aQMedJPwhm3sJCodk4wYvJBf9hgD7qBHnrfQ Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0ab7129ea5d24ab19be52eba0b3e71f2 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ListImageFiltersTestJSON-1535619399 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ab7129ea5d24ab19be52eba0b3e71f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ab7129ea5d24ab19be52eba0b3e71f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ab7129ea5d24ab19be52eba0b3e71f2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ab7129ea5d24ab19be52eba0b3e71f2"}]}] Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ListImageFiltersTestJSON-1535619399 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0ab7129ea5d24ab19be52eba0b3e71f2 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1535619399 Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ListImageFiltersTestJSON-1535619399-project Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 4b806f7cf8fa47c797b25ad51429724b Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ListImageFiltersTestJSON-1535619399-project Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance e086890c-6209-43d2-a7e7-aa5a748c3479 could not be found. Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'e086890c-6209-43d2-a7e7-aa5a748c3479'} Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e086890c-6209-43d2-a7e7-aa5a748c3479 could not be found. Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e086890c-6209-43d2-a7e7-aa5a748c3479 could not be found. Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:28.758689 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:28.764257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:28.764257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:28.764257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:28.764257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:28.764257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:28.764257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e086890c-6209-43d2-a7e7-aa5a748c3479 could not be found. Aug 27 03:24:28.764257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:28.766375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Returning 404 to user: Instance e086890c-6209-43d2-a7e7-aa5a748c3479 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:28.767425 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55516229-962c-450c-9cbc-c631ca3447d0 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479" status: 404 len: 111 microversion: 2.1 time: 0.045023 Aug 27 03:24:28.768176 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1727/3547] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:28 2022] GET /compute/v2.1/servers/e086890c-6209-43d2-a7e7-aa5a748c3479 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:24:28.777121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5f506f58-9adf-461e-a68b-703a331ae1dc tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe45c30a5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:28.932559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:28.934058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:28.946144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.949266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.949906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:28.951673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:28.954864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:28.955573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:29.048330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:29.050727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:29.053291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:29.053998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lazy-loading 'fault' on Instance uuid bdde2b7a-9f85-47bd-8d86-8f51c40b781d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:24:29.069100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:29.197929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5f506f58-9adf-461e-a68b-703a331ae1dc tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/images/79619fa5-664f-4b2c-b081-1c3ce22098dc" status: 204 len: 0 microversion: 2.1 time: 0.425354 Aug 27 03:24:29.199195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1821/3548] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:28 2022] DELETE /compute/v2.1/images/79619fa5-664f-4b2c-b081-1c3ce22098dc => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:29.208505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82987e0a-d8bd-4b8b-b148-51aa7698aa55 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457cc05e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:29.580029 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82987e0a-d8bd-4b8b-b148-51aa7698aa55 tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/images/9bef044c-2245-4231-80dd-d126b03b0136" status: 204 len: 0 microversion: 2.1 time: 0.374220 Aug 27 03:24:29.582582 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1822/3549] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:29 2022] DELETE /compute/v2.1/images/9bef044c-2245-4231-80dd-d126b03b0136 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:29.598067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d95b6871-8646-4a71-a632-484f7898651f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] Calling method '.version_select at 0x7fe457c1ab80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:29.657193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73695cba42d41748ed9d7587cae5f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5095940a4e34b8598707e7a6c653dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:29.668125 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e787f73-39ee-4649-a5ab-92f26b018aea tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 200 len: 1330 microversion: 2.1 time: 0.741143 Aug 27 03:24:29.676463 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1728/3550] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:28 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 1330 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:29.749630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:29.750315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:29.761885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:29.762422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:29.762870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:29.768283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:29.769731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:29.773038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:30.134802 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d95b6871-8646-4a71-a632-484f7898651f tempest-ListImageFiltersTestJSON-1535619399 tempest-ListImageFiltersTestJSON-1535619399-project] 10.222.0.69 "DELETE /compute/v2.1/images/d869ebeb-1326-48ae-95ff-dc83de1160ef" status: 204 len: 0 microversion: 2.1 time: 0.546510 Aug 27 03:24:30.135386 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1823/3551] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:29 2022] DELETE /compute/v2.1/images/d869ebeb-1326-48ae-95ff-dc83de1160ef => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:30.269954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:30.271506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:30.298633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:30.303967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:30.307098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:30.308367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:30.310216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:30.310766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:30.613830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:30.624914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:30.634508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:30.636736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ff4c787-7810-41d7-8816-ae91823b4dd0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.891054 Aug 27 03:24:30.650950 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1729/3552] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:29 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:30.664676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8b857df9-b1a0-4c32-b5ab-718564dcafb0 req-7a0f165b-aa7c-4c06-826c-d073afd66dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "bdd5d6d2-7f93-4496-91ad-112ae37f48c3"}, {"server_uuid": "bdde2b7a-9f85-47bd-8d86-8f51c40b781d", "name": "network-vif-deleted", "tag": "00cace5e-6426-4300-928f-446d3b5e2d5d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:30.685814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8b857df9-b1a0-4c32-b5ab-718564dcafb0 req-7a0f165b-aa7c-4c06-826c-d073afd66dbc service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:30.692388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8b857df9-b1a0-4c32-b5ab-718564dcafb0 req-7a0f165b-aa7c-4c06-826c-d073afd66dbc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:30.693105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8b857df9-b1a0-4c32-b5ab-718564dcafb0 req-7a0f165b-aa7c-4c06-826c-d073afd66dbc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:30.723093 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8b857df9-b1a0-4c32-b5ab-718564dcafb0 req-7a0f165b-aa7c-4c06-826c-d073afd66dbc service nova] Creating event network-changed:bdd5d6d2-7f93-4496-91ad-112ae37f48c3 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:24:30.723944 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8b857df9-b1a0-4c32-b5ab-718564dcafb0 req-7a0f165b-aa7c-4c06-826c-d073afd66dbc service nova] Creating event network-vif-deleted:00cace5e-6426-4300-928f-446d3b5e2d5d for instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d on n-h2-852086-5 Aug 27 03:24:30.751803 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8b857df9-b1a0-4c32-b5ab-718564dcafb0 req-7a0f165b-aa7c-4c06-826c-d073afd66dbc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098966 Aug 27 03:24:30.753174 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1730/3553] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:30.766655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:30.768697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] [instance: bdde2b7a-9f85-47bd-8d86-8f51c40b781d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:30.776530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:30.777648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:30.778375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:30.779388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:30.780676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:30.781372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:30.809505 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] HTTP exception thrown: Instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d could not be found. Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Request method failure captured: Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d HTTP/1.1 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY10f1Lnwt3h2H3yXcaotsS7y-XUGisTwbjNJ6nfETmEJFi9K9AxuZejUK1d1AT843CFErcX1tpqkQqlk785VaeLYeqP5ztGkF1uxvlkE9Vif9gcEffmK9IvZJxcWj6Nyb6KD3_KwlAueM2mSuTmdA73op20lSCCH52oa-ndI2TDG5E Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f5095940a4e34b8598707e7a6c653dda Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesAdminNegativeTest-1244288600 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5095940a4e34b8598707e7a6c653dda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5095940a4e34b8598707e7a6c653dda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5095940a4e34b8598707e7a6c653dda", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5095940a4e34b8598707e7a6c653dda"}]}] Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesAdminNegativeTest-1244288600 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f5095940a4e34b8598707e7a6c653dda Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1244288600 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-VolumesAdminNegativeTest-1244288600-project Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f73695cba42d41748ed9d7587cae5f08 Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesAdminNegativeTest-1244288600-project Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d could not be found. Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'bdde2b7a-9f85-47bd-8d86-8f51c40b781d'} Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d could not be found. Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d could not be found. Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:30.811831 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:30.816356 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:30.816356 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:30.816356 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:30.816356 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:30.816356 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:30.816356 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d could not be found. Aug 27 03:24:30.816356 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:30.820464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Returning 404 to user: Instance bdde2b7a-9f85-47bd-8d86-8f51c40b781d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:30.821583 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42b442b0-9e70-428d-9319-a09b47eff480 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d" status: 404 len: 111 microversion: 2.1 time: 0.067125 Aug 27 03:24:30.822823 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1731/3554] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:30 2022] GET /compute/v2.1/servers/bdde2b7a-9f85-47bd-8d86-8f51c40b781d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:24:30.834476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9ce8340-ce84-4c58-aecd-c97b10451a16 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] Calling method '.version_select at 0x7fe457787700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:30.862193 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9ce8340-ce84-4c58-aecd-c97b10451a16 tempest-VolumesAdminNegativeTest-1244288600 tempest-VolumesAdminNegativeTest-1244288600-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375366225" status: 202 len: 0 microversion: 2.1 time: 0.031864 Aug 27 03:24:30.864960 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1732/3555] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:24:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375366225 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:24:31.028062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:31.043040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cba81106-2ef8-4be1-a6c6-fd9ad36b76b1 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.905075 Aug 27 03:24:31.045274 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1824/3556] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:30 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:31.665451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:31.666221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:31.681518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:31.683979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:31.684600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:31.687738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:31.689576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:31.690809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:32.066116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:32.067919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:32.071766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:32.095930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:32.096765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:32.099219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:32.100148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:32.100909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:32.101494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:32.178220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:32.191496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:32.206520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:32.207843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-831270b6-2f6a-450b-a679-1a428bddb4d7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.547529 Aug 27 03:24:32.208513 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1733/3557] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:31 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:24:32.846373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fbdd2392-5d59-4f54-b54b-0c04d5466928 req-7a41768c-04b6-4168-b58e-a6fdd2e95913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "b03b9929-c210-4a99-9b50-66c9f9836740"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:32.872957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fbdd2392-5d59-4f54-b54b-0c04d5466928 req-7a41768c-04b6-4168-b58e-a6fdd2e95913 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:32.873445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fbdd2392-5d59-4f54-b54b-0c04d5466928 req-7a41768c-04b6-4168-b58e-a6fdd2e95913 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:32.873902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fbdd2392-5d59-4f54-b54b-0c04d5466928 req-7a41768c-04b6-4168-b58e-a6fdd2e95913 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:32.886967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fbdd2392-5d59-4f54-b54b-0c04d5466928 req-7a41768c-04b6-4168-b58e-a6fdd2e95913 service nova] Creating event network-changed:b03b9929-c210-4a99-9b50-66c9f9836740 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:24:32.905311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:32.910419 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fbdd2392-5d59-4f54-b54b-0c04d5466928 req-7a41768c-04b6-4168-b58e-a6fdd2e95913 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068266 Aug 27 03:24:32.916043 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9d75ddd-9013-4917-a752-0f43f5b238a2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.854945 Aug 27 03:24:32.917075 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1734/3558] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:32.918780 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1825/3559] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:32 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:33.238755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:33.239633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:33.251590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:33.253960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:33.256132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:33.257924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:33.262824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:33.263435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:33.858910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:33.870501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:33.877888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:33.879521 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de4fc4c7-bd5d-4ffa-a508-ce19e512e474 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.646650 Aug 27 03:24:33.882044 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1735/3560] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:33 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:33.961632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:33.962545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:33.986279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:33.986801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:33.987229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:33.987940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:33.988407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:33.992563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:34.829196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:34.836998 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3c90e3df-4c7e-4b24-87b0-3ffb9db098ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.898997 Aug 27 03:24:34.854186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1826/3561] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:33 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:34.906427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:34.906427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:34.916732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:34.930299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:34.931003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:34.931781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:34.932261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:34.933472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:34.951498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-346219c6-cbf0-4068-98cf-e8835ea5f69d req-c65cc10f-3ec9-49ac-82f9-199af7388e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "b615d33f-ac86-45b7-ba09-719b4d74a4d5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:34.973887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-346219c6-cbf0-4068-98cf-e8835ea5f69d req-c65cc10f-3ec9-49ac-82f9-199af7388e3c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:34.975101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-346219c6-cbf0-4068-98cf-e8835ea5f69d req-c65cc10f-3ec9-49ac-82f9-199af7388e3c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:34.976054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-346219c6-cbf0-4068-98cf-e8835ea5f69d req-c65cc10f-3ec9-49ac-82f9-199af7388e3c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:34.988053 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-346219c6-cbf0-4068-98cf-e8835ea5f69d req-c65cc10f-3ec9-49ac-82f9-199af7388e3c service nova] Creating event network-changed:b615d33f-ac86-45b7-ba09-719b4d74a4d5 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:24:34.993210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-346219c6-cbf0-4068-98cf-e8835ea5f69d req-c65cc10f-3ec9-49ac-82f9-199af7388e3c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046550 Aug 27 03:24:34.994376 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1827/3562] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:24:35.852835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:35.865420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:35.867346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:35.868839 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ac93b3d-13de-4a2f-a547-11c695475118 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.968115 Aug 27 03:24:35.886131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:35.886131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:35.887323 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1736/3563] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:34 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:35.894870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:35.896066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:35.897013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:35.897861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:35.898962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:35.899522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.223852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:36.248575 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea5e8c41-ae8f-4210-9601-599be6de0659 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.383628 Aug 27 03:24:36.258314 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1828/3564] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:35 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:36.899246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:36.901056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:36.913684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.923013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.923766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:36.925178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:36.925806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:36.926448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.082460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-09b36fc3-d85b-4266-99a6-cfcb3247edf0 req-8468e11c-9c50-4e56-95a1-4a5d153ef5ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "4dfc9eee-0466-4eae-8cc0-7ba5ff267227"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:37.110246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-09b36fc3-d85b-4266-99a6-cfcb3247edf0 req-8468e11c-9c50-4e56-95a1-4a5d153ef5ed service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.112460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-09b36fc3-d85b-4266-99a6-cfcb3247edf0 req-8468e11c-9c50-4e56-95a1-4a5d153ef5ed service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.115849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-09b36fc3-d85b-4266-99a6-cfcb3247edf0 req-8468e11c-9c50-4e56-95a1-4a5d153ef5ed service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.145224 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-09b36fc3-d85b-4266-99a6-cfcb3247edf0 req-8468e11c-9c50-4e56-95a1-4a5d153ef5ed service nova] Creating event network-changed:4dfc9eee-0466-4eae-8cc0-7ba5ff267227 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:24:37.152701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-09b36fc3-d85b-4266-99a6-cfcb3247edf0 req-8468e11c-9c50-4e56-95a1-4a5d153ef5ed service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073395 Aug 27 03:24:37.153374 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1829/3565] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:24:37.279280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:37.281786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:37.289885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.291229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.293420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.296124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.297037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.297950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.515422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:37.529858 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc56ce75-db2a-477c-ab76-d00197dba57b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.254203 Aug 27 03:24:37.532901 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1830/3566] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:37 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:37.578646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:37.579517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:37.588905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.589955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.590824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.591561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.592086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.592517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.629467 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d2bea047-e4a3-4c87-bc5d-6e3a216dd24b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments/e79a626d-5e97-4cba-b646-fafe15dbfacc" status: 200 len: 194 microversion: 2.20 time: 0.073919 Aug 27 03:24:37.635812 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1831/3567] 10.222.0.69 () {60 vars in 1454 bytes} [Sat Aug 27 03:24:37 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments/e79a626d-5e97-4cba-b646-fafe15dbfacc => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:37.716918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:37.717438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:37.731892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.731892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.735254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.735254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:37.735254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:37.735254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:37.877931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lazy-loading 'services' on Instance uuid b3889386-64a2-4858-af6e-009e8606df9f {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:24:37.976458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-002b1297-b0e7-4914-877f-05e6e0b830a1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments/e79a626d-5e97-4cba-b646-fafe15dbfacc" status: 202 len: 0 microversion: 2.20 time: 0.264357 Aug 27 03:24:37.981788 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1832/3568] 10.222.0.69 () {60 vars in 1457 bytes} [Sat Aug 27 03:24:37 2022] DELETE /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments/e79a626d-5e97-4cba-b646-fafe15dbfacc => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:37.990258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:38.000157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:38.024444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:38.025434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:38.026058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:38.027118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:38.028801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:38.029501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:38.090877 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-930e1a2a-254c-4d8b-a252-0d0ef77cb92b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106985 Aug 27 03:24:38.091789 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1833/3569] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:37 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:38.238372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:38.260875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:38.263796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:38.268131 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-386422a5-a8da-43a5-9b63-e1b42a037a5f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 1.377317 Aug 27 03:24:38.277146 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1737/3570] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:36 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:38.560839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:38.562069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:38.595026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:38.596529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:38.597224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:38.599503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:38.600695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:38.601394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:38.942299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:38.963425 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21211106-edea-496d-b9fe-361f6d685d95 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.406700 Aug 27 03:24:38.966707 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1834/3571] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:38 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:39.105510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:39.108112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:39.127799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:39.128586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:39.129216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:39.130115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:39.130780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:39.131215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:39.201419 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b090a1e4-4873-4917-8be3-3b717f7febd4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101143 Aug 27 03:24:39.206600 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1738/3572] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:39 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:24:39.311726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:39.312631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:39.328255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:39.329083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:39.335371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:39.336458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:39.337104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:39.337721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:39.992390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:39.993684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:40.014582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:40.015388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:40.016033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:40.016971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:40.017628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:40.018267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:40.099198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:40.124033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:40.125693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:40.127284 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-790fd3e3-37ce-452d-b979-76dda3de7039 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.820055 Aug 27 03:24:40.128252 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1835/3573] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:39 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:40.215118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:40.218103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:40.237526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:40.251454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:40.257859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:40.263639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:40.264515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:40.266556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:40.369955 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62bc006c-bd79-46fd-8319-2c5854bbcab0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159604 Aug 27 03:24:40.378449 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1836/3574] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:40 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:24:40.998813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:41.019184 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccc08e11-32b7-4e44-9ed1-1d2369f860ed tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 1.030476 Aug 27 03:24:41.020070 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1739/3575] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:39 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:41.157360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:41.158776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:41.172133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:41.175955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:41.179195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:41.182787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:41.183668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:41.184366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:41.384202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:41.387464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:41.407268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:41.408172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:41.408896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:41.409942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:41.413400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:41.414118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:41.502428 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e7d5b01-3648-484a-a992-c708861b86a4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122129 Aug 27 03:24:41.509497 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1740/3576] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:41 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:42.046018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:42.046724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:42.058661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:42.059150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:42.059583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:42.063840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:42.065862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:42.067609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:42.862839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:42.879878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:42.884272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:42.888779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a13bfd5-a883-4e1c-a75b-c892680ef96e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 1.737219 Aug 27 03:24:42.889250 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1837/3577] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:41 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:42.906982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:42.909372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:42.921281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:42.928625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:42.929505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:42.931031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:42.931708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:42.935303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:43.035244 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b9baf771-ebc8-4a28-9253-54f52d032d6c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144871 Aug 27 03:24:43.035853 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1838/3578] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:42 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:43.067479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d285d54b-2a3f-4c0e-865e-ca5e0ce3ddc5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Action: 'create', calling method: .version_select at 0x7fe457c9ed30>, body: {"keypair": {"name": "tempest-keypair-488282231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRcb7PF2V4dfDu9f6mTZZu+rFgeVY4KBU7EWm0J+HFby01KoM8xYncxyC+AjWRtU5NkiPfGmnD+2zGZ3VP7INKtbCSEc9y28OpNTbLy3joZJWwdH+7TbLuRGWmxin3bZQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:43.124114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d285d54b-2a3f-4c0e-865e-ca5e0ce3ddc5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Getting quotas for project 8a99adf57f6b4eb0a3d5db791cc29e46. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:24:43.143319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d285d54b-2a3f-4c0e-865e-ca5e0ce3ddc5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Getting quotas for user 4e04f79ef1a24f97a2475c8a8b6ae14c and project 8a99adf57f6b4eb0a3d5db791cc29e46. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:24:43.206393 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d285d54b-2a3f-4c0e-865e-ca5e0ce3ddc5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.155743 Aug 27 03:24:43.207010 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1839/3579] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:24:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:24:43.917813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:43.919426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:43.935527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:43.938570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:43.939235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:43.942442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:43.944708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:43.948824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:44.037853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:44.060843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-536208f3-04ab-46eb-8873-186856be79e4 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 2.024172 Aug 27 03:24:44.065296 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1741/3580] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:42 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:44.077424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:44.085716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:44.112213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:44.113013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:44.113633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:44.114575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:44.115213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:44.115909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:44.226401 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-676613c1-4a9f-4731-8919-46680be38ffe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159760 Aug 27 03:24:44.233677 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1742/3581] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:44 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:45.086907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:45.087872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:45.104291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:45.106884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:45.107784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:45.110564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:45.111518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:45.113867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:45.139991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:45.162439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:45.168267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:45.174210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2f2046d-50cf-45c6-9f36-07516154963c tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 1.261588 Aug 27 03:24:45.193861 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1840/3582] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:43 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:24:45.248260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:45.253016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:45.263786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:45.264726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:45.265462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:45.266508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:45.267269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:45.268079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:45.335566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:45.338223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9bbe4d28-1115-48a7-ac49-543e16a94cef tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101991 Aug 27 03:24:45.351504 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1841/3583] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:45 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:24:45.763405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:45.775598 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8956f9a-c82f-4fe4-9144-bc983c31ebec tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.693931 Aug 27 03:24:45.777243 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1743/3584] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:45 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:46.201037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:46.201657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:46.209417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:46.209841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:46.210304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:46.223465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:46.223796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:46.224257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:46.353006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:46.358335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:46.366462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:46.367867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:46.368610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:46.369632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:46.371162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:46.371882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:46.414094 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2a67da3-c63e-4411-b9db-78e9f0ead5e3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065658 Aug 27 03:24:46.421943 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1744/3585] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:46 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:24:46.798846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:46.799870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:46.813964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:46.815657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:46.816470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:46.819388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:46.824645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:46.826613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:47.191741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:47.209860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:47.211387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:47.212897 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c411a77c-6748-4ef2-9ea8-80949253049e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 1.015536 Aug 27 03:24:47.213170 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1842/3586] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:46 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:47.429788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:47.432020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:47.468527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:47.471497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:47.473100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:47.474140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:47.475116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:47.475816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:47.528496 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3d8ae90a-c054-4a81-bb1d-eee97b32aa32 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.101772 Aug 27 03:24:47.540539 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1843/3587] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:24:47 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:47.613751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:47.614668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:47.623924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:47.625505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:47.626490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:47.627610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:47.628192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:47.628781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:47.668389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:47.734009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:47.746844 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32cf768f-ddb1-4c61-abde-fb8a76ffa021 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.949537 Aug 27 03:24:47.749554 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1745/3588] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:46 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:24:47.816942 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48f055c1-a85f-443e-bed7-5b98b129abcd tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 204 len: 0 microversion: 2.20 time: 0.207902 Aug 27 03:24:47.818851 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1844/3589] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:24:47 2022] DELETE /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:24:47.830675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:47.831773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:47.847749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:47.850052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:47.850818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:47.855664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:47.856500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:47.857152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:48.245232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:48.248872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:48.261673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:48.262601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:48.263237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:48.264283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:48.265433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:48.266103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:48.319889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:48.331605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:48.334925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:48.337010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-812f3e05-9356-4436-8a43-ad828ab19c8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.514008 Aug 27 03:24:48.339758 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1746/3590] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:47 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:24:48.777736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:48.778420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:48.785309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:48.785663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:48.786100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:48.797190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:48.797924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:48.799002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:48.967944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:48.993034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:48.998863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:49.000516 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8442310c-a3c3-4afe-823e-1b9559ba66bf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.762930 Aug 27 03:24:49.004424 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1845/3591] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:48 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:24:49.274803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:49.288953 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1da423c4-c39b-403f-9dad-45dfd12fc851 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.516822 Aug 27 03:24:49.297088 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1747/3592] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:48 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:49.320295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-405042893", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7ee452c0-734c-4f38-ad6a-5464f4b35819"}, {"port": "1a261b78-b479-41f5-80c0-d31949515c7f", "tag": "port-1"}, {"port": "aefcec6d-0a13-4988-8127-fb6b417065d8", "tag": "port-2"}, {"uuid": "5fb67aa1-e694-4e4b-b8fc-5dbd185248c6", "tag": "net-1"}, {"uuid": "5fb67aa1-e694-4e4b-b8fc-5dbd185248c6"}, {"uuid": "08a39793-8078-484e-964b-af1cab7f2749", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "08a39793-8078-484e-964b-af1cab7f2749", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6c40fa6d-242c-43f7-b393-b81891a924ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "77822b26-3f58-4060-bcf4-f3870c75e8c4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5678280f-d9ae-4dc4-a431-1b92065ab750", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2058808327"}], "key_name": "tempest-keypair-488282231", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:49.362107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:49.363076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:49.369870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:49.371952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:49.372617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:49.373627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:49.374293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:49.374893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:49.438683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:49.676897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] validate_networks() for [('7ee452c0-734c-4f38-ad6a-5464f4b35819', None, None, None, None, None), (None, None, '1a261b78-b479-41f5-80c0-d31949515c7f', None, None, None), (None, None, 'aefcec6d-0a13-4988-8127-fb6b417065d8', None, None, None), ('5fb67aa1-e694-4e4b-b8fc-5dbd185248c6', None, None, None, None, None), ('5fb67aa1-e694-4e4b-b8fc-5dbd185248c6', None, None, None, None, None), ('08a39793-8078-484e-964b-af1cab7f2749', '10.2.2.100', None, None, None, None), ('08a39793-8078-484e-964b-af1cab7f2749', '10.2.2.200', None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:24:50.221706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:50.243891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:50.249687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:50.256274 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa01976f-f7dc-473d-bb45-a32f69090864 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1724 microversion: 2.20 time: 0.898220 Aug 27 03:24:50.261394 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1748/3593] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:49 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1724 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:50.272304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:50.273282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:50.297881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:50.301001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:50.302972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:50.303561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:50.307684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:50.308561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:50.309633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:51.108744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:51.123675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:51.133472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:51.136892 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7192b86d-15b0-4db6-913d-3b0bb786d555 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.873723 Aug 27 03:24:51.140898 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1749/3594] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:50 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:51.160383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:51.160383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:51.180058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:51.180871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:51.181478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:51.182477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:51.185238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:51.185874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:52.217567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:52.235416 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-743eb7c7-1ef5-4418-81ad-4628d1bc38a8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 1.092572 Aug 27 03:24:52.236349 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1750/3595] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:51 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:52.241217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:52.242069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:52.259353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:52.260208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:52.260980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:52.262177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:52.262893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:52.263533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:52.507015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:52.524812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:52.525942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:52.527905 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36d8c3ee-753e-4866-b0a6-869aecf1a599 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1656 microversion: 2.20 time: 0.290365 Aug 27 03:24:52.528729 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1751/3596] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:52 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1656 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:52.546683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:52.552862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:52.565461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:52.565977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:52.566465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:52.573956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:52.579879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:52.588582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:53.165023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:53.350869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:53.368679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:53.371717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:53.373130 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff29b6e0-f01b-4e29-8832-95de8e162ff5 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.843091 Aug 27 03:24:53.373717 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1752/3597] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:52 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:53.378735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:53.379616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:53.390662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:53.391571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:53.392235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:53.393213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:53.393893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:53.394585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:53.896169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:53.911884 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dfe22911-3fc5-44dd-9f0c-72c8c462b814 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1510 microversion: 2.1 time: 0.536586 Aug 27 03:24:53.914415 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1753/3598] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:53 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1510 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:53.946827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:53.947953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:53.965266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:53.967680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:53.969014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:53.971480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:53.972512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:53.974514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:54.081784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:54.095095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:54.097868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:54.099673 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f62cd3d6-eb29-4cf9-bc60-2c78d4d1b74d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 200 len: 1367 microversion: 2.20 time: 0.182612 Aug 27 03:24:54.100618 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1754/3599] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:53 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:54.123584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c652369e-c89f-4fca-bf1c-aafd3652b05b req-b2200f79-e40e-47c5-b324-bb3a7f639989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3889386-64a2-4858-af6e-009e8606df9f", "name": "network-vif-deleted", "tag": "544e928d-a4d3-43ac-9b2f-854b3810328a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:54.136591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c652369e-c89f-4fca-bf1c-aafd3652b05b req-b2200f79-e40e-47c5-b324-bb3a7f639989 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:54.137565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c652369e-c89f-4fca-bf1c-aafd3652b05b req-b2200f79-e40e-47c5-b324-bb3a7f639989 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:54.138362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c652369e-c89f-4fca-bf1c-aafd3652b05b req-b2200f79-e40e-47c5-b324-bb3a7f639989 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:54.154710 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c652369e-c89f-4fca-bf1c-aafd3652b05b req-b2200f79-e40e-47c5-b324-bb3a7f639989 service nova] Creating event network-vif-deleted:544e928d-a4d3-43ac-9b2f-854b3810328a for instance b3889386-64a2-4858-af6e-009e8606df9f on n-h1-852086-5 Aug 27 03:24:54.160791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c652369e-c89f-4fca-bf1c-aafd3652b05b req-b2200f79-e40e-47c5-b324-bb3a7f639989 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058788 Aug 27 03:24:54.165092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1755/3600] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:24:54.338316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1248486009", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "08f9dc5c-a8e9-4de2-8a89-eee18ed96cd2"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:24:54.414327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] validate_networks() for [('08f9dc5c-a8e9-4de2-8a89-eee18ed96cd2', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:24:55.853708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:24:55.854383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:24:55.854791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:24:55.855407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:24:55.856033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:24:55.874439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:55.874936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:55.875372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:55.876119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:55.876577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:55.877016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:55.942771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Getting quotas for project 136ed6e9eee649218d39c3afa4ef8f71. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:24:55.960075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Getting quotas for user 0e08ca2687b1407a86a22f9bd863cf05 and project 136ed6e9eee649218d39c3afa4ef8f71. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:24:56.006453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:24:56.015768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:24:56.150853 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c59816d-cefd-4ec9-9a03-c25ad84031f7 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.982900 Aug 27 03:24:56.154766 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1756/3601] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:24:56.193914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:56.198201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:56.235957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:56.237408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:56.238197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:56.241543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:56.242241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:56.242874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:56.639766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:56.660673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:56.662049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:56.663377 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3817060-f4e2-4d8d-9b4f-08e820ae4561 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.506900 Aug 27 03:24:56.674195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1757/3602] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:56 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:56.674195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:56.674195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:56.692366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:56.692869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:56.693339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:56.694044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:56.694595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:56.694984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:57.332104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:57.340747 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b7a541f-59eb-4fe7-9b07-21a2336ce880 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1487 microversion: 2.1 time: 0.675755 Aug 27 03:24:57.341338 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1758/3603] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:56 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1487 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:57.363294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:57.366329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:57.391747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:57.392613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:57.393307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:57.396873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:57.397615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:57.398326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:57.442738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] HTTP exception thrown: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Request method failure captured: Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f HTTP/1.1 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1_-frECvJRu6gyJxGas2hkTJXzz3t2YzowVcKt2W3M8ZaNzRIEXLvtbw6AWrKEULaABBYGgHa2oNDHxiqgVh6nr9n4rA1iZ28TloF9t2PDrbcSRlJORsLfzNe6ZIOHDXjgiWCFyRr1W5p-VG7RTaOP11VXue-qZJ7tTxE9K8DsXVg Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f53131cd9e41486b88777602871e8c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f53131cd9e41486b88777602871e8c96", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}] Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7ab173f6fa384800afe3fcafea2a628b Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b3889386-64a2-4858-af6e-009e8606df9f'} Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:57.476841 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Returning 404 to user: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb57dfe3-2906-4b00-b1a8-ea3ce559618a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 404 len: 111 microversion: 2.20 time: 0.136173 Aug 27 03:24:57.482119 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1759/3604] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:57 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:24:57.494662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:57.496415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:57.503002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:57.503791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:57.505463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:57.506440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:57.507945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:57.508620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:57.709345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:57.732431 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea392da6-13ff-49c1-95eb-0906e4a6b710 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1277 microversion: 2.1 time: 0.242209 Aug 27 03:24:57.733703 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1760/3605] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:57 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:57.740875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:57.741400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:57.759496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:57.760006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:57.760458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:57.761658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:57.762147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:57.762618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:57.815552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:24:57.996115 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37240757-1de2-475e-a0eb-11aca0ee3bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 204 len: 0 microversion: 2.1 time: 0.260026 Aug 27 03:24:58.000607 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1761/3606] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:24:57 2022] DELETE /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:24:58.014007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a20e3597-45f2-46d5-97f0-4ae81bddfb7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '.version_select at 0x7fe460337ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:58.059787 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a20e3597-45f2-46d5-97f0-4ae81bddfb7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124590980" status: 204 len: 0 microversion: 2.20 time: 0.056198 Aug 27 03:24:58.062592 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1762/3607] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124590980 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:24:58.075005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:58.077815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:58.097872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:58.098501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:58.098954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:58.100944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:58.105156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:58.106872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:58.712104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:58.733087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:58.748368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:58.748368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1904b057-7587-41fc-a632-4a40670fea28 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.684182 Aug 27 03:24:58.770058 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1763/3608] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:58 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:24:58.789305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:58.802070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:58.815568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:58.825682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:58.826840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:58.828544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:58.829267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:58.829925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:58.973405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:24:59.142109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:24:59.142574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:24:59.143115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:24:59.143555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:24:59.144398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:24:59.225444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:59.230013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:59.236085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:59.241699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:59.246344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:59.249244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:59.267679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:59.285498 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ffe48c9-edde-4d8e-90bc-521d45d5b179 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1493 microversion: 2.1 time: 0.514293 Aug 27 03:24:59.286452 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1764/3609] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:58 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1493 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:59.299966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:59.302958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:59.335486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Getting quotas for project 8a99adf57f6b4eb0a3d5db791cc29e46. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:24:59.344594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Getting quotas for user 4e04f79ef1a24f97a2475c8a8b6ae14c and project 8a99adf57f6b4eb0a3d5db791cc29e46. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:24:59.353294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:59.357877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:59.358430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:59.359598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:59.359753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:59.360092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:59.696988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:24:59.718506 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24f8c4fc-e18d-4b72-beb0-a465d4f755c8 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1285 microversion: 2.1 time: 0.430123 Aug 27 03:24:59.719838 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1765/3610] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:24:59 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1285 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:24:59.771949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:24:59.774904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6c40fa6d-242c-43f7-b393-b81891a924ed',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='77822b26-3f58-4060-bcf4-f3870c75e8c4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5678280f-d9ae-4dc4-a431-1b92065ab750',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:24:59.775159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:24:59.775778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:24:59.783468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:59.783951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:59.784392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:59.785098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:24:59.785551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:24:59.785982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:24:59.801143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:00.335531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:00.349678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:00.363076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:00.364560 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-586a44b1-dd4c-41d6-9eed-237337ef59ee tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.595521 Aug 27 03:25:00.369397 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1766/3611] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:24:59 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:25:00.376980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:00.381457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:00.405831 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-deb0ab8a-8c49-4ebd-a985-af6f6f36bceb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.089953 Aug 27 03:25:00.410042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:00.410752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:00.411361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:00.412302 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1846/3612] 10.222.0.69 () {62 vars in 1189 bytes} [Sat Aug 27 03:24:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 11097 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:25:00.412639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:00.413268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:00.413865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:00.424062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c4a83ebe-a70e-477a-b053-a1a240276121 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:00.438467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c4a83ebe-a70e-477a-b053-a1a240276121 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:00.735051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c4a83ebe-a70e-477a-b053-a1a240276121 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:00.747779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c4a83ebe-a70e-477a-b053-a1a240276121 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:00.752704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c4a83ebe-a70e-477a-b053-a1a240276121 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:00.770744 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c4a83ebe-a70e-477a-b053-a1a240276121 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1284 microversion: 2.32 time: 0.349790 Aug 27 03:25:00.784795 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1847/3613] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:00 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1284 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:00.792050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:00.808050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:00.836497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:00.839251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:00.840968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:00.845356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:00.846306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:00.850750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:01.050084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:01.062491 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd6fb3b7-69d9-4b06-bab9-a19a2a261712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 200 len: 1493 microversion: 2.1 time: 0.691182 Aug 27 03:25:01.064852 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1767/3614] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:00 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 1493 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:01.324086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c040f782-3942-48c4-97b5-f01c61ebb88b req-5e8ae1d9-8ea9-44d1-83a9-d48593fe3e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3985591f-9a52-4bb4-9dd7-564d21a56880", "name": "network-vif-deleted", "tag": "59b4626b-537e-468e-9d29-aaae43db4419"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:01.337263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c040f782-3942-48c4-97b5-f01c61ebb88b req-5e8ae1d9-8ea9-44d1-83a9-d48593fe3e35 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:01.338341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c040f782-3942-48c4-97b5-f01c61ebb88b req-5e8ae1d9-8ea9-44d1-83a9-d48593fe3e35 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:01.339071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c040f782-3942-48c4-97b5-f01c61ebb88b req-5e8ae1d9-8ea9-44d1-83a9-d48593fe3e35 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:01.356943 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c040f782-3942-48c4-97b5-f01c61ebb88b req-5e8ae1d9-8ea9-44d1-83a9-d48593fe3e35 service nova] Creating event network-vif-deleted:59b4626b-537e-468e-9d29-aaae43db4419 for instance 3985591f-9a52-4bb4-9dd7-564d21a56880 on n-h2-852086-5 Aug 27 03:25:01.362579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c040f782-3942-48c4-97b5-f01c61ebb88b req-5e8ae1d9-8ea9-44d1-83a9-d48593fe3e35 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044438 Aug 27 03:25:01.363794 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1768/3615] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:01.410421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:01.412527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:01.430519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:01.434949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:01.435678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:01.436963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:01.437601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:01.438369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:01.489572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:01.500040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4b26ebe-09e2-474c-843b-27965d0973c2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1283 microversion: 2.1 time: 0.721618 Aug 27 03:25:01.503446 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1848/3616] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:00 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1283 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:01.788395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:01.800822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a25304f-a652-40c6-a9b9-f3d2ed737fc6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:01.801161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:01.801434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a25304f-a652-40c6-a9b9-f3d2ed737fc6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:01.802982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:01.805437 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77f8dd71-0fe0-4db6-ba55-f9e4a8e32876 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.413409 Aug 27 03:25:01.808867 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1769/3617] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:01 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:01.985569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24cfed3e-0b8a-483a-92cb-b378a98c0f6e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'create', calling method: .version_select at 0x7fe460402ee0>, body: {"keypair": {"name": "tempest-keypair-763094187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkfkxLYwNFgGDm/Ol0nvJ323ZA6cQv8PvhgrPXaMdkJP2zhMIQbiuiix2zXydpkn+Gglp+WPvFyk5daYINse4DESrXi+PRwEYsVPlJES1ZDGjwG1c3gjunvEgMOwmEvDg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:02.017283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-24cfed3e-0b8a-483a-92cb-b378a98c0f6e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for project f53131cd9e41486b88777602871e8c96. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:02.024371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a25304f-a652-40c6-a9b9-f3d2ed737fc6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:02.027138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-24cfed3e-0b8a-483a-92cb-b378a98c0f6e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for user 7ab173f6fa384800afe3fcafea2a628b and project f53131cd9e41486b88777602871e8c96. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:02.032905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a25304f-a652-40c6-a9b9-f3d2ed737fc6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:02.041213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a25304f-a652-40c6-a9b9-f3d2ed737fc6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:02.044253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a25304f-a652-40c6-a9b9-f3d2ed737fc6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1284 microversion: 2.32 time: 0.246405 Aug 27 03:25:02.049891 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1849/3618] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:01 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:02.084982 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24cfed3e-0b8a-483a-92cb-b378a98c0f6e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.108881 Aug 27 03:25:02.087726 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1770/3619] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:25:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:25:02.089312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:02.090098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:02.107040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:02.109027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:02.110339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:02.111039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:02.112503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:02.113378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:02.114085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:02.145590 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 HTTP/1.1 Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '3985591f-9a52-4bb4-9dd7-564d21a56880'} Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:02.154352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:02.159655 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:02.159655 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:02.159655 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:02.159655 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:02.159655 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:02.159655 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:02.159655 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:02.161531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:02.164282 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7af68a56-4b5a-49ea-9333-7df1ba567322 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 404 len: 111 microversion: 2.1 time: 0.081178 Aug 27 03:25:02.166120 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1850/3620] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:02 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:25:02.323316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-997307673", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "be792eba-f4b7-46b8-9127-1ca32ef532fe"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:02.443622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] validate_networks() for [('be792eba-f4b7-46b8-9127-1ca32ef532fe', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:25:02.525008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:02.526318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:02.543810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:02.544865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:02.545529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:02.546839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:02.548141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:02.552488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:02.991736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.003335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24a0d670-e2de-4d56-a61f-1be3a300079b tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1325 microversion: 2.1 time: 0.482120 Aug 27 03:25:03.003937 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1851/3621] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:02 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:03.036423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:03.037652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:03.046546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:03.047344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:03.048117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:03.050217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:03.050961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:03.051579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:03.474500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.490214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.492066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.494632 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d7c9262-6ea3-4dcc-89cc-66565df00014 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.481209 Aug 27 03:25:03.495722 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1852/3622] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:03 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:03.505211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:03.506093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:03.531758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:03.539702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:03.540556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:03.543106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:03.544278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:03.546232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:03.668257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.681432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.686698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.691165 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3659e5bb-344e-4320-8f65-6a65b08ab58e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1574 microversion: 2.32 time: 0.190507 Aug 27 03:25:03.691776 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1853/3623] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:03 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:04.260375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:25:04.261824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:25:04.262549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:25:04.263272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:25:04.263890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:25:04.270223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf731e5d-f51f-4131-9dcc-970ffc2fdc80 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'create', calling method: .version_select at 0x7fe4579be5e0>, body: {"keypair": {"name": "tempest-keypair-907814670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHaI5E5qUN64nNXpYudCrsrCz/wQX4f9e76NEEF94MkUw3f/m8ghNJNiMsgroFcTwHHItA1Zph54WdPQEIX5808bEfBgvPOYwP725mVY67ThvQfkWy4/pDjWlL0E/Jp1A=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:04.306683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:04.314964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:04.315920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:04.317000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:04.321449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:04.328734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:04.335002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-bf731e5d-f51f-4131-9dcc-970ffc2fdc80 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for project a0cf74946f704a99a6878baa30bbac4e. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:04.350878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-bf731e5d-f51f-4131-9dcc-970ffc2fdc80 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for user 89f850adf9a7432798f86fe9d2d17b79 and project a0cf74946f704a99a6878baa30bbac4e. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:04.403971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:04.411145 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf731e5d-f51f-4131-9dcc-970ffc2fdc80 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.717983 Aug 27 03:25:04.413925 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1854/3624] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:25:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:04.423850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Getting quotas for user 267cffdb49624ff986aed20fd255b1db and project 304ea20c86dc44d3bd25a884bc30b6ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:04.436618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:04.440995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:04.457781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:04.460101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:25:04.461057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:04.462493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:25:04.463259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:04.464484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:04.469798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:04.470811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:04.568348 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d1cac74-39f0-4299-9045-dfd0bbcb983a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.251429 Aug 27 03:25:04.571054 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1771/3625] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:25:04.582398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bea0b985-dcb3-4429-86ea-6384e9752050 req-6776950d-193e-4659-a566-9bc37abdae6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1035d4-9f10-431e-9a59-97f8c88d72f8", "tag": "511b3e95-ffc9-4638-ae80-423054ac3d7f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:04.610846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bea0b985-dcb3-4429-86ea-6384e9752050 req-6776950d-193e-4659-a566-9bc37abdae6e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:04.611777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bea0b985-dcb3-4429-86ea-6384e9752050 req-6776950d-193e-4659-a566-9bc37abdae6e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:04.612465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bea0b985-dcb3-4429-86ea-6384e9752050 req-6776950d-193e-4659-a566-9bc37abdae6e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:04.625860 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bea0b985-dcb3-4429-86ea-6384e9752050 req-6776950d-193e-4659-a566-9bc37abdae6e service nova] Creating event network-changed:511b3e95-ffc9-4638-ae80-423054ac3d7f for instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 on n-h2-852086-5 Aug 27 03:25:04.631257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bea0b985-dcb3-4429-86ea-6384e9752050 req-6776950d-193e-4659-a566-9bc37abdae6e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059014 Aug 27 03:25:04.632927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1772/3626] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:04.643513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:04.644917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:04.655730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:04.656630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:04.657365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:04.661690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:04.662478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:04.663170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:04.886821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:04.898739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7d913e50-b384-4661-ae7f-3260bd6bfaea tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1325 microversion: 2.1 time: 0.480730 Aug 27 03:25:04.902037 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1855/3627] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:04 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1325 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:04.918768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f75159b-27bb-47e9-8744-2359f8acba2d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:04.919901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f75159b-27bb-47e9-8744-2359f8acba2d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:05.584977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f75159b-27bb-47e9-8744-2359f8acba2d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.592285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f75159b-27bb-47e9-8744-2359f8acba2d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1214 microversion: 2.1 time: 0.688663 Aug 27 03:25:05.608060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.618516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.621961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.623556 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-51f9a1c8-37a8-4296-9876-9af4f3c2a8ef tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.989293 Aug 27 03:25:05.624698 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1773/3628] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:04 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:05.630661 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1856/3629] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:04 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1214 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:05.632143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:05.633038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:05.644716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:05.645751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:05.646482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:05.647440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:05.648134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:05.648838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:05.944974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.960564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.961182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b641bced-d8db-41b7-8f60-a4af2112b1ae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe457b8b670>, body: {"keypair": {"name": "tempest-keypair-2026685370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc8KwAk3ld4n2ij9d2aCHYeD7DilCOmnKcX1uhfClGp5LrpkiVMMj87Y8F5/FrFnOPlWgbHb8WiW+XQddOWxKvtx8vJqqQaoNuj7xz3n02B5l4zakFaBbENLdWHfnWQ4A=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:05.962024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.965169 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3901876c-84ba-4a92-889c-03eb7d16595c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1592 microversion: 2.32 time: 0.338405 Aug 27 03:25:05.968695 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1774/3630] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:05 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1592 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:05.978188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:05.979086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:05.999516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b641bced-d8db-41b7-8f60-a4af2112b1ae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:06.003266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.003815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.004854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.005611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.006081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.006551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.008437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b641bced-d8db-41b7-8f60-a4af2112b1ae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:06.069967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b641bced-d8db-41b7-8f60-a4af2112b1ae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.438145 Aug 27 03:25:06.071028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1857/3631] 10.222.0.69 () {62 vars in 1199 bytes} [Sat Aug 27 03:25:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 03:25:06.087010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c202ad40-f35e-4d99-8800-3689d906d278 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457b8bd30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:06.129498 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c202ad40-f35e-4d99-8800-3689d906d278 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-2026685370" status: 200 len: 513 microversion: 2.2 time: 0.048706 Aug 27 03:25:06.133003 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1858/3632] 10.222.0.69 () {60 vars in 1258 bytes} [Sat Aug 27 03:25:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2026685370 => generated 513 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:06.146383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a61d14b8-08a4-4dc8-a1df-b092d35b47ad tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457c5f430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:06.209702 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a61d14b8-08a4-4dc8-a1df-b092d35b47ad tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026685370" status: 204 len: 0 microversion: 2.2 time: 0.068580 Aug 27 03:25:06.210899 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1859/3633] 10.222.0.69 () {60 vars in 1261 bytes} [Sat Aug 27 03:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026685370 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:06.224097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-09987af9-a3ce-46b6-ab09-f2387ebfe2ba tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe457c9ef70>, body: {"keypair": {"name": "tempest-keypair-1252003374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVOjUuWbGkjQHgTedhOu5UyuPBV0+3Lv4G9yaxGoe+C5YDlJsHC58D55sWyEJZxbh/t42Wmqbdy1MCASUX7T4BS/K07xxv3Vm9zYsre2Mytycg0jeEpKhfv/4VJPRyQZg=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:06.278462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-09987af9-a3ce-46b6-ab09-f2387ebfe2ba tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:06.288738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-09987af9-a3ce-46b6-ab09-f2387ebfe2ba tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:06.396967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-09987af9-a3ce-46b6-ab09-f2387ebfe2ba tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.176815 Aug 27 03:25:06.397595 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1860/3634] 10.222.0.69 () {62 vars in 1199 bytes} [Sat Aug 27 03:25:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 27 03:25:06.410368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-446cf7bc-5dce-4143-a2b0-d531c9a680a8 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457b5d3a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:06.492947 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-446cf7bc-5dce-4143-a2b0-d531c9a680a8 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252003374" status: 204 len: 0 microversion: 2.2 time: 0.086450 Aug 27 03:25:06.498270 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1861/3635] 10.222.0.69 () {60 vars in 1261 bytes} [Sat Aug 27 03:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252003374 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:06.514154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfdbbb29-039c-4af4-a32d-7eb85fd22aae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe457bb7040>, body: {"keypair": {"name": "tempest-keypair-1186598823", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:06.570332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cfdbbb29-039c-4af4-a32d-7eb85fd22aae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:06.589631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cfdbbb29-039c-4af4-a32d-7eb85fd22aae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:06.675317 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfdbbb29-039c-4af4-a32d-7eb85fd22aae tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.170553 Aug 27 03:25:06.676275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1862/3636] 10.222.0.69 () {62 vars in 1199 bytes} [Sat Aug 27 03:25:06 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 27 03:25:06.691847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:06.694606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:06.711503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.712423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.713206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.717027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.717827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.719690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.910262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:06.926417 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c7c89dd-8ede-4cfa-9b04-c609f42482fb tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1272 microversion: 2.1 time: 0.245402 Aug 27 03:25:06.927759 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1863/3637] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:06 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:06.941375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:06.941375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:06.956404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.956917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.957356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.958085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.958567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.964202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.523328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.553450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.555328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.557003 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d671e9d6-bf24-4f8f-878c-b5007bb02189 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.626861 Aug 27 03:25:07.584760 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1864/3638] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:06 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:07.591690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a65d30fa-7d11-44b9-95cc-0d88795b797b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457ba68b0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:07.630189 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a65d30fa-7d11-44b9-95cc-0d88795b797b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186598823" status: 204 len: 0 microversion: 2.2 time: 0.043754 Aug 27 03:25:07.636348 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1865/3639] 10.222.0.69 () {60 vars in 1261 bytes} [Sat Aug 27 03:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186598823 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:07.642865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:07.643905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:07.652212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.653190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.656053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.657609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.660857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.661749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.752679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.766600 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c085ad8-3b52-4509-9cfa-12f218384076 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1325 microversion: 2.1 time: 1.796630 Aug 27 03:25:07.768192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1775/3640] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:05 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1325 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:07.801143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df73c8b4-8408-411f-8959-a20933a8e178 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe4602418b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-338765236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUJ9txY+PL2QMK2+TYebF94ZHncGgjLAGyJIeYzWWWWEogEmWEsFvlImJ24iLqMNCz/fQhjk0/ubx+3XP+nuVgpN2PXssr20590yV6IDaUovnxO+s53uaX1DNE2Akm7Tw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:07.809991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:07.837588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.844638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-df73c8b4-8408-411f-8959-a20933a8e178 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:07.864576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-df73c8b4-8408-411f-8959-a20933a8e178 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:07.869612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.869612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.869612 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-96a82580-1be9-4f3b-b839-f193facb9ca6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1592 microversion: 2.32 time: 0.230742 Aug 27 03:25:07.872281 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1866/3641] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:07 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1592 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:07.920489 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df73c8b4-8408-411f-8959-a20933a8e178 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.150879 Aug 27 03:25:07.931692 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1776/3642] 10.222.0.69 () {62 vars in 1199 bytes} [Sat Aug 27 03:25:07 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 03:25:07.938954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-13dc63c3-f8c1-4cf6-b054-80284aae5012 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe457bb8040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1496861381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHf4fk2GnkgeZ390hzyj0hDhsn/GqgBBLVUIIJ7SuywT7vqlkTAMCFKlL5ORxKxhgWN6P2Zmps49f8hBuPi2jwKaaSDdm9vYo3hMi7x13fpAsgwdAItxeJYUmAYplDKwg=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:07.949288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:07.950041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:07.966118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.967079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.967954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.970259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.970496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-13dc63c3-f8c1-4cf6-b054-80284aae5012 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:07.971879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.972408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.989706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-13dc63c3-f8c1-4cf6-b054-80284aae5012 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:08.056359 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-13dc63c3-f8c1-4cf6-b054-80284aae5012 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.118668 Aug 27 03:25:08.072868 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1867/3643] 10.222.0.69 () {62 vars in 1199 bytes} [Sat Aug 27 03:25:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 27 03:25:08.091895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a59233f0-e058-4bfc-969c-d2854ef81edd tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe457c895e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1320844203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfRv6BJfZw7VfvwdQhI4hMF0AeMvQbOYxerfJkMZezR5F0filHLjDwGq9EHr4MganKPxRAQPVYXKR1SS+BKgiyLeqLxIUXgeRuAA5LA6qkzsr7ZlPLn0zbQCA2eIyHgag=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:08.117006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a59233f0-e058-4bfc-969c-d2854ef81edd tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:08.126805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a59233f0-e058-4bfc-969c-d2854ef81edd tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:08.128874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:08.183804 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a59233f0-e058-4bfc-969c-d2854ef81edd tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.108969 Aug 27 03:25:08.186082 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1868/3644] 10.222.0.69 () {62 vars in 1199 bytes} [Sat Aug 27 03:25:08 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 03:25:08.208143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-76948699-5966-456a-b041-01f4a404feb7 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457baa940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.214464 n-d-852086-5 devstack@n-api.service[122407]: WARNING oslo_db.sqlalchemy.utils [None req-76948699-5966-456a-b041-01f4a404feb7 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:25:08.226849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-76948699-5966-456a-b041-01f4a404feb7 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.033260 Aug 27 03:25:08.227948 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1869/3645] 10.222.0.69 () {60 vars in 1177 bytes} [Sat Aug 27 03:25:08 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:08.251598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:08.252388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff4a5ce6-43dd-4f26-a515-8f5dda04b9c8 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457a25700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.265029 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81dab598-cb16-4c05-8b32-fb762d7ea2b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1272 microversion: 2.1 time: 0.319412 Aug 27 03:25:08.270572 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1777/3646] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:07 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:08.336561 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff4a5ce6-43dd-4f26-a515-8f5dda04b9c8 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1320844203" status: 204 len: 0 microversion: 2.2 time: 0.096438 Aug 27 03:25:08.336763 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1870/3647] 10.222.0.69 () {60 vars in 1321 bytes} [Sat Aug 27 03:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1320844203 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:08.347066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e570d8a-cc35-4906-851c-c52be39eb3f8 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe4602288b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.384807 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e570d8a-cc35-4906-851c-c52be39eb3f8 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1496861381" status: 204 len: 0 microversion: 2.2 time: 0.042268 Aug 27 03:25:08.392656 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1778/3648] 10.222.0.69 () {60 vars in 1321 bytes} [Sat Aug 27 03:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1496861381 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:08.401823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1767a423-d6e8-404a-973c-385212fad16e tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457a05c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.454542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1767a423-d6e8-404a-973c-385212fad16e tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-338765236" status: 204 len: 0 microversion: 2.2 time: 0.060307 Aug 27 03:25:08.462732 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1871/3649] 10.222.0.69 () {60 vars in 1318 bytes} [Sat Aug 27 03:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-338765236 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:25:08.469663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32b43f97-11d1-4b75-a06e-8efe90e93063 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe4577a59d0>, body: {"keypair": {"name": "tempest-keypair-811082508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvdCu5NT9VIiUB4hK2bNZgpUJp0/KuM0j0CDzWhSKOjNYPHkbB+YLYoUm3YRMlgPcDQYjuQmmefKTybSO5c4aKtPCKEO7Pq3xgEq36wUY29t7wcS7UsckAd+3Ux8Tz3Cw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:08.572924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-32b43f97-11d1-4b75-a06e-8efe90e93063 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:08.599312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.600347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:08.605832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-32b43f97-11d1-4b75-a06e-8efe90e93063 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:08.614115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:08.614820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:08.615277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:08.616994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:08.616994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:08.616994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:08.705793 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32b43f97-11d1-4b75-a06e-8efe90e93063 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.240239 Aug 27 03:25:08.706686 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1779/3650] 10.222.0.69 () {62 vars in 1199 bytes} [Sat Aug 27 03:25:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 242 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 27 03:25:08.719454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec6743f5-6c5c-46d3-947f-1d66587ab8a4 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe4577a53a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.751744 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec6743f5-6c5c-46d3-947f-1d66587ab8a4 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-811082508" status: 200 len: 512 microversion: 2.2 time: 0.037689 Aug 27 03:25:08.752678 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1780/3651] 10.222.0.69 () {60 vars in 1255 bytes} [Sat Aug 27 03:25:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-811082508 => generated 512 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:08.765709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c009e1c-069d-4e1e-9ca7-52d805b74b18 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe4603c7ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.771946 n-d-852086-5 devstack@n-api.service[122408]: WARNING oslo_db.sqlalchemy.utils [None req-9c009e1c-069d-4e1e-9ca7-52d805b74b18 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:25:08.779897 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c009e1c-069d-4e1e-9ca7-52d805b74b18 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.019621 Aug 27 03:25:08.781831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1781/3652] 10.222.0.69 () {60 vars in 1177 bytes} [Sat Aug 27 03:25:08 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:08.793084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.794975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:08.804304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:08.805878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:08.806619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:08.808356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:08.810724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:08.811433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.139909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.154343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.159654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.163994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4609ba27-c161-40b7-8fc1-e7d16ed0287b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.569359 Aug 27 03:25:09.178341 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1872/3653] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:08 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:09.178341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b61d1f3f-f98a-48da-a28c-14d10206db6d tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe457cc0820>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:09.223163 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b61d1f3f-f98a-48da-a28c-14d10206db6d tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811082508" status: 204 len: 0 microversion: 2.2 time: 0.052294 Aug 27 03:25:09.228421 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1873/3654] 10.222.0.69 () {60 vars in 1258 bytes} [Sat Aug 27 03:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811082508 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:09.241431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:09.243347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:09.253359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.255065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.256907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.257872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.258596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.259393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.323905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:09.505118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.516539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b70a375-47c7-4c1d-9871-684a6c21a82f tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1325 microversion: 2.1 time: 0.729990 Aug 27 03:25:09.519697 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1782/3655] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:08 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1325 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:09.527248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Action: 'create', calling method: .version_select at 0x7fe4601af3a0>, body: {"keypair": {"name": "tempest-keypair-1949528158", "type": "x509"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:09.568666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:09.627742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:09.658899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.668065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.processutils [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpbpfgzgbf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbpfgzgbf/temp.key -subj /CN=0511db354faa4e8f8dfe4b15cb308715 -extensions v3_req_client {{(pid=122408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 03:25:09.679486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.683319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.689705 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90a95ead-08f1-40db-94ac-13bdf2c89b7b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1660 microversion: 2.32 time: 0.453547 Aug 27 03:25:09.691330 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1874/3656] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:09 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1660 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:09.716404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:09.717472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:09.727817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.728733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.730492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.731541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.732254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.732924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.948933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.958967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45b8f2c6-8c21-4832-8c65-59fc51c36bca tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1272 microversion: 2.1 time: 0.246719 Aug 27 03:25:09.964271 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1875/3657] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:09 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:10.075679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.processutils [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpbpfgzgbf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbpfgzgbf/temp.key -subj /CN=0511db354faa4e8f8dfe4b15cb308715 -extensions v3_req_client" returned: 0 in 0.407s {{(pid=122408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 03:25:10.078567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.processutils [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpbpfgzgbf/temp.key -password pass: {{(pid=122408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 03:25:10.148747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.processutils [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpbpfgzgbf/temp.key -password pass:" returned: 0 in 0.070s {{(pid=122408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 03:25:10.197000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:10.198070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:10.209398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:10.213375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:10.214728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:10.225894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:10.230836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:10.231451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:10.233858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:10.246699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Getting quotas for user 0511db354faa4e8f8dfe4b15cb308715 and project 2d713de23ff441e889a810ba2a93e6e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:10.302089 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97820087-8ce0-48e2-b419-ae002468450b tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.780879 Aug 27 03:25:10.305438 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1783/3658] 10.222.0.69 () {62 vars in 1198 bytes} [Sat Aug 27 03:25:09 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 785 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:10.320508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de18c7df-d630-4063-beed-87e9f44050d9 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe460228310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:10.342357 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de18c7df-d630-4063-beed-87e9f44050d9 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs/tempest-keypair-1949528158" status: 200 len: 1534 microversion: 2.2 time: 0.031097 Aug 27 03:25:10.342960 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1784/3659] 10.222.0.69 () {60 vars in 1258 bytes} [Sat Aug 27 03:25:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1949528158 => generated 1534 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:10.356924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f13a3e8-59f0-46ee-8f05-ec7e843c120f tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe4573ea160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:10.369825 n-d-852086-5 devstack@n-api.service[122408]: WARNING oslo_db.sqlalchemy.utils [None req-1f13a3e8-59f0-46ee-8f05-ec7e843c120f tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:25:10.385645 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f13a3e8-59f0-46ee-8f05-ec7e843c120f tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.032893 Aug 27 03:25:10.387879 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1785/3660] 10.222.0.69 () {60 vars in 1177 bytes} [Sat Aug 27 03:25:10 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:10.400333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d4a1ca8-1a03-4251-9599-1724f18c0876 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] Calling method '.version_select at 0x7fe4573fdee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:10.441425 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d4a1ca8-1a03-4251-9599-1724f18c0876 tempest-KeyPairsV22TestJSON-1292670847 tempest-KeyPairsV22TestJSON-1292670847-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949528158" status: 204 len: 0 microversion: 2.2 time: 0.048329 Aug 27 03:25:10.441964 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1786/3661] 10.222.0.69 () {60 vars in 1261 bytes} [Sat Aug 27 03:25:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949528158 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:25:10.485408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-653275608", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfe226ac-cb9c-435c-adb7-920865fa8bea"}], "security_groups": [{"name": "tempest-securitygroup--1172402538"}], "key_name": "tempest-keypair-763094187", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:10.589347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:10.606019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:10.615855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:10.622564 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1df09d5e-f0d6-4e6a-b2ef-fcf4b6535c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.427056 Aug 27 03:25:10.626365 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1876/3662] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:10 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:10.637902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:10.653063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:10.661212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:10.677947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:10.678623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:10.680439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:10.681627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:10.683353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.031288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:11.039526 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e9b90ff-6cdd-448f-9a96-11ab592ab2db tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1325 microversion: 2.1 time: 0.411641 Aug 27 03:25:11.041363 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1877/3663] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:10 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1325 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:11.047377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:11.047994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:11.066297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:11.066618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:11.067060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.068045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:11.068861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:11.069141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.231045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] validate_networks() for [('bfe226ac-cb9c-435c-adb7-920865fa8bea', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:25:11.359673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:11.383174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:11.385033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:11.389650 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b19bb478-f1c1-46a8-af15-c25ecd7bdde2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1660 microversion: 2.32 time: 0.346323 Aug 27 03:25:11.392244 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1878/3664] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:11 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1660 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:11.400256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1430461653", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05166925-98fa-4fca-b74f-85bb13110797"}], "security_groups": [{"name": "tempest-securitygroup--1610275985"}], "key_name": "tempest-keypair-907814670", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:11.717409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] validate_networks() for [('05166925-98fa-4fca-b74f-85bb13110797', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:25:12.941697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:25:12.949643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:25:12.951446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:25:12.952812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:25:12.957810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:25:12.997332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:12.998970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:12.999670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.002981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.003762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.005347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.101209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:13.112332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for user 89f850adf9a7432798f86fe9d2d17b79 and project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:13.138108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:25:13.142080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:25:13.233304 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-52f03565-2ae3-4d31-97d8-23b81b61ca3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.839608 Aug 27 03:25:13.234542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1879/3665] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:25:13.241947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:13.242800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:13.253879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.263672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.264271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.266580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.267427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.267911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.559800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:25:13.560908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:25:13.561615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:25:13.562281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:25:13.562909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:25:13.592538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.606792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.611186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.613394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.614886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.616809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.678485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for project f53131cd9e41486b88777602871e8c96. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:13.699239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Getting quotas for user 7ab173f6fa384800afe3fcafea2a628b and project f53131cd9e41486b88777602871e8c96. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:13.756153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:25:13.758774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:25:13.866326 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f931ac1-dfe3-40ad-9ffe-500eedd2b372 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.386127 Aug 27 03:25:13.867010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1787/3666] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:25:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3388 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 03:25:13.878246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:13.878894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:13.895407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.896434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.896890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.897757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.899515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.899984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.249448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:14.264895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f9e570a-9694-4061-a426-0177ad64d6e7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 1.028354 Aug 27 03:25:14.268343 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1880/3667] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:13 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:14.279662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.279662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:14.292829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.293195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.293637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.306948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.312364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.312843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.369376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:14.477194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:14.499393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:14.500945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:14.502179 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8639e240-3a5c-4f9b-908d-9aaf14890b3f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.627993 Aug 27 03:25:14.502773 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1788/3668] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:13 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:14.536039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.538472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:14.571325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.580914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.582267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.585823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.586648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.587374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.718086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:14.742279 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-952b1d27-b11c-40f2-8732-843aadab0cd5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1325 microversion: 2.1 time: 0.472554 Aug 27 03:25:14.746962 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1881/3669] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:14 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1325 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:14.764915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.765539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:14.797094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.797626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.798069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.808404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.812317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.815467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:15.033123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:15.068953 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a277de72-2494-405d-91a4-7326256a5755 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1234 microversion: 2.1 time: 0.319495 Aug 27 03:25:15.072514 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1882/3670] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:14 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1234 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:15.090115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:15.097349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:15.111761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:15.112473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:15.113112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:15.114036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:15.115253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:15.117738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:15.237519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:15.248181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:15.255831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:15.257744 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a34a3461-5bd0-44d9-9868-e4c01af9e5f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1276 microversion: 2.20 time: 0.182612 Aug 27 03:25:15.265675 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1883/3671] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:15 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:15.810298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6adbde-dbc4-45b0-9c40-a27fd3d484a6 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1877267975", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:15.822127 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6f6adbde-dbc4-45b0-9c40-a27fd3d484a6 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] HTTP exception thrown: min_count must be <= max_count Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6adbde-dbc4-45b0-9c40-a27fd3d484a6 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Request method failure captured: Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 184 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6ZTw9D1DDaDakLr-UyznUiHCirsW-2tesdtsCDxttgnfUOtlHEulYLNB48WKO_liwVmb-9eUPzT6FzX4Tshzj_kn3t0AR_PvrRA3rafOYd895oiM0UQGH56S2d_zm6-MyS97DTQc6muCEJln1uUXh7MXTcJQKuMG8zySJlU9qfEP0 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c2a8274065284bc299470f3541927d02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c2a8274065284bc299470f3541927d02", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}] Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89e8187953a24c52aa5255badfceb630 Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1877267975", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: exception: min_count must be <= max_count Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1877267975', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 27 03:25:15.824296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:15.833948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6adbde-dbc4-45b0-9c40-a27fd3d484a6 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Returning 400 to user: min_count must be <= max_count {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:15.838065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f6adbde-dbc4-45b0-9c40-a27fd3d484a6 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.553608 Aug 27 03:25:15.841911 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1884/3672] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:15 2022] POST /compute/v2.1/servers => generated 74 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:15.859935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-31372df8-bef2-4e62-a117-bac92ab019af req-7d65593b-89ba-429d-b729-dda7e705bd1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ba86e1-7386-4c27-a788-fc1e403d05d5", "tag": "a418ee44-8726-4585-8f39-f22945d3dea4"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:15.878458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-31372df8-bef2-4e62-a117-bac92ab019af req-7d65593b-89ba-429d-b729-dda7e705bd1d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:15.881307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-31372df8-bef2-4e62-a117-bac92ab019af req-7d65593b-89ba-429d-b729-dda7e705bd1d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:15.882029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-31372df8-bef2-4e62-a117-bac92ab019af req-7d65593b-89ba-429d-b729-dda7e705bd1d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:15.914127 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-31372df8-bef2-4e62-a117-bac92ab019af req-7d65593b-89ba-429d-b729-dda7e705bd1d service nova] Creating event network-changed:a418ee44-8726-4585-8f39-f22945d3dea4 for instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 on n-h1-852086-5 Aug 27 03:25:15.926473 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-31372df8-bef2-4e62-a117-bac92ab019af req-7d65593b-89ba-429d-b729-dda7e705bd1d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076297 Aug 27 03:25:15.930305 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1885/3673] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:15.940503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2f0d4e6a-155a-4bdf-9c15-48b264f60c5c req-9df4e5a0-87fe-4820-b099-0dc09794f987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1035d4-9f10-431e-9a59-97f8c88d72f8", "name": "network-vif-plugged", "status": "completed", "tag": "511b3e95-ffc9-4638-ae80-423054ac3d7f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:15.985221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2f0d4e6a-155a-4bdf-9c15-48b264f60c5c req-9df4e5a0-87fe-4820-b099-0dc09794f987 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:15.987414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2f0d4e6a-155a-4bdf-9c15-48b264f60c5c req-9df4e5a0-87fe-4820-b099-0dc09794f987 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:15.988080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2f0d4e6a-155a-4bdf-9c15-48b264f60c5c req-9df4e5a0-87fe-4820-b099-0dc09794f987 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:16.006065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-2f0d4e6a-155a-4bdf-9c15-48b264f60c5c req-9df4e5a0-87fe-4820-b099-0dc09794f987 service nova] Creating event network-vif-plugged:511b3e95-ffc9-4638-ae80-423054ac3d7f for instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 on n-h2-852086-5 Aug 27 03:25:16.018115 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2f0d4e6a-155a-4bdf-9c15-48b264f60c5c req-9df4e5a0-87fe-4820-b099-0dc09794f987 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082365 Aug 27 03:25:16.020447 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1886/3674] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:16.032429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.034479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:16.043109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:16.043244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:16.044443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:16.044597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:16.045441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:16.045884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:16.266559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:16.309002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:16.314510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:16.315766 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b550b73-6a9b-4ad2-b45d-4a74719eb799 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1754 microversion: 2.32 time: 1.812037 Aug 27 03:25:16.343416 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1789/3675] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:14 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1754 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:16.357640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.358236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:16.368996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:16.372010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:16.374842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:16.375901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:16.376651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:16.378892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:16.526119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:16.552085 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3363c1c-db6f-4b98-aaef-35013f5c452e tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 0.529191 Aug 27 03:25:16.552792 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1887/3676] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:16 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:16.599043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.599678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:16.624631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:16.625276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:16.625718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:16.626474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:16.627169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:16.627807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:16.993502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.002351 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51888b92-15f9-4c00-9062-684b2bc11b32 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1325 microversion: 2.1 time: 0.428457 Aug 27 03:25:17.012564 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1888/3677] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:16 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1325 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:17.021491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02d38901-4ac8-42bf-8086-92d8fc86408b tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1305725291", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "max_count": 0}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02d38901-4ac8-42bf-8086-92d8fc86408b tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Request method failure captured: Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 168 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6ZTw9D1DDaDakLr-UyznUiHCirsW-2tesdtsCDxttgnfUOtlHEulYLNB48WKO_liwVmb-9eUPzT6FzX4Tshzj_kn3t0AR_PvrRA3rafOYd895oiM0UQGH56S2d_zm6-MyS97DTQc6muCEJln1uUXh7MXTcJQKuMG8zySJlU9qfEP0 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c2a8274065284bc299470f3541927d02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c2a8274065284bc299470f3541927d02", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}] Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89e8187953a24c52aa5255badfceb630 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1305725291", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "max_count": 0}} Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1305725291', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'max_count': 0}}} Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 0 Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:25:17.030701 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02d38901-4ac8-42bf-8086-92d8fc86408b tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02d38901-4ac8-42bf-8086-92d8fc86408b tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018812 Aug 27 03:25:17.036798 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1889/3678] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:25:17.053101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:17.053721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:17.070416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.070903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.076231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.077515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.078257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.081950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.161965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.171281 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6ef416e2-f7ee-4aee-9653-0bd92c83e9ce tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1296 microversion: 2.1 time: 0.137557 Aug 27 03:25:17.183444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1890/3679] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:17 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1296 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:17.192076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:17.193002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:17.200079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.200881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.202036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.202972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.203610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.204873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.324096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.340881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.343972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.347745 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-efcd3384-02c2-4076-a5a8-aa0e32951d9c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1338 microversion: 2.20 time: 0.162983 Aug 27 03:25:17.355452 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1891/3680] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:17 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:17.364035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ada3fcc-d59a-457d-8d0d-a19bf0c0a050 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-319322988", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "max_count": 2.5}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ada3fcc-d59a-457d-8d0d-a19bf0c0a050 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Request method failure captured: Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 169 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6ZTw9D1DDaDakLr-UyznUiHCirsW-2tesdtsCDxttgnfUOtlHEulYLNB48WKO_liwVmb-9eUPzT6FzX4Tshzj_kn3t0AR_PvrRA3rafOYd895oiM0UQGH56S2d_zm6-MyS97DTQc6muCEJln1uUXh7MXTcJQKuMG8zySJlU9qfEP0 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c2a8274065284bc299470f3541927d02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c2a8274065284bc299470f3541927d02", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}] Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89e8187953a24c52aa5255badfceb630 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-319322988", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "max_count": 2.5}} Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-319322988', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'max_count': 2.5}}} Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:25:17.374971 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:25:17.380296 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.391996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ada3fcc-d59a-457d-8d0d-a19bf0c0a050 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:17.394279 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ada3fcc-d59a-457d-8d0d-a19bf0c0a050 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036378 Aug 27 03:25:17.395301 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1892/3681] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:25:17.404822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:17.406022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:17.430394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.431070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.431549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.434848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.437361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.437850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.526865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.543740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.547960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.549516 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b0272d0-142c-4d2b-aa9f-23af31aee3ce tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 1.204965 Aug 27 03:25:17.552719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1790/3682] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:16 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:17.563450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-582294c0-5e28-485c-b376-90f368940aa0 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2135681186", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 0}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-582294c0-5e28-485c-b376-90f368940aa0 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Request method failure captured: Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 168 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY6ZTw9D1DDaDakLr-UyznUiHCirsW-2tesdtsCDxttgnfUOtlHEulYLNB48WKO_liwVmb-9eUPzT6FzX4Tshzj_kn3t0AR_PvrRA3rafOYd895oiM0UQGH56S2d_zm6-MyS97DTQc6muCEJln1uUXh7MXTcJQKuMG8zySJlU9qfEP0 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c2a8274065284bc299470f3541927d02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c2a8274065284bc299470f3541927d02", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}] Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 89e8187953a24c52aa5255badfceb630 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2135681186", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 0}} Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2135681186', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'min_count': 0}}} Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 0 Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:25:17.570212 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 03:25:17.576379 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:17.578095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-582294c0-5e28-485c-b376-90f368940aa0 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:17.585867 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-582294c0-5e28-485c-b376-90f368940aa0 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031748 Aug 27 03:25:17.587099 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1791/3683] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:25:17.617119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:17.618469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:17.636862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.638588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.640779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.641882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.643929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.644583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.462731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:18.483804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:18.486465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:18.488813 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f945ab00-b889-4240-87d2-0480f4085eba tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1754 microversion: 2.32 time: 1.092530 Aug 27 03:25:18.490180 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1893/3684] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:17 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1754 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:18.508145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7816aa9-da7b-4698-a536-7cc209219f59 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1922160864", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 2.5}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:18.519008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7816aa9-da7b-4698-a536-7cc209219f59 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Request method failure captured: Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 170 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6ZTw9D1DDaDakLr-UyznUiHCirsW-2tesdtsCDxttgnfUOtlHEulYLNB48WKO_liwVmb-9eUPzT6FzX4Tshzj_kn3t0AR_PvrRA3rafOYd895oiM0UQGH56S2d_zm6-MyS97DTQc6muCEJln1uUXh7MXTcJQKuMG8zySJlU9qfEP0 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c2a8274065284bc299470f3541927d02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c2a8274065284bc299470f3541927d02", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2a8274065284bc299470f3541927d02"}]}] Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c2a8274065284bc299470f3541927d02 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-128917250 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89e8187953a24c52aa5255badfceb630 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-128917250-project Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1922160864", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "min_count": 2.5}} Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1922160864', 'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e', 'flavorRef': '452', 'min_count': 2.5}}} Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:25:18.519763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 03:25:18.526565 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:18.532134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7816aa9-da7b-4698-a536-7cc209219f59 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:18.533314 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e7816aa9-da7b-4698-a536-7cc209219f59 tempest-MultipleCreateNegativeTestJSON-128917250 tempest-MultipleCreateNegativeTestJSON-128917250-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041623 Aug 27 03:25:18.534450 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1894/3685] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:25:18.535772 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-464b87dc-06bd-4245-bb83-f697e20b4a13 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 0.937076 Aug 27 03:25:18.536369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1792/3686] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:17 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:18.542520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:18.547010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:18.563145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.563647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.564094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.564818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.565277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.565707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.566892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:18.611610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:18.675455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.675960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.676400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.677115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.677602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.678032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.826007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:18.843794 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-867844e9-735e-4b06-89c3-5432925c9715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1296 microversion: 2.1 time: 0.306313 Aug 27 03:25:18.844728 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1793/3687] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:18 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1296 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:18.857736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:18.858732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:18.869441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.878999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.879580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.880262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.880971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.881830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.204276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:19.223724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf8df0cf-af71-4819-8515-4d483237fdd2 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1522 microversion: 2.1 time: 0.687884 Aug 27 03:25:19.228728 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1895/3688] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:18 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:19.240535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:19.244574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:19.261350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.267736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.268428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.269288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.269950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.270516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.623602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:19.636558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:19.640533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:19.643869 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02802e35-6a33-4f49-b7b1-fd5959ce88ae tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 0.797926 Aug 27 03:25:19.649882 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1794/3689] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:18 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:19.662393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:19.662905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:19.691827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.699397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.700632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.704734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.705706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.708991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.804400 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] HTTP exception thrown: Instance is not a member of specified network Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Request method failure captured: Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8/ips/invalid HTTP/1.1 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY6FiiB2dkYMcq-lEy-HJM2iafbVtIXpEQ2VyE52s0_9rDscvgBC6xCLEGy-h3DSogMEIVZpHR_EGxAswyDfaOhK4BhdhqhNlqc_yrsvN2P2Fj_FLX2Z3CeJCGfRgzS-YxM7wbUkHV_aqOMIKDAdiHifP2U-hZZwIr7Qzi3c_IHmRhA Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 136ed6e9eee649218d39c3afa4ef8f71 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/136ed6e9eee649218d39c3afa4ef8f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/136ed6e9eee649218d39c3afa4ef8f71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_136ed6e9eee649218d39c3afa4ef8f71", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/136ed6e9eee649218d39c3afa4ef8f71"}]}] Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 136ed6e9eee649218d39c3afa4ef8f71 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerAddressesNegativeTestJSON-2089718514-project Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 0e08ca2687b1407a86a22f9bd863cf05 Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2089718514-project Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance is not a member of specified network Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': '5c1035d4-9f10-431e-9a59-97f8c88d72f8', 'id': 'invalid'} Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 27 03:25:19.826027 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:19.831700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:19.832769 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a86f34c-07b2-4d30-ac1c-a6be06d2ca59 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.177106 Aug 27 03:25:19.833522 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1795/3690] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:25:19 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8/ips/invalid => generated 91 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:25:19.848340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:19.856624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:19.863533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.864436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.866452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.875292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.876286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.876942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:20.091166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:20.106914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:20.108367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:20.109561 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1a1d365-4ee5-4fda-8001-5f84d7314afd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.879612 Aug 27 03:25:20.110132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1896/3691] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:19 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:20.139189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:20.142552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:20.153212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:20.159364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:20.160084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:20.171275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:20.172053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:20.172698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:20.605150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:20.615923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ffeb5b79-23fb-41a7-a06c-a4e2be984cc9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 0.480967 Aug 27 03:25:20.616199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1897/3692] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:20 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:20.633361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b89134ce-4da5-44c2-accb-2e0735ab2154 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:20.634026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b89134ce-4da5-44c2-accb-2e0735ab2154 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Failed to fetch instance by id 999 {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 03:25:20.634707 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b89134ce-4da5-44c2-accb-2e0735ab2154 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] HTTP exception thrown: Instance 999 could not be found. Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b89134ce-4da5-44c2-accb-2e0735ab2154 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Request method failure captured: Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6FiiB2dkYMcq-lEy-HJM2iafbVtIXpEQ2VyE52s0_9rDscvgBC6xCLEGy-h3DSogMEIVZpHR_EGxAswyDfaOhK4BhdhqhNlqc_yrsvN2P2Fj_FLX2Z3CeJCGfRgzS-YxM7wbUkHV_aqOMIKDAdiHifP2U-hZZwIr7Qzi3c_IHmRhA Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 136ed6e9eee649218d39c3afa4ef8f71 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/136ed6e9eee649218d39c3afa4ef8f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/136ed6e9eee649218d39c3afa4ef8f71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_136ed6e9eee649218d39c3afa4ef8f71", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/136ed6e9eee649218d39c3afa4ef8f71"}]}] Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 136ed6e9eee649218d39c3afa4ef8f71 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerAddressesNegativeTestJSON-2089718514-project Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 0e08ca2687b1407a86a22f9bd863cf05 Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2089718514-project Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 999 could not be found. Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '999'} Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 03:25:20.636436 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:20.642087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b89134ce-4da5-44c2-accb-2e0735ab2154 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:20.642087 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b89134ce-4da5-44c2-accb-2e0735ab2154 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.018193 Aug 27 03:25:20.643984 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1898/3693] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:25:20 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:25:20.657585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:20.658454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:20.674212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:20.678024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:20.678694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:20.679464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:20.679942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:20.680382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.603900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:21.628807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:21.643494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:21.651574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:21.656838 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2e45120-41e5-45ad-9f31-a63d5967a8ab tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1801 microversion: 2.32 time: 1.818616 Aug 27 03:25:21.661751 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1796/3694] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:19 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1801 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:21.680176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:21.696123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:21.699197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:21.704825 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-606a289b-36d1-4d88-af71-c18c0504e0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 1.057518 Aug 27 03:25:21.705712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1899/3695] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:20 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:21.743389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:21.749362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:21.750470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:21.754222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:21.757057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:21.758613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.761728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:21.763533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:21.764738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.773242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:21.776933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:21.778029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.784931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:21.785963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:21.787568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.853389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:25:22.028197 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a582572-6c92-49d6-a276-02f09985f92a tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 204 len: 0 microversion: 2.1 time: 0.363351 Aug 27 03:25:22.032038 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1797/3696] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:21 2022] DELETE /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:22.051767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:22.052764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:22.062493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.063117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.063669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.064512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.067463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.068053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.314454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.331629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.348060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.349775 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-15d5a8bc-4e87-4a6e-9e92-fbd5a425b2df tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 0.624747 Aug 27 03:25:22.350415 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1900/3697] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:21 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:22.372001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:22.375339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:22.386485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.393465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.394043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.395024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.395700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.398561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.741360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.758849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.766222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.770522 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a11db59e-f918-4085-9307-e7bad5f81169 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.736546 Aug 27 03:25:22.774082 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1798/3698] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:22 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:22.782823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c87ea0b3-2651-46ae-906b-2d86bf3b5531 req-7a875ca5-ec3e-4e1b-b06d-5588b0f39ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-plugged", "status": "completed", "tag": "5483ccb2-45f0-4bdd-9b3b-a9b357359a2f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:22.814573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c87ea0b3-2651-46ae-906b-2d86bf3b5531 req-7a875ca5-ec3e-4e1b-b06d-5588b0f39ff3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.816043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c87ea0b3-2651-46ae-906b-2d86bf3b5531 req-7a875ca5-ec3e-4e1b-b06d-5588b0f39ff3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.818175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c87ea0b3-2651-46ae-906b-2d86bf3b5531 req-7a875ca5-ec3e-4e1b-b06d-5588b0f39ff3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.851961 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c87ea0b3-2651-46ae-906b-2d86bf3b5531 req-7a875ca5-ec3e-4e1b-b06d-5588b0f39ff3 service nova] Creating event network-vif-plugged:5483ccb2-45f0-4bdd-9b3b-a9b357359a2f for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:22.864979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c87ea0b3-2651-46ae-906b-2d86bf3b5531 req-7a875ca5-ec3e-4e1b-b06d-5588b0f39ff3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089194 Aug 27 03:25:22.867222 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1799/3699] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:22.881178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:22.883627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:22.889419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.904768 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6912d1ab-323c-49de-9913-99f526e6274f tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 0.541185 Aug 27 03:25:22.905410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1901/3700] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:22 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:22.906526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.907906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.909857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.910647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.920860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.922123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.925784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:22.927150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:22.936270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.937021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.938792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.940121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.940935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.941759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.026999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:23.131124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=42 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:23.294935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:23.341661 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-baee7b9a-c7ed-41c5-ad80-9cc29ce8e847 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1528 microversion: 2.1 time: 0.462411 Aug 27 03:25:23.348805 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1800/3701] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:22 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1528 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:23.361864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:23.361864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:23.378498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:23.380426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:23.384327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:23.386265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.387305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:23.387787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:23.388226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.397277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:23.400100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:23.402278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f2226f5b-4a92-45cc-9f8d-ddb188374b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1848 microversion: 2.32 time: 0.482372 Aug 27 03:25:23.403309 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1902/3702] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:22 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1848 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:23.409441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cc79e619-a644-461d-b0be-0f3544a59cfe req-7eb2a3ff-ae29-46e9-99e5-cab787dd0cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:23.427533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc79e619-a644-461d-b0be-0f3544a59cfe req-7eb2a3ff-ae29-46e9-99e5-cab787dd0cce service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:23.428436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc79e619-a644-461d-b0be-0f3544a59cfe req-7eb2a3ff-ae29-46e9-99e5-cab787dd0cce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:23.429195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc79e619-a644-461d-b0be-0f3544a59cfe req-7eb2a3ff-ae29-46e9-99e5-cab787dd0cce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.467371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cc79e619-a644-461d-b0be-0f3544a59cfe req-7eb2a3ff-ae29-46e9-99e5-cab787dd0cce service nova] Creating event network-changed:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h2-852086-5 Aug 27 03:25:23.485109 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cc79e619-a644-461d-b0be-0f3544a59cfe req-7eb2a3ff-ae29-46e9-99e5-cab787dd0cce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080421 Aug 27 03:25:23.488032 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1903/3703] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:23.513594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:23.515821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:23.550622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:23.551137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:23.551587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.552317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:23.552777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:23.553210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:23.643159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:23.721795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=38 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:24.022972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.039442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.042114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.045186 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b9d2bf7-8d7e-4cfb-9e19-e1a381fbfdf2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 0.552058 Aug 27 03:25:24.050009 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1904/3704] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:23 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:24.054926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-657a739a-1af0-4a4f-930b-479e779f00db req-690a4028-84cd-4440-93ec-ad367a8ccb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:24.076720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-657a739a-1af0-4a4f-930b-479e779f00db req-690a4028-84cd-4440-93ec-ad367a8ccb62 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.086894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-657a739a-1af0-4a4f-930b-479e779f00db req-690a4028-84cd-4440-93ec-ad367a8ccb62 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.087674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-657a739a-1af0-4a4f-930b-479e779f00db req-690a4028-84cd-4440-93ec-ad367a8ccb62 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.093533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:24.102020 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-657a739a-1af0-4a4f-930b-479e779f00db req-690a4028-84cd-4440-93ec-ad367a8ccb62 service nova] Creating event network-changed:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:25:24.128144 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-657a739a-1af0-4a4f-930b-479e779f00db req-690a4028-84cd-4440-93ec-ad367a8ccb62 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076469 Aug 27 03:25:24.129401 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1905/3705] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:24.134738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:24.136140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:24.154567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.155434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.156100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.157018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.157683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.158355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.798396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.834209 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6edca908-ac2a-4db9-9ac9-7297f856d026 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 1.466067 Aug 27 03:25:24.834209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1801/3706] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:23 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:24.850340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:24.851021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:24.869302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.873193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.873858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.874807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.875477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.876826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.913044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.924680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.926353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:24.928081 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfc79e41-8485-4f59-8ea1-65932e1afc09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.797319 Aug 27 03:25:24.943635 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1906/3707] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:24 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:24.949259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:24.949892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:24.957998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.958528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.958977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.959939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.960151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.960582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.156557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.167552 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c413e35e-e496-4bcb-b546-a6d4a387a14c tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1528 microversion: 2.1 time: 0.232040 Aug 27 03:25:25.183178 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1907/3708] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:24 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1528 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:25.195803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:25.196952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:25.205438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.206263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.206903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.207815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.208461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.209102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.422671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.433947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.435884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.437455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b30f1097-3a20-48bc-9620-2d2cac345b88 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1848 microversion: 2.32 time: 0.252590 Aug 27 03:25:25.438238 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1908/3709] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:25 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1848 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:25.448253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-plugged", "status": "completed", "tag": "0e1b377f-5c08-4c5c-809b-9437d5e3c209"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-plugged", "status": "completed", "tag": "0c491876-95d6-4d38-82f0-b30e9d00b1de"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-plugged", "status": "completed", "tag": "bdd5d6d2-7f93-4496-91ad-112ae37f48c3"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-plugged", "status": "completed", "tag": "b615d33f-ac86-45b7-ba09-719b4d74a4d5"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-plugged", "status": "completed", "tag": "b03b9929-c210-4a99-9b50-66c9f9836740"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:25.465303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.466010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.466837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.482735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Creating event network-vif-plugged:0e1b377f-5c08-4c5c-809b-9437d5e3c209 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:25.483565 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Creating event network-vif-plugged:0c491876-95d6-4d38-82f0-b30e9d00b1de for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:25.484179 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Creating event network-vif-plugged:bdd5d6d2-7f93-4496-91ad-112ae37f48c3 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:25.484810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Creating event network-vif-plugged:b615d33f-ac86-45b7-ba09-719b4d74a4d5 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:25.485418 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] Creating event network-vif-plugged:b03b9929-c210-4a99-9b50-66c9f9836740 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:25.491981 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-79873c1f-a14c-4431-ba2b-9df241422dd4 req-cb2e478e-b09f-4f04-a8e8-8df081a9aa45 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.052292 Aug 27 03:25:25.492750 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1909/3710] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:25.504986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:25.506398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:25.511710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:25.515798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.517606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.517606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.519545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.519545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.519545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.745513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.763201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.765112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.766900 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39f084f6-ab59-4e56-ad2a-ac1d89e1654f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 0.271128 Aug 27 03:25:25.767953 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1910/3711] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:25 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:25.785939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:25.796349 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cec25f11-42a6-46d2-bc04-40d2e8c54ba6 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 0.971173 Aug 27 03:25:25.800277 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1802/3712] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:24 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:25.851436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:25.852165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:25.862261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.863040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.863659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.865241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.865909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.866705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.961463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:25.962356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:25.975541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.976976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.980792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:25.981592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:25.982078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:25.985918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.111381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:26.124050 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fec66d84-5ffc-4ef6-8ae7-ab57ab7ae63a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 0.277376 Aug 27 03:25:26.139887 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1911/3713] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:25 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:26.203134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:26.221469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:26.250430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.251509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.252309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.253166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.253882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.254775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.573043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:26.586604 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f3f6487-1be2-4a4e-aed6-4ab9c10bc9b5 tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1528 microversion: 2.1 time: 0.389578 Aug 27 03:25:26.588988 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1912/3714] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:26 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1528 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:26.596937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:26.598390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:26.608829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.610670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.610670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.611627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.612195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.613577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.709486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:26.778902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:26.794660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:26.810290 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97ba6289-7db4-4701-994a-1e15ea13a22f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 0.848393 Aug 27 03:25:26.814859 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1803/3715] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:25 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:26.823732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-71db9407-fbcd-4d65-b692-64b29a3ffb95 req-e63ac29a-a9f4-4ca2-9fba-06b4aca25278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "ae27ab8a-5ee1-4b13-ba45-faab9b193597"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:26.860270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71db9407-fbcd-4d65-b692-64b29a3ffb95 req-e63ac29a-a9f4-4ca2-9fba-06b4aca25278 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.861022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71db9407-fbcd-4d65-b692-64b29a3ffb95 req-e63ac29a-a9f4-4ca2-9fba-06b4aca25278 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.861636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71db9407-fbcd-4d65-b692-64b29a3ffb95 req-e63ac29a-a9f4-4ca2-9fba-06b4aca25278 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.905361 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-71db9407-fbcd-4d65-b692-64b29a3ffb95 req-e63ac29a-a9f4-4ca2-9fba-06b4aca25278 service nova] Creating event network-changed:ae27ab8a-5ee1-4b13-ba45-faab9b193597 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:25:26.930237 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-71db9407-fbcd-4d65-b692-64b29a3ffb95 req-e63ac29a-a9f4-4ca2-9fba-06b4aca25278 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105673 Aug 27 03:25:26.934144 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1804/3716] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:26.939651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:26.941445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:26.955886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.956372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.962402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:26.964425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:26.964915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:26.967991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.213617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.233125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.234864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.236328 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aa13e80d-7e23-49fb-b0f8-717d536821de tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1848 microversion: 2.32 time: 0.646092 Aug 27 03:25:27.252186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1913/3717] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:26 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1848 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:27.252186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:27.252186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:27.271298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.272018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.273439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.274416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.278692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.279172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.360048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.373990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.375518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.376665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b693ba40-6f76-4500-9084-e5116e54fade tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 0.443226 Aug 27 03:25:27.384844 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1805/3718] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:26 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:27.397465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:27.398097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:27.408152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.408933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.409882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.410897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.412654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.413446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.673692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.683329 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d587bc3e-a230-41bd-b28a-e4a8f370534f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 0.293665 Aug 27 03:25:27.701671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:27.705500 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1806/3719] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:27 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:27.710110 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3328ea83-8b80-437b-af3e-076d8a6c377a tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 0.466379 Aug 27 03:25:27.716061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2877010e-dd2a-4e78-84fc-c5b36b56d89a req-19441cce-0827-4864-a75a-a76b9aa962a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-plugged", "status": "completed", "tag": "4dfc9eee-0466-4eae-8cc0-7ba5ff267227"}, {"server_uuid": "02ba86e1-7386-4c27-a788-fc1e403d05d5", "name": "network-vif-plugged", "status": "completed", "tag": "a418ee44-8726-4585-8f39-f22945d3dea4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:27.717016 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1914/3720] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:27 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:27.739801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:27.740690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:27.755644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.756652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2877010e-dd2a-4e78-84fc-c5b36b56d89a req-19441cce-0827-4864-a75a-a76b9aa962a1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.757627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.758396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2877010e-dd2a-4e78-84fc-c5b36b56d89a req-19441cce-0827-4864-a75a-a76b9aa962a1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.759039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.759678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2877010e-dd2a-4e78-84fc-c5b36b56d89a req-19441cce-0827-4864-a75a-a76b9aa962a1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.761562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.766992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.767866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.802220 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2877010e-dd2a-4e78-84fc-c5b36b56d89a req-19441cce-0827-4864-a75a-a76b9aa962a1 service nova] Creating event network-vif-plugged:4dfc9eee-0466-4eae-8cc0-7ba5ff267227 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:27.804429 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2877010e-dd2a-4e78-84fc-c5b36b56d89a req-19441cce-0827-4864-a75a-a76b9aa962a1 service nova] Creating event network-vif-plugged:a418ee44-8726-4585-8f39-f22945d3dea4 for instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 on n-h1-852086-5 Aug 27 03:25:27.823137 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2877010e-dd2a-4e78-84fc-c5b36b56d89a req-19441cce-0827-4864-a75a-a76b9aa962a1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110013 Aug 27 03:25:27.828386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1807/3721] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:27.846634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:27.859343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:27.866546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.868924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.870544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.872508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lazy-loading 'fault' on Instance uuid 5c1035d4-9f10-431e-9a59-97f8c88d72f8 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:25:27.885826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.886560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.887007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:27.887736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:27.888196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:27.888642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:28.010047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e08ca2687b1407a86a22f9bd863cf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ed6e9eee649218d39c3afa4ef8f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:28.023803 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e583f60d-ae01-4f3a-9d02-db2ea55f6b7d tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 200 len: 1315 microversion: 2.1 time: 0.295992 Aug 27 03:25:28.025023 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1915/3722] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:27 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:28.260855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:28.261772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:28.271329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:28.274860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:28.275519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:28.280222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:28.281023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:28.281482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.082545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.097426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.109034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.110635 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d42cec26-d15c-4d29-9a7a-37098d971176 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 1.275725 Aug 27 03:25:29.122426 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1808/3723] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:27 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:29.127571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:29.128522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:29.148227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:29.149071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:29.149752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.150838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:29.152293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:29.153034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.360009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.388231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.399795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.408869 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0669c5d0-9ca3-437b-9b2e-b09e338649d6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1869 microversion: 2.32 time: 1.150329 Aug 27 03:25:29.414024 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1916/3724] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:28 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1869 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:25:29.437088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:29.441967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:29.468174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:29.469093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:29.469845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.470980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:29.471701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:29.472526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.866038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.873933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.881939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.883422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:29.890790 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-760e241a-e695-4478-80fb-a5f0ef3941d1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 0.475043 Aug 27 03:25:29.891421 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1917/3725] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:29 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:29.892066 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5394aa3d-9bb9-4a90-812e-774130335b76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 0.768253 Aug 27 03:25:29.892827 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1809/3726] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:29 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:29.908424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8e330aad-9d51-4093-8773-570c3b771180 req-48392c3f-d1d8-4e57-84ad-4e7b2f75e0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "1a261b78-b479-41f5-80c0-d31949515c7f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:29.914927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:29.917051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:29.934368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:29.935219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:29.936454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.937033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8e330aad-9d51-4093-8773-570c3b771180 req-48392c3f-d1d8-4e57-84ad-4e7b2f75e0f6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:29.937521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8e330aad-9d51-4093-8773-570c3b771180 req-48392c3f-d1d8-4e57-84ad-4e7b2f75e0f6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:29.937956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8e330aad-9d51-4093-8773-570c3b771180 req-48392c3f-d1d8-4e57-84ad-4e7b2f75e0f6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.939379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:29.941608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:29.942366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:29.968155 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8e330aad-9d51-4093-8773-570c3b771180 req-48392c3f-d1d8-4e57-84ad-4e7b2f75e0f6 service nova] Creating event network-changed:1a261b78-b479-41f5-80c0-d31949515c7f for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:25:29.975755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8e330aad-9d51-4093-8773-570c3b771180 req-48392c3f-d1d8-4e57-84ad-4e7b2f75e0f6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079938 Aug 27 03:25:29.977720 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1810/3727] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:29.991058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8ea3968b-352e-4aeb-84e3-ef824ef28f4e req-3ddb6cd4-412a-414e-9808-982720f4787f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1035d4-9f10-431e-9a59-97f8c88d72f8", "name": "network-vif-deleted", "tag": "511b3e95-ffc9-4638-ae80-423054ac3d7f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:30.005083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ea3968b-352e-4aeb-84e3-ef824ef28f4e req-3ddb6cd4-412a-414e-9808-982720f4787f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.006721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ea3968b-352e-4aeb-84e3-ef824ef28f4e req-3ddb6cd4-412a-414e-9808-982720f4787f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.007831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ea3968b-352e-4aeb-84e3-ef824ef28f4e req-3ddb6cd4-412a-414e-9808-982720f4787f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.022909 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8ea3968b-352e-4aeb-84e3-ef824ef28f4e req-3ddb6cd4-412a-414e-9808-982720f4787f service nova] Creating event network-vif-deleted:511b3e95-ffc9-4638-ae80-423054ac3d7f for instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 on n-h2-852086-5 Aug 27 03:25:30.032075 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8ea3968b-352e-4aeb-84e3-ef824ef28f4e req-3ddb6cd4-412a-414e-9808-982720f4787f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050297 Aug 27 03:25:30.035058 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1811/3728] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:30.051945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:30.052992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] [instance: 5c1035d4-9f10-431e-9a59-97f8c88d72f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:30.063437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.064641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.065365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.066354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.066982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.067588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.084305 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] HTTP exception thrown: Instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 could not be found. Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Request method failure captured: Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 HTTP/1.1 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY6FiiB2dkYMcq-lEy-HJM2iafbVtIXpEQ2VyE52s0_9rDscvgBC6xCLEGy-h3DSogMEIVZpHR_EGxAswyDfaOhK4BhdhqhNlqc_yrsvN2P2Fj_FLX2Z3CeJCGfRgzS-YxM7wbUkHV_aqOMIKDAdiHifP2U-hZZwIr7Qzi3c_IHmRhA Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 136ed6e9eee649218d39c3afa4ef8f71 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/136ed6e9eee649218d39c3afa4ef8f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/136ed6e9eee649218d39c3afa4ef8f71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_136ed6e9eee649218d39c3afa4ef8f71", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/136ed6e9eee649218d39c3afa4ef8f71"}]}] Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 136ed6e9eee649218d39c3afa4ef8f71 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2089718514 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerAddressesNegativeTestJSON-2089718514-project Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 0e08ca2687b1407a86a22f9bd863cf05 Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2089718514-project Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 could not be found. Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '5c1035d4-9f10-431e-9a59-97f8c88d72f8'} Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 could not be found. Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 could not be found. Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:30.086916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 could not be found. Aug 27 03:25:30.093411 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:30.095273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] Returning 404 to user: Instance 5c1035d4-9f10-431e-9a59-97f8c88d72f8 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:30.096315 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b320a49-de08-4dbe-a889-8db03dd00cca tempest-ServerAddressesNegativeTestJSON-2089718514 tempest-ServerAddressesNegativeTestJSON-2089718514-project] 10.222.0.69 "GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8" status: 404 len: 111 microversion: 2.1 time: 0.059935 Aug 27 03:25:30.097900 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1812/3729] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:30 2022] GET /compute/v2.1/servers/5c1035d4-9f10-431e-9a59-97f8c88d72f8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:30.148486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:30.149113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:30.164466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.165398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.168551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.169779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.174966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.175577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.626957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:30.640984 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59376665-4ad3-4dc6-b871-8b5dc2a666a5 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1314 microversion: 2.1 time: 0.748462 Aug 27 03:25:30.664185 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1918/3730] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:29 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:30.670675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:30.696217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:30.711235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.712743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.714116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:30.715085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:30.715883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:30.716502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:31.333592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:31.358363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:31.360646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:31.362716 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-440be575-fc1e-4a79-b63c-6161d359a3ec tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1880 microversion: 2.42 time: 1.219014 Aug 27 03:25:31.363296 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1813/3731] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:30 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1880 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:25:31.376853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:31.382448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:31.404401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:31.405411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:31.406053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:31.407505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:31.408150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:31.408763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:31.431921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:31.454381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:31.456448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:31.458145 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95059b40-def9-480a-baba-ece270953422 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1869 microversion: 2.32 time: 0.792503 Aug 27 03:25:31.458824 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1919/3732] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:30 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1869 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:31.472615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:31.474800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:31.510332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:31.511130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:31.511703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:31.512577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:31.513184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:31.514689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.233197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:32.251147 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cdde3b0-5513-4dad-8f39-e450e49f9e14 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 0.882539 Aug 27 03:25:32.268637 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1814/3733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:31 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:32.289260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:32.290191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:32.331385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.332317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.332950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.333842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.335066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.335760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.486221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:32.501481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:32.503481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:32.505076 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48c74764-cacf-41aa-889d-6fc91b06ec67 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 1.044861 Aug 27 03:25:32.505652 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1920/3734] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:31 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:32.510533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f6f7bfdc-ffc4-4060-8fc2-22bc6485f9f3 req-65233349-6556-4d1f-bff0-8c585eb853b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "aefcec6d-0a13-4988-8127-fb6b417065d8"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:32.525002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6f7bfdc-ffc4-4060-8fc2-22bc6485f9f3 req-65233349-6556-4d1f-bff0-8c585eb853b2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.525579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6f7bfdc-ffc4-4060-8fc2-22bc6485f9f3 req-65233349-6556-4d1f-bff0-8c585eb853b2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.526018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6f7bfdc-ffc4-4060-8fc2-22bc6485f9f3 req-65233349-6556-4d1f-bff0-8c585eb853b2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.541699 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f6f7bfdc-ffc4-4060-8fc2-22bc6485f9f3 req-65233349-6556-4d1f-bff0-8c585eb853b2 service nova] Creating event network-changed:aefcec6d-0a13-4988-8127-fb6b417065d8 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:25:32.548312 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f6f7bfdc-ffc4-4060-8fc2-22bc6485f9f3 req-65233349-6556-4d1f-bff0-8c585eb853b2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041240 Aug 27 03:25:32.548944 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1921/3735] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:32.561211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:32.562241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:32.571643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.573538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.574731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:32.576277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:32.577104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:32.577984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.135987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:33.143924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:33.155773 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6050b8af-47d6-4ce5-af46-84a45664a8c0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1502 microversion: 2.1 time: 0.884927 Aug 27 03:25:33.157803 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1815/3736] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:32 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1502 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:33.166070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:33.175827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:33.188695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.189492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.190115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.191760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.193147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.194410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.538828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:33.559559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:33.562383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:33.565399 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-445c45f6-5f60-4f08-8828-7413028f3929 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2837 microversion: 2.42 time: 1.009797 Aug 27 03:25:33.589577 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1922/3737] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:32 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2837 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:33.599333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8a0c52eb-6a56-4a8e-9c41-abee7cd46b79 req-1adede9c-bc8c-4f63-98d9-e90d83004e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "name": "network-vif-plugged", "status": "completed", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:33.612882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8a0c52eb-6a56-4a8e-9c41-abee7cd46b79 req-1adede9c-bc8c-4f63-98d9-e90d83004e46 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.613631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8a0c52eb-6a56-4a8e-9c41-abee7cd46b79 req-1adede9c-bc8c-4f63-98d9-e90d83004e46 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.614426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8a0c52eb-6a56-4a8e-9c41-abee7cd46b79 req-1adede9c-bc8c-4f63-98d9-e90d83004e46 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.628761 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8a0c52eb-6a56-4a8e-9c41-abee7cd46b79 req-1adede9c-bc8c-4f63-98d9-e90d83004e46 service nova] Creating event network-vif-plugged:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h2-852086-5 Aug 27 03:25:33.635149 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8a0c52eb-6a56-4a8e-9c41-abee7cd46b79 req-1adede9c-bc8c-4f63-98d9-e90d83004e46 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042337 Aug 27 03:25:33.636990 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1923/3738] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:33.643313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:33.644361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:33.656202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.657107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.657824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.661045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.661851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.662643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.671500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:33.695159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:33.706842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lazy-loading 'flavor' on Instance uuid 02ba86e1-7386-4c27-a788-fc1e403d05d5 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:25:33.721123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:33.722656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:33.723893 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-978567bb-e730-4939-ac66-754a4c6205aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.564667 Aug 27 03:25:33.730564 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1816/3739] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:33 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:33.736874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:33.739202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:33.755664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.756332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.756886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.757721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.758331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.758875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.846593 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9936e25-9410-4003-b4ab-9f50902674b8 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "POST /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5/action" status: 202 len: 0 microversion: 2.1 time: 0.207763 Aug 27 03:25:33.847855 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1924/3740] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:25:33 2022] POST /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:25:33.855154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:33.856257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:33.863203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.863949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.864576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:33.866006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:33.866668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:33.867393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.197064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:34.207965 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80f29339-3998-42f1-b56d-747d19cf6993 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 0.475910 Aug 27 03:25:34.224377 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1817/3741] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:33 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:34.232668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:34.234832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:34.243479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.244076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.245028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.245880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.246458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.246978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.325693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:34.344844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:34.352580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:34.354036 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c609306-b8be-4681-9f02-0f37eb3a17d9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1406 microversion: 2.20 time: 0.504876 Aug 27 03:25:34.367840 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1925/3742] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:33 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:34.371858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:34.372619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:34.385743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.386503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.392493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.393609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.394493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.395190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.467514 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bea27b0f-3335-4085-9f74-c6975c8c5c39 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.241217 Aug 27 03:25:34.477228 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1818/3743] 10.222.0.69 () {60 vars in 1316 bytes} [Sat Aug 27 03:25:34 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8/os-interface => generated 1830 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:34.764006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:34.770189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:34.787276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.790118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.791265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:34.796774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:34.799564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:34.804524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:35.039599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:35.070434 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f974b5c1-0c76-4bf3-8902-6f2ccea3b712 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1510 microversion: 2.1 time: 0.711980 Aug 27 03:25:35.072250 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1926/3744] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:34 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1510 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:35.235001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:35.236113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:35.257026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:35.257824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:35.258487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:35.259394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:35.260673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:35.261293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:35.832476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:35.853861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:35.858554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:35.859779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0aec585-71b4-46ae-919c-81abf7a289be tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.104584 Aug 27 03:25:35.860563 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1819/3745] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:34 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:25:35.870477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:35.877353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:35.886214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:35.886917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:35.887532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:35.888414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:35.889040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:35.889659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:35.986905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:36.011166 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-72aa3496-50be-4678-9f60-d703c24123c7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 0.779572 Aug 27 03:25:36.013978 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1927/3746] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:35 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:36.030220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cceb0ced-19ee-4737-9639-426a216fc4da req-d2099740-126a-4fd1-874d-43921e26c4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "5a0b4c7a-a135-4d68-b8d3-a8cd69119f06"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:36.046625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cceb0ced-19ee-4737-9639-426a216fc4da req-d2099740-126a-4fd1-874d-43921e26c4d8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.047519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cceb0ced-19ee-4737-9639-426a216fc4da req-d2099740-126a-4fd1-874d-43921e26c4d8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.047519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cceb0ced-19ee-4737-9639-426a216fc4da req-d2099740-126a-4fd1-874d-43921e26c4d8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.068373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cceb0ced-19ee-4737-9639-426a216fc4da req-d2099740-126a-4fd1-874d-43921e26c4d8 service nova] Creating event network-changed:5a0b4c7a-a135-4d68-b8d3-a8cd69119f06 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:25:36.078248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cceb0ced-19ee-4737-9639-426a216fc4da req-d2099740-126a-4fd1-874d-43921e26c4d8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062465 Aug 27 03:25:36.080258 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1928/3747] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:36.086501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-813c91a0-2999-4cf5-837e-d640dc47fe4f req-0d443922-35ea-4089-a08b-4a88a22dc3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-plugged", "status": "completed", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:36.110124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-813c91a0-2999-4cf5-837e-d640dc47fe4f req-0d443922-35ea-4089-a08b-4a88a22dc3c4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.111418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-813c91a0-2999-4cf5-837e-d640dc47fe4f req-0d443922-35ea-4089-a08b-4a88a22dc3c4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.112050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-813c91a0-2999-4cf5-837e-d640dc47fe4f req-0d443922-35ea-4089-a08b-4a88a22dc3c4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.130567 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-813c91a0-2999-4cf5-837e-d640dc47fe4f req-0d443922-35ea-4089-a08b-4a88a22dc3c4 service nova] Creating event network-vif-plugged:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:25:36.136788 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-813c91a0-2999-4cf5-837e-d640dc47fe4f req-0d443922-35ea-4089-a08b-4a88a22dc3c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054866 Aug 27 03:25:36.138399 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1929/3748] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:36.150238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:36.151641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:36.166684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.167187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.167630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.175518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.176035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.176504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.638119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:36.658228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:36.660048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:36.661490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62e4ef51-fa22-4e9a-abfe-6aabd3a944d1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1597 microversion: 2.20 time: 0.799738 Aug 27 03:25:36.662684 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1820/3749] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:35 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1597 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:36.672778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:36.688189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:36.688698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:36.693184 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cde36499-0350-4c69-b7d6-d71439851945 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1493 microversion: 2.1 time: 0.553184 Aug 27 03:25:36.693790 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1930/3750] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:36 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1493 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:36.697236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.706246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.707235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.708188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.708821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.709550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.717497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:36.727042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:36.741567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.750629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.751197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.752544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.753255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.753947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.810708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:25:36.910833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40436e98-7603-495d-a3b4-3d75d03dac70 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 204 len: 0 microversion: 2.1 time: 0.197773 Aug 27 03:25:36.912612 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1931/3751] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:36 2022] DELETE /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:25:36.921457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:36.922425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:36.941732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.942875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.943929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:36.945719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:36.947663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:36.948753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:37.126919 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6cb32b4-3045-4762-9199-4a70248de57a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.442425 Aug 27 03:25:37.128334 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1821/3752] 10.222.0.69 () {60 vars in 1316 bytes} [Sat Aug 27 03:25:36 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-interface => generated 284 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:25:37.138345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:37.139359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:37.150316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:37.153380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:37.158555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:37.159805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:37.160541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:37.161234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:37.757435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:37.782506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:37.798702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:37.800680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8ad3149c-6e5c-4a0a-8b42-0d6d3b4a7b66 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.886148 Aug 27 03:25:37.818192 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1932/3753] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:36 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:37.824090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:37.835080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:37.842443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:37.843438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:37.844168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:37.845873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:37.846649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:37.847336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:38.215719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:38.231987 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7933ab90-d9e2-4d41-9259-c8109e268418 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1364 microversion: 2.1 time: 0.413095 Aug 27 03:25:38.233644 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1933/3754] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:37 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:38.313587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-041ac987-af95-41cc-8366-7df4fa27449c req-41bbef3f-788b-4cb1-9af3-8855bb767ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "d78d7323-5afa-431c-9cd9-c6983436a16d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:38.336229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-041ac987-af95-41cc-8366-7df4fa27449c req-41bbef3f-788b-4cb1-9af3-8855bb767ff0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:38.340089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-041ac987-af95-41cc-8366-7df4fa27449c req-41bbef3f-788b-4cb1-9af3-8855bb767ff0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:38.341652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-041ac987-af95-41cc-8366-7df4fa27449c req-41bbef3f-788b-4cb1-9af3-8855bb767ff0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:38.374867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-041ac987-af95-41cc-8366-7df4fa27449c req-41bbef3f-788b-4cb1-9af3-8855bb767ff0 service nova] Creating event network-changed:d78d7323-5afa-431c-9cd9-c6983436a16d for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:25:38.382853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-041ac987-af95-41cc-8366-7df4fa27449c req-41bbef3f-788b-4cb1-9af3-8855bb767ff0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077070 Aug 27 03:25:38.384308 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1934/3755] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:38.818311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:38.832771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:38.839973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:38.844848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d917bfbe-6d89-4c5a-a5aa-739a9987e915 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1499 microversion: 2.1 time: 1.714713 Aug 27 03:25:38.849363 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1822/3756] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:37 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1499 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:38.855678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:38.856504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:38.857326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:38.858328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:38.858979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:38.859720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:39.265006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:39.265751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:39.272915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:39.273502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:39.274034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:39.274887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:39.275384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:39.276467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:39.348798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:39.362985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:39.364751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:39.366694 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b97157d2-adc1-4e38-b9e2-86074606b8fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.541452 Aug 27 03:25:39.368021 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1935/3757] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:38 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:25:39.871495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:39.872813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:39.880960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:39.881457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:39.882103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:39.882881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:39.883339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:39.884061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:40.251911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:40.267923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3eaa9f2a-faf8-4338-83e0-51d45ec403cf tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1499 microversion: 2.1 time: 0.400259 Aug 27 03:25:40.310782 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1936/3758] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:39 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1499 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:40.366827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:40.380229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0cce4421-b211-4861-a651-ae2237cc191a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1550 microversion: 2.1 time: 1.118990 Aug 27 03:25:40.383646 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1823/3759] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:39 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1550 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:40.409661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:40.410324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:40.412447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:40.413428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:40.427767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:40.428263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:40.428813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:40.429389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:40.429840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:40.430319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:40.433679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:40.434440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:40.437403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:40.438483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:40.439113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:40.439811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:40.699833 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32b1a0a4-1741-4c39-83d7-6365b9d11898 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295162 Aug 27 03:25:40.700945 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1824/3760] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:25:40 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:40.712588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bcb6b121-8c3c-4fba-b3a3-b6696258b101 req-63222676-be14-4899-bc94-a772c7928e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "74829acf-8c1f-4b9d-9058-e4429ee36c60"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:40.733625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bcb6b121-8c3c-4fba-b3a3-b6696258b101 req-63222676-be14-4899-bc94-a772c7928e37 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:40.734541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bcb6b121-8c3c-4fba-b3a3-b6696258b101 req-63222676-be14-4899-bc94-a772c7928e37 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:40.735216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bcb6b121-8c3c-4fba-b3a3-b6696258b101 req-63222676-be14-4899-bc94-a772c7928e37 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:40.768974 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bcb6b121-8c3c-4fba-b3a3-b6696258b101 req-63222676-be14-4899-bc94-a772c7928e37 service nova] Creating event network-changed:74829acf-8c1f-4b9d-9058-e4429ee36c60 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:25:40.775281 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bcb6b121-8c3c-4fba-b3a3-b6696258b101 req-63222676-be14-4899-bc94-a772c7928e37 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072619 Aug 27 03:25:40.776946 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1825/3761] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:40.907015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7fc0c15f-51dc-4ab3-99f9-d9c717ea7969 req-8e0566e8-4399-4d10-9793-fbcea46c2fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "tag": "5483ccb2-45f0-4bdd-9b3b-a9b357359a2f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:40.920560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7fc0c15f-51dc-4ab3-99f9-d9c717ea7969 req-8e0566e8-4399-4d10-9793-fbcea46c2fd4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:40.921885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7fc0c15f-51dc-4ab3-99f9-d9c717ea7969 req-8e0566e8-4399-4d10-9793-fbcea46c2fd4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:40.923116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7fc0c15f-51dc-4ab3-99f9-d9c717ea7969 req-8e0566e8-4399-4d10-9793-fbcea46c2fd4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:40.941987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7fc0c15f-51dc-4ab3-99f9-d9c717ea7969 req-8e0566e8-4399-4d10-9793-fbcea46c2fd4 service nova] Creating event network-changed:5483ccb2-45f0-4bdd-9b3b-a9b357359a2f for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:25:40.949712 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7fc0c15f-51dc-4ab3-99f9-d9c717ea7969 req-8e0566e8-4399-4d10-9793-fbcea46c2fd4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048460 Aug 27 03:25:40.952867 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1826/3762] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:41.190408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:41.206988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:41.208432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:41.212411 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b944853-26b6-4070-9cd9-b3fea89d5021 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.822417 Aug 27 03:25:41.214112 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1937/3763] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:40 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:41.311446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:41.312191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:41.330305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:41.331182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:41.331786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:41.332690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:41.333304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:41.333895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:42.241644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:42.243086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:42.257127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:42.258038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:42.258762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:42.260038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:42.261110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:42.261892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:42.652028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cffdb49624ff986aed20fd255b1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ea20c86dc44d3bd25a884bc30b6ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:42.673499 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-537de9e5-8c67-42a5-96ae-fec075eb5ffa tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 200 len: 1499 microversion: 2.1 time: 1.370178 Aug 27 03:25:42.674427 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1827/3764] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:41 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 1499 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:42.840300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-745dc01c-27f0-4676-ab18-08a46afcfec3 req-b551024c-7496-44d1-8c7e-2838bb03b9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "7c4f392d-0ced-41e9-b62c-450fb4af76a2"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:42.867198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-745dc01c-27f0-4676-ab18-08a46afcfec3 req-b551024c-7496-44d1-8c7e-2838bb03b9f5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:42.867848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-745dc01c-27f0-4676-ab18-08a46afcfec3 req-b551024c-7496-44d1-8c7e-2838bb03b9f5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:42.868199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-745dc01c-27f0-4676-ab18-08a46afcfec3 req-b551024c-7496-44d1-8c7e-2838bb03b9f5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:42.905683 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-745dc01c-27f0-4676-ab18-08a46afcfec3 req-b551024c-7496-44d1-8c7e-2838bb03b9f5 service nova] Creating event network-changed:7c4f392d-0ced-41e9-b62c-450fb4af76a2 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:25:42.917467 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-745dc01c-27f0-4676-ab18-08a46afcfec3 req-b551024c-7496-44d1-8c7e-2838bb03b9f5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092164 Aug 27 03:25:42.918996 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1828/3765] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:43.120161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:43.143106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:43.145308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:43.146853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-73ce3f70-0252-4671-bd2a-f24e00674c0e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.910095 Aug 27 03:25:43.147875 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1938/3766] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:42 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:43.177588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5676a2c5-7cac-4e1c-8b26-c290fb49b95f req-894d46c6-4f98-4192-9ec6-d2c5f0872302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ba86e1-7386-4c27-a788-fc1e403d05d5", "name": "network-vif-deleted", "tag": "a418ee44-8726-4585-8f39-f22945d3dea4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:43.198012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5676a2c5-7cac-4e1c-8b26-c290fb49b95f req-894d46c6-4f98-4192-9ec6-d2c5f0872302 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.201431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5676a2c5-7cac-4e1c-8b26-c290fb49b95f req-894d46c6-4f98-4192-9ec6-d2c5f0872302 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.202013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5676a2c5-7cac-4e1c-8b26-c290fb49b95f req-894d46c6-4f98-4192-9ec6-d2c5f0872302 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.224207 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5676a2c5-7cac-4e1c-8b26-c290fb49b95f req-894d46c6-4f98-4192-9ec6-d2c5f0872302 service nova] Creating event network-vif-deleted:a418ee44-8726-4585-8f39-f22945d3dea4 for instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 on n-h1-852086-5 Aug 27 03:25:43.246070 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5676a2c5-7cac-4e1c-8b26-c290fb49b95f req-894d46c6-4f98-4192-9ec6-d2c5f0872302 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072483 Aug 27 03:25:43.250259 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1829/3767] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:43.699704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:43.701089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:43.717052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.718182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.718900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.720023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.721086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.722519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.781208 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 HTTP/1.1 Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '02ba86e1-7386-4c27-a788-fc1e403d05d5'} Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:43.785588 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-433faee4-6b84-4fe7-abdf-c500b89b4129 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 404 len: 111 microversion: 2.1 time: 0.091261 Aug 27 03:25:43.797087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1939/3768] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:43 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:43.808924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:43.812486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:43.830408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.836057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.837208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.838599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.843244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.844409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.874599 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 HTTP/1.1 Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '02ba86e1-7386-4c27-a788-fc1e403d05d5'} Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:43.879444 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.886186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:43.887625 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa45b2d5-6098-4a77-a10f-e4669cddfac9 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 404 len: 111 microversion: 2.1 time: 0.087347 Aug 27 03:25:43.903426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:43.904012 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1830/3769] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:43 2022] DELETE /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:43.905196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02ba86e1-7386-4c27-a788-fc1e403d05d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:43.915661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.918788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.919739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.928972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.929794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.930304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.949342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:43.956453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 HTTP/1.1 Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '02ba86e1-7386-4c27-a788-fc1e403d05d5'} Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:43.962661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 02ba86e1-7386-4c27-a788-fc1e403d05d5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58ac09c2-e520-4064-977e-1cda487a365d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5" status: 404 len: 111 microversion: 2.1 time: 0.070155 Aug 27 03:25:43.971090 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1940/3770] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:43 2022] GET /compute/v2.1/servers/02ba86e1-7386-4c27-a788-fc1e403d05d5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:43.977167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:43.978331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:43.990032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.993228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.995710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:43.996049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:43.996783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:43.997465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.015319 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 HTTP/1.1 Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3985591f-9a52-4bb4-9dd7-564d21a56880'} Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.019899 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.033430 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-954fdc0a-f02f-48ef-a9fc-f1a29d730fc7 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 404 len: 111 microversion: 2.1 time: 0.053030 Aug 27 03:25:44.038500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.038500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 3985591f-9a52-4bb4-9dd7-564d21a56880] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.043586 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1831/3771] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:43 2022] DELETE /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:25:44.055805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.056457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.057857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.058871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.059574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.064453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.110772 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 HTTP/1.1 Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '3985591f-9a52-4bb4-9dd7-564d21a56880'} Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.117234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.123672 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.123672 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.123672 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.123672 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.123672 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.123672 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. Aug 27 03:25:44.123672 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.127813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 3985591f-9a52-4bb4-9dd7-564d21a56880 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.128863 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37e80cab-7f70-46e4-b827-cb70ab8f4727 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880" status: 404 len: 111 microversion: 2.1 time: 0.097042 Aug 27 03:25:44.130113 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1941/3772] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:44 2022] GET /compute/v2.1/servers/3985591f-9a52-4bb4-9dd7-564d21a56880 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:44.138952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.139619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.151745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.152412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.152969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.153813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.155885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.158055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.187753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.188686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.195549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.200093 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.200337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.200883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 HTTP/1.1 Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6'} Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.201682 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.208159 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.209340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.209340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.209535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.209535 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f51bc15-5f45-46be-84bb-773248de1c59 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 404 len: 111 microversion: 2.1 time: 0.073624 Aug 27 03:25:44.210976 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1832/3773] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:44 2022] DELETE /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:44.216544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.223620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.224262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.242151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.242765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.243226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.243958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.244468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.244983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.287020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 HTTP/1.1 Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6'} Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.294327 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.300877 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.300877 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.300877 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.300877 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.300877 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.300877 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. Aug 27 03:25:44.300877 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.303942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.309170 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-121f3826-34df-41e0-b2d0-33f9afa0d05d tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6" status: 404 len: 111 microversion: 2.1 time: 0.090487 Aug 27 03:25:44.313787 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1833/3774] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:44 2022] GET /compute/v2.1/servers/02a5ee6d-6a8b-4dbf-acf1-29199b7d1ba6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:44.327508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.328246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.335858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.336770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.337553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.340070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.341038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.341723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.366245 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 HTTP/1.1 Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'dcdd1cc0-f3df-4014-9d3b-9008281ad483'} Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.367814 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.374007 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.378458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.379203 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccd7fa65-14c6-4e65-adb8-cb05db2fa3e2 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 404 len: 111 microversion: 2.1 time: 0.059652 Aug 27 03:25:44.380314 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1834/3775] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:44 2022] DELETE /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:44.389022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.390002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: dcdd1cc0-f3df-4014-9d3b-9008281ad483] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.399085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.405360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.405972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.406890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:44.407477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:44.408196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:44.443265 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 HTTP/1.1 Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'dcdd1cc0-f3df-4014-9d3b-9008281ad483'} Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.448068 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.452640 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.452640 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.452640 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.452640 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.452640 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.452640 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. Aug 27 03:25:44.452640 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.457183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance dcdd1cc0-f3df-4014-9d3b-9008281ad483 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.458429 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2f10282-e4af-4bf8-9d8b-143620bdc562 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483" status: 404 len: 111 microversion: 2.1 time: 0.074176 Aug 27 03:25:44.462621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1835/3776] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:44 2022] GET /compute/v2.1/servers/dcdd1cc0-f3df-4014-9d3b-9008281ad483 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:44.467930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d829f4f-386e-4646-b540-78b0d5fa882c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.468583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d829f4f-386e-4646-b540-78b0d5fa882c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.474777 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9d829f4f-386e-4646-b540-78b0d5fa882c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d829f4f-386e-4646-b540-78b0d5fa882c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 HTTP/1.1 Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'db8063ab-edcf-4807-8298-eea24ee08ef9'} Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.476451 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.481623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.485471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d829f4f-386e-4646-b540-78b0d5fa882c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.486758 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d829f4f-386e-4646-b540-78b0d5fa882c tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9" status: 404 len: 111 microversion: 2.1 time: 0.022739 Aug 27 03:25:44.490988 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1836/3777] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:44 2022] DELETE /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:44.496427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05b3b7ed-d2ec-428d-b14b-be4f58b30d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:44.497441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05b3b7ed-d2ec-428d-b14b-be4f58b30d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: db8063ab-edcf-4807-8298-eea24ee08ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:44.505942 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-05b3b7ed-d2ec-428d-b14b-be4f58b30d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05b3b7ed-d2ec-428d-b14b-be4f58b30d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 HTTP/1.1 Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'db8063ab-edcf-4807-8298-eea24ee08ef9'} Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:44.512440 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:44.520251 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:44.520251 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:44.520251 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:44.520251 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. Aug 27 03:25:44.520251 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:25:44.520251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05b3b7ed-d2ec-428d-b14b-be4f58b30d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance db8063ab-edcf-4807-8298-eea24ee08ef9 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:44.520251 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05b3b7ed-d2ec-428d-b14b-be4f58b30d64 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9" status: 404 len: 111 microversion: 2.1 time: 0.027434 Aug 27 03:25:44.524122 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1837/3778] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:44 2022] GET /compute/v2.1/servers/db8063ab-edcf-4807-8298-eea24ee08ef9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:44.919343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:44.944698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:44.946427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:44.950605 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92e4433b-e04a-4e79-9b71-11cc15c362ec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.767664 Aug 27 03:25:44.951392 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1942/3779] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:44 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:45.393897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e8826a03-77bf-49df-a602-1607f7add6b5 req-9ad98790-3a12-4320-930a-93370d9b2272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:45.409491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e8826a03-77bf-49df-a602-1607f7add6b5 req-9ad98790-3a12-4320-930a-93370d9b2272 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:45.409883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e8826a03-77bf-49df-a602-1607f7add6b5 req-9ad98790-3a12-4320-930a-93370d9b2272 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:45.410350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e8826a03-77bf-49df-a602-1607f7add6b5 req-9ad98790-3a12-4320-930a-93370d9b2272 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:45.459435 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e8826a03-77bf-49df-a602-1607f7add6b5 req-9ad98790-3a12-4320-930a-93370d9b2272 service nova] Creating event network-changed:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h2-852086-5 Aug 27 03:25:45.476103 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e8826a03-77bf-49df-a602-1607f7add6b5 req-9ad98790-3a12-4320-930a-93370d9b2272 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086548 Aug 27 03:25:45.476728 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1838/3780] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:45.980655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:45.981508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:45.992635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:45.993141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:45.993586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:45.994917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:45.995379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:45.995926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:47.461225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:47.481642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:47.487645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:47.489488 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-702bf172-6768-4f7e-be7d-842ffae1cc2d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.515537 Aug 27 03:25:47.493770 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1943/3781] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:45 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:48.400293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c5a21c3a-03fe-414e-a150-0c973eb115a0 req-95edcc74-b9ec-4fc6-be62-f3854293f923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:48.426061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c5a21c3a-03fe-414e-a150-0c973eb115a0 req-95edcc74-b9ec-4fc6-be62-f3854293f923 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:48.426881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c5a21c3a-03fe-414e-a150-0c973eb115a0 req-95edcc74-b9ec-4fc6-be62-f3854293f923 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:48.429528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c5a21c3a-03fe-414e-a150-0c973eb115a0 req-95edcc74-b9ec-4fc6-be62-f3854293f923 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:48.457217 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c5a21c3a-03fe-414e-a150-0c973eb115a0 req-95edcc74-b9ec-4fc6-be62-f3854293f923 service nova] Creating event network-changed:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:25:48.471476 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c5a21c3a-03fe-414e-a150-0c973eb115a0 req-95edcc74-b9ec-4fc6-be62-f3854293f923 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074746 Aug 27 03:25:48.474628 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1839/3782] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:48.524147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:48.527164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:48.545330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:48.548421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:48.550370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:48.554361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:48.556817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:48.558566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:49.062190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:49.077455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:49.083873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:49.085272 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3968473-89b6-4a64-8edd-91ff84147489 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.569381 Aug 27 03:25:49.107032 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1944/3783] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:48 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:50.035568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db4cadd0-b7cb-4226-af90-e2936d468b77 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Action: 'create', calling method: .version_select at 0x7fe46033ca60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1090963715", "policies": ["affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:50.086919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-db4cadd0-b7cb-4226-af90-e2936d468b77 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:50.104181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-db4cadd0-b7cb-4226-af90-e2936d468b77 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:50.125690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:50.129606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:50.142926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:50.154196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:50.158348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:50.160159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:50.165249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:50.166133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:50.168397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:50.261215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-db4cadd0-b7cb-4226-af90-e2936d468b77 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:50.269308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-db4cadd0-b7cb-4226-af90-e2936d468b77 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:50.290277 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db4cadd0-b7cb-4226-af90-e2936d468b77 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.689862 Aug 27 03:25:50.302073 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1840/3784] 10.222.0.69 () {60 vars in 1174 bytes} [Sat Aug 27 03:25:49 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:50.309033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cf7882e-480a-4d9d-8d11-dde6bc3868a3 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Action: 'create', calling method: .version_select at 0x7fe4573e3c10>, body: {"server_group": {"name": "tempest-server-group-1640228612", "policies": ["affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:50.365764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4cf7882e-480a-4d9d-8d11-dde6bc3868a3 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:50.393703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4cf7882e-480a-4d9d-8d11-dde6bc3868a3 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:50.536965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4cf7882e-480a-4d9d-8d11-dde6bc3868a3 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:50.551016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4cf7882e-480a-4d9d-8d11-dde6bc3868a3 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:50.580986 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cf7882e-480a-4d9d-8d11-dde6bc3868a3 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.276672 Aug 27 03:25:50.582541 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1841/3785] 10.222.0.69 () {60 vars in 1173 bytes} [Sat Aug 27 03:25:50 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:50.593904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bd45021-56c8-4ee6-a9c1-5bb7b11f8761 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Action: 'create', calling method: .version_select at 0x7fe4573a88b0>, body: {"server_group": {"name": "tempest-server-group-1640228612", "policies": ["affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:50.622054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1bd45021-56c8-4ee6-a9c1-5bb7b11f8761 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:50.632661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1bd45021-56c8-4ee6-a9c1-5bb7b11f8761 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:50.708169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1bd45021-56c8-4ee6-a9c1-5bb7b11f8761 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:50.719320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1bd45021-56c8-4ee6-a9c1-5bb7b11f8761 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:50.751088 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bd45021-56c8-4ee6-a9c1-5bb7b11f8761 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.160979 Aug 27 03:25:50.758278 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1842/3786] 10.222.0.69 () {60 vars in 1173 bytes} [Sat Aug 27 03:25:50 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:50.766265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7998b6df-a3ee-4839-85fe-60f9e27d3dc1 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:50.846101 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7998b6df-a3ee-4839-85fe-60f9e27d3dc1 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/5d4a672e-b3ea-4884-8f4c-e70488c06ea2" status: 204 len: 0 microversion: 2.1 time: 0.083340 Aug 27 03:25:50.846921 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1843/3787] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:25:50 2022] DELETE /compute/v2.1/os-server-groups/5d4a672e-b3ea-4884-8f4c-e70488c06ea2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:50.873839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a88eb2a-cede-45fa-9cdc-011381d99d42 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:50.935858 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a88eb2a-cede-45fa-9cdc-011381d99d42 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.082219 Aug 27 03:25:50.951879 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1844/3788] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:25:50 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:50.972366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7da581f5-ac52-4d1c-a59e-7662b16a1b97 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.045937 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7da581f5-ac52-4d1c-a59e-7662b16a1b97 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/11c48a68-69b7-416c-88d7-33752571661b" status: 204 len: 0 microversion: 2.1 time: 0.085422 Aug 27 03:25:51.050367 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1845/3789] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:25:50 2022] DELETE /compute/v2.1/os-server-groups/11c48a68-69b7-416c-88d7-33752571661b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:51.057125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cc2dc3a-2af2-4d3a-9614-ae2ee3bf397b tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.077440 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5cc2dc3a-2af2-4d3a-9614-ae2ee3bf397b tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.025772 Aug 27 03:25:51.086086 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1846/3790] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:25:51 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:51.125169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b319dca1-1e8f-45fd-849c-08bba66cdf1f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Action: 'create', calling method: .version_select at 0x7fe4573e3310>, body: {"server_group": {"name": "tempest-server-group-603817464", "policies": ["affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:51.188421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b319dca1-1e8f-45fd-849c-08bba66cdf1f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:51.196548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b319dca1-1e8f-45fd-849c-08bba66cdf1f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:51.199425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:51.303619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b319dca1-1e8f-45fd-849c-08bba66cdf1f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:51.311312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b319dca1-1e8f-45fd-849c-08bba66cdf1f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:51.343011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b319dca1-1e8f-45fd-849c-08bba66cdf1f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.232596 Aug 27 03:25:51.348714 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1847/3791] 10.222.0.69 () {60 vars in 1173 bytes} [Sat Aug 27 03:25:51 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:51.362200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-941f3977-636d-453d-b88c-cb7a978cb370 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.464927 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-941f3977-636d-453d-b88c-cb7a978cb370 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/903913a4-7f72-4d56-a17f-51c58746f441" status: 204 len: 0 microversion: 2.1 time: 0.113651 Aug 27 03:25:51.465971 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1848/3792] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:25:51 2022] DELETE /compute/v2.1/os-server-groups/903913a4-7f72-4d56-a17f-51c58746f441 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:51.483253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-506a6ead-5500-4ce6-8224-d477a8d76505 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.512282 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-506a6ead-5500-4ce6-8224-d477a8d76505 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040703 Aug 27 03:25:51.516129 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1849/3793] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:25:51 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:51.530920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-207d4f16-b839-4ae2-8dd8-ac34d08e920a tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Action: 'create', calling method: .version_select at 0x7fe4573a9a60>, body: {"server_group": {"name": "tempest-server-group-1495270964", "policies": ["anti-affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:51.557289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-207d4f16-b839-4ae2-8dd8-ac34d08e920a tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:51.569163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-207d4f16-b839-4ae2-8dd8-ac34d08e920a tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:51.601924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:51.623292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:51.625975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:51.628740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-900722c9-7db0-4639-ae79-d30840200966 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.518824 Aug 27 03:25:51.629746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1945/3794] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:50 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:51.637704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.638736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:51.653660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.654597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.655906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.658459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.661086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.661930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.670474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-207d4f16-b839-4ae2-8dd8-ac34d08e920a tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:51.693562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-207d4f16-b839-4ae2-8dd8-ac34d08e920a tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:51.711132 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 HTTP/1.1 Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7d7876dd-acea-4450-b47d-fa8125c09808'} Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:51.712838 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.719645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:51.723507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-276f81cd-8a90-4ab9-915d-75a8f6caac90 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 404 len: 111 microversion: 2.1 time: 0.088284 Aug 27 03:25:51.728766 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1946/3795] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:51 2022] DELETE /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:51.731466 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-207d4f16-b839-4ae2-8dd8-ac34d08e920a tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.204294 Aug 27 03:25:51.732637 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1850/3796] 10.222.0.69 () {60 vars in 1173 bytes} [Sat Aug 27 03:25:51 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:51.737028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.737630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 7d7876dd-acea-4450-b47d-fa8125c09808] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:51.748067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-882632ae-a1b6-437a-a5a8-e7aefedb0c1b tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.763031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.763442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.763889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.764620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.765081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.765514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.802541 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-882632ae-a1b6-437a-a5a8-e7aefedb0c1b tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/6ee0de4b-0575-432b-819a-5c20dc9c493b" status: 204 len: 0 microversion: 2.1 time: 0.060409 Aug 27 03:25:51.803202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1851/3797] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:25:51 2022] DELETE /compute/v2.1/os-server-groups/6ee0de4b-0575-432b-819a-5c20dc9c493b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:25:51.812649 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 HTTP/1.1 Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7d7876dd-acea-4450-b47d-fa8125c09808'} Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:51.814943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.827331 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.827331 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:51.827331 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:51.827331 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:51.827331 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:51.827331 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. Aug 27 03:25:51.827331 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.827874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da9e8b59-d2f9-4f6b-b9e9-f0eae9922a10 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.827982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 7d7876dd-acea-4450-b47d-fa8125c09808 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:51.827982 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d548206c-113a-4250-a8ef-8e845891c4e0 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808" status: 404 len: 111 microversion: 2.1 time: 0.096839 Aug 27 03:25:51.830674 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1947/3798] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:51 2022] GET /compute/v2.1/servers/7d7876dd-acea-4450-b47d-fa8125c09808 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:51.837003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.837898 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da9e8b59-d2f9-4f6b-b9e9-f0eae9922a10 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029554 Aug 27 03:25:51.839085 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1852/3799] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:25:51 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:51.845591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:51.869446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.870309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.870779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.871542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.872007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.872451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.917660 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 HTTP/1.1 Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '99e93809-d503-4674-8eb4-26e2626405e9'} Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:51.919252 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:51.930763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-596220e2-77aa-4def-84ff-ba3110eb839b tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "DELETE /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 404 len: 111 microversion: 2.1 time: 0.087810 Aug 27 03:25:51.932743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-682901473", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "1bd18960-b82c-4bc8-85b5-99f1619edd44"}]}, "os:scheduler_hints": {"group": "7d1d5284-b878-4f79-b0d8-dbb46df1cb30"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:51.938965 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1948/3800] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:25:51 2022] DELETE /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:25:51.943071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:51.944568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] [instance: 99e93809-d503-4674-8eb4-26e2626405e9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:51.955771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.956730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.957370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.958409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:51.960019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:51.960811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:51.993920 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] HTTP exception thrown: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Request method failure captured: Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 HTTP/1.1 Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1ArOVNUr9cl4rIkLYqJrBzyKfdL0kjxbOR84_HjYrFGUk4iNW8aq4XratuJWBv8Bzw0H9jQuXRTO4cO7w9X5M9xyH9yckwQ3lbEUbHENu7OJ6jwzB72MztXEgyi5PXLLI7SG3BWsllQFcjJ88Y0TEtuM8r8qyiUYVbr84Kl-090TE Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ea20c86dc44d3bd25a884bc30b6ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ea20c86dc44d3bd25a884bc30b6ad"}]}] Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ea20c86dc44d3bd25a884bc30b6ad Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1495946699 Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 267cffdb49624ff986aed20fd255b1db Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-1495946699-project Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '99e93809-d503-4674-8eb4-26e2626405e9'} Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:25:52.000193 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:52.006917 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:25:52.006917 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:25:52.006917 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:25:52.006917 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:25:52.006917 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:25:52.006917 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. Aug 27 03:25:52.006917 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:25:52.008641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] Returning 404 to user: Instance 99e93809-d503-4674-8eb4-26e2626405e9 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:25:52.009725 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a812ad19-f4f8-4371-944e-c5133263eb58 tempest-DeleteServersTestJSON-1495946699 tempest-DeleteServersTestJSON-1495946699-project] 10.222.0.69 "GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9" status: 404 len: 111 microversion: 2.1 time: 0.074236 Aug 27 03:25:52.015993 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1949/3801] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:51 2022] GET /compute/v2.1/servers/99e93809-d503-4674-8eb4-26e2626405e9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:25:52.054031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] validate_networks() for [('1bd18960-b82c-4bc8-85b5-99f1619edd44', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:25:52.657257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:52.658953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:52.675681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:52.677682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:52.678223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:52.678969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:52.679430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:52.681199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:53.480196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:25:53.481223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:25:53.481913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:25:53.483966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:53.485169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:25:53.486742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:25:53.510896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:53.514743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:53.519251 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9d46de5-5011-445f-8fe1-01560374fbe6 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.865857 Aug 27 03:25:53.522230 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1950/3802] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:52 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:53.540163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:53.541199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:53.541717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:53.542695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:53.543360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:53.543966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:53.598309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:53.615774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:53.659001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:25:53.661619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:25:53.779583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:53.792163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:53.858109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:53.893898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:53.915530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Getting quotas for user 274949cae7be4d828c38e95d46620b6b and project 8b0f6ff672904c88be51f2f000aaa5c8. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:54.007162 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8750d07-1f73-43ef-8a63-1df2e2599e61 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070521 Aug 27 03:25:54.008784 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1853/3803] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:25:54.023430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-67b58c8e-560c-487e-ab58-4d216eea6415 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:54.023430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67b58c8e-560c-487e-ab58-4d216eea6415 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:54.349957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-67b58c8e-560c-487e-ab58-4d216eea6415 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:54.361066 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-67b58c8e-560c-487e-ab58-4d216eea6415 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1212 microversion: 2.1 time: 0.342384 Aug 27 03:25:54.383275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1951/3804] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:54 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1212 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:54.553919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:54.554400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:54.576593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:54.579047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:54.579802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:54.586476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:54.587029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:54.587568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:55.396993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:55.397621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:55.413762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:55.414303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:55.414783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:55.415501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:55.416562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:55.417331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:55.693597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:55.717638 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b01583e-ce58-48af-bddc-be88f7926c73 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1208 microversion: 2.1 time: 0.325460 Aug 27 03:25:55.721355 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1952/3805] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:55 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1208 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:56.011036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:56.032464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:56.037223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:56.043841 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a3eb62a-543a-4d0c-96a1-194a17128aa4 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.495497 Aug 27 03:25:56.048796 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1854/3806] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:54 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:56.749711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:56.750352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:56.756291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:56.771494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:56.772386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:56.774335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:56.775455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:56.777818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:56.778845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:56.983047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:57.015478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-418e990d-a6e9-4f1e-9e42-a7c35faaf286 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1270 microversion: 2.1 time: 0.269666 Aug 27 03:25:57.018930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1953/3807] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:56 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1270 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:57.079580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:57.080369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:57.101098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:57.101913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:57.102609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:57.106418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:57.107223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:57.108133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:58.055268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:58.056018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:58.071401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:58.072672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:58.074705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:58.076351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:58.077144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:58.078112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:58.175711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:58.196836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:58.201496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:58.203338 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75323fe1-a553-47b9-ab0a-a279e14323b0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.129958 Aug 27 03:25:58.220779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:58.232954 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1855/3808] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:57 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:25:58.234103 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc6085a7-88d2-4f21-a5ee-df237de17a25 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1270 microversion: 2.1 time: 0.183243 Aug 27 03:25:58.235179 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1954/3809] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:58 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:59.232277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:59.233122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:59.248790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:59.249359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:59.249736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:59.255022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:59.261502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:59.262944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:59.268173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:59.269944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:59.284292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:59.287441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:59.292339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:59.303681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:59.304691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:59.307902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:59.940491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:59.959863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:59.967256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:59.971779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a580311f-cb01-422e-bee2-ac8540146dbc tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.744110 Aug 27 03:25:59.984111 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1856/3810] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:25:59 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:00.726853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:00.742349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4908167-0727-4424-8e83-52bcbd65d085 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 1.485562 Aug 27 03:26:00.743566 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1955/3811] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:59 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:00.947660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-92181df0-645c-4698-9f76-6e3ff9d8755c req-44a49e45-5180-4b23-8a21-9a9bcf065c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87fd94f8-f9ca-487d-9871-e01c32001974", "tag": "97e2fccd-b654-4581-97e2-350ed0ba15dc"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:00.977423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-92181df0-645c-4698-9f76-6e3ff9d8755c req-44a49e45-5180-4b23-8a21-9a9bcf065c14 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:00.978071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-92181df0-645c-4698-9f76-6e3ff9d8755c req-44a49e45-5180-4b23-8a21-9a9bcf065c14 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:00.979099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-92181df0-645c-4698-9f76-6e3ff9d8755c req-44a49e45-5180-4b23-8a21-9a9bcf065c14 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:00.993147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:01.003489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:01.004345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:01.026740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:01.031967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-92181df0-645c-4698-9f76-6e3ff9d8755c req-44a49e45-5180-4b23-8a21-9a9bcf065c14 service nova] Creating event network-changed:97e2fccd-b654-4581-97e2-350ed0ba15dc for instance 87fd94f8-f9ca-487d-9871-e01c32001974 on n-h1-852086-5 Aug 27 03:26:01.042937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:01.044803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:01.045838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:01.046550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:01.047187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:01.060287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-92181df0-645c-4698-9f76-6e3ff9d8755c req-44a49e45-5180-4b23-8a21-9a9bcf065c14 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116326 Aug 27 03:26:01.064066 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1857/3812] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:01.777869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:01.779585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:01.796296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:01.798462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:01.799645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:01.800434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:01.800914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:01.801349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:01.952783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:01.972401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:01.991539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:01.992809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-940c761e-f9c6-496e-b12f-db9b11b948f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.993872 Aug 27 03:26:01.997435 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1956/3813] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:00 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:02.429334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:02.445108 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-729e15cd-024c-42d9-802c-afcd877974b9 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 0.671962 Aug 27 03:26:02.447555 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1858/3814] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:01 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:03.018280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:03.020231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:03.028748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:03.029676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:03.030416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:03.031403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:03.032121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:03.032787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:03.471031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:03.472027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:03.480061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:03.480636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:03.481086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:03.481819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:03.482300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:03.483035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:03.570355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:03.828433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:03.843732 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe807b16-83ef-483d-90f6-55fd182e6998 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 0.379601 Aug 27 03:26:03.849066 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1859/3815] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:03 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:03.942120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:03.954744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:03.956905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:03.958682 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e822e7b4-f555-4e7d-80fc-555bbc93a760 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.944401 Aug 27 03:26:03.976890 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1957/3816] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:03 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:04.870757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:04.871937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:04.873359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=54 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:04.892649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:04.892649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:04.892649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:04.892649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:04.892649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:04.892649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:04.985463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:04.986105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:04.998899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:05.001890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:05.004285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:05.006680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:05.010926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:05.013071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:05.022698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:05.354799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:05.371844 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63ab6055-a599-4dc3-b24c-77a6aacf3124 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 0.505849 Aug 27 03:26:05.380170 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1860/3817] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:04 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:05.443805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:05.482438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:05.486406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:05.488752 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1156490e-5758-4886-b9fe-32a5d56d6a30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.507515 Aug 27 03:26:05.490295 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1958/3818] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:04 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:26:06.090743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-106857573", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "2b04f773-2696-4ad3-94c1-bcf6bb04ac97"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:06.184415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:26:06.409985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:06.410890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:06.435478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:06.441160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:06.441903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:06.442865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:06.449627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:06.451739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:06.912475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:26:06.912902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:26:06.913379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:26:06.914379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:26:06.915593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:26:06.930487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:06.932062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:06.932770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:06.933856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:06.934614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:06.935345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:06.937566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:06.952521 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24391396-4e31-40e0-842e-7fe8e8ce6020 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 0.548702 Aug 27 03:26:06.966382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1959/3819] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:06 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:06.974703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:06.975739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:06.984146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:06.985360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:06.986113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:06.988384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:06.991514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:06.992471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:07.006357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:26:07.030810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:26:07.055084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:26:07.064633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:26:07.194814 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe787b30-c44f-4851-8819-035eb38e3662 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.629972 Aug 27 03:26:07.195823 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1861/3820] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:26:07.207924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-316a1e55-ad5f-4dee-8335-37e04d5dc3c1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:07.208961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-316a1e55-ad5f-4dee-8335-37e04d5dc3c1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:07.370495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-316a1e55-ad5f-4dee-8335-37e04d5dc3c1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:07.384133 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-316a1e55-ad5f-4dee-8335-37e04d5dc3c1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1192 microversion: 2.1 time: 0.178860 Aug 27 03:26:07.385255 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1862/3821] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:07 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1192 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:07.909849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:07.936612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:07.940431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:07.943535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f7ffc72-582d-4591-915a-8de38a2d17af tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.973494 Aug 27 03:26:07.944814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1960/3822] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:06 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:07.976840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:07.978411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:08.002845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.003744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.004914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.006243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.006976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.008058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.410125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:08.411847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:08.456734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.457503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.458556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.459487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.460187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.460994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.490329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:08.510643 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5343c421-5a87-489e-9074-bc9c3f22f628 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 0.536276 Aug 27 03:26:08.511916 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1863/3823] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:07 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:08.716093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:08.720905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:08.732401 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-488933fe-234d-4b0c-9663-6a6cb34d3b69 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1196 microversion: 2.1 time: 0.330419 Aug 27 03:26:08.733033 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1961/3824] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:08 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1196 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:08.969004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:08.969661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:08.982508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.984922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.985642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:08.987208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:08.987925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:08.988621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:09.394586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-84124146-a7b9-4cc6-a13c-68cb2464603f req-de7a18b3-98df-4d5b-8bfc-42be7057da7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fd94f8-f9ca-487d-9871-e01c32001974", "name": "network-vif-plugged", "status": "completed", "tag": "97e2fccd-b654-4581-97e2-350ed0ba15dc"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:09.421810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84124146-a7b9-4cc6-a13c-68cb2464603f req-de7a18b3-98df-4d5b-8bfc-42be7057da7a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:09.429293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84124146-a7b9-4cc6-a13c-68cb2464603f req-de7a18b3-98df-4d5b-8bfc-42be7057da7a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:09.430748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84124146-a7b9-4cc6-a13c-68cb2464603f req-de7a18b3-98df-4d5b-8bfc-42be7057da7a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:09.477535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-84124146-a7b9-4cc6-a13c-68cb2464603f req-de7a18b3-98df-4d5b-8bfc-42be7057da7a service nova] Creating event network-vif-plugged:97e2fccd-b654-4581-97e2-350ed0ba15dc for instance 87fd94f8-f9ca-487d-9871-e01c32001974 on n-h1-852086-5 Aug 27 03:26:09.486414 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-84124146-a7b9-4cc6-a13c-68cb2464603f req-de7a18b3-98df-4d5b-8bfc-42be7057da7a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100772 Aug 27 03:26:09.487361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1962/3825] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:09.537025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.537747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:09.554768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:09.561308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:09.562024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:09.563924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:09.565864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:09.566914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:09.625906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:09.658288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:09.664146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:09.671395 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f2a831f-bb60-4635-9fdb-96d3e33c5078 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.706411 Aug 27 03:26:09.673720 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1864/3826] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:08 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:09.768649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:09.769971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:09.795803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:09.797087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:09.798376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:09.799745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:09.800565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:09.801172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:10.042633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:10.083017 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e76eea7-f163-4a66-b490-5a5bb936da5e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 0.549693 Aug 27 03:26:10.084530 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1963/3827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:09 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:10.274386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:10.289340 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12f3785c-331d-4f91-bdcf-a27db59dc86b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1262 microversion: 2.1 time: 0.530553 Aug 27 03:26:10.292460 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1865/3828] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:09 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1262 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:10.705877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:10.708035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:10.721393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:10.727694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:10.730301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:10.731636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:10.733653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:10.736389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:11.139428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:11.142531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:11.176251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:11.178854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:11.202047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:11.208544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:11.214203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:11.216682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:11.755163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:11.780114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a5bf246-bec6-48d4-932a-0d029ec0a276 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1312 microversion: 2.1 time: 0.652795 Aug 27 03:26:11.782489 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1866/3829] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:11 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1312 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:11.801080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:11.807312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:11.835292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:11.837750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:11.839039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:11.841246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:11.843015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:11.846203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:12.308478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:12.312679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:12.328609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:12.336775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:12.340823 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49f446b0-2d09-4b43-9adb-bc6e5565c394 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.551753 Aug 27 03:26:12.354202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1867/3830] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:11 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:12.354776 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6dd45e4c-63a1-47e9-99a9-243ee9d19ddd tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.645828 Aug 27 03:26:12.354776 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1964/3831] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:10 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:12.810636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:12.811374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:12.824827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:12.825341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:12.828644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:12.829741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:12.830252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:12.833763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.024301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-411c20cf-d2d5-4297-a564-603310582f03 req-2af844a8-e970-4e65-86e3-3e6cf82e00b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6336c272-e9fc-47d8-b2c8-5a19def0c93a", "tag": "691ff810-3d82-425f-abb7-2197323d0bbb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:13.053756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-411c20cf-d2d5-4297-a564-603310582f03 req-2af844a8-e970-4e65-86e3-3e6cf82e00b7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.054585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-411c20cf-d2d5-4297-a564-603310582f03 req-2af844a8-e970-4e65-86e3-3e6cf82e00b7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.055217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-411c20cf-d2d5-4297-a564-603310582f03 req-2af844a8-e970-4e65-86e3-3e6cf82e00b7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.072512 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-411c20cf-d2d5-4297-a564-603310582f03 req-2af844a8-e970-4e65-86e3-3e6cf82e00b7 service nova] Creating event network-changed:691ff810-3d82-425f-abb7-2197323d0bbb for instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a on n-h1-852086-5 Aug 27 03:26:13.081541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-411c20cf-d2d5-4297-a564-603310582f03 req-2af844a8-e970-4e65-86e3-3e6cf82e00b7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063769 Aug 27 03:26:13.083166 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1965/3832] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:26:13.375158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:13.377602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:13.407529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.408577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.409209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.410143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.413249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.414328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.677341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:13.698175 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77273696-f3c1-4938-a9fb-fdfc23e67383 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1496 microversion: 2.1 time: 0.890867 Aug 27 03:26:13.702326 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1868/3833] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:12 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1496 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:13.739422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:13.742268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:13.760866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.763240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.764195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.766270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.769026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.770002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.878606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:13.900898 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d53719ee-f2d6-4bd7-a404-2ec3175b0510 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.533381 Aug 27 03:26:13.915803 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1966/3834] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:13 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:13.936403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f8d94ff-ae3d-4b72-9878-3e8dd9e1410c tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:13.956787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.server_groups [None req-6f8d94ff-ae3d-4b72-9878-3e8dd9e1410c tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Querying cell c415b947-a476-436d-b81a-456a5f662c42(cell1) for 1 instances {{(pid=122407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 03:26:13.957724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f8d94ff-ae3d-4b72-9878-3e8dd9e1410c tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:13.958382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f8d94ff-ae3d-4b72-9878-3e8dd9e1410c tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:13.958970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f8d94ff-ae3d-4b72-9878-3e8dd9e1410c tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:13.984348 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f8d94ff-ae3d-4b72-9878-3e8dd9e1410c tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/7d1d5284-b878-4f79-b0d8-dbb46df1cb30" status: 200 len: 222 microversion: 2.1 time: 0.066293 Aug 27 03:26:13.985468 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1967/3835] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:26:13 2022] GET /compute/v2.1/os-server-groups/7d1d5284-b878-4f79-b0d8-dbb46df1cb30 => generated 222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:13.997361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:14.006286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:14.019281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.019281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.019281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:14.023196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.023802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.029187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:14.094929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:26:14.330246 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-97598db1-1065-4cd5-b838-28e16af430d7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 204 len: 0 microversion: 2.1 time: 0.335941 Aug 27 03:26:14.332928 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1968/3836] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:26:13 2022] DELETE /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:26:14.360405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:14.361345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:14.389354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.390062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.390384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:14.391502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.392152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.392625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:14.673418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:14.701765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:14.730841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:14.739682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79c3be1f-11af-4506-b0df-461c77022f3f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.027274 Aug 27 03:26:14.763648 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1869/3837] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:13 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:14.936675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:14.940748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:14.958622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.959766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.960548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:14.962334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:14.964105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:14.965318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:15.238686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:15.261014 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f24c946-4a43-4342-ab7f-787f91599650 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.328078 Aug 27 03:26:15.263482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1870/3838] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:14 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:15.454264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:15.474683 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-465a2095-ad55-4860-845c-8f77fa35e0cd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1502 microversion: 2.1 time: 1.130711 Aug 27 03:26:15.478988 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1969/3839] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:14 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1502 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:15.801563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:15.803854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:15.827142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:15.828369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:15.829357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:15.830854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:15.832210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:15.833164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:16.297749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:16.303876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:16.361421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:16.374904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:16.376364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:16.377458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:16.378447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:16.379112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:16.451988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:16.487205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:16.488894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:16.492302 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-488eb318-c52a-4ad3-b989-701ca1d36191 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.699692 Aug 27 03:26:16.506272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1871/3840] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:15 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:16.521809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:16.523094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:16.546592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:16.551417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:16.552232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:16.553232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:16.553918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:16.559963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:16.964699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:17.017552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:17.053677 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7fb5547b-2ca4-4e9d-9c0e-0aa949577ecb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.763466 Aug 27 03:26:17.070779 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1970/3841] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:16 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:17.241856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:17.255158 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6cc5d8c4-b5ff-4caf-8fc6-159c7f144918 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1502 microversion: 2.1 time: 0.739610 Aug 27 03:26:17.261044 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1872/3842] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:16 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1502 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:17.526933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:17.528056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:17.544175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:17.546125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:17.546898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:17.547940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:17.548680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:17.549497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:18.083590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:18.088282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:18.089203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:18.105182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:18.106532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:18.107565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:18.108591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:18.110733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:18.119198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:18.216469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:18.265815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:18.269565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:18.272887 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca16146c-532b-4bc4-bee8-c04a5860cd21 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.753407 Aug 27 03:26:18.275985 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1971/3843] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:17 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:18.296989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:18.298992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:18.316099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:18.317285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:18.321181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:18.322829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:18.326857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:18.327693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:18.825027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:18.856638 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-063f4239-3d65-4f34-af8c-000c0a7ca9d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.771150 Aug 27 03:26:18.862966 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1873/3844] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:18 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:18.879777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b1e5e492-3292-444e-b2cc-3fde0014f908 req-f427bd36-a25f-4f07-9262-c24eb9617cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fd94f8-f9ca-487d-9871-e01c32001974", "name": "network-vif-deleted", "tag": "97e2fccd-b654-4581-97e2-350ed0ba15dc"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:18.925539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1e5e492-3292-444e-b2cc-3fde0014f908 req-f427bd36-a25f-4f07-9262-c24eb9617cae service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:18.930504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1e5e492-3292-444e-b2cc-3fde0014f908 req-f427bd36-a25f-4f07-9262-c24eb9617cae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:18.931185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1e5e492-3292-444e-b2cc-3fde0014f908 req-f427bd36-a25f-4f07-9262-c24eb9617cae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:18.950694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '274949cae7be4d828c38e95d46620b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0f6ff672904c88be51f2f000aaa5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:18.973355 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee7f7602-0536-4173-bf2b-b924ddd7c8ec tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 200 len: 1460 microversion: 2.1 time: 0.686721 Aug 27 03:26:18.975101 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1972/3845] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:18 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 1460 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:18.982567 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b1e5e492-3292-444e-b2cc-3fde0014f908 req-f427bd36-a25f-4f07-9262-c24eb9617cae service nova] Creating event network-vif-deleted:97e2fccd-b654-4581-97e2-350ed0ba15dc for instance 87fd94f8-f9ca-487d-9871-e01c32001974 on n-h1-852086-5 Aug 27 03:26:19.000801 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b1e5e492-3292-444e-b2cc-3fde0014f908 req-f427bd36-a25f-4f07-9262-c24eb9617cae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135730 Aug 27 03:26:19.002322 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1874/3846] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:19.301242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:19.301854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:19.318681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.319452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.320192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.321268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.322631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.323490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.739131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:19.741314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:19.759015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.761673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.762826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.764847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.766363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.768395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.842105 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a7644275-a90a-4b73-adf6-8c3080ca93f5 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/ips" status: 200 len: 151 microversion: 2.20 time: 0.112156 Aug 27 03:26:19.844111 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1875/3847] 10.222.0.69 () {60 vars in 1289 bytes} [Sat Aug 27 03:26:19 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/ips => generated 151 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:26:19.891214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:19.893684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:19.907368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.907700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:19.909144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.910113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.911599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:19.912285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:19.912921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:19.950192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:19.957541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:19.967739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2aeeb667-304b-448e-8edf-456aef69cbf8 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.663375 Aug 27 03:26:19.972120 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1973/3848] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:19 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:20.002265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.003226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:20.010602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.013887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.015713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.016687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.019240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.020452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.060107 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] HTTP exception thrown: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Request method failure captured: Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 HTTP/1.1 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY693_xgsYmNTn5Bv3sP3NWk_YDOiPXrkbDyuIHg0xHU6T-d2pUwbwbm5iN2uu5Bs7cnwg_27sTBs7ymLf7AEOMOoA23glN5NaQSOT_1G9tXghcBsamclG0qyUVQFTu5Q1h7w3mckKTuUe-dGL64cetKYa0h2B97QwbogknewzklOKs Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b0f6ff672904c88be51f2f000aaa5c8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}] Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 274949cae7be4d828c38e95d46620b6b Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '87fd94f8-f9ca-487d-9871-e01c32001974'} Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.061795 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Returning 404 to user: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b831a9b6-cf5b-4e17-98a1-ad8041e0ac59 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 404 len: 111 microversion: 2.1 time: 0.069547 Aug 27 03:26:20.068430 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1974/3849] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:19 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:26:20.080409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-609b5d56-a447-44ed-8376-a19a1615d1da tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.111681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.server_groups [None req-609b5d56-a447-44ed-8376-a19a1615d1da tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Querying cell c415b947-a476-436d-b81a-456a5f662c42(cell1) for 1 instances {{(pid=122407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 03:26:20.112387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609b5d56-a447-44ed-8376-a19a1615d1da tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.114007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609b5d56-a447-44ed-8376-a19a1615d1da tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.115396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609b5d56-a447-44ed-8376-a19a1615d1da tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.130895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-609b5d56-a447-44ed-8376-a19a1615d1da tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.055461 Aug 27 03:26:20.132005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1975/3850] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:26:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:20.146798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5deba026-2573-4725-b555-700e52494e02 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.166244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.server_groups [None req-5deba026-2573-4725-b555-700e52494e02 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Querying cell c415b947-a476-436d-b81a-456a5f662c42(cell1) for 1 instances {{(pid=122407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 03:26:20.168489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5deba026-2573-4725-b555-700e52494e02 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.169220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5deba026-2573-4725-b555-700e52494e02 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.171046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5deba026-2573-4725-b555-700e52494e02 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.211919 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5deba026-2573-4725-b555-700e52494e02 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/os-server-groups/7d1d5284-b878-4f79-b0d8-dbb46df1cb30" status: 200 len: 184 microversion: 2.1 time: 0.066929 Aug 27 03:26:20.213423 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1976/3851] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:26:20 2022] GET /compute/v2.1/os-server-groups/7d1d5284-b878-4f79-b0d8-dbb46df1cb30 => generated 184 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:20.221898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:20.225708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.231758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:20.236314 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b51bddb-59f1-49ea-95e9-d15600280b2c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.354364 Aug 27 03:26:20.243974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.252208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.252938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.253858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.254493 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1876/3852] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:19 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:20.254677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.255256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.285827 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] HTTP exception thrown: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Request method failure captured: Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 HTTP/1.1 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY693_xgsYmNTn5Bv3sP3NWk_YDOiPXrkbDyuIHg0xHU6T-d2pUwbwbm5iN2uu5Bs7cnwg_27sTBs7ymLf7AEOMOoA23glN5NaQSOT_1G9tXghcBsamclG0qyUVQFTu5Q1h7w3mckKTuUe-dGL64cetKYa0h2B97QwbogknewzklOKs Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b0f6ff672904c88be51f2f000aaa5c8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}] Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 274949cae7be4d828c38e95d46620b6b Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '87fd94f8-f9ca-487d-9871-e01c32001974'} Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:26:20.288234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.297067 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.300917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Returning 404 to user: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:20.302125 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-74ea6aae-0e51-49df-b21c-4b8bf9114048 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 404 len: 111 microversion: 2.1 time: 0.080672 Aug 27 03:26:20.303499 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1977/3853] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:26:20 2022] DELETE /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:26:20.314447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.315442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] [instance: 87fd94f8-f9ca-487d-9871-e01c32001974] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:20.325530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.326466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.327153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.329132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:20.330665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:20.332116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:20.366031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:20.367656 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] HTTP exception thrown: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Request method failure captured: Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 HTTP/1.1 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY693_xgsYmNTn5Bv3sP3NWk_YDOiPXrkbDyuIHg0xHU6T-d2pUwbwbm5iN2uu5Bs7cnwg_27sTBs7ymLf7AEOMOoA23glN5NaQSOT_1G9tXghcBsamclG0qyUVQFTu5Q1h7w3mckKTuUe-dGL64cetKYa0h2B97QwbogknewzklOKs Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b0f6ff672904c88be51f2f000aaa5c8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}] Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 274949cae7be4d828c38e95d46620b6b Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '87fd94f8-f9ca-487d-9871-e01c32001974'} Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.370450 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Returning 404 to user: Instance 87fd94f8-f9ca-487d-9871-e01c32001974 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b284460-a0ca-49b0-9327-482f0fd228bd tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974" status: 404 len: 111 microversion: 2.1 time: 0.065625 Aug 27 03:26:20.379194 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1877/3854] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:20 2022] GET /compute/v2.1/servers/87fd94f8-f9ca-487d-9871-e01c32001974 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:26:20.387146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00d3dcb4-84c3-4621-8f1c-18676f32069e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.401959 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-00d3dcb4-84c3-4621-8f1c-18676f32069e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] HTTP exception thrown: Instance group 6ee0de4b-0575-432b-819a-5c20dc9c493b could not be found. Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00d3dcb4-84c3-4621-8f1c-18676f32069e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Request method failure captured: Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-server-groups/6ee0de4b-0575-432b-819a-5c20dc9c493b HTTP/1.1 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY693_xgsYmNTn5Bv3sP3NWk_YDOiPXrkbDyuIHg0xHU6T-d2pUwbwbm5iN2uu5Bs7cnwg_27sTBs7ymLf7AEOMOoA23glN5NaQSOT_1G9tXghcBsamclG0qyUVQFTu5Q1h7w3mckKTuUe-dGL64cetKYa0h2B97QwbogknewzklOKs Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b0f6ff672904c88be51f2f000aaa5c8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}] Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 274949cae7be4d828c38e95d46620b6b Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance group 6ee0de4b-0575-432b-819a-5c20dc9c493b could not be found. Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6ee0de4b-0575-432b-819a-5c20dc9c493b'} Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6ee0de4b-0575-432b-819a-5c20dc9c493b could not be found. Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6ee0de4b-0575-432b-819a-5c20dc9c493b could not be found. Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.404264 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6ee0de4b-0575-432b-819a-5c20dc9c493b could not be found. Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00d3dcb4-84c3-4621-8f1c-18676f32069e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Returning 404 to user: Instance group 6ee0de4b-0575-432b-819a-5c20dc9c493b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00d3dcb4-84c3-4621-8f1c-18676f32069e tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/6ee0de4b-0575-432b-819a-5c20dc9c493b" status: 404 len: 117 microversion: 2.1 time: 0.026320 Aug 27 03:26:20.412074 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1978/3855] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:26:20 2022] DELETE /compute/v2.1/os-server-groups/6ee0de4b-0575-432b-819a-5c20dc9c493b => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:26:20.427916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc120f2-9286-47a1-acb1-4ff32fc06989 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.465413 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2bc120f2-9286-47a1-acb1-4ff32fc06989 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] HTTP exception thrown: Instance group 903913a4-7f72-4d56-a17f-51c58746f441 could not be found. Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc120f2-9286-47a1-acb1-4ff32fc06989 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Request method failure captured: Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-server-groups/903913a4-7f72-4d56-a17f-51c58746f441 HTTP/1.1 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY693_xgsYmNTn5Bv3sP3NWk_YDOiPXrkbDyuIHg0xHU6T-d2pUwbwbm5iN2uu5Bs7cnwg_27sTBs7ymLf7AEOMOoA23glN5NaQSOT_1G9tXghcBsamclG0qyUVQFTu5Q1h7w3mckKTuUe-dGL64cetKYa0h2B97QwbogknewzklOKs Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b0f6ff672904c88be51f2f000aaa5c8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}] Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 274949cae7be4d828c38e95d46620b6b Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance group 903913a4-7f72-4d56-a17f-51c58746f441 could not be found. Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '903913a4-7f72-4d56-a17f-51c58746f441'} Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 903913a4-7f72-4d56-a17f-51c58746f441 could not be found. Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 903913a4-7f72-4d56-a17f-51c58746f441 could not be found. Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.485817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 903913a4-7f72-4d56-a17f-51c58746f441 could not be found. Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc120f2-9286-47a1-acb1-4ff32fc06989 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Returning 404 to user: Instance group 903913a4-7f72-4d56-a17f-51c58746f441 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:20.491843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bc120f2-9286-47a1-acb1-4ff32fc06989 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/903913a4-7f72-4d56-a17f-51c58746f441" status: 404 len: 117 microversion: 2.1 time: 0.075868 Aug 27 03:26:20.500019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c00ddfe1-04d3-4333-99a6-1cf0aa06049f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.506782 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1878/3856] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:26:20 2022] DELETE /compute/v2.1/os-server-groups/903913a4-7f72-4d56-a17f-51c58746f441 => generated 117 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:26:20.517358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c00ddfe1-04d3-4333-99a6-1cf0aa06049f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] HTTP exception thrown: Instance group 11c48a68-69b7-416c-88d7-33752571661b could not be found. Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c00ddfe1-04d3-4333-99a6-1cf0aa06049f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Request method failure captured: Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-server-groups/11c48a68-69b7-416c-88d7-33752571661b HTTP/1.1 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY693_xgsYmNTn5Bv3sP3NWk_YDOiPXrkbDyuIHg0xHU6T-d2pUwbwbm5iN2uu5Bs7cnwg_27sTBs7ymLf7AEOMOoA23glN5NaQSOT_1G9tXghcBsamclG0qyUVQFTu5Q1h7w3mckKTuUe-dGL64cetKYa0h2B97QwbogknewzklOKs Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b0f6ff672904c88be51f2f000aaa5c8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}] Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 274949cae7be4d828c38e95d46620b6b Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance group 11c48a68-69b7-416c-88d7-33752571661b could not be found. Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '11c48a68-69b7-416c-88d7-33752571661b'} Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 11c48a68-69b7-416c-88d7-33752571661b could not be found. Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 11c48a68-69b7-416c-88d7-33752571661b could not be found. Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.523680 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.529173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.529173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.529173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:20.529173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:20.529173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 11c48a68-69b7-416c-88d7-33752571661b could not be found. Aug 27 03:26:20.529173 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.531732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c00ddfe1-04d3-4333-99a6-1cf0aa06049f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Returning 404 to user: Instance group 11c48a68-69b7-416c-88d7-33752571661b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:20.539194 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c00ddfe1-04d3-4333-99a6-1cf0aa06049f tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/11c48a68-69b7-416c-88d7-33752571661b" status: 404 len: 117 microversion: 2.1 time: 0.041142 Aug 27 03:26:20.543855 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1979/3857] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:26:20 2022] DELETE /compute/v2.1/os-server-groups/11c48a68-69b7-416c-88d7-33752571661b => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:26:20.553283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78cfb9e9-ed57-4c9f-bcc1-b08048e414a7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.594549 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-78cfb9e9-ed57-4c9f-bcc1-b08048e414a7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] HTTP exception thrown: Instance group 5d4a672e-b3ea-4884-8f4c-e70488c06ea2 could not be found. Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78cfb9e9-ed57-4c9f-bcc1-b08048e414a7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Request method failure captured: Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-server-groups/5d4a672e-b3ea-4884-8f4c-e70488c06ea2 HTTP/1.1 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY693_xgsYmNTn5Bv3sP3NWk_YDOiPXrkbDyuIHg0xHU6T-d2pUwbwbm5iN2uu5Bs7cnwg_27sTBs7ymLf7AEOMOoA23glN5NaQSOT_1G9tXghcBsamclG0qyUVQFTu5Q1h7w3mckKTuUe-dGL64cetKYa0h2B97QwbogknewzklOKs Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b0f6ff672904c88be51f2f000aaa5c8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b0f6ff672904c88be51f2f000aaa5c8"}]}] Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8b0f6ff672904c88be51f2f000aaa5c8 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerGroupTestJSON-668018265 Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 274949cae7be4d828c38e95d46620b6b Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerGroupTestJSON-668018265-project Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance group 5d4a672e-b3ea-4884-8f4c-e70488c06ea2 could not be found. Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '5d4a672e-b3ea-4884-8f4c-e70488c06ea2'} Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5d4a672e-b3ea-4884-8f4c-e70488c06ea2 could not be found. Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5d4a672e-b3ea-4884-8f4c-e70488c06ea2 could not be found. Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.601223 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5d4a672e-b3ea-4884-8f4c-e70488c06ea2 could not be found. Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78cfb9e9-ed57-4c9f-bcc1-b08048e414a7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Returning 404 to user: Instance group 5d4a672e-b3ea-4884-8f4c-e70488c06ea2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:20.609402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78cfb9e9-ed57-4c9f-bcc1-b08048e414a7 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/5d4a672e-b3ea-4884-8f4c-e70488c06ea2" status: 404 len: 117 microversion: 2.1 time: 0.057120 Aug 27 03:26:20.616961 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1879/3858] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:26:20 2022] DELETE /compute/v2.1/os-server-groups/5d4a672e-b3ea-4884-8f4c-e70488c06ea2 => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:26:20.623914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1d8f6dfa-b2e1-474f-9429-338712d67635 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:20.710043 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1d8f6dfa-b2e1-474f-9429-338712d67635 tempest-ServerGroupTestJSON-668018265 tempest-ServerGroupTestJSON-668018265-project] 10.222.0.69 "DELETE /compute/v2.1/os-server-groups/7d1d5284-b878-4f79-b0d8-dbb46df1cb30" status: 204 len: 0 microversion: 2.1 time: 0.090644 Aug 27 03:26:20.711719 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1980/3859] 10.222.0.69 () {58 vars in 1266 bytes} [Sat Aug 27 03:26:20 2022] DELETE /compute/v2.1/os-server-groups/7d1d5284-b878-4f79-b0d8-dbb46df1cb30 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:26:21.000573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:21.001375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:21.018454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.020558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.022745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.023649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.025611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.028529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.182048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:21.183471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:21.191214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.192304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.193258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.194298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.195141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.195820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.669151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:21.690770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:21.693543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:21.697685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:21.703328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-609bdf8d-5611-4245-a21d-a101773d0684 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.706059 Aug 27 03:26:21.704413 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1880/3860] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:20 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:21.728580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:21.738357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:21.738989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:21.739610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:21.746955 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4cbc88d-9c06-401a-8bb2-920f2fa90d93 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2956 microversion: 2.42 time: 0.570328 Aug 27 03:26:21.751261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.752154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.752906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.753873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.754572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.755245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.756333 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1981/3861] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:21 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2956 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:21.828104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:21.829019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:21.865395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.870868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.872029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:21.873132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:21.874324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:21.875309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:22.132805 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6016c48-e605-42cc-9525-1be309e22bac tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.339351 Aug 27 03:26:22.135045 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1982/3862] 10.222.0.69 () {60 vars in 1316 bytes} [Sat Aug 27 03:26:21 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8/os-interface => generated 1830 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:22.244298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:22.272945 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-680c09f9-72a4-4d74-809e-3d0ec2ab9e74 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.542203 Aug 27 03:26:22.276356 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1881/3863] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:21 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:22.739993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:22.741047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:22.760749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:22.761126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:22.762254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:22.764360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:22.767530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:22.768684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:23.317691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:23.323839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:23.358877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:23.363848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:23.372750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:23.374910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:23.376826 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7184ae13-2d1a-4330-ad3a-737f1fcb6217 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.644751 Aug 27 03:26:23.377562 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1983/3864] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:22 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:23.383000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:23.391072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:23.392956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:23.395126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:23.396933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:23.681432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-791416149", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "3879a38f-3638-4b9e-b9bc-afad4f94e87d"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:23.759229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] validate_networks() for [('3879a38f-3638-4b9e-b9bc-afad4f94e87d', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:26:24.059579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:24.077934 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-524ad3a3-be79-4aed-9743-7f3be2dd6dbb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.770411 Aug 27 03:26:24.091741 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1882/3865] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:23 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:24.301776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:24.302683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:24.314765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:24.353832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:24.356516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:24.360119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:24.361444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:24.379168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:24.383607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:24.521426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lazy-loading 'flavor' on Instance uuid 50ae66e7-4995-4f43-8509-afcb80b64503 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:26:24.733027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:26:24.735584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:26:24.737034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:26:24.738124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:26:24.739329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:26:24.823580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:24.827979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:24.831355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:24.833270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:24.840436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:24.841632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:24.973299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Getting quotas for project 50d8763898d6436ba136b2a31e2d4e5a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:26:25.010797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Getting quotas for user f38b3ce448da4737a1ef194308759759 and project 50d8763898d6436ba136b2a31e2d4e5a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:26:25.104832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:26:25.109610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:26:25.158192 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12f2ea39-1850-4e57-a8e4-01fcc3da7d0e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/action" status: 202 len: 0 microversion: 2.20 time: 0.864527 Aug 27 03:26:25.162891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1883/3866] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:26:24 2022] POST /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/action => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:26:25.181528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:25.185246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:25.207181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:25.213108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:25.213108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:25.213108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:25.216368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:25.220337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:25.394320 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ccc26bc-5536-4120-84af-496225718ae7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.004170 Aug 27 03:26:25.398254 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1984/3867] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:26:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:26:25.413364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-a105f44d-ffde-41a1-882e-0906880d9686 req-55dea60d-58e4-44d2-bc18-c4432c3f975c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6336c272-e9fc-47d8-b2c8-5a19def0c93a", "name": "network-vif-plugged", "status": "completed", "tag": "691ff810-3d82-425f-abb7-2197323d0bbb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:25.442713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a105f44d-ffde-41a1-882e-0906880d9686 req-55dea60d-58e4-44d2-bc18-c4432c3f975c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:25.443706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a105f44d-ffde-41a1-882e-0906880d9686 req-55dea60d-58e4-44d2-bc18-c4432c3f975c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:25.444675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a105f44d-ffde-41a1-882e-0906880d9686 req-55dea60d-58e4-44d2-bc18-c4432c3f975c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:25.471451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:25.474790 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-a105f44d-ffde-41a1-882e-0906880d9686 req-55dea60d-58e4-44d2-bc18-c4432c3f975c service nova] Creating event network-vif-plugged:691ff810-3d82-425f-abb7-2197323d0bbb for instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a on n-h1-852086-5 Aug 27 03:26:25.485048 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-a105f44d-ffde-41a1-882e-0906880d9686 req-55dea60d-58e4-44d2-bc18-c4432c3f975c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084339 Aug 27 03:26:25.486769 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1985/3868] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:25.496213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:25.497425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:25.516247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:25.517172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:25.517910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:25.518966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:25.557247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:25.558051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:26.308571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.341083 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf69ba59-e12a-4dd8-bd38-be706fca4269 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.852002 Aug 27 03:26:26.362245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1986/3869] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:25 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:26.376624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:26.380574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:26.433922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:26.437661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:26.438794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:26.443232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:26.444836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:26.445947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:26.449147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:26.526202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.556535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.566062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.567991 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83283cf0-0726-4b5c-b369-24cf751a6d44 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.402833 Aug 27 03:26:26.575931 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1884/3870] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:25 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:26.581315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c184e424-4e0f-4e32-9cd7-60a8c77399ad tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:26.581938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c184e424-4e0f-4e32-9cd7-60a8c77399ad tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:26.787173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c184e424-4e0f-4e32-9cd7-60a8c77399ad tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.802752 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c184e424-4e0f-4e32-9cd7-60a8c77399ad tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1216 microversion: 2.1 time: 0.225636 Aug 27 03:26:26.822197 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1885/3871] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:26 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:26.940791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.960487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.976132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:26.981088 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-804aeb9f-0a90-4ccf-a433-8491c455e501 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 0.617566 Aug 27 03:26:26.985208 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1987/3872] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:26 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:27.375554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:27.376251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:27.392106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:27.392611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:27.397596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:27.398505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:27.399009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:27.405356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:27.597792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:27.601490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:27.626405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:27.628802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:27.636123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:27.637312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:27.637941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:27.642477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:28.005208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:28.017383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7bad20ec-612e-4fd9-9019-0d114b2f2cdb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1292 microversion: 2.1 time: 0.647477 Aug 27 03:26:28.022800 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1886/3873] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:27 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1292 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:28.028231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:28.042465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:28.064173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:28.064616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:28.065060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:28.065781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:28.066287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:28.066807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:28.308938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:28.323492 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cbe76351-afb4-4a2a-a341-74958d12cb57 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1268 microversion: 2.1 time: 0.299258 Aug 27 03:26:28.327621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1887/3874] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:28 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1268 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:28.336328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:28.339897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:28.357854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:28.358610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:28.359244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:28.360145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:28.360802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:28.362579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:28.406996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:28.444390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:28.448644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:28.454510 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-80948964-be25-44ec-b9b9-09056e063eec tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.863779 Aug 27 03:26:28.455365 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1988/3875] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:27 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:29.045574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:29.046289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:29.060317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:29.060816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:29.061264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:29.061991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:29.062730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:29.063312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:29.405444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:29.438576 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-783e650e-3276-40f4-a82d-3e50ebb05db0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1473 microversion: 2.1 time: 0.399025 Aug 27 03:26:29.456100 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1989/3876] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:29 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:29.498471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:29.499462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:29.509317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:29.510736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:29.511729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:29.512988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:29.513909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:29.514800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:29.716869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:29.753801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:29.757027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:29.759258 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da55caf4-4153-4900-950e-51e452ec3a35 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 1.426669 Aug 27 03:26:29.760120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:29.760610 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1888/3877] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:28 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:29.770842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:29.773435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:29.788375 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc5f4424-d196-476d-9ffa-7adb8d3bb793 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1274 microversion: 2.1 time: 0.327026 Aug 27 03:26:29.789838 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1990/3878] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:29 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1274 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:29.815332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-944368386", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:29.820095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:29.834934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:29.839263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:29.841882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:29.843206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:29.845139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:29.961475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:26:30.555678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:26:30.557563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:26:30.558405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:26:30.559045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:26:30.560126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:26:30.578277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.579098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.579610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.580451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.581380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.581894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.605379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:26:30.620713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:26:30.639199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:26:30.641875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 4c31b7aa-13c4-466a-9f35-c40b2d977934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:26:30.698981 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-afec974e-eef4-4d6e-bd1d-6923dd33387e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888283 Aug 27 03:26:30.700380 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1991/3879] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:26:30.714873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e0e43a90-d8cd-4250-aec8-823b93fe89b2 req-566b23be-ea95-427a-bdfd-adc1eff74164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-plugged", "status": "completed", "tag": "ae27ab8a-5ee1-4b13-ba45-faab9b193597"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:30.733577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0e43a90-d8cd-4250-aec8-823b93fe89b2 req-566b23be-ea95-427a-bdfd-adc1eff74164 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.734073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0e43a90-d8cd-4250-aec8-823b93fe89b2 req-566b23be-ea95-427a-bdfd-adc1eff74164 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.734588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0e43a90-d8cd-4250-aec8-823b93fe89b2 req-566b23be-ea95-427a-bdfd-adc1eff74164 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.756447 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e0e43a90-d8cd-4250-aec8-823b93fe89b2 req-566b23be-ea95-427a-bdfd-adc1eff74164 service nova] Creating event network-vif-plugged:ae27ab8a-5ee1-4b13-ba45-faab9b193597 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:30.764114 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e0e43a90-d8cd-4250-aec8-823b93fe89b2 req-566b23be-ea95-427a-bdfd-adc1eff74164 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061877 Aug 27 03:26:30.765183 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1992/3880] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:30.772688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1edde920-b34b-4ec9-9dca-37dd14e32b87 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:30.775064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1edde920-b34b-4ec9-9dca-37dd14e32b87 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 4c31b7aa-13c4-466a-9f35-c40b2d977934] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:30.784203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:30.807686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:30.813023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1edde920-b34b-4ec9-9dca-37dd14e32b87 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 4c31b7aa-13c4-466a-9f35-c40b2d977934] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:26:30.815184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:30.817936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42835945-ec22-4419-9f4b-4f9f257997ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.054416 Aug 27 03:26:30.821854 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1889/3881] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:29 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:30.833628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:30.836032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:30.856365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.857111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.857815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.861608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:30.862502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:30.863094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:30.984840 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1edde920-b34b-4ec9-9dca-37dd14e32b87 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934" status: 204 len: 0 microversion: 2.1 time: 0.218277 Aug 27 03:26:30.989572 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1993/3882] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:26:30 2022] DELETE /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:26:30.995619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:30.996251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:31.006007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.006622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.007021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.007829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.008293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.009291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.111511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:31.123927 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d0f150f-2bde-4213-8349-27163e76d7c6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1274 microversion: 2.1 time: 0.133227 Aug 27 03:26:31.124976 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1994/3883] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:30 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:31.130547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-300f9da8-30cb-40cb-8806-472d13a6cb64 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:31.131452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-300f9da8-30cb-40cb-8806-472d13a6cb64 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 4c31b7aa-13c4-466a-9f35-c40b2d977934] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:31.156592 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-300f9da8-30cb-40cb-8806-472d13a6cb64 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-300f9da8-30cb-40cb-8806-472d13a6cb64 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934 HTTP/1.1 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4c31b7aa-13c4-466a-9f35-c40b2d977934'} Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:31.174934 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:26:31.182365 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:26:31.192033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-300f9da8-30cb-40cb-8806-472d13a6cb64 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:26:31.195140 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-300f9da8-30cb-40cb-8806-472d13a6cb64 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934" status: 404 len: 111 microversion: 2.1 time: 0.068053 Aug 27 03:26:31.197118 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1995/3884] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:31 2022] GET /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:26:31.290035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:31.297919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:31.335929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.341364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.346843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.349654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.350582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.358891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.603758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:31.614887 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0873a96-c63b-4c21-bdd3-4c415bf4e323 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.333602 Aug 27 03:26:31.616067 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1996/3885] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:31 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:31.623932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-710050266", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "2b04f773-2696-4ad3-94c1-bcf6bb04ac97"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:31.730153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:26:31.791472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:31.815894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:31.821641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:31.825833 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4d4c00b-25db-477a-9e5c-7027ba0027a0 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 1.001510 Aug 27 03:26:31.827881 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1890/3886] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:30 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:31.845849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:31.847054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:31.862465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.864392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.865448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:31.868139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:31.870052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:31.871078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:32.883557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:26:32.885343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:26:32.886528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:26:32.887500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:26:32.889269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:26:32.932142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:32.933054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:32.934952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:32.936513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:32.937445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:32.938044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:32.962897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:32.986573 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cce444b0-8dea-4677-bd53-6feba3b703f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 1.155942 Aug 27 03:26:32.987562 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1891/3887] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:31 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:33.002353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:26:33.008186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:26:33.011778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:33.012639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:33.020123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:33.020851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:33.021482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:33.022408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:33.023052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:33.023641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:33.036853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:26:33.042966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:26:33.139843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-695f98c3-95d3-4e3f-82a6-ebb04a8e9d3f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522083 Aug 27 03:26:33.143896 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1997/3888] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:26:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:26:33.166277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:33.168645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:33.191619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:33.192386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:33.193016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:33.194246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:33.195144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:33.196123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.083740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.093866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c4299d8b-02af-4fe1-bdf8-83c8066eb5a0 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 0.946294 Aug 27 03:26:34.094676 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1998/3889] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:33 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:34.099987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:34.100865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:34.112447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:34.113377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:34.113895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.114751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:34.115281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:34.115788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.144855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.174346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.178709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.187845 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c882ddbc-3462-45b7-8772-015fbfdc3333 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.182482 Aug 27 03:26:34.192293 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1892/3890] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:33 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:34.200320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:34.201476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:34.221581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:34.224149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:34.224999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.228771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:34.231282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:34.232251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.392025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.408382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.412526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.413914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-23319d9b-e0ba-4398-8b10-6e634b548911 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 0.318115 Aug 27 03:26:34.417959 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 1999/3891] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:34 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:34.426357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:34.427455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:34.438821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:34.439650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:34.440296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.441222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:34.441890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:34.442693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:34.535193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:34.546050 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-264e73a3-6c90-4fb0-88c9-118442f587e8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1272 microversion: 2.1 time: 0.126396 Aug 27 03:26:34.547809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2000/3892] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:34 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:34.987320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:35.001944 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24a9004e-46a8-4da2-9de5-88d61b729f71 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.808374 Aug 27 03:26:35.009707 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1893/3893] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:34 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:35.039162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1504771154"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:35.042921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:35.066097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.069720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.070558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.071534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.079282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.080392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.121603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:35.125613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:35.145588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.146664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.147106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.148671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.149162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.150796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.577061 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6d0edd4-a835-4a12-b01d-ac993450e062 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.542140 Aug 27 03:26:35.578252 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2001/3894] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:26:35 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 03:26:35.585301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:35.586017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:35.596945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.597508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.597965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:35.599004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:35.599483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:35.599919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:36.039282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.057285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.058553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.060246 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81726011-c90f-4790-aa8a-289fd0ea5c69 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.480370 Aug 27 03:26:36.061291 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2002/3895] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:35 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:36.068118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:36.068118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:36.090909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:36.096700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:36.097672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:36.098738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:36.099465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:36.100106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:36.236401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.247866 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4769e06-bbff-4cb1-b0d9-f065d99dd0d7 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 1.134825 Aug 27 03:26:36.263348 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1894/3896] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:35 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:36.269578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:36.270810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:36.279100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:36.280328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:36.281033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:36.282284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:36.283541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:36.284209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:36.319494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:36.429734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.471277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.475005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.481420 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b99da990-2fa5-4d74-817e-40130f819c09 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 0.415238 Aug 27 03:26:36.482571 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2003/3897] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:36 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:36.601260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:36.615581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-96b7ae54-24da-481b-9372-a35330b95c43 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1278 microversion: 2.1 time: 0.350514 Aug 27 03:26:36.616680 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1895/3898] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:36 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:37.099589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:37.100859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:37.112593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.113447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.114610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.115549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.116242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.116889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.280039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:37.286007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:37.303989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:37.309450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.313409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.314082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.318734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.319238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.319686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.512513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:37.550642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:37.556284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:37.559923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab1321b1-c043-47f2-bf62-3e708e93a621 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.466474 Aug 27 03:26:37.561639 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2004/3899] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:37 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:37.573533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c167e0a8-d052-4436-9bf5-4235c190f585 req-39db2e8f-8938-4356-bd68-afe1ddadf76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-plugged", "status": "completed", "tag": "7c4f392d-0ced-41e9-b62c-450fb4af76a2"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:37.593629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c167e0a8-d052-4436-9bf5-4235c190f585 req-39db2e8f-8938-4356-bd68-afe1ddadf76d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.594836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c167e0a8-d052-4436-9bf5-4235c190f585 req-39db2e8f-8938-4356-bd68-afe1ddadf76d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.595888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c167e0a8-d052-4436-9bf5-4235c190f585 req-39db2e8f-8938-4356-bd68-afe1ddadf76d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.604454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:37.628855 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c167e0a8-d052-4436-9bf5-4235c190f585 req-39db2e8f-8938-4356-bd68-afe1ddadf76d service nova] Creating event network-vif-plugged:7c4f392d-0ced-41e9-b62c-450fb4af76a2 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:37.643043 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c167e0a8-d052-4436-9bf5-4235c190f585 req-39db2e8f-8938-4356-bd68-afe1ddadf76d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077880 Aug 27 03:26:37.645196 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2005/3900] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:37.656795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:37.658391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:37.673534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.675198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.676521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.678123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:37.679278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:37.680317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:37.995313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:38.022776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:38.027665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:38.030349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3d6ed0a3-4e33-4270-8607-8a8679f54cc2 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 0.382858 Aug 27 03:26:38.059037 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2006/3901] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:37 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:38.080690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:38.081912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:38.106040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:38.112012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:38.113584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:38.115201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:38.116343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:38.119536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:38.261287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:38.274926 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b3911da-6c85-4298-ade1-b743f9628c4f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1278 microversion: 2.1 time: 0.213232 Aug 27 03:26:38.275872 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2007/3902] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:38 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:38.595137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:38.601038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:38.629803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:38.632129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:38.633295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:38.635349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:38.636645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:38.637505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:38.734142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:38.752250 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc72b803-51d8-436e-92a0-227f15d1c346 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 1.480238 Aug 27 03:26:38.771798 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1896/3903] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:37 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:39.007435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0f146558-abe0-4b9b-97db-db844d3c7567 req-d54004cd-976d-4a93-b9cd-7552e30e0cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b209b62-78b4-44c2-9491-871f5f78a1cb", "tag": "d2626c74-84ff-4cbd-a187-eccc9617cc59"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:39.037260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0f146558-abe0-4b9b-97db-db844d3c7567 req-d54004cd-976d-4a93-b9cd-7552e30e0cb3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.037859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0f146558-abe0-4b9b-97db-db844d3c7567 req-d54004cd-976d-4a93-b9cd-7552e30e0cb3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.039599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0f146558-abe0-4b9b-97db-db844d3c7567 req-d54004cd-976d-4a93-b9cd-7552e30e0cb3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.064428 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0f146558-abe0-4b9b-97db-db844d3c7567 req-d54004cd-976d-4a93-b9cd-7552e30e0cb3 service nova] Creating event network-changed:d2626c74-84ff-4cbd-a187-eccc9617cc59 for instance 1b209b62-78b4-44c2-9491-871f5f78a1cb on n-h1-852086-5 Aug 27 03:26:39.078595 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0f146558-abe0-4b9b-97db-db844d3c7567 req-d54004cd-976d-4a93-b9cd-7552e30e0cb3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079309 Aug 27 03:26:39.080209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1897/3904] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:39.095369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:39.098703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:39.109793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.111017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.112137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.113201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.114133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.117677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.342119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:39.374791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:39.378539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:39.380429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a3709ac6-8c2c-4a75-b9c0-351a6b3b76a0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.800231 Aug 27 03:26:39.382055 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2008/3905] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:38 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:26:39.388910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:39.389532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:39.397852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.398404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.398843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.401270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.401417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.401906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.537131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:39.561492 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-299993d1-3199-4839-b95d-2953ed3acb00 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1278 microversion: 2.1 time: 0.178092 Aug 27 03:26:39.565898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2009/3906] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:39 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:39.724334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-plugged", "status": "completed", "tag": "5a0b4c7a-a135-4d68-b8d3-a8cd69119f06"}, {"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-plugged", "status": "completed", "tag": "1a261b78-b479-41f5-80c0-d31949515c7f"}, {"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-plugged", "status": "completed", "tag": "d78d7323-5afa-431c-9cd9-c6983436a16d"}, {"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-plugged", "status": "completed", "tag": "aefcec6d-0a13-4988-8127-fb6b417065d8"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:39.748763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.749713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.750353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.766728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Creating event network-vif-plugged:5a0b4c7a-a135-4d68-b8d3-a8cd69119f06 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:39.767674 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Creating event network-vif-plugged:1a261b78-b479-41f5-80c0-d31949515c7f for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:39.769778 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Creating event network-vif-plugged:d78d7323-5afa-431c-9cd9-c6983436a16d for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:39.770529 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] Creating event network-vif-plugged:aefcec6d-0a13-4988-8127-fb6b417065d8 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:39.786286 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d677702f-94ba-47d8-84e8-3f74c99cce0b req-69ee55f8-e132-44f7-85f4-97af7367e3a9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.065689 Aug 27 03:26:39.787894 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2010/3907] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:39.795501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:39.796554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:39.806403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.807094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.807735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.808621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:39.809224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:39.809998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:39.871391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:39.922647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:39.924783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:39.926152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3af0b5b-da09-4781-aff3-49ce44999b56 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 0.844506 Aug 27 03:26:39.927169 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1898/3908] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:39 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:40.221999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:40.237008 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f3178d93-f896-400a-b171-e91f76dda4a6 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 0.447543 Aug 27 03:26:40.237781 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2011/3909] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:39 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:40.407594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:40.408304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:40.419868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:40.423890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:40.425400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:40.426704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:40.431827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:40.432672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:40.608101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:40.608710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:40.624020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:40.624932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:40.626864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:40.628983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:40.630939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:40.631637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:41.530549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:41.546941 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc3a897a-dfe6-4c52-af5b-acc34472f976 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.944824 Aug 27 03:26:41.554105 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2012/3910] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:40 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:41.572113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:41.573127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:41.595412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:41.596246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:41.598595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:41.599895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:41.603987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:41.605324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:42.020978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:42.035200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:42.044653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:42.055230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-570a41cc-9fbf-4c61-ae22-710f8bcf7bc3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1743 microversion: 2.20 time: 0.498013 Aug 27 03:26:42.057543 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2013/3911] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:41 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1743 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:42.068277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:42.071185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:42.080390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:42.083226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:42.084777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:42.086064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:42.088367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:42.089092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:42.089702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:42.330796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:42.355386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:42.365652 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ed90c6b-6081-4bad-bef5-9b33007dd7e9 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 0.305912 Aug 27 03:26:42.369465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:42.371554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:42.375789 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-420289bf-d8bc-4cd5-98af-05b0cf60977f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 1.973772 Aug 27 03:26:42.376187 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2014/3912] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:42 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:42.380177 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1899/3913] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:40 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:42.403916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c7531f5f-38b9-4e63-9988-ee9c798b32c9 req-38eeb86f-c9ab-445b-b74b-9aa8a359acba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-plugged", "status": "completed", "tag": "74829acf-8c1f-4b9d-9058-e4429ee36c60"}, {"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-plugged", "status": "completed", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:42.429793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7531f5f-38b9-4e63-9988-ee9c798b32c9 req-38eeb86f-c9ab-445b-b74b-9aa8a359acba service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:42.432433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7531f5f-38b9-4e63-9988-ee9c798b32c9 req-38eeb86f-c9ab-445b-b74b-9aa8a359acba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:42.437734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c7531f5f-38b9-4e63-9988-ee9c798b32c9 req-38eeb86f-c9ab-445b-b74b-9aa8a359acba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:42.481243 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c7531f5f-38b9-4e63-9988-ee9c798b32c9 req-38eeb86f-c9ab-445b-b74b-9aa8a359acba service nova] Creating event network-vif-plugged:74829acf-8c1f-4b9d-9058-e4429ee36c60 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:42.484727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c7531f5f-38b9-4e63-9988-ee9c798b32c9 req-38eeb86f-c9ab-445b-b74b-9aa8a359acba service nova] Creating event network-vif-plugged:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:26:42.498681 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c7531f5f-38b9-4e63-9988-ee9c798b32c9 req-38eeb86f-c9ab-445b-b74b-9aa8a359acba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120975 Aug 27 03:26:42.499699 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2015/3914] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:42.590945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:42.596003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:42.632382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:42.635303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:42.636772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:42.637906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:42.638689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:42.639766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:43.085511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:43.086312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:43.101504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:43.103532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=20 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:43.106705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:43.107825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:43.110326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:43.111362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:43.113569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:43.119092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:43.175932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:43.199132 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-beaf19ac-6ba5-4d44-95b8-c23631013f75 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.624856 Aug 27 03:26:43.202407 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1900/3915] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:42 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:43.390799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:43.392533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:43.408084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:43.408858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:43.409458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:43.410408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:43.412307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:43.413790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:43.526154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:43.562249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:43.576170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:43.579994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ceccb3b8-b6f5-4e82-ad61-02838c6fcbb9 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1743 microversion: 2.20 time: 0.499186 Aug 27 03:26:43.607071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2016/3916] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:43 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1743 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:43.621068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:43.622755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:43.633743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:43.635803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:43.636879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:43.638354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:43.639374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:43.640492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:44.157384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:44.177132 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f18663b-dc13-4dac-9d53-71d0e03bac8f tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 0.793713 Aug 27 03:26:44.191424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1901/3917] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:43 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:44.231082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:44.232596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:44.253470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:44.254821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:44.255934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:44.262688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:44.272320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:44.280386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:44.281937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:44.312188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:44.339094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:44.341865 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4639bca-3a4f-4bff-b3f7-58a10c82050b tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1878 microversion: 2.32 time: 0.731324 Aug 27 03:26:44.368061 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2017/3918] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:43 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1878 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:44.608958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:44.609924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:44.643026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:44.643821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:44.644453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:44.646209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:44.654729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:44.669715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:45.146493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:45.160434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:45.165976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:45.174552 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84164e7f-a8f7-446c-98ee-c503ee18af82 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.573256 Aug 27 03:26:45.175242 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2018/3919] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:44 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:45.198116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:45.198781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:45.221257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:45.221762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:45.223900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:45.224678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:45.225173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:45.225608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:46.544381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:46.558934 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca707692-3b19-41bf-a0b0-e1a9a25fc4df tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 1.364945 Aug 27 03:26:46.578996 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2019/3920] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:45 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:46.596521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:46.597162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:46.636390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:46.636909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:46.642297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:46.643096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:46.643583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:46.644037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:46.871785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:46.894032 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-607407ed-e548-4600-90e0-0903bae95486 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 2.669250 Aug 27 03:26:46.897568 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1902/3921] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:44 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 2673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:46.909294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-67a9a711-c38b-4b6c-8f04-204a8bb61645 req-2af5b837-ccb5-40ed-9352-80b432e10608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9202ba1e-6f84-4e06-9d55-e538dcd9f9d5", "tag": "88b0faa7-f84b-49a8-a0c2-01f6320aa006"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:46.943740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-67a9a711-c38b-4b6c-8f04-204a8bb61645 req-2af5b837-ccb5-40ed-9352-80b432e10608 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:46.944534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-67a9a711-c38b-4b6c-8f04-204a8bb61645 req-2af5b837-ccb5-40ed-9352-80b432e10608 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:46.945133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-67a9a711-c38b-4b6c-8f04-204a8bb61645 req-2af5b837-ccb5-40ed-9352-80b432e10608 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:46.977109 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-67a9a711-c38b-4b6c-8f04-204a8bb61645 req-2af5b837-ccb5-40ed-9352-80b432e10608 service nova] Creating event network-changed:88b0faa7-f84b-49a8-a0c2-01f6320aa006 for instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 on n-h2-852086-5 Aug 27 03:26:46.997326 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-67a9a711-c38b-4b6c-8f04-204a8bb61645 req-2af5b837-ccb5-40ed-9352-80b432e10608 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094913 Aug 27 03:26:47.002647 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1903/3922] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:47.018716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:47.024099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:47.037304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:47.037975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:47.044372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:47.046895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:47.047622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:47.048226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:47.503290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:47.509283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:47.517899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:47.519612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:47.523856 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-720c4882-0f27-408b-bc17-6a3ad18bc6fc tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.518585 Aug 27 03:26:47.530143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:47.548078 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1904/3923] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:47 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:47.564484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:47.565830 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-771226c3-45e6-4e29-98d1-4a46da4ff19a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2833 microversion: 2.32 time: 0.987305 Aug 27 03:26:47.566438 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2020/3924] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:46 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2833 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:47.588570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:47.589939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:47.609185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:47.609911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:47.614241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:47.614679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:47.616597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:47.619797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:47.621903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:47.622568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:47.641026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:47.644348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:47.645899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:47.649543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:47.654695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:47.655392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:47.979964 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37ac05bc-9fb4-483a-891c-b56d23e398b5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.383600 Aug 27 03:26:47.980905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2021/3925] 10.222.0.69 () {60 vars in 1316 bytes} [Sat Aug 27 03:26:47 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b/os-interface => generated 1832 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:47.985944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:47.986788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:48.008262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:48.009663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:48.029191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:48.030064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:48.030592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:48.037611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:48.425748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:48.444945 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4c5aeca0-49f6-4028-9421-98e01079ccaa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.462677 Aug 27 03:26:48.450351 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2022/3926] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:47 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:48.553090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:48.554093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:48.570543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:48.572843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:48.573658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:48.574584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:48.575200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:48.575927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:48.926680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:48.954957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee02a55d-7d4c-423c-9cb1-b9d12153c2d8 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 1.371398 Aug 27 03:26:48.959392 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1905/3927] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:47 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:49.045028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-64a6600b-8e33-4078-b738-31283c0ed491 req-8184acea-3cb2-4312-ad8a-f692a73b1eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "name": "network-vif-plugged", "status": "completed", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:49.069725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-64a6600b-8e33-4078-b738-31283c0ed491 req-8184acea-3cb2-4312-ad8a-f692a73b1eff service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:49.073113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-64a6600b-8e33-4078-b738-31283c0ed491 req-8184acea-3cb2-4312-ad8a-f692a73b1eff service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:49.075060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-64a6600b-8e33-4078-b738-31283c0ed491 req-8184acea-3cb2-4312-ad8a-f692a73b1eff service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:49.121790 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-64a6600b-8e33-4078-b738-31283c0ed491 req-8184acea-3cb2-4312-ad8a-f692a73b1eff service nova] Creating event network-vif-plugged:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h2-852086-5 Aug 27 03:26:49.142012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-64a6600b-8e33-4078-b738-31283c0ed491 req-8184acea-3cb2-4312-ad8a-f692a73b1eff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099434 Aug 27 03:26:49.144192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1906/3928] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:26:49.481647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:49.484033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:49.514705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:49.517183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:49.524049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:49.525241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:49.526785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:49.529554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:49.869833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:49.907789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:49.909644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:49.912313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-006172c2-bce0-4aef-a0a0-d38cdab87f76 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 1.363046 Aug 27 03:26:49.954912 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2023/3929] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:48 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:26:49.992476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:49.995017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:50.028199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:50.028703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:50.039108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:50.041038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:50.041827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:50.048962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:50.120238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:51.012865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:51.050813 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8bcd7e21-cffe-4f23-b4eb-fed57a06fd86 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 1.065236 Aug 27 03:26:51.051707 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2024/3930] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:49 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:51.074013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:51.075376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:51.097992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:51.098858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:51.099503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:51.100406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:51.104349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:51.105090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:51.567995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:51.581700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:51.585936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:51.591662 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e58a398c-859b-45dd-acd7-5a742046d760 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.532997 Aug 27 03:26:51.614014 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2025/3931] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:51 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:51.621665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-461103ad-7fc1-4793-9f5d-b3f08b61ab8f req-decbfd5b-562e-4065-961d-97272aa4b9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b209b62-78b4-44c2-9491-871f5f78a1cb", "name": "network-vif-plugged", "status": "completed", "tag": "d2626c74-84ff-4cbd-a187-eccc9617cc59"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:51.652158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-461103ad-7fc1-4793-9f5d-b3f08b61ab8f req-decbfd5b-562e-4065-961d-97272aa4b9dd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:51.655022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-461103ad-7fc1-4793-9f5d-b3f08b61ab8f req-decbfd5b-562e-4065-961d-97272aa4b9dd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:51.660506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-461103ad-7fc1-4793-9f5d-b3f08b61ab8f req-decbfd5b-562e-4065-961d-97272aa4b9dd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:51.702377 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-461103ad-7fc1-4793-9f5d-b3f08b61ab8f req-decbfd5b-562e-4065-961d-97272aa4b9dd service nova] Creating event network-vif-plugged:d2626c74-84ff-4cbd-a187-eccc9617cc59 for instance 1b209b62-78b4-44c2-9491-871f5f78a1cb on n-h1-852086-5 Aug 27 03:26:51.715428 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-461103ad-7fc1-4793-9f5d-b3f08b61ab8f req-decbfd5b-562e-4065-961d-97272aa4b9dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097410 Aug 27 03:26:51.716616 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2026/3932] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:52.076262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:52.076985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:52.085733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:52.087244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:52.087871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:52.088820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:52.089446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:52.090064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:52.244124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:52.259823 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9f3448d-7b95-4303-b5f2-e03366f4364d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 2.785968 Aug 27 03:26:52.292490 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1907/3933] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:49 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 2820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:52.582002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:52.599065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-157a689d-9fb2-4fa8-a7fa-8e352efb7687 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 0.529644 Aug 27 03:26:52.601974 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2027/3934] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:52 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:52.622438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:52.623079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:52.647965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:52.648471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:52.649457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:52.657685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:52.661555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:52.664243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.293928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:53.294954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:53.338875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:53.339370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.339815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.340536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:53.340997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.341427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.727293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:53.747116 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fc3397b-f1c2-4da8-a06a-4f1730671d8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.458390 Aug 27 03:26:53.748809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2028/3935] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:53 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:53.754186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:53.766792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:53.776544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:53.779434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.782073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.783278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:53.783916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.786813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:54.085211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:54.126557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:54.129625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:54.131983 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20d94a82-ae30-40e7-bd7c-819b7e06caf1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 1.516690 Aug 27 03:26:54.170689 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1908/3936] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:52 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:54.467715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:54.485178 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8531e588-0a81-486c-b567-1e7905355a46 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1316 microversion: 2.1 time: 0.734659 Aug 27 03:26:54.504429 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2029/3937] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:53 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:54.770494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:54.771409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:54.788447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=54 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:54.794614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:54.798626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:54.803519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:54.810087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:54.813295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:54.816244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:55.185717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:55.186386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:55.205671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:55.206113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:55.206969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:55.207990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:55.208636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:55.213810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:55.671859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:55.691765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:55.731204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:55.736182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:55.739223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c79f2b4a-55d9-46c0-b4bc-62be548f6d55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.562851 Aug 27 03:26:55.740919 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2030/3938] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:55 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:55.745985 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95c7fdcc-92d9-4949-a90a-ce5653aac6b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.979301 Aug 27 03:26:55.749757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:55.751012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:55.753235 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1909/3939] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:54 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:55.788977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:55.791569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:55.792492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:55.794038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:55.795070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:55.796347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.174887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:56.189646 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3830c2e-5102-43ab-9e4f-5abc3af31978 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1504 microversion: 2.1 time: 0.446765 Aug 27 03:26:56.191439 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2031/3940] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:55 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:56.219440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:56.220905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:56.228461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.229314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.229973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.230942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.231609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.232263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.296316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:56.297551 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d75a67f9-0744-4342-9d38-8802708f8bed tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb/os-instance-actions/req-0ccc26bc-5536-4120-84af-496225718ae7" status: 200 len: 313 microversion: 2.1 time: 0.086228 Aug 27 03:26:56.298418 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1910/3941] 10.222.0.69 () {58 vars in 1419 bytes} [Sat Aug 27 03:26:56 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb/os-instance-actions/req-0ccc26bc-5536-4120-84af-496225718ae7 => generated 313 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:26:56.318204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:56.328115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:56.352712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.361201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.361992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.363044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.363781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.364874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.710785 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-888ea84b-2ecb-4b42-97b6-4b1d295c8c2d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "POST /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb/action" status: 202 len: 0 microversion: 2.1 time: 0.397326 Aug 27 03:26:56.714558 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2032/3942] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:26:56 2022] POST /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:26:56.759381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:56.763245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:56.786385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.786616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:56.791024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.791710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.798656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:56.804314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.805137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.807552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.819471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.820207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.827564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.829055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.830659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.838892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:57.171582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:57.206682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:57.208176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:57.209427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b50f98ea-30a6-46ed-acd0-581a76a505be tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.439089 Aug 27 03:26:57.232824 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2033/3943] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:56 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:26:57.237880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:57.238941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:57.256237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:57.256647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:57.257093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:57.257814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:57.258849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:57.259383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:57.757038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:57.781088 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a331c107-9c5a-4239-82f4-6723655f04c7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.546043 Aug 27 03:26:57.781088 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2034/3944] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:57 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:57.978704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:58.037297 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7008d234-4190-4329-b672-1fc73d5b0a60 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1506 microversion: 2.1 time: 1.318312 Aug 27 03:26:58.046476 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1911/3945] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:56 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1506 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:58.170949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-32f0dc10-0277-433c-9553-9734db995fb5 req-a172ceac-3245-4b98-ac32-0223e06ed2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "tag": "ae27ab8a-5ee1-4b13-ba45-faab9b193597"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:58.201622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-32f0dc10-0277-433c-9553-9734db995fb5 req-a172ceac-3245-4b98-ac32-0223e06ed2b6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:58.202443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-32f0dc10-0277-433c-9553-9734db995fb5 req-a172ceac-3245-4b98-ac32-0223e06ed2b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:58.203063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-32f0dc10-0277-433c-9553-9734db995fb5 req-a172ceac-3245-4b98-ac32-0223e06ed2b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:58.236792 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-32f0dc10-0277-433c-9553-9734db995fb5 req-a172ceac-3245-4b98-ac32-0223e06ed2b6 service nova] Creating event network-changed:ae27ab8a-5ee1-4b13-ba45-faab9b193597 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:26:58.248567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:58.249706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-32f0dc10-0277-433c-9553-9734db995fb5 req-a172ceac-3245-4b98-ac32-0223e06ed2b6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082270 Aug 27 03:26:58.250967 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2035/3946] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:26:58.255964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:58.300278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:58.300802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:58.302873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:58.303676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:58.306679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:58.307832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:58.805813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:58.806851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:58.845323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:58.845815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:58.846285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:58.847010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:58.847465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:58.847891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:59.375179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:59.389017 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90732bce-a65e-418d-ba81-a06f4f6b188a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.588874 Aug 27 03:26:59.394819 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2036/3947] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:58 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:59.414052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:59.415446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:59.434685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:59.435621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:59.439131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:59.440274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:59.441003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:59.442434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:59.612553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:59.630238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:59.637951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:59.648495 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37790b1a-2210-46ac-9d16-453a9014cc0b tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 1.411433 Aug 27 03:26:59.651380 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1912/3948] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:26:58 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:27:00.386430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:00.412340 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-153355b0-2db3-44e5-88a0-3e277c5f72ca tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1506 microversion: 2.1 time: 1.015423 Aug 27 03:27:00.413677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2037/3949] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:59 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1506 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:00.434852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:00.436014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:00.453764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:00.455285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:00.456349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:00.457944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:00.459172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:00.460259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:00.693448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:00.694049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:00.714256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:00.714778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:00.715210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:00.723505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:00.724183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:00.724942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:01.104627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:01.120947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:01.122506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:01.123790 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-25ce1494-a5a8-4190-8ba6-a051ab1bb3a8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.434918 Aug 27 03:27:01.146620 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2038/3950] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:00 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:27:01.436188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:01.436961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:01.453053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:01.458701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:01.460608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:01.464950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:01.467602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:01.469160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:01.815016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:01.844377 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b65faf5c-81a3-471d-996c-4a83bf22186d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 1.415066 Aug 27 03:27:01.864518 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1913/3951] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:00 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:01.977421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ed89b314-1b94-4fff-87c2-e09ec43274f9 req-2d1751f5-ef30-4299-bda4-52976e284968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9202ba1e-6f84-4e06-9d55-e538dcd9f9d5", "name": "network-vif-plugged", "status": "completed", "tag": "88b0faa7-f84b-49a8-a0c2-01f6320aa006"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:02.034522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ed89b314-1b94-4fff-87c2-e09ec43274f9 req-2d1751f5-ef30-4299-bda4-52976e284968 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:02.043019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ed89b314-1b94-4fff-87c2-e09ec43274f9 req-2d1751f5-ef30-4299-bda4-52976e284968 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:02.057989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ed89b314-1b94-4fff-87c2-e09ec43274f9 req-2d1751f5-ef30-4299-bda4-52976e284968 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:02.085118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:02.122248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:02.132747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-60554346-cba9-4ce3-b15d-6f2aa07f9fe1 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1506 microversion: 2.1 time: 0.701004 Aug 27 03:27:02.146190 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2039/3952] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:01 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1506 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:02.216227 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ed89b314-1b94-4fff-87c2-e09ec43274f9 req-2d1751f5-ef30-4299-bda4-52976e284968 service nova] Creating event network-vif-plugged:88b0faa7-f84b-49a8-a0c2-01f6320aa006 for instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 on n-h2-852086-5 Aug 27 03:27:02.248155 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ed89b314-1b94-4fff-87c2-e09ec43274f9 req-2d1751f5-ef30-4299-bda4-52976e284968 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274952 Aug 27 03:27:02.248793 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1914/3953] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:02.309459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:02.327303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:02.375589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:02.377663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:02.379760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:02.381528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:02.389334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:02.391267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:02.416093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1687201468", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:03.188603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:03.215079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:03.216534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:03.217738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4dc82de6-f750-4276-8990-b495d5237209 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.937757 Aug 27 03:27:03.218551 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1915/3954] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:02 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:03.238690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:03.239865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:03.247492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:03.247983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:03.248418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:03.249136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:03.249593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:03.250018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:03.606802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:03.623711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5288491b-6ded-4943-b608-cd9239645552 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1320 microversion: 2.1 time: 0.400890 Aug 27 03:27:03.637816 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1916/3955] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:03 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:03.652140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:03.653018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:03.674144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:03.675020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:03.675615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:03.676565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:03.677196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:03.677780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:04.002014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] validate_networks() for [('3b07bf9e-9073-45ab-8322-e54fc983f3bd', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:04.040111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:04.053487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea6c4bea-67fa-4715-a97a-e3fe2bf4834d tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1504 microversion: 2.1 time: 0.410979 Aug 27 03:27:04.058418 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1917/3956] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:03 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:04.075828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:04.076483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:04.090899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:04.103247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:04.104565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:04.106142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:04.110366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:04.111409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:04.404467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:04.413078 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b898d2c-8754-4c36-ad12-6ed4816a2f09 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.356319 Aug 27 03:27:04.433573 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1918/3957] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:04 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:04.433573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '.version_select at 0x7fe45737d550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:04.433573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:04.493132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:04.494001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:04.500581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:04.501904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:04.502785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:04.503543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:04.607124 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60dc730a-cc8f-402b-be0d-0ea530167f8a tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.185191 Aug 27 03:27:04.608225 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1919/3958] 10.222.0.69 () {58 vars in 1296 bytes} [Sat Aug 27 03:27:04 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb/os-instance-actions => generated 611 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:04.628071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:04.629401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:04.652135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:04.652830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:04.656572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:04.657916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:04.659325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:04.663291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.150100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:05.158907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:05.160364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:05.161937 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cef0d95-57bd-4054-80af-1229f70d1c55 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.552443 Aug 27 03:27:05.169293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:05.182519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:05.183884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:05.184810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:05.187504 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1920/3959] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:04 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:05.191809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:05.203409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:05.203926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:05.221456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.221966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.225612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.225998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.227075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.230511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.232319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.234603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.235211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.235549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.235718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.236636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.283036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:05.312979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Getting quotas for project 64ead14cbaec48cea0f7317e81ea8325. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:05.323506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Getting quotas for user e198e17424c9429381bccc4b8ce7ce6b and project 64ead14cbaec48cea0f7317e81ea8325. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:05.364277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:05.376398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:05.490029 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88378b7b-0207-4e03-a836-d18cb1cf9cfa tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 204 len: 0 microversion: 2.1 time: 0.300735 Aug 27 03:27:05.498219 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1921/3960] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:05 2022] DELETE /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:05.501983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:05.502730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:05.531370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.531882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.532333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.533089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.533556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.533988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.590398 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58bb7df0-7fd3-4904-b1d0-7424aa2b8a55 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.453376 Aug 27 03:27:05.596560 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2040/3961] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:05.608455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:05.609970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:05.624437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.627857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.628314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:05.629076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:05.629636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:05.629958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.316217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:06.327952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fa5c668-c71e-41bc-95f2-4c4d812635dd tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1501 microversion: 2.1 time: 0.830143 Aug 27 03:27:06.355295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1922/3962] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:05 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1501 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:06.363627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:06.364373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:06.379910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.380781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.381463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.383712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.385856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.388818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.566441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:06.573121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:06.585367 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e67adb5f-146b-41d0-8f66-81800c88a360 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.985514 Aug 27 03:27:06.586918 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2041/3963] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:05 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:06.595605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:06.596463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:06.606758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.608001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.609019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.611098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.612153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.632387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.796719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:06.806345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c0048a7-6e89-488c-9128-90e5c3431b35 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1218 microversion: 2.1 time: 0.217717 Aug 27 03:27:06.806900 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2042/3964] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:06 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:06.822094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:06.822688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:06.823550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:06.838228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2b4977b-3b80-434a-b91a-2369547bddec tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1510 microversion: 2.1 time: 0.481868 Aug 27 03:27:06.839960 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1923/3965] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:06 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:06.848102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:06.849625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:06.856307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.856831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.863753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.864710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.865635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.867139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.867455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.867968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.868807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.877250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.877837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.881837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.218543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:07.231534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:07.237370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:07.240621 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-beb50ca9-7719-48e5-b28e-bef9c605ae31 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.425549 Aug 27 03:27:07.252041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2043/3966] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:06 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:07.266705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-311978935"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:07.269474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:07.293355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.294118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.296570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.297504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.298131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.300229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.588599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:07.607488 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-650098cb-f4b5-4527-9adb-50f6a8c609d2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1501 microversion: 2.1 time: 0.765760 Aug 27 03:27:07.623211 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1924/3967] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:06 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1501 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:07.635057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-56620974-f05f-482a-adc2-e2c92d82450c req-6113964d-847b-44f6-9b4c-346b6961a669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-unplugged", "status": "completed", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:07.672348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-56620974-f05f-482a-adc2-e2c92d82450c req-6113964d-847b-44f6-9b4c-346b6961a669 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.675551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-56620974-f05f-482a-adc2-e2c92d82450c req-6113964d-847b-44f6-9b4c-346b6961a669 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.676889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-56620974-f05f-482a-adc2-e2c92d82450c req-6113964d-847b-44f6-9b4c-346b6961a669 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.704240 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f29ff1e0-41dc-4f06-be8c-93e5a75899f4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.450580 Aug 27 03:27:07.706037 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2044/3968] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:27:07 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 03:27:07.710002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-56620974-f05f-482a-adc2-e2c92d82450c req-6113964d-847b-44f6-9b4c-346b6961a669 service nova] Creating event network-vif-unplugged:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:27:07.713545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:07.714445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:07.723514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.724186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.724777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.725387 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-56620974-f05f-482a-adc2-e2c92d82450c req-6113964d-847b-44f6-9b4c-346b6961a669 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097113 Aug 27 03:27:07.725872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.728081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.728844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.729473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1925/3969] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:07.764185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:07.831420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:07.832137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:07.840353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.841177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.841815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.842780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.843432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.844080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.901366 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d37af0a2-e58b-40d1-a84e-3645c8f39f47 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 204 len: 0 microversion: 2.1 time: 0.193568 Aug 27 03:27:07.901971 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2045/3970] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:07 2022] DELETE /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:07.910804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:07.911517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:07.934502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.935000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.935439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.936160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:07.936617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:07.937043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.995707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:08.011840 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c4d9fdf-9a85-4f90-aa38-c231fa9d81f7 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1266 microversion: 2.1 time: 0.184554 Aug 27 03:27:08.027327 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1926/3971] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:07 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:08.033254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:08.034466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:08.043860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:08.044620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:08.045216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:08.047269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:08.048030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:08.048620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:08.360459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:08.380270 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b315ae9f-b128-4e3e-8edf-a1a6a6d7860c tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1510 microversion: 2.1 time: 0.473201 Aug 27 03:27:08.394230 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2046/3972] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:07 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1510 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:08.394230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:08.394230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:08.404894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:08.408834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:08.409605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:08.411119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:08.413876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:08.415772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:08.465332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:08.483906 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86406209-6eca-433b-883e-44a42e13d47b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1507 microversion: 2.1 time: 0.455001 Aug 27 03:27:08.485361 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1927/3973] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:08 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:08.661843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:08.679317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:08.682077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:08.684895 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-696b9fc5-1667-459f-8571-063c81bf7def tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.296299 Aug 27 03:27:08.685694 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2047/3974] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:08 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:08.969475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-97afc3e2-d173-436c-a357-268a5fb2629e req-2b8ab2a3-da77-4e2d-926b-52d863afcc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b209b62-78b4-44c2-9491-871f5f78a1cb", "name": "network-vif-deleted", "tag": "d2626c74-84ff-4cbd-a187-eccc9617cc59"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:08.987767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-97afc3e2-d173-436c-a357-268a5fb2629e req-2b8ab2a3-da77-4e2d-926b-52d863afcc1e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:08.988254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-97afc3e2-d173-436c-a357-268a5fb2629e req-2b8ab2a3-da77-4e2d-926b-52d863afcc1e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:08.988735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-97afc3e2-d173-436c-a357-268a5fb2629e req-2b8ab2a3-da77-4e2d-926b-52d863afcc1e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.019274 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-97afc3e2-d173-436c-a357-268a5fb2629e req-2b8ab2a3-da77-4e2d-926b-52d863afcc1e service nova] Creating event network-vif-deleted:d2626c74-84ff-4cbd-a187-eccc9617cc59 for instance 1b209b62-78b4-44c2-9491-871f5f78a1cb on n-h1-852086-5 Aug 27 03:27:09.026152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-97afc3e2-d173-436c-a357-268a5fb2629e req-2b8ab2a3-da77-4e2d-926b-52d863afcc1e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060300 Aug 27 03:27:09.031175 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1928/3975] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:09.038729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:09.042013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:09.051841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.053109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.053813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.055635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.056898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.057540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.160953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:09.191994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0fcffa99-10d9-4b9b-bd93-5ab837244e09 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1272 microversion: 2.1 time: 0.161813 Aug 27 03:27:09.193012 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2048/3976] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:09 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:09.417509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:09.418404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:09.428177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.430923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.431814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.432951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.433982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.435861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.492391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.493703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.494442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.494908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lazy-loading 'fault' on Instance uuid 1b209b62-78b4-44c2-9491-871f5f78a1cb {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:27:09.512527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:09.513725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:09.523119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.524027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.524998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.526916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.527699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.528444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.590200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38b3ce448da4737a1ef194308759759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d8763898d6436ba136b2a31e2d4e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:09.607110 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b010f73-db78-418a-965c-b5f6fa5dde74 tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 200 len: 1306 microversion: 2.1 time: 0.196328 Aug 27 03:27:09.621806 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1929/3977] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:09 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 1306 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:09.721324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:09.723047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:09.738947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.740206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.741265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.742872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.744252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.745333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.997816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:10.015264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-18193a5c-beb4-4464-9fe0-5328e7507117 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1507 microversion: 2.1 time: 0.508967 Aug 27 03:27:10.016355 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2049/3978] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:09 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:10.223110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:10.224949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:10.247287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.248800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.250400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.252264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.253461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.254783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.280864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:10.291291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:10.295265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:10.298827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:10.328572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8081df05-b739-4b50-9638-83d017318c9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1738 microversion: 2.20 time: 0.611424 Aug 27 03:27:10.352811 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1930/3979] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:09 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1738 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:10.633988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:10.634739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] [instance: 1b209b62-78b4-44c2-9491-871f5f78a1cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:10.663823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.665013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.665861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.666737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.667235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.667677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.714695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:10.730381 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] HTTP exception thrown: Instance 1b209b62-78b4-44c2-9491-871f5f78a1cb could not be found. Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Request method failure captured: Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb HTTP/1.1 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7fuPuE8_l3D9AfOk2tHkldBE9Ew8ch26vY8Cqi71DlWGDu5qenYUSHcL5UlobgLErqQD7h45ZMxdJOjhSvOi4gO2oBDvrEFMH368gVsK8e0NM0F5YwgSMSJHDbRzhbMeUZAqGazglHhQ4_ePCTiHs6NSZklNwqhZ6k6OUHV2YhKIQ Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 50d8763898d6436ba136b2a31e2d4e5a Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-InstanceActionsTestJSON-22065708 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/50d8763898d6436ba136b2a31e2d4e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/50d8763898d6436ba136b2a31e2d4e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_50d8763898d6436ba136b2a31e2d4e5a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/50d8763898d6436ba136b2a31e2d4e5a"}]}] Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-InstanceActionsTestJSON-22065708 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 50d8763898d6436ba136b2a31e2d4e5a Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-InstanceActionsTestJSON-22065708 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-InstanceActionsTestJSON-22065708-project Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: f38b3ce448da4737a1ef194308759759 Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-InstanceActionsTestJSON-22065708-project Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 1b209b62-78b4-44c2-9491-871f5f78a1cb could not be found. Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1b209b62-78b4-44c2-9491-871f5f78a1cb'} Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b209b62-78b4-44c2-9491-871f5f78a1cb could not be found. Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b209b62-78b4-44c2-9491-871f5f78a1cb could not be found. Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:10.734381 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:10.737798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:10.737798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:10.737798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:10.737798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:10.737798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:10.737798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b209b62-78b4-44c2-9491-871f5f78a1cb could not be found. Aug 27 03:27:10.737798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:10.742736 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aecf8496-9fd1-42ab-9ff8-720ba9204c4b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1314 microversion: 2.1 time: 0.523188 Aug 27 03:27:10.752317 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2050/3980] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:10 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:10.752730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] Returning 404 to user: Instance 1b209b62-78b4-44c2-9491-871f5f78a1cb could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:10.752730 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6a5d85a-09a2-45b1-b583-c420e3600cdf tempest-InstanceActionsTestJSON-22065708 tempest-InstanceActionsTestJSON-22065708-project] 10.222.0.69 "GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb" status: 404 len: 111 microversion: 2.1 time: 0.118919 Aug 27 03:27:10.752730 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1931/3981] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:10 2022] GET /compute/v2.1/servers/1b209b62-78b4-44c2-9491-871f5f78a1cb => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:27:11.038466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:11.039665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:11.048853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.051773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.052284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.053053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.053507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.053945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.370762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:11.372141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:11.391309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.391825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.392284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.393008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.394952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.395640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.711183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:11.735171 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33f6b311-d486-4dca-93e9-e29fee457a29 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1507 microversion: 2.1 time: 0.700676 Aug 27 03:27:11.735789 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2051/3982] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:11 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1507 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:11.776766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:11.777673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:11.795204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.796248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.796859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.797776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.806462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.809653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.867057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:11.899669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:11.903239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:11.905966 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9242910c-137f-4dda-bad0-bf517d57fe4d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1720 microversion: 2.20 time: 0.539710 Aug 27 03:27:11.919155 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1932/3983] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:11 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1720 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:12.661394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3287428f-366e-4140-a681-922cf4d3d59b req-2aeb8d46-c24e-44ec-8d79-515ad51ece35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9202ba1e-6f84-4e06-9d55-e538dcd9f9d5", "name": "network-vif-deleted", "tag": "88b0faa7-f84b-49a8-a0c2-01f6320aa006"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:12.703970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3287428f-366e-4140-a681-922cf4d3d59b req-2aeb8d46-c24e-44ec-8d79-515ad51ece35 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.704595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3287428f-366e-4140-a681-922cf4d3d59b req-2aeb8d46-c24e-44ec-8d79-515ad51ece35 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.705057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3287428f-366e-4140-a681-922cf4d3d59b req-2aeb8d46-c24e-44ec-8d79-515ad51ece35 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.744698 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3287428f-366e-4140-a681-922cf4d3d59b req-2aeb8d46-c24e-44ec-8d79-515ad51ece35 service nova] Creating event network-vif-deleted:88b0faa7-f84b-49a8-a0c2-01f6320aa006 for instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 on n-h2-852086-5 Aug 27 03:27:12.764977 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3287428f-366e-4140-a681-922cf4d3d59b req-2aeb8d46-c24e-44ec-8d79-515ad51ece35 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105897 Aug 27 03:27:12.770052 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1933/3984] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:12.786115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:12.789377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:12.815525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.816423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.817171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.818451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.819269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.831241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.993004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:13.002079 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-26375a48-f0e7-4107-a624-409cf76830a1 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1314 microversion: 2.1 time: 1.240437 Aug 27 03:27:13.015095 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2052/3985] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:11 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1314 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:13.026309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:13.027287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:13.034889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:13.036608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.037676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.038674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.040704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.042470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.043192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.073091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:13.091239 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6694c4a1-7441-45bf-adad-fd4b0516ee85 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1465 microversion: 2.1 time: 0.321170 Aug 27 03:27:13.092102 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1934/3986] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:12 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1465 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:13.117996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5391b9e1-dcd9-4def-9727-5db1eac1908a req-77c96638-c0b5-4333-8512-32fb6cbc1152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "278f5a6c-e268-45f3-a572-95a9b8dc22e6", "tag": "b0983c98-ddb3-4184-a19f-d336ddd97586"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:13.140040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5391b9e1-dcd9-4def-9727-5db1eac1908a req-77c96638-c0b5-4333-8512-32fb6cbc1152 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.140526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5391b9e1-dcd9-4def-9727-5db1eac1908a req-77c96638-c0b5-4333-8512-32fb6cbc1152 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.140962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5391b9e1-dcd9-4def-9727-5db1eac1908a req-77c96638-c0b5-4333-8512-32fb6cbc1152 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.154972 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5391b9e1-dcd9-4def-9727-5db1eac1908a req-77c96638-c0b5-4333-8512-32fb6cbc1152 service nova] Creating event network-changed:b0983c98-ddb3-4184-a19f-d336ddd97586 for instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 on n-h1-852086-5 Aug 27 03:27:13.160470 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5391b9e1-dcd9-4def-9727-5db1eac1908a req-77c96638-c0b5-4333-8512-32fb6cbc1152 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052341 Aug 27 03:27:13.162106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1935/3987] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:13.443230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:13.455074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:13.457698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:13.460826 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16570b3b-020b-4f4d-b1eb-909e38891b7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1720 microversion: 2.20 time: 0.444823 Aug 27 03:27:13.462514 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2053/3988] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:13 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1720 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:13.579482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-47f0adab-f48d-416a-8e69-4d7dd54121df req-b6d26fee-fb8d-46aa-828f-68d482b303ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "name": "network-vif-unplugged", "status": "completed", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:13.595834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47f0adab-f48d-416a-8e69-4d7dd54121df req-b6d26fee-fb8d-46aa-828f-68d482b303ab service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.596551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47f0adab-f48d-416a-8e69-4d7dd54121df req-b6d26fee-fb8d-46aa-828f-68d482b303ab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.597194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47f0adab-f48d-416a-8e69-4d7dd54121df req-b6d26fee-fb8d-46aa-828f-68d482b303ab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.615324 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-47f0adab-f48d-416a-8e69-4d7dd54121df req-b6d26fee-fb8d-46aa-828f-68d482b303ab service nova] Creating event network-vif-unplugged:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h2-852086-5 Aug 27 03:27:13.636081 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-47f0adab-f48d-416a-8e69-4d7dd54121df req-b6d26fee-fb8d-46aa-828f-68d482b303ab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063766 Aug 27 03:27:13.636946 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1936/3989] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:14.034464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:14.035144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:14.051284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.052302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.053551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.054423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.055611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.056761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.119456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:14.120314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:14.141711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.146107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.146875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.147926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.149050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.150909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.242974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:14.251403 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb22e163-18f6-489b-a391-c1715ae6956c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1465 microversion: 2.1 time: 0.142158 Aug 27 03:27:14.252185 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1937/3990] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:14 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1465 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:14.359732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:14.380614 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b68a57f-e51b-4aa2-9a45-83db66b0e608 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1314 microversion: 2.1 time: 0.358463 Aug 27 03:27:14.382572 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2054/3991] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:14 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:14.491497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:14.493101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:14.502628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.503131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.503871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.505119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.505587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.506015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.708316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:14.725839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:14.740513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:14.743705 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a32158b-2a4d-4575-8366-4314e5daa7a3 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1720 microversion: 2.20 time: 0.260158 Aug 27 03:27:14.749516 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1938/3992] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:14 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:15.274689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:15.276170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:15.283170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:15.285291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.286091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.286814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.287749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.288407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.289547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.312669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:15.333438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.334083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.334683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.335207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lazy-loading 'fault' on Instance uuid 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:27:15.346266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:15.404259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:15.405677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:15.413856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.414777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.415443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.417809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.418660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.419350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.432397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:15.450292 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9d9c7f86-c116-4951-9ecd-ac46c0bda892 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 200 len: 1310 microversion: 2.1 time: 0.178977 Aug 27 03:27:15.450292 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2055/3993] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:15 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:15.785471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:15.788587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:15.823485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.825692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.830018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.834323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.838253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.840788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:16.110676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:16.129835 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-289b721f-1273-45fd-b7e9-e07b83973c31 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1314 microversion: 2.1 time: 0.727947 Aug 27 03:27:16.131042 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1939/3994] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:15 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:16.152053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9e4532d0-25c7-4eae-9911-35ff65f307aa req-f622f1be-997d-4cd3-ad65-80f2b115eb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-plugged", "status": "completed", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:16.181655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9e4532d0-25c7-4eae-9911-35ff65f307aa req-f622f1be-997d-4cd3-ad65-80f2b115eb7c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:16.182575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9e4532d0-25c7-4eae-9911-35ff65f307aa req-f622f1be-997d-4cd3-ad65-80f2b115eb7c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:16.183618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9e4532d0-25c7-4eae-9911-35ff65f307aa req-f622f1be-997d-4cd3-ad65-80f2b115eb7c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:16.215526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9e4532d0-25c7-4eae-9911-35ff65f307aa req-f622f1be-997d-4cd3-ad65-80f2b115eb7c service nova] Creating event network-vif-plugged:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:27:16.229004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9e4532d0-25c7-4eae-9911-35ff65f307aa req-f622f1be-997d-4cd3-ad65-80f2b115eb7c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089523 Aug 27 03:27:16.232436 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1940/3995] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:16.244360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:16.257167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:16.259734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:16.260999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a500c211-2063-4fc1-ac4e-0bfed57c755c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1723 microversion: 2.20 time: 0.487386 Aug 27 03:27:16.264605 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2056/3996] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:15 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:16.294191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cfa7bb0-6096-4042-ae07-e60b891f7271"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:16.297763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:16.314351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:16.316221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:16.317266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:16.318840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:16.320203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:16.323238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:16.473662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:16.475189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:16.495287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:16.500127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:16.500995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:16.503198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:16.503845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:16.504489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:16.585982 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 HTTP/1.1 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '9202ba1e-6f84-4e06-9d55-e538dcd9f9d5'} Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:16.592048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:27:16.596113 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:16.596113 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:16.596113 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:16.596113 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:16.596113 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:16.596113 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:27:16.596113 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:27:16.599305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:16.600494 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-226ccc41-7dfd-4420-ab78-c52df53637b2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 404 len: 111 microversion: 2.1 time: 0.131521 Aug 27 03:27:16.601745 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2057/3997] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:16 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:16.616118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9f9e686-e047-4bd6-9da4-759d48283200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: .version_select at 0x7fe457baa430>, body: {"keypair": {"name": "tempest-key-2060403056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBVKWHeV5kOPzep5OcN8JeQLLdab4dqy2gLza+4l139iMfMDa5AZxMIuIM5+udy+EXNXRIbOHspTiCGYpt8JCrEiA486ug4s0GmiZIOY5LWRjII/+poqbWN6PUCQicXZw=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:16.640751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d9f9e686-e047-4bd6-9da4-759d48283200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:16.648260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d9f9e686-e047-4bd6-9da4-759d48283200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:16.690392 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9f9e686-e047-4bd6-9da4-759d48283200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.077968 Aug 27 03:27:16.700436 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2058/3998] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:27:16 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:16.706324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-491b1ffd-58df-48b9-b3d5-be37adea018c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '.version_select at 0x7fe457198670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:16.712361 n-d-852086-5 devstack@n-api.service[122407]: WARNING oslo_db.sqlalchemy.utils [None req-491b1ffd-58df-48b9-b3d5-be37adea018c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:27:16.722542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-491b1ffd-58df-48b9-b3d5-be37adea018c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.020484 Aug 27 03:27:16.736195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2059/3999] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:27:16 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:17.058918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-837149690", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-key-2060403056", "networks": [{"uuid": "2b04f773-2696-4ad3-94c1-bcf6bb04ac97"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:17.073287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a596bad7-b409-4088-81f8-e706e6f60444 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.784150 Aug 27 03:27:17.079129 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1941/4000] 10.222.0.69 () {62 vars in 1364 bytes} [Sat Aug 27 03:27:16 2022] POST /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-volume_attachments => generated 188 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:27:17.154690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:17.155300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:17.176048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:17.176745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:17.177145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:17.180349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:17.185649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:17.189374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:17.216536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:17.456139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:17.471844 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63b8dd72-0d5e-4e10-9b23-b9fd2bcb2490 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1314 microversion: 2.1 time: 0.322936 Aug 27 03:27:17.478216 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1942/4001] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:17 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:17.497786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:17.498462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:17.528633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:17.534520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:17.535552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:17.536776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:17.537557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:17.545036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:18.145462 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-92108fee-c2db-468b-bbd5-d166a0561983 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-volume_attachments/3cfa7bb0-6096-4042-ae07-e60b891f7271" status: 202 len: 0 microversion: 2.20 time: 0.661846 Aug 27 03:27:18.146102 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1943/4002] 10.222.0.69 () {60 vars in 1457 bytes} [Sat Aug 27 03:27:17 2022] DELETE /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-volume_attachments/3cfa7bb0-6096-4042-ae07-e60b891f7271 => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:18.313871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:18.314515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:18.349382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:18.353184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:18.354870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:18.362933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:18.363963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:18.369634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:18.465373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:18.465927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:18.466228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:18.466724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:18.467146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:18.477606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122408) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 03:27:18.484948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:18.486598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:18.489144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:18.491641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:18.492964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:18.493695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:18.516426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:18.532209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:18.583933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:18.587065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:18.736825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:18.776413 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8ef932f0-b82c-41dd-803a-f15226f3ee5c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722098 Aug 27 03:27:18.787165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2060/4003] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:18.797698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:18.801181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:18.815551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:18.820224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:18.823055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:18.824774 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-876972e5-9e85-4bc2-9648-1152a488091e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "POST /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/action" status: 202 len: 0 microversion: 2.20 time: 0.521884 Aug 27 03:27:18.826400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:18.827717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:18.829346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:18.831654 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1944/4004] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:27:18 2022] POST /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:18.854875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66a68402-ee54-4d7e-9214-9cee656d5f01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:18.858947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66a68402-ee54-4d7e-9214-9cee656d5f01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:19.172247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66a68402-ee54-4d7e-9214-9cee656d5f01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:19.190246 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66a68402-ee54-4d7e-9214-9cee656d5f01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1228 microversion: 2.1 time: 0.355581 Aug 27 03:27:19.192396 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1945/4005] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:18 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1228 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:19.223031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:19.226352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:19.257213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:19.260141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:19.260876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:19.262997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:19.264820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:19.268332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:19.934919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:19.957462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:19.963914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:19.969985 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f2ad666-6295-4579-b786-f6ccd400063f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1671 microversion: 2.20 time: 0.770294 Aug 27 03:27:19.970651 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1946/4006] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:19 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1671 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:19.979684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7a0c7058-c087-4f7b-bca8-98e55f2de205 req-2072c730-344b-48af-b396-17836654f86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278f5a6c-e268-45f3-a572-95a9b8dc22e6", "name": "network-vif-plugged", "status": "completed", "tag": "b0983c98-ddb3-4184-a19f-d336ddd97586"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:20.022236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a0c7058-c087-4f7b-bca8-98e55f2de205 req-2072c730-344b-48af-b396-17836654f86c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:20.023031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a0c7058-c087-4f7b-bca8-98e55f2de205 req-2072c730-344b-48af-b396-17836654f86c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:20.023702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a0c7058-c087-4f7b-bca8-98e55f2de205 req-2072c730-344b-48af-b396-17836654f86c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:20.037590 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7a0c7058-c087-4f7b-bca8-98e55f2de205 req-2072c730-344b-48af-b396-17836654f86c service nova] Creating event network-vif-plugged:b0983c98-ddb3-4184-a19f-d336ddd97586 for instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 on n-h1-852086-5 Aug 27 03:27:20.044524 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7a0c7058-c087-4f7b-bca8-98e55f2de205 req-2072c730-344b-48af-b396-17836654f86c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070165 Aug 27 03:27:20.045693 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1947/4007] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:20.219078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:20.220775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:20.234152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:20.234870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:20.235777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:20.237597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:20.238354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:20.238996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:20.495571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:20.541022 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c39b18e-7ea7-4234-b876-5743d094a252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1224 microversion: 2.1 time: 0.330278 Aug 27 03:27:20.577537 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1948/4008] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:20 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1224 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:20.599610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:20.612136 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-03415956-ef4d-4746-9c03-85155d14e154 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1314 microversion: 2.1 time: 1.823376 Aug 27 03:27:20.616048 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2061/4009] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:18 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1314 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:20.995042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:20.996127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:21.020419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:21.025063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:21.026117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:21.040493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:21.044198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:21.045077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:21.578105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:21.578922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:21.610796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:21.615539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:21.616175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:21.618789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:21.619583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:21.623768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:21.791683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:21.817849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d28824c0-7831-42bb-ab4c-a485c17d1eb9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1286 microversion: 2.1 time: 0.249929 Aug 27 03:27:21.819868 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2062/4010] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:21 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:21.829939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:21.833059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:21.849192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:21.854030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:21.856174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:21.860953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:21.861773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:21.862559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:22.192468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:22.227204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:22.231389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:22.235589 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca2e6ded-f9c7-492b-bd7e-69ea5a414c26 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1671 microversion: 2.20 time: 1.245299 Aug 27 03:27:22.236433 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1949/4011] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:20 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1671 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:22.543596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:22.563598 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-051c9321-54dc-4872-af5d-b5848ff04d24 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1314 microversion: 2.1 time: 0.739188 Aug 27 03:27:22.571015 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2063/4012] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:21 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:22.854257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:22.855485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:22.878025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:22.878824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:22.879336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:22.880563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:22.881255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:22.882268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:23.012075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:23.021338 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20cef2de-7d55-4d89-bf1b-77d1c66dc96b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1286 microversion: 2.1 time: 0.173373 Aug 27 03:27:23.029289 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1950/4013] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:22 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:23.271212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:23.271924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:23.316699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:23.321754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:23.329832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:23.333894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:23.334517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:23.339072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:23.593018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:23.594418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:23.598599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:23.603626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:23.604507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:23.605306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:23.606335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:23.607313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:23.607987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:23.894875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:23.903104 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dcb82ba2-2610-475e-8ad7-178b27583ef8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1499 microversion: 2.1 time: 0.314171 Aug 27 03:27:23.919148 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1951/4014] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:23 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1499 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:23.925600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:23.927998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:23.935184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:23.935897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:23.936520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:23.937399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:23.938010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:23.938616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:23.965152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lazy-loading 'flavor' on Instance uuid 278f5a6c-e268-45f3-a572-95a9b8dc22e6 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:27:24.102208 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5939255c-45f5-43e7-b4f6-eae64e163b71 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "POST /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6/action" status: 200 len: 32 microversion: 2.1 time: 0.180194 Aug 27 03:27:24.110395 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1952/4015] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:27:23 2022] POST /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:27:24.126489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:24.130152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:24.145470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:24.147894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:24.148669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:24.151440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:24.152300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:24.153002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:24.226139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:24.241803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:24.251318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:24.252678 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-08b0f3f4-d9d4-4b11-9437-d2069ed445ed tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.988932 Aug 27 03:27:24.254218 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2064/4016] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:23 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:24.267020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:24.269982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:24.279910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:24.281366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:24.281992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:24.283049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:24.283684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:24.284302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:24.762460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:24.772192 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-023bdef4-bfd1-4574-9459-dc4ba5e586a3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.516663 Aug 27 03:27:24.783542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2065/4017] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:24 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:25.061570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:25.070102 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e861ac7d-bed6-4a19-ad0f-07f32aced525 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.955774 Aug 27 03:27:25.080439 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1953/4018] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:24 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:25.284071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:25.285539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:25.315382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.318927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.321233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:25.324627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.327100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.328290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:25.526764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8e611839-de6f-4b98-bccb-f49f5289d61b req-93300ef6-dfb1-4cfb-945e-3cdb08c21ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:25.548699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8e611839-de6f-4b98-bccb-f49f5289d61b req-93300ef6-dfb1-4cfb-945e-3cdb08c21ef9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.549459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8e611839-de6f-4b98-bccb-f49f5289d61b req-93300ef6-dfb1-4cfb-945e-3cdb08c21ef9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.550107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8e611839-de6f-4b98-bccb-f49f5289d61b req-93300ef6-dfb1-4cfb-945e-3cdb08c21ef9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:25.581741 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8e611839-de6f-4b98-bccb-f49f5289d61b req-93300ef6-dfb1-4cfb-945e-3cdb08c21ef9 service nova] Creating event network-changed:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h1-852086-5 Aug 27 03:27:25.603751 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8e611839-de6f-4b98-bccb-f49f5289d61b req-93300ef6-dfb1-4cfb-945e-3cdb08c21ef9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083075 Aug 27 03:27:25.610041 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1954/4019] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:25.669261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-354d94dd-0676-46ac-a09e-d7a267d56b67 req-3f4e80de-bdc3-4925-870b-751710cbcaca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010a38a0-1870-4e4b-8b44-cf583e8e52b6", "tag": "aea0c69a-3119-4b2b-9615-98cbdb05ee67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:25.718514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-354d94dd-0676-46ac-a09e-d7a267d56b67 req-3f4e80de-bdc3-4925-870b-751710cbcaca service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.719947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-354d94dd-0676-46ac-a09e-d7a267d56b67 req-3f4e80de-bdc3-4925-870b-751710cbcaca service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.720406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-354d94dd-0676-46ac-a09e-d7a267d56b67 req-3f4e80de-bdc3-4925-870b-751710cbcaca service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:25.756386 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-354d94dd-0676-46ac-a09e-d7a267d56b67 req-3f4e80de-bdc3-4925-870b-751710cbcaca service nova] Creating event network-changed:aea0c69a-3119-4b2b-9615-98cbdb05ee67 for instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 on n-h2-852086-5 Aug 27 03:27:25.774303 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-354d94dd-0676-46ac-a09e-d7a267d56b67 req-3f4e80de-bdc3-4925-870b-751710cbcaca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114134 Aug 27 03:27:25.778068 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1955/4020] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:25.800429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:25.801886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:25.812091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.812819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.813872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:25.814947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:25.815619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:25.816343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:25.910475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:25.923721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:25.925173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:25.926415 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46c8dcf7-2844-4de5-bf47-eff6afb62040 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.649403 Aug 27 03:27:25.934183 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2066/4021] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:25 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:26.093538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:26.094573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:26.117314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:26.121113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:26.122089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:26.123385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:26.126625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:26.130379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:26.492318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:26.502892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e3434c0-81cd-4021-8c2f-cc1d9a782692 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.413592 Aug 27 03:27:26.510817 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2067/4022] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:26 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:26.722912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:26.742500 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e720ca5-f4cf-4f83-8d22-ce5d3b71006e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.948223 Aug 27 03:27:26.743844 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1956/4023] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:25 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:26.959236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:26.960320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:26.975058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:26.978690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:26.989952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:26.991268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:26.993626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:26.994853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.207451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:27.219780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:27.222950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:27.224675 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f66ae3aa-9297-40ec-a49c-78c79b819765 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.275820 Aug 27 03:27:27.225888 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2068/4024] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:26 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:27.532892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:27.536105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:27.553219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:27.553728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:27.557674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.560830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:27.561535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:27.563311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.772833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:27.775417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:27.794498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:27.795885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:27.802944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.807799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:27.808694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:27.810264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:27.895727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:27.910629 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f761d68-2a09-43b8-b686-495526cb5bd4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.382392 Aug 27 03:27:27.925497 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1957/4025] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:27 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:28.267325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:28.271529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:28.296561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:28.297458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:28.298073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:28.299125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:28.299771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:28.301163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:28.505976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:28.564799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:28.643944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:28.664701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:28.667142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:28.672197 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1dd68e0a-6154-4820-8784-577dae8ddb8c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.423464 Aug 27 03:27:28.682588 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1958/4026] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:28 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:27:28.740805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:28.763702 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-010aef1c-30e6-41ce-9eab-d5adbe674949 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.996096 Aug 27 03:27:28.766715 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2069/4027] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:27 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:28.937275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:28.938057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:28.950105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:28.954478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:28.960166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:28.962197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:28.966845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:28.974925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:29.178148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:29.427345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:29.457230 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2678f4af-8b00-4e18-bc38-840851894834 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.522494 Aug 27 03:27:29.458960 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1959/4028] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:28 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:29.701181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:29.702663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:29.724211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:29.725038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:29.726455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:29.727563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:29.728432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:29.729144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:29.786061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:29.787149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:29.801875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:29.808265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:29.810555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:29.811849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:29.813739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:29.814685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:31.324116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:31.339497 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f761187-d5ba-4c23-a137-9891e3bf75a0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 1.557713 Aug 27 03:27:31.346260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1960/4029] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:29 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:31.361474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:31.369006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:31.419356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:31.424834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:31.429238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:31.432386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:31.442594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:31.442594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:31.883066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:31.905587 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e419366-dcfc-49ac-b4e7-6eab692c6f91 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.557278 Aug 27 03:27:31.913470 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1961/4030] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:31 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:32.333736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:32.347932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:32.349423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:32.350770 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21c9f54c-c5c4-49b4-a85e-7149f930d4ad tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 2.654020 Aug 27 03:27:32.362365 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2070/4031] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:29 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:32.371919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:32.372567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:32.386707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:32.387231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:32.387680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:32.388422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:32.388892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:32.389327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:32.445826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:32.816181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:32.828344 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7010656c-aeb4-4b26-894f-c31bcee48afc tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.461967 Aug 27 03:27:32.828930 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1962/4032] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:32 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:32.935118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:32.936004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:32.953280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:32.953789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:32.957222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:32.961697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:32.962665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:32.963648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:33.395203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:33.395935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:33.424628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:33.425196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:33.425725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:33.426639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:33.427537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:33.428238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:33.872060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:33.881147 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc6a298b-35ba-4f86-b712-070eafc590c0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.950377 Aug 27 03:27:33.887723 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2071/4033] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:32 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:33.902675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:33.904859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:33.936638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:33.940198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:33.941006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:33.941998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:33.946800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:33.947583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:34.884513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:34.904966 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1eee83b3-7cb1-4e3e-8071-d12574fd24c4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 1.015780 Aug 27 03:27:34.906278 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2072/4034] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:33 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:34.917666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:34.932891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:34.933838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:34.944106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:34.945043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:34.946072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:34.947672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:34.948927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:34.950571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:34.951140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:34.951859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:34.961567 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e8d4d83-aeb7-4c45-9669-91a0add1e002 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 1.562378 Aug 27 03:27:34.962647 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1963/4035] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:33 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:35.027287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-12422d86-d36b-4430-9b4d-a19b097cc635 req-7c88f60e-647b-4385-b1b1-0231b3f28fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010a38a0-1870-4e4b-8b44-cf583e8e52b6", "name": "network-vif-plugged", "status": "completed", "tag": "aea0c69a-3119-4b2b-9615-98cbdb05ee67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:35.067365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12422d86-d36b-4430-9b4d-a19b097cc635 req-7c88f60e-647b-4385-b1b1-0231b3f28fc8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:35.068721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12422d86-d36b-4430-9b4d-a19b097cc635 req-7c88f60e-647b-4385-b1b1-0231b3f28fc8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:35.069387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12422d86-d36b-4430-9b4d-a19b097cc635 req-7c88f60e-647b-4385-b1b1-0231b3f28fc8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:35.104880 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-12422d86-d36b-4430-9b4d-a19b097cc635 req-7c88f60e-647b-4385-b1b1-0231b3f28fc8 service nova] Creating event network-vif-plugged:aea0c69a-3119-4b2b-9615-98cbdb05ee67 for instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 on n-h2-852086-5 Aug 27 03:27:35.123358 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-12422d86-d36b-4430-9b4d-a19b097cc635 req-7c88f60e-647b-4385-b1b1-0231b3f28fc8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100085 Aug 27 03:27:35.130411 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1964/4036] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:35.575139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:35.586357 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-798394e7-1652-441c-bdf8-a9d8e1cf8007 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.658471 Aug 27 03:27:35.588694 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2073/4037] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:34 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:35.932433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:35.933155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:35.953052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:35.961583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:35.962737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:35.969198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:35.971369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:35.977380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:35.991085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:35.992653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:36.007302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.010222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.011138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.012210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.014692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.015481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.331491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:36.342729 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f8eafa7-28f7-4540-a73f-1f94d51094e5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.415225 Aug 27 03:27:36.343320 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1965/4038] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:35 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:36.423942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:36.447311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:36.449095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:36.454499 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ef418f96-fdf9-419b-a9da-a69e59065008 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.467319 Aug 27 03:27:36.465560 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2074/4039] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:35 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:36.614224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:36.616368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:36.641510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.642195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.665766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:36.666632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:36.667126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:36.678838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.072028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:37.085436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6befd231-ea6f-4cbd-92ae-5178f0192ee9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1328 microversion: 2.1 time: 0.477129 Aug 27 03:27:37.087735 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1966/4040] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:36 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1328 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:37.374401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:37.375619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:37.405065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.406596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.407120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.409630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.411562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.412022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.425867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:37.496109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:37.501197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:37.546316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.550919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.556004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.562945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.564135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.565547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:38.141857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:38.149831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:38.162733 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aaa8809c-2384-4838-b967-caa370548d3f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.799263 Aug 27 03:27:38.165576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:38.168134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:38.170952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d869afc9-4041-4730-bddb-f37505d95f85 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.694051 Aug 27 03:27:38.172602 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1967/4041] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:37 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:38.173427 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2075/4042] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:37 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:38.178846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:38.179648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:38.192621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:38.195224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:38.208144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:38.209775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:38.211576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:38.223442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:38.225698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:38.225915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:38.228329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:38.229809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:38.230522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:38.232190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:38.237748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:38.238390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:38.564256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:38.579720 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6482c77b-004c-4cb7-a3d0-d82449754a29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.405231 Aug 27 03:27:38.581827 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1968/4043] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:38 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:39.189623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:39.190462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:39.201732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.206550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.210737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.212470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.214966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.216664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.672436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:39.691878 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36c88cf6-53c1-4e52-a343-455d8cafe0a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.506439 Aug 27 03:27:39.693051 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1969/4044] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:39 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:39.698774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:39.699689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:39.719923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.720852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.721723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.722794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.725630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.726757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.050859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.067477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.076137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.077125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.083690 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60cdcced-0ce4-424b-a695-9cc9c63795f4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.389371 Aug 27 03:27:40.092897 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a1c3349-170b-4ee4-8b69-03b4c7c70fd3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1510 microversion: 2.1 time: 1.918250 Aug 27 03:27:40.093347 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1970/4045] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:39 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:40.107691 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2076/4046] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:38 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1510 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:40.117658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:40.118936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:40.120037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:40.127897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.128913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.129583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.130552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.131373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.131613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:40.132830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.155353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.164972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.165548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.166637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.167344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.172299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.569034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.581310 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07932af2-f34f-4717-a77d-3ac38029bd73 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.486669 Aug 27 03:27:40.582519 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1971/4047] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:40 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:40.619937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1021279987"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:40.623612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:40.635795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.636652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.637324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.638369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.640097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.641391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.785380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.802356 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0a58a46-121a-4b37-b049-03c9811620f4 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1510 microversion: 2.1 time: 0.688831 Aug 27 03:27:40.824718 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2077/4048] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:40 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1510 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:40.841536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:40.842748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:40.864265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.872777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.873586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.874742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.878105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.879046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.257145 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a033cff6-1aa7-4825-ae6b-439e81cb2943 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.651139 Aug 27 03:27:41.280765 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1972/4049] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:27:40 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 03:27:41.309858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:41.329547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:41.381995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.396989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.401292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.411108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.415518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.424123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.494284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:41.511320 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f7216f5-be4e-43f8-ab82-3a0f5c99a743 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.684767 Aug 27 03:27:41.554600 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2078/4050] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:40 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:41.567125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:41.572782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:41.593427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.594258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.594886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.595912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.596536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.597115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.670524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:41.997350 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b79c6474-3899-411f-ad97-c598fe009798 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 204 len: 0 microversion: 2.1 time: 0.710939 Aug 27 03:27:42.008916 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1973/4051] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:41 2022] DELETE /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:42.020016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:42.045651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:42.077711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.080813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.087169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.097816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.099023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.100330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.618261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:42.680869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:42.689772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:42.698423 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-532b2327-dec7-4adf-accb-790551e8bd7c tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 1.141874 Aug 27 03:27:42.712985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:42.727158 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2079/4052] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:41 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:42.732392 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1bae3f6-ef40-4583-b66c-f02035d03e2f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.724789 Aug 27 03:27:42.745117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:42.746419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:42.758641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.760417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.761660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.763027 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1974/4053] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:42 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:42.764857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.766146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.767467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.790994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:42.799469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:42.833803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.834857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.836228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.850307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.851795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.855253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:43.314882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:43.332606 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed26f6ca-f973-4966-8747-b26b3a6dae87 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.568002 Aug 27 03:27:43.334242 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1975/4054] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:42 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:43.351594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-604ad63b-03ec-40f3-8e6d-0d8b0b7f29ff req-4c5703a8-6faf-4c53-89bb-71b406c83b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-unplugged", "status": "completed", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:43.374655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-604ad63b-03ec-40f3-8e6d-0d8b0b7f29ff req-4c5703a8-6faf-4c53-89bb-71b406c83b3d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:43.380561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-604ad63b-03ec-40f3-8e6d-0d8b0b7f29ff req-4c5703a8-6faf-4c53-89bb-71b406c83b3d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:43.381287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-604ad63b-03ec-40f3-8e6d-0d8b0b7f29ff req-4c5703a8-6faf-4c53-89bb-71b406c83b3d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:43.405395 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-604ad63b-03ec-40f3-8e6d-0d8b0b7f29ff req-4c5703a8-6faf-4c53-89bb-71b406c83b3d service nova] Creating event network-vif-unplugged:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:27:43.428912 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-604ad63b-03ec-40f3-8e6d-0d8b0b7f29ff req-4c5703a8-6faf-4c53-89bb-71b406c83b3d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092397 Aug 27 03:27:43.430712 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1976/4055] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:43.746842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:43.748054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:43.760856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:43.761617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:43.765451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:43.766965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:43.768881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:43.772701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:43.799035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:43.818288 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8bb84d77-c1f1-4819-b166-64e6036e0a1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1516 microversion: 2.1 time: 1.089257 Aug 27 03:27:43.834275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2080/4056] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:42 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1516 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:43.834275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:43.834275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:43.867792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:43.876046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:43.881342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:43.881912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:43.883441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:43.883932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:43.884602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:43.896856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:44.349448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:44.359100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:44.362431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:44.364107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aba9e83a-0148-40b5-b191-d0d26e059826 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.621616 Aug 27 03:27:44.386804 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1977/4057] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:43 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:27:44.392960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:44.395275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:44.430337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:44.431635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:44.432715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:44.434645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:44.436082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:44.437365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:44.783993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:44.801030 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d29173c4-bf1f-4bf7-8ddb-a6aab35925fb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.975382 Aug 27 03:27:44.802637 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2081/4058] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:43 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:44.811306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:44.825037 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-54f9520e-6222-4d3d-836e-a86ef6833c67 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.436604 Aug 27 03:27:44.829537 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1978/4059] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:44 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:44.852719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:44.853844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:44.876406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:44.876944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:44.877414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:44.878194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:44.878681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:44.879114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:45.406505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:45.407470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:45.440965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:45.441854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:45.442821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:45.443940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:45.445553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:45.446488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:45.839285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:45.854769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:45.866340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:45.868095 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb3c019b-cbef-4fde-bfa9-937e8ea6f2e8 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.473189 Aug 27 03:27:45.868727 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1979/4060] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:45 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:45.903417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:45.904335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:45.926763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:45.927483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:45.928141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:45.929089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:45.929738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:45.930476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:45.932387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:45.953535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-116f9a66-5592-4ac2-8d02-cd492b333d3e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1516 microversion: 2.1 time: 1.105998 Aug 27 03:27:45.955663 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2082/4061] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:44 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1516 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:45.977765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:45.978972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:45.996124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.002574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.003408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.004346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.004963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.005630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.180232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:46.197780 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1434559-79b3-4b58-a7c1-0924e34ac42e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1686 microversion: 2.1 time: 0.299870 Aug 27 03:27:46.200619 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1980/4062] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:45 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1686 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:46.445308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:46.470566 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2c032bb1-c68c-42bb-844a-ee7553d889e6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.502847 Aug 27 03:27:46.471493 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2083/4063] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:45 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:46.900073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:46.901272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:46.920306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.921110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.921549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.922991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.923460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.923876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.985346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:46.986772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:47.003810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.004513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.006177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.008623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.009305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.013519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.163777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.177042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.181411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.182980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bbe3ddaa-58c4-46ba-b958-8ba2f7baa414 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.288197 Aug 27 03:27:47.188916 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1981/4064] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:46 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:27:47.231717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:47.232809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:47.244389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.245533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.247041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.248934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.251305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.252460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.449440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.459801 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77948900-29a1-4fbe-9b9f-61682b4111cb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.234699 Aug 27 03:27:47.460856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1982/4065] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:47 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:47.498901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:47.499524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:47.506606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.507337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.508545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.509303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.509775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.510234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.671611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.697599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-799489e3-cd6d-4b4f-bb0c-a98c06b7449c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 200 len: 1474 microversion: 2.1 time: 0.716137 Aug 27 03:27:47.699236 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2084/4066] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:46 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 1474 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:47.720189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4828502a-28bc-456a-8465-834981d23b0f req-e76460c7-c7c1-453e-9353-29299487d5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010a38a0-1870-4e4b-8b44-cf583e8e52b6", "name": "network-vif-deleted", "tag": "aea0c69a-3119-4b2b-9615-98cbdb05ee67"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:47.742463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4828502a-28bc-456a-8465-834981d23b0f req-e76460c7-c7c1-453e-9353-29299487d5ab service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.745953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4828502a-28bc-456a-8465-834981d23b0f req-e76460c7-c7c1-453e-9353-29299487d5ab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.746820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4828502a-28bc-456a-8465-834981d23b0f req-e76460c7-c7c1-453e-9353-29299487d5ab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.776646 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4828502a-28bc-456a-8465-834981d23b0f req-e76460c7-c7c1-453e-9353-29299487d5ab service nova] Creating event network-vif-deleted:aea0c69a-3119-4b2b-9615-98cbdb05ee67 for instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 on n-h2-852086-5 Aug 27 03:27:47.798010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4828502a-28bc-456a-8465-834981d23b0f req-e76460c7-c7c1-453e-9353-29299487d5ab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096233 Aug 27 03:27:47.806144 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2085/4067] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:47.854124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0d59bf10-b66b-498e-8775-5bde5267cc7d req-f7634214-b9ac-4d11-b93b-58a2bb7e3aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-plugged", "status": "completed", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:47.875337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0d59bf10-b66b-498e-8775-5bde5267cc7d req-f7634214-b9ac-4d11-b93b-58a2bb7e3aba service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.877061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0d59bf10-b66b-498e-8775-5bde5267cc7d req-f7634214-b9ac-4d11-b93b-58a2bb7e3aba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.878695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0d59bf10-b66b-498e-8775-5bde5267cc7d req-f7634214-b9ac-4d11-b93b-58a2bb7e3aba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.911406 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0d59bf10-b66b-498e-8775-5bde5267cc7d req-f7634214-b9ac-4d11-b93b-58a2bb7e3aba service nova] Creating event network-vif-plugged:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:27:47.922220 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0d59bf10-b66b-498e-8775-5bde5267cc7d req-f7634214-b9ac-4d11-b93b-58a2bb7e3aba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073038 Aug 27 03:27:47.926807 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2086/4068] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:47.928318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.940743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f1de4c14-8359-4fac-a65e-ae04e6d06bf0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.445915 Aug 27 03:27:47.942308 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1983/4069] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:47 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:48.216194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:48.217599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:48.235511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.240844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.241704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.247151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.248676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.249238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.489145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:48.489791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:48.497921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.535887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.540418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.548920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.552425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.554699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.907973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:48.918805 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9969a87-1cc2-4e55-978e-33a00034576f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.433439 Aug 27 03:27:48.920121 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1984/4070] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:48 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:48.926781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:48.927500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:48.936080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.936749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.937072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.937931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.938597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.939185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.957387 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 HTTP/1.1 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '010a38a0-1870-4e4b-8b44-cf583e8e52b6'} Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:48.959362 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:48.963352 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:48.963352 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:48.963352 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:48.963352 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:48.963352 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:48.963352 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:27:48.963352 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:27:48.966920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:48.968177 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63a51e74-f75d-454f-9522-fbf8f5705864 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 404 len: 111 microversion: 2.1 time: 0.046672 Aug 27 03:27:48.969020 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1985/4071] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:48 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:48.978867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:48.979535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:49.001424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:49.002591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:49.014986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:49.016087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:49.016735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:49.017346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:49.186015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:49.200999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:49.202957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:49.205156 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-94b79e5a-c758-49bf-84d9-a2884dee167a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 1.000703 Aug 27 03:27:49.217779 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2087/4072] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:48 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:49.234839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:49.235389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50b5d1fd-ecef-4611-9339-055dbf1946a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '.version_select at 0x7fe4571a4e50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:49.265260 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40c4a213-9645-43cb-8636-1dfc7edf951c tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.294699 Aug 27 03:27:49.269501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1986/4073] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:48 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:49.327436 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50b5d1fd-ecef-4611-9339-055dbf1946a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-key-2060403056" status: 202 len: 0 microversion: 2.1 time: 0.095537 Aug 27 03:27:49.328569 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2088/4074] 10.222.0.69 () {58 vars in 1209 bytes} [Sat Aug 27 03:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2060403056 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:27:49.564634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1801850016", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "2b04f773-2696-4ad3-94c1-bcf6bb04ac97"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:49.650326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:49.792108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-936916187", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:49.904455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] validate_networks() for [('8616c99f-523a-4e1f-805f-fcb7d85c9627', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:50.603449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:50.604124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:50.604337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:50.604926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:50.605662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:50.622788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.623413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.623914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.625550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.626211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.626656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.654891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:50.661292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for user 8e78ab2dacae4a25803ea9f0cf512b87 and project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:50.683822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:50.686614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:50.707682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:50.708208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:50.708971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:50.709770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:50.710546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:50.729493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.730255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.731051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.732138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.732868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.733739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.756556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:50.763374 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-db447cf5-b703-4941-9990-9c451961ec81 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.136395 Aug 27 03:27:50.764801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:50.766363 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2089/4075] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:50.778475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:50.780410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:50.781669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:50.786270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:50.787616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.789348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.789913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.794782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.796273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.797504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.904618 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-480b3373-4a90-464a-8f5b-7f75b4e87fd9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346348 Aug 27 03:27:50.907046 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1987/4076] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:50.921927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:50.922648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:50.973500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.977105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.977487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:50.978299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:50.983008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:50.983008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:51.192613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:51.204864 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30fdda80-1bc7-4465-8338-475939c707e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.437361 Aug 27 03:27:51.222897 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2090/4077] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:50 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:51.229494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:51.230977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:51.240459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:51.241201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:51.242355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:51.243903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:51.244636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:51.245287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:51.754393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:51.766717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:51.768169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:51.769369 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9b0106f-dba0-4945-8fca-a2aca92c685f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.545136 Aug 27 03:27:51.803481 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2091/4078] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:51 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:51.814150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:51.821627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:51.847129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:51.847766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:51.849134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:51.861911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:51.862665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:51.864433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:51.990787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:52.021034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:52.033048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:52.036429 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9dd33770-a101-4255-8c46-13a8a6677e30 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2951 microversion: 2.32 time: 1.127275 Aug 27 03:27:52.040381 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1988/4079] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:50 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2951 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:52.059470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:52.065027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:52.086446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.091918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.099136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.100493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.103514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.109763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.289605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:52.299801 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-015a02f4-2130-40bc-8f0e-2fbe76ec4787 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.494765 Aug 27 03:27:52.300496 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2092/4080] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:51 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:52.322419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:52.323446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:52.342983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.343781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.346358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.347529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.349546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.350227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.543162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:52.583755 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17e4db30-94eb-438e-b675-80a747d57bc1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1205 microversion: 2.1 time: 0.282026 Aug 27 03:27:52.595810 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2093/4081] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:52 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1205 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:52.605971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:52.606912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:52.616952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.618067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.618924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.619929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.620785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.622030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.773112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:52.802077 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ec5ed09-a38e-4d99-bb81-3eea0f881cd4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1225 microversion: 2.1 time: 0.760493 Aug 27 03:27:52.808601 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1989/4082] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:52 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1225 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:52.860965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:52.864357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:52.883030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.885943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.886786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:52.889303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:52.893479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:52.894465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:53.050706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f59f3a42-b227-4726-a497-e260dc588177 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.452977 Aug 27 03:27:53.051322 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2094/4083] 10.222.0.69 () {60 vars in 1316 bytes} [Sat Aug 27 03:27:52 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b/os-interface => generated 1832 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:53.058529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:53.062039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:53.079014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:53.079807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:53.080401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:53.082790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:53.086676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:53.087465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:53.097356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:53.453832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:53.464442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:53.465961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:53.467248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0534041-40df-4588-a777-d86a54fced95 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.414704 Aug 27 03:27:53.467832 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2095/4084] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:53 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:53.477557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1723468808", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:53.517353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:53.533996 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecaa73b5-8c73-4823-9f66-3fbe1b777042 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.699475 Aug 27 03:27:53.534634 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1990/4085] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:52 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:53.557866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:53.571386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:53.577983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:53.605394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:53.608905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:53.609357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:53.610880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:53.616081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:53.618045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:53.623689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] validate_networks() for [('8616c99f-523a-4e1f-805f-fcb7d85c9627', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:55.053753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:55.054619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:55.055127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:55.055830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:55.057770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:55.077270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:55.092501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.093658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.094507 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d506944a-878c-4066-b2eb-49ecb77650ae tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 1.550887 Aug 27 03:27:55.095291 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1991/4086] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:53 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:55.095942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.096970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.099923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.101013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.109572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:55.110853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:55.129539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.130529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.131157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.132615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.134881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.139304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.153386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:55.160766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for user 8e78ab2dacae4a25803ea9f0cf512b87 and project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:55.177994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:55.185023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:55.274660 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc59df2c-11a5-4b65-8bda-1203fa870f35 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.801035 Aug 27 03:27:55.282197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2096/4087] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:55.297421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-a690a85a-e15f-47e5-b085-fb02a576b1c1 req-0c22e597-8646-4bf2-81ff-4d23c4cd3332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "name": "network-vif-plugged", "status": "completed", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:55.312574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a690a85a-e15f-47e5-b085-fb02a576b1c1 req-0c22e597-8646-4bf2-81ff-4d23c4cd3332 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.313458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a690a85a-e15f-47e5-b085-fb02a576b1c1 req-0c22e597-8646-4bf2-81ff-4d23c4cd3332 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.315731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a690a85a-e15f-47e5-b085-fb02a576b1c1 req-0c22e597-8646-4bf2-81ff-4d23c4cd3332 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.330931 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-a690a85a-e15f-47e5-b085-fb02a576b1c1 req-0c22e597-8646-4bf2-81ff-4d23c4cd3332 service nova] Creating event network-vif-plugged:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h1-852086-5 Aug 27 03:27:55.337985 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-a690a85a-e15f-47e5-b085-fb02a576b1c1 req-0c22e597-8646-4bf2-81ff-4d23c4cd3332 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044992 Aug 27 03:27:55.338954 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2097/4088] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:55.345083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:55.345950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:55.356698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.357912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.359050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.360000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.360814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.361392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.661850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:55.679883 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c406856d-106c-4b77-a9a1-3e23f9a53814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1267 microversion: 2.1 time: 0.576121 Aug 27 03:27:55.680606 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1992/4089] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:55 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1267 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:55.688805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:55.689720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:55.707192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.708061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.708716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:55.709815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:55.711103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:55.714111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.134729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.146989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.150605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.156213 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02b6f3d2-5217-43f9-b375-b2b9ec2448db tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.814084 Aug 27 03:27:56.157525 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2098/4090] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:55 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:56.162505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:56.163960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:56.170432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.177213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.182808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.184576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.185327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.185786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.326703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.329486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.338789 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc37ed58-f9dc-4e11-99d1-9aebb896a903 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.657011 Aug 27 03:27:56.339385 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1993/4091] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:55 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:56.342887 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4bed049-b3a4-4199-9ff0-7297d0af9a8e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1226 microversion: 2.1 time: 0.184015 Aug 27 03:27:56.347419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:56.348231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:56.364435 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2099/4092] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:56 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1226 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:56.367364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.376552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.377067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.377863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.378508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.378967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.704433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:56.710475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:56.718461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.719250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.719833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.720771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.721452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.722057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.830658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.848724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-638af46d-20e1-4fd8-aafb-471cd2ae5d9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1267 microversion: 2.1 time: 0.150188 Aug 27 03:27:56.850122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2100/4093] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:56 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:56.925963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:56.942360 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28cf2c1f-d83a-429a-95a7-702b72398007 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.598266 Aug 27 03:27:56.943285 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1994/4094] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:56 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:57.185604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:57.187072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:57.197112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.198025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.199582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.202930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.204459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.206209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.365813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:57.369529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:57.390888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.392047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.392724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.395384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.398813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.399403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.440085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:57.888378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:57.923740 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8050a95d-6b7e-49d0-8b10-3167562e325b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.562639 Aug 27 03:27:57.925482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1995/4095] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:57 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:27:57.932297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:57.933335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:57.941998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.942799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.943575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:57.944386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:57.945185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:57.945879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.008174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:58.034102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:58.044743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:58.054347 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b1f3bd9e-c587-4248-89bd-ac4a0999dc68 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.871087 Aug 27 03:27:58.071773 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2101/4096] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:57 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:58.093399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:58.098863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:58.123809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.125707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.128199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.129163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.131373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.133976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.582426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:58.597849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fe71a4a9-4ba2-405b-b343-5818a543c59f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.523014 Aug 27 03:27:58.598803 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2102/4097] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:58 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:58.611290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:58.612174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:58.638475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.639436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.640056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.640983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.641607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.642231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.892578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:58.925930 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ea9b26a-69df-4cf4-a67e-50f5e44b55c3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1274 microversion: 2.1 time: 0.990112 Aug 27 03:27:58.928688 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1996/4098] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:57 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1274 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:58.942440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8b4348a0-b39c-469a-b644-0728e6c33ab9 req-0d0be700-7b02-4bd3-83f8-d21724c914b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6149aa8e-84bb-4a4c-933c-da6b1c15a90e", "tag": "df29fb7e-38e5-4a90-b040-48fc33be1ef4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:58.974930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8b4348a0-b39c-469a-b644-0728e6c33ab9 req-0d0be700-7b02-4bd3-83f8-d21724c914b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.975749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8b4348a0-b39c-469a-b644-0728e6c33ab9 req-0d0be700-7b02-4bd3-83f8-d21724c914b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.976507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8b4348a0-b39c-469a-b644-0728e6c33ab9 req-0d0be700-7b02-4bd3-83f8-d21724c914b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.007971 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8b4348a0-b39c-469a-b644-0728e6c33ab9 req-0d0be700-7b02-4bd3-83f8-d21724c914b8 service nova] Creating event network-changed:df29fb7e-38e5-4a90-b040-48fc33be1ef4 for instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e on n-h2-852086-5 Aug 27 03:27:59.018247 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8b4348a0-b39c-469a-b644-0728e6c33ab9 req-0d0be700-7b02-4bd3-83f8-d21724c914b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086828 Aug 27 03:27:59.019774 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1997/4099] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:59.040108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:59.046778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:59.050492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:59.053929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c72aaaf-c784-40a5-ab50-8b89259af5c3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.453779 Aug 27 03:27:59.056009 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2103/4100] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:58 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:59.065133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.066813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.068941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.071631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.072508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.076469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.091518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:59.092402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:59.108903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.111802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.117034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.118639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.119131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.119933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.464090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:59.480913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:59.482821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:59.486529 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-72d00158-e71f-41de-8593-968555f3179f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1729 microversion: 2.20 time: 0.405503 Aug 27 03:27:59.494050 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2104/4101] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:27:59 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1729 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:27:59.556209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:59.564719 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d46abd9-4b0f-488a-8608-402cdd999575 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.540009 Aug 27 03:27:59.582915 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1998/4102] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:59 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:59.624795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:59.625414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:59.641616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.642500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.643104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.643989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.644623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.645050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.850296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:59.868147 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c77be39c-96d6-4159-9c32-e0700fbdd4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.246702 Aug 27 03:27:59.870404 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2105/4103] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:59 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:59.955059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:59.956701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:59.969455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.972350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.973009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.973946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.974970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.977102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.076153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:00.076774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:00.085153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.085971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.086497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.087217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.087671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.088094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.141905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:00.158223 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d83076a-fc81-4e01-b6ea-7edc8772f698 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1280 microversion: 2.1 time: 0.209833 Aug 27 03:28:00.159056 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1999/4104] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:59 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:00.336867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:00.347635 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6bacf01-e30e-4fb3-8b01-c4abf82a5f83 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1505 microversion: 2.1 time: 0.275451 Aug 27 03:28:00.351949 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2106/4105] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:00 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:00.518403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:00.522278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:00.546366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.546995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.547672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.548574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.549170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.549709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.595588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:00.596354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:00.615241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.617387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.618008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.618830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.621632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.622707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.744471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:00.775138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:00.931556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:00.954662 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad3e78ab-5418-40ba-bfd9-ef5612187afb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.357565 Aug 27 03:28:00.954662 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2107/4106] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:00 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:00.965778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-93f310b4-b94b-4acd-b720-0c6ecf46ec2e req-fe73ddf7-ba97-4a3d-be9a-429541e48146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7972c949-6a4f-44e5-908b-e7ef35f7b275", "tag": "22852294-181a-40e1-87c8-8f529beb5507"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:00.982556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93f310b4-b94b-4acd-b720-0c6ecf46ec2e req-fe73ddf7-ba97-4a3d-be9a-429541e48146 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.986479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93f310b4-b94b-4acd-b720-0c6ecf46ec2e req-fe73ddf7-ba97-4a3d-be9a-429541e48146 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.987080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93f310b4-b94b-4acd-b720-0c6ecf46ec2e req-fe73ddf7-ba97-4a3d-be9a-429541e48146 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.004454 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-93f310b4-b94b-4acd-b720-0c6ecf46ec2e req-fe73ddf7-ba97-4a3d-be9a-429541e48146 service nova] Creating event network-changed:22852294-181a-40e1-87c8-8f529beb5507 for instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 on n-h2-852086-5 Aug 27 03:28:01.019710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-93f310b4-b94b-4acd-b720-0c6ecf46ec2e req-fe73ddf7-ba97-4a3d-be9a-429541e48146 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069911 Aug 27 03:28:01.020359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2108/4107] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:01.028563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:01.036662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:01.047154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.048393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.050155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.051270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.051915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.052506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.228180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:01.252199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:01.262403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:01.273269 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aabba3a4-45f7-451a-8689-b6d8ab29c7f1 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1716 microversion: 2.20 time: 0.750527 Aug 27 03:28:01.274888 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2000/4108] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:00 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1716 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:01.286260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:01.287699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:01.304339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.305939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.307414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.308636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.309335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.310006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.402200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:01.411259 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b9da269b-9456-4bbb-984b-bbeab84eee52 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.389644 Aug 27 03:28:01.423603 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2109/4109] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:01 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:01.429654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:01.430638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:01.441076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.441748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.444038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.447232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.448034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.448486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.495966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:01.512154 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d855d33d-99d7-4388-b9b4-fe3fc5f9eba5 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1280 microversion: 2.1 time: 0.234710 Aug 27 03:28:01.512991 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2001/4110] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:01 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:01.689130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:01.698458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65e604fa-cfbd-4493-8aa8-56afdc15de52 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1485 microversion: 2.1 time: 0.273418 Aug 27 03:28:01.710517 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2110/4111] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:01 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1485 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:01.864098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1581338694", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:01.983791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:01.990035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:01.995493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] validate_networks() for [('3b07bf9e-9073-45ab-8322-e54fc983f3bd', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:28:02.010664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.011525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.012205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:02.013143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.013898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.014599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:02.227089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:02.238396 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e726337-500c-4f49-918a-b48e4d19f6bb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.273249 Aug 27 03:28:02.241112 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2111/4112] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:01 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:02.440882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:02.441825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:02.454052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.454920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.456588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:02.466680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.468153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.468853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:02.807691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:02.822330 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d820c064-b693-4388-86c8-8631902e599e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.385650 Aug 27 03:28:02.822927 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2112/4113] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:02 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:02.851181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:02.852244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:02.859412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.860267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.860960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:02.861924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.862634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.863272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.096454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:03.114913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:03.120789 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-796e9128-cfe4-4973-86bc-e1f4e2848394 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.280383 Aug 27 03:28:03.122359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2113/4114] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:02 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:03.274266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:03.275085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:03.289831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:03.290494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:03.291014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.291828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:03.292365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:03.292878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.501988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:03.517315 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4c536dd2-18db-43f4-9ba5-158076292700 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.251106 Aug 27 03:28:03.518000 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2114/4115] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:03 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:03.769565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:28:03.770641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:28:03.771343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:28:03.771934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:28:03.772648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:28:03.799530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:03.807188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:03.812108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.814923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:03.817376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:03.817920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.839482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Getting quotas for project 64ead14cbaec48cea0f7317e81ea8325. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:28:03.845978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Getting quotas for user e198e17424c9429381bccc4b8ce7ce6b and project 64ead14cbaec48cea0f7317e81ea8325. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:28:03.858226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:03.858851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:03.864340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:28:03.869276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:28:03.869476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:03.869903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:03.874486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.875266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:03.875737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:03.876171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.955779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a7f1fd6-ead5-4452-8f1f-b50a6b723ebb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.096532 Aug 27 03:28:03.961369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2002/4116] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:28:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:28:03.966979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-061d22e3-03e6-4755-a524-40bf6dcc61cd req-5aaf7ac2-535e-42a3-9dd9-c1cfb654ada2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6149aa8e-84bb-4a4c-933c-da6b1c15a90e", "name": "network-vif-plugged", "status": "completed", "tag": "df29fb7e-38e5-4a90-b040-48fc33be1ef4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:03.994611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-061d22e3-03e6-4755-a524-40bf6dcc61cd req-5aaf7ac2-535e-42a3-9dd9-c1cfb654ada2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:03.995229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-061d22e3-03e6-4755-a524-40bf6dcc61cd req-5aaf7ac2-535e-42a3-9dd9-c1cfb654ada2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:03.995708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-061d22e3-03e6-4755-a524-40bf6dcc61cd req-5aaf7ac2-535e-42a3-9dd9-c1cfb654ada2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.009103 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-061d22e3-03e6-4755-a524-40bf6dcc61cd req-5aaf7ac2-535e-42a3-9dd9-c1cfb654ada2 service nova] Creating event network-vif-plugged:df29fb7e-38e5-4a90-b040-48fc33be1ef4 for instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e on n-h2-852086-5 Aug 27 03:28:04.014809 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-061d22e3-03e6-4755-a524-40bf6dcc61cd req-5aaf7ac2-535e-42a3-9dd9-c1cfb654ada2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051464 Aug 27 03:28:04.016110 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2003/4117] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:04.021700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa70a88b-4ebb-4a13-97c6-5663f651b38d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:04.023705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa70a88b-4ebb-4a13-97c6-5663f651b38d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:04.227785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aa70a88b-4ebb-4a13-97c6-5663f651b38d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:04.239216 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa70a88b-4ebb-4a13-97c6-5663f651b38d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1214 microversion: 2.1 time: 0.221833 Aug 27 03:28:04.246744 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2004/4118] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:04 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:04.264443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:04.268459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:04.285951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:04.289427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:04.290966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.293653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:04.295216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:04.298319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.319144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:04.332481 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f5f4882-bd50-4cef-b49e-e12aa23a95a0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.480748 Aug 27 03:28:04.346514 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2115/4119] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:03 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:04.552811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:04.554183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:04.556325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:04.582291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:04.582738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:04.585126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.587465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:04.587951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:04.590932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.824194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:04.833482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-092cc1d5-bee7-4e6a-a235-b71aadd9529b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.585468 Aug 27 03:28:04.834368 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2005/4120] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:04 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:04.861053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:04.873319 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1da4fef5-aeb5-49e0-be8a-40540639d01e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.324227 Aug 27 03:28:04.876007 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2116/4121] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:04 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:05.262904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:05.264124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:05.272079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.273147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.274378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.275178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.275672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.276114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.353918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:05.354814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:05.361071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:05.362632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:05.365884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.367092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.367859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.368791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.369397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.369958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.560961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:05.565245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:05.574420 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78912b9f-d241-4370-8a19-803f1c1cd049 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1218 microversion: 2.1 time: 0.316178 Aug 27 03:28:05.577158 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c56fab99-64cf-4a74-9760-8a478eac097c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.227821 Aug 27 03:28:05.577862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2006/4122] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:05 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1218 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:05.578098 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2117/4123] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:05 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:05.813310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-21cb1130-069b-4691-85cc-1c1dca9ae034 req-dc032d08-a7ae-4790-8259-a096a3119657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e47f54e-4421-4a9f-978e-ebd3e92aff77", "tag": "a6345e7d-90fc-4730-9aeb-af9bb2570beb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:05.850321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-21cb1130-069b-4691-85cc-1c1dca9ae034 req-dc032d08-a7ae-4790-8259-a096a3119657 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.856596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-21cb1130-069b-4691-85cc-1c1dca9ae034 req-dc032d08-a7ae-4790-8259-a096a3119657 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.859292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:05.860454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-21cb1130-069b-4691-85cc-1c1dca9ae034 req-dc032d08-a7ae-4790-8259-a096a3119657 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.860861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:05.879959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.880830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.881491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.882833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.883580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.884226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.924368 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-21cb1130-069b-4691-85cc-1c1dca9ae034 req-dc032d08-a7ae-4790-8259-a096a3119657 service nova] Creating event network-changed:a6345e7d-90fc-4730-9aeb-af9bb2570beb for instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 on n-h1-852086-5 Aug 27 03:28:05.940846 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-21cb1130-069b-4691-85cc-1c1dca9ae034 req-dc032d08-a7ae-4790-8259-a096a3119657 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134236 Aug 27 03:28:05.948103 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2118/4124] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:28:05.968016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:05.975231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:05.997061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.002922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.004391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.006096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.008629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.011058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.430454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:06.439838 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d6e7f6b-5089-4b6e-bcd6-a5efae0fd59f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1681 microversion: 2.1 time: 0.489553 Aug 27 03:28:06.440752 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2119/4125] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:05 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1681 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:06.598291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:06.599105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:06.605855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.606622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.607253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.608597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.609241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.609839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.760644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:06.829015 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb306b8a-dbf4-4676-9b8d-c88f208bea45 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.971468 Aug 27 03:28:06.829652 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2007/4126] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:05 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:06.861312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:06.865638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:06.876510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.877351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.878142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.879458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.880240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.881479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.937221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:06.952275 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-968d3d76-8f17-4d3e-817a-60e8e29bc1c5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.356820 Aug 27 03:28:06.953583 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2120/4127] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:06 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:07.065310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:07.073730 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f8f6154-fb01-4c0a-98c5-4eb92b9e9e9a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1274 microversion: 2.1 time: 0.227086 Aug 27 03:28:07.074355 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2008/4128] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:06 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:07.465473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:07.467984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:07.481607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:07.482322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:07.483090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:07.484562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:07.485066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:07.485508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:07.752277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:07.766665 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5eebc17a-0cf1-4c3b-87a9-369511682d37 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.308093 Aug 27 03:28:07.767276 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2121/4129] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:07 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:07.852754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:07.853898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:07.865191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:07.865700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:07.866769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:07.869037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:07.870201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:07.871529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:07.988106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:07.990368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:08.003529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.004665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.005216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.006118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.007257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.008598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.294496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:08.308151 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-568c1a73-2f38-418d-8ae3-3c13ac4c71eb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.333154 Aug 27 03:28:08.308763 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2122/4130] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:07 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:08.316403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:08.317288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:08.326569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.327400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.328062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.330264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.331573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.332234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.380148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:08.391592 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c094581e-38a5-4305-bf5a-26542a046908 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.544399 Aug 27 03:28:08.404690 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2009/4131] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:07 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:08.404690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d6ec69a2-1b6f-4826-af04-ff2e1efad644 req-982fed7b-c2e7-4d43-a089-22e4a614e850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7972c949-6a4f-44e5-908b-e7ef35f7b275", "name": "network-vif-plugged", "status": "completed", "tag": "22852294-181a-40e1-87c8-8f529beb5507"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:08.411631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d6ec69a2-1b6f-4826-af04-ff2e1efad644 req-982fed7b-c2e7-4d43-a089-22e4a614e850 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.412188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d6ec69a2-1b6f-4826-af04-ff2e1efad644 req-982fed7b-c2e7-4d43-a089-22e4a614e850 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.412696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d6ec69a2-1b6f-4826-af04-ff2e1efad644 req-982fed7b-c2e7-4d43-a089-22e4a614e850 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.435100 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d6ec69a2-1b6f-4826-af04-ff2e1efad644 req-982fed7b-c2e7-4d43-a089-22e4a614e850 service nova] Creating event network-vif-plugged:22852294-181a-40e1-87c8-8f529beb5507 for instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 on n-h2-852086-5 Aug 27 03:28:08.444056 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d6ec69a2-1b6f-4826-af04-ff2e1efad644 req-982fed7b-c2e7-4d43-a089-22e4a614e850 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048944 Aug 27 03:28:08.446284 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2010/4132] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:08.646119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:08.656745 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58989123-bd47-4c81-94e7-aecc6312d084 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1314 microversion: 2.1 time: 0.345233 Aug 27 03:28:08.657715 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2123/4133] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:08 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:08.928035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:08.928668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:08.935096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.935820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.936437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.937333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.938075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.938847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.108790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6832e016-b895-4e14-9531-63706dece047 req-34a9d324-5e1f-4cee-a1b4-0a55009e44fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33451c2d-e89b-421d-a61c-0c15ff478c9e", "tag": "2888e755-20a0-4360-bd78-65bf9c376320"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:09.121922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6832e016-b895-4e14-9531-63706dece047 req-34a9d324-5e1f-4cee-a1b4-0a55009e44fe service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.122724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6832e016-b895-4e14-9531-63706dece047 req-34a9d324-5e1f-4cee-a1b4-0a55009e44fe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.123316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6832e016-b895-4e14-9531-63706dece047 req-34a9d324-5e1f-4cee-a1b4-0a55009e44fe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.137407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6832e016-b895-4e14-9531-63706dece047 req-34a9d324-5e1f-4cee-a1b4-0a55009e44fe service nova] Creating event network-changed:2888e755-20a0-4360-bd78-65bf9c376320 for instance 33451c2d-e89b-421d-a61c-0c15ff478c9e on n-h2-852086-5 Aug 27 03:28:09.144171 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6832e016-b895-4e14-9531-63706dece047 req-34a9d324-5e1f-4cee-a1b4-0a55009e44fe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059337 Aug 27 03:28:09.145094 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2124/4134] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:28:09.175742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:09.190458 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1dfc5e1b-4a94-4b26-91f0-ea8db16207f9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.277251 Aug 27 03:28:09.191441 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2011/4135] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:08 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:09.337027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:09.352692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:09.364576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.364576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.364997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.365684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.368035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.368576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.413540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:09.414545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:09.425194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.426057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.426790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.428065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.430229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.431023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.653666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:09.671850 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a10b1509-9718-474a-9a05-9783144c61ab tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1309 microversion: 2.1 time: 0.343749 Aug 27 03:28:09.689200 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2125/4136] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:09 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:09.705142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:09.705773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:09.723434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.724166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.724765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.725708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.730473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:09.738473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.743042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.745276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e114e52-200a-4ae7-9926-b106a5f1eabb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.332666 Aug 27 03:28:09.745908 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2012/4137] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:09 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:10.047562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:10.059659 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-94c132f6-c157-4ab9-86df-d34e11a9f17d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1314 microversion: 2.1 time: 0.361040 Aug 27 03:28:10.060860 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2126/4138] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:09 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:10.629353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:10.631354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:10.640457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.641250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.641993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.642920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.643531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.644108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.693632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:10.695254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:10.703711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.704869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.705859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.707689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.709234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.712020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.893768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:10.903986 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-18e77606-2c89-4de0-9213-fc7447cefd56 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1490 microversion: 2.1 time: 0.214330 Aug 27 03:28:10.904594 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2127/4139] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:10 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1490 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:10.915574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:10.915574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:10.922247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.923271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.924161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.925497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.927327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.927673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.972750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:10.983924 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14d3bad5-067c-47d9-a46b-82c211a92bb9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.359019 Aug 27 03:28:10.994831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2013/4140] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:10 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:11.004070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1801850016", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "2b04f773-2696-4ad3-94c1-bcf6bb04ac97"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:11.090085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:28:11.112060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:11.124422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df794771-5d1a-4849-9d3a-be9f0538e585 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.218668 Aug 27 03:28:11.125309 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2128/4141] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:10 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:11.135541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:11.136390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:11.145000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.145393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.146289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.148073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.148784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.149382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.314013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:11.324684 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2b7228c-52be-498c-b2c3-168ae9ca14c5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.197953 Aug 27 03:28:11.325443 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2129/4142] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:11 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:11.330776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:11.331685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:11.340512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.342150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.342717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.343534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.344090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.344667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.848605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:28:11.851299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:28:11.852465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:28:11.853512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:28:11.855763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:28:11.884073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.886054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.888066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.889852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.891291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.893100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.948317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:28:11.962496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:28:11.992244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:28:11.997321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:28:12.128431 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd4da640-3385-44be-bf2f-824a56c033b5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132074 Aug 27 03:28:12.140064 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2014/4143] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:28:12.147041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:12.155139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:12.175918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.179761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.180412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.182739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.182872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:12.184239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.185542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.198309 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b2fd4e3-3837-4bcd-b389-c4e85ea468f8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1314 microversion: 2.1 time: 0.871428 Aug 27 03:28:12.199252 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2130/4144] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:11 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:12.214317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f557b3bc-0048-4636-bcb7-d70831c756a4 req-90c1f745-46af-4530-893a-8ed87ba1d192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-unplugged", "status": "completed", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:12.242332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f557b3bc-0048-4636-bcb7-d70831c756a4 req-90c1f745-46af-4530-893a-8ed87ba1d192 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.242833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f557b3bc-0048-4636-bcb7-d70831c756a4 req-90c1f745-46af-4530-893a-8ed87ba1d192 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.243278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f557b3bc-0048-4636-bcb7-d70831c756a4 req-90c1f745-46af-4530-893a-8ed87ba1d192 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.278251 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f557b3bc-0048-4636-bcb7-d70831c756a4 req-90c1f745-46af-4530-893a-8ed87ba1d192 service nova] Creating event network-vif-unplugged:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:28:12.289052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f557b3bc-0048-4636-bcb7-d70831c756a4 req-90c1f745-46af-4530-893a-8ed87ba1d192 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088469 Aug 27 03:28:12.290268 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2131/4145] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:12.295895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-247e69fb-de7f-471b-94ed-3c866c6558ee tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:12.301668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-247e69fb-de7f-471b-94ed-3c866c6558ee tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:12.451893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-247e69fb-de7f-471b-94ed-3c866c6558ee tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:12.470648 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-247e69fb-de7f-471b-94ed-3c866c6558ee tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1209 microversion: 2.1 time: 0.178283 Aug 27 03:28:12.472304 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2132/4146] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:12 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1209 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:12.480008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:12.482744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:12.497293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.497927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.498939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.500181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.500995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.501539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.516705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:12.528219 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bad5855-0727-45a0-be17-aca537726fc5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.386671 Aug 27 03:28:12.528823 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2015/4147] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:12 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:12.548104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:12.556034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:12.558740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:12.566801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.567496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.567947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.568678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.569175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.569623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.588698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:12.680122 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4247b9e4-b0fe-4b85-b201-062fa4df5649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.129672 Aug 27 03:28:12.682222 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2016/4148] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:12 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:12.702866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:12.704382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:12.722636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.723772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.724391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.726121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.727138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.727824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:13.099456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:13.119556 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b79ccf28-3726-4898-8172-2d137923aa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1670 microversion: 2.1 time: 0.432319 Aug 27 03:28:13.120728 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2017/4149] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:12 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:13.164889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:13.184279 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4949bd77-3668-4c00-a8fe-cbd747ab4c8f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.709562 Aug 27 03:28:13.185251 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2133/4150] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:12 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:13.237128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:13.237859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:13.247066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.248011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.249158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:13.250623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.251440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.252220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:13.494847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:13.495822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:13.506016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.509271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.511287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:13.512115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.512611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.513031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:13.606951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:13.610218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:13.617572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff1ea9f3-c15c-4516-8d23-0f955456f0e0 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1314 microversion: 2.1 time: 0.384401 Aug 27 03:28:13.619536 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2018/4151] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:13 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:13.627002 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4115d4fc-bea9-419d-8475-b7b97455eb61 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1261 microversion: 2.1 time: 0.137520 Aug 27 03:28:13.628533 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2134/4152] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:13 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:14.145946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:14.147595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:14.156443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.157272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.157943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.158904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.159605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.160237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.211371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:14.211981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:14.223516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.224667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.225239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.227109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.227734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.228828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.492938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:14.503355 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2863ccb4-d5ba-44d9-8b96-dbf4a9a36326 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.298043 Aug 27 03:28:14.505056 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2135/4153] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:14 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:14.511695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-58a4e12c-f5d9-416a-bb0e-0e8316f53d1d req-8848bd08-4a8e-4fc7-88c6-e369cd3220ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47f54e-4421-4a9f-978e-ebd3e92aff77", "name": "network-vif-plugged", "status": "completed", "tag": "a6345e7d-90fc-4730-9aeb-af9bb2570beb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:14.533589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-58a4e12c-f5d9-416a-bb0e-0e8316f53d1d req-8848bd08-4a8e-4fc7-88c6-e369cd3220ad service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.534371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-58a4e12c-f5d9-416a-bb0e-0e8316f53d1d req-8848bd08-4a8e-4fc7-88c6-e369cd3220ad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.534967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-58a4e12c-f5d9-416a-bb0e-0e8316f53d1d req-8848bd08-4a8e-4fc7-88c6-e369cd3220ad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.550269 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-58a4e12c-f5d9-416a-bb0e-0e8316f53d1d req-8848bd08-4a8e-4fc7-88c6-e369cd3220ad service nova] Creating event network-vif-plugged:a6345e7d-90fc-4730-9aeb-af9bb2570beb for instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 on n-h1-852086-5 Aug 27 03:28:14.559588 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-58a4e12c-f5d9-416a-bb0e-0e8316f53d1d req-8848bd08-4a8e-4fc7-88c6-e369cd3220ad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052818 Aug 27 03:28:14.564783 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2136/4154] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:14.596518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:14.636970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0178596-86c3-45e1-9eca-2dc348c775c9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1670 microversion: 2.1 time: 0.495629 Aug 27 03:28:14.639467 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2019/4155] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:14 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1670 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:14.660602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:14.661438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:14.665542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:14.669013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:14.676309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.676822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.677270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.677991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.684185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.684685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.690351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.691824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.692795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.694599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:14.695653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:14.696699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.023916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:15.040821 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c47756a-df15-421f-bbc7-1ba4f1a3b62a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1267 microversion: 2.1 time: 0.389446 Aug 27 03:28:15.042505 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2020/4156] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:14 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1267 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:15.162150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:15.174862 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ca8a434-a04c-40b4-9f72-6213b39b9b0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1314 microversion: 2.1 time: 0.536705 Aug 27 03:28:15.177079 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2137/4157] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:14 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:15.539184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:15.540269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:15.574204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.576487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.577301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.579178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.579876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.580433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.680188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:15.681339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:15.705890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.707415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.708468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.710018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.713223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.714307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.842795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:15.857694 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36983983-303e-4bbc-84c9-528008fd8282 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1322 microversion: 2.1 time: 0.325860 Aug 27 03:28:15.870732 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2021/4158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:15 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:15.950430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:15.970861 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4414a372-cc96-429f-821f-f9c68f09b13c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.306640 Aug 27 03:28:15.986778 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2138/4159] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:15 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:15.999784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:16.004962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:16.017067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.017945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.018786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.020036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.020844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.021638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.068638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:16.070802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:16.083305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.084228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.085058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.086645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.087476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.088219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.094589 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03ffacfb-19bb-4501-b1d8-fe823edec022 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 200 len: 323 microversion: 2.1 time: 0.104081 Aug 27 03:28:16.095790 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2022/4160] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:15 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 323 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:16.110291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:16.111442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:16.121651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.122372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.122899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.123545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.124009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.125306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.364987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:16.383923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2109b5c-261c-4160-9e35-3661ecc0c6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1309 microversion: 2.1 time: 0.324584 Aug 27 03:28:16.384771 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2139/4161] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:16 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1309 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:16.409492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:16.411228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:16.426911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.427618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.428219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.429512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.434671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.437976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.679881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:16.689165 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-99875140-b7c7-4338-8618-1f97adb76ba8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1314 microversion: 2.1 time: 0.294580 Aug 27 03:28:16.703054 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2140/4162] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:16 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:16.711976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8f91c34a-98b5-41c0-950d-36fe3d4d48c4 req-ba5664cc-676d-4bbb-acd5-c248b0686524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33451c2d-e89b-421d-a61c-0c15ff478c9e", "name": "network-vif-plugged", "status": "completed", "tag": "2888e755-20a0-4360-bd78-65bf9c376320"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:16.722291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8f91c34a-98b5-41c0-950d-36fe3d4d48c4 req-ba5664cc-676d-4bbb-acd5-c248b0686524 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.722914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8f91c34a-98b5-41c0-950d-36fe3d4d48c4 req-ba5664cc-676d-4bbb-acd5-c248b0686524 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.723576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8f91c34a-98b5-41c0-950d-36fe3d4d48c4 req-ba5664cc-676d-4bbb-acd5-c248b0686524 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.737493 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8f91c34a-98b5-41c0-950d-36fe3d4d48c4 req-ba5664cc-676d-4bbb-acd5-c248b0686524 service nova] Creating event network-vif-plugged:2888e755-20a0-4360-bd78-65bf9c376320 for instance 33451c2d-e89b-421d-a61c-0c15ff478c9e on n-h2-852086-5 Aug 27 03:28:16.743427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8f91c34a-98b5-41c0-950d-36fe3d4d48c4 req-ba5664cc-676d-4bbb-acd5-c248b0686524 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038779 Aug 27 03:28:16.744155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2141/4163] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:16.894804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:16.896358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:16.907250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.907250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.907250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.907250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.907250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.907250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.938037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:16.946513 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06f67a51-e1db-4d65-a1aa-1d14f061f735 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.841172 Aug 27 03:28:16.963022 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2023/4164] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:16 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:16.989014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:16.990500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:17.007735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.008932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.009969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.011501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.013869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.015197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.134527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:17.143680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2b87f07-fcd8-4ebb-b636-674919b2101a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1515 microversion: 2.1 time: 0.254954 Aug 27 03:28:17.144257 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2142/4165] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:16 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:17.167441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:17.170966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:17.180278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.180978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.181630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.182698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.183108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.183272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.210646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'flavor' on Instance uuid 4e47f54e-4421-4a9f-978e-ebd3e92aff77 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:17.333743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:17.356253 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2fc77de6-6db4-4710-b901-863d72d2a154 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.374878 Aug 27 03:28:17.357506 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2024/4166] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:16 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:17.388032 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39395891-efbc-43df-8235-45d8d937b7d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action" status: 200 len: 32 microversion: 2.1 time: 0.225240 Aug 27 03:28:17.388780 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2143/4167] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:17 2022] POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:28:17.393073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:17.394137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:17.401229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:17.402723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:17.419664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.426358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.427080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.430445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.430676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.433111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.433549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.435089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.436122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.447107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.448467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.449579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.756048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:17.765821 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce0b9f1c-e543-4d11-99d4-8fd37e30d0d9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.369005 Aug 27 03:28:17.767165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2144/4168] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:17 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:17.773833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:17.774726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:17.798471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.799391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.800048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.801014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.812205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.818516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.992757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:18.006498 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa50da62-b59a-4eaa-9211-33093d477517 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.620612 Aug 27 03:28:18.007653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2025/4169] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:17 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:18.013677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:18.015492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:18.026003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:18.028752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.029505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.030264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.031155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.033650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.034314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.058006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:18.068113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d64275e-bf7f-475d-8ab8-b9638feed418 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1309 microversion: 2.1 time: 0.299556 Aug 27 03:28:18.068874 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2145/4170] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:17 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:18.074588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-efc18be3-91f0-4bd0-a923-b46483ca7faf req-25dac421-bdeb-4242-9c77-fdc0244316c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3aaaa43-32ea-4b23-a28a-9bd35a335b5c", "tag": "42d99cfe-76bc-4827-94b2-246f286ea304"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:18.089842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-efc18be3-91f0-4bd0-a923-b46483ca7faf req-25dac421-bdeb-4242-9c77-fdc0244316c3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.091161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-efc18be3-91f0-4bd0-a923-b46483ca7faf req-25dac421-bdeb-4242-9c77-fdc0244316c3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.092217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-efc18be3-91f0-4bd0-a923-b46483ca7faf req-25dac421-bdeb-4242-9c77-fdc0244316c3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.117678 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-efc18be3-91f0-4bd0-a923-b46483ca7faf req-25dac421-bdeb-4242-9c77-fdc0244316c3 service nova] Creating event network-changed:42d99cfe-76bc-4827-94b2-246f286ea304 for instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c on n-h1-852086-5 Aug 27 03:28:18.124990 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-efc18be3-91f0-4bd0-a923-b46483ca7faf req-25dac421-bdeb-4242-9c77-fdc0244316c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054108 Aug 27 03:28:18.126003 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2146/4171] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:18.135563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:18.136279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:18.144360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.144857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.145294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.146013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.146486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.147622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.396515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:18.409262 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-74be9f3f-077c-4003-8b99-b579696f536c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.280475 Aug 27 03:28:18.410419 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2147/4172] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:18 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:18.533659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:18.567343 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed4a575a-bdf2-45f0-9091-fb44a35e9025 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1314 microversion: 2.1 time: 0.554761 Aug 27 03:28:18.574499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1064840437", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "05166925-98fa-4fca-b74f-85bb13110797"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:18.579821 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2026/4173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:18 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:18.657792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] validate_networks() for [('05166925-98fa-4fca-b74f-85bb13110797', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:28:18.792692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:18.793746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:18.816791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.818672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.820573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.826515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.827562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.828498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.081233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:19.095958 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cf7b283-7e30-4207-be42-139964e5b05d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.310392 Aug 27 03:28:19.096980 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2027/4174] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:18 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:19.119150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:19.122396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:19.134127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.135049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.135833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.137107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.137946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.138730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.345101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:19.356048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6eaae85-b95c-4850-bd8c-dbe08acb0036 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1309 microversion: 2.1 time: 0.246886 Aug 27 03:28:19.356654 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2028/4175] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:19 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:19.374483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:28:19.375102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:28:19.375509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:28:19.375975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:28:19.376458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:28:19.386932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.387467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.388069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.388892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.389450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.389968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.408397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:28:19.414583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for user 89f850adf9a7432798f86fe9d2d17b79 and project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:28:19.427761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:28:19.431201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:28:19.479256 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48d09f29-c58b-4d42-8fbc-e939645ddd1e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908595 Aug 27 03:28:19.480125 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2148/4176] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:28:19.499170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7087ac67-93e6-445a-9593-209913e849c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:19.499895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7087ac67-93e6-445a-9593-209913e849c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:19.575378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7087ac67-93e6-445a-9593-209913e849c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:19.588581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7087ac67-93e6-445a-9593-209913e849c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1215 microversion: 2.1 time: 0.095595 Aug 27 03:28:19.589617 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2029/4177] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:19 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:19.592509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:19.593266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:19.602556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.603265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.603824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.604762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.605327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.605849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.759307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:19.775994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a637148-1e86-44e5-b75f-8ef18d450f3d tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1500 microversion: 2.1 time: 0.188398 Aug 27 03:28:19.777106 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2149/4178] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:19 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:19.812563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:19.815382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:19.827709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.828598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.829630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.830912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.831774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.832557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.861423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lazy-loading 'flavor' on Instance uuid 33451c2d-e89b-421d-a61c-0c15ff478c9e {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:19.967719 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5929618-fb08-4bfb-8941-580cdd4aef9e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "POST /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e/action" status: 200 len: 32 microversion: 2.1 time: 0.159843 Aug 27 03:28:19.968748 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2030/4179] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:19 2022] POST /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:28:19.987352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:19.988566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:19.996088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.996880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.997614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.998666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.999419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.999852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.133953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:20.137119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.150960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.152570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.154536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.156852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.157978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.159151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.201991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:20.205394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:20.210300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:20.212502 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45ac21f0-d108-4784-bcf3-73d9f1ac5e59 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.237406 Aug 27 03:28:20.213545 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2150/4180] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:19 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:20.381810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:20.383084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.404313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.405560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.406582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.408012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.410988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.411313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.512029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:20.520293 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-774524de-893f-493c-8ad1-d59a8f868542 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.395494 Aug 27 03:28:20.521436 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2031/4181] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:20 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:20.613311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:20.614520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.631044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.635280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.636032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.637248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.638040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.641620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.687847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:20.706817 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bbb06453-6d73-4485-8d1c-2b68e2bfd6c3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1309 microversion: 2.1 time: 0.331542 Aug 27 03:28:20.708297 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2151/4182] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:20 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:20.849349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:20.860157 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccd9ba9a-ecf7-47e5-9fa2-1cb58e482b9d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1267 microversion: 2.1 time: 0.251667 Aug 27 03:28:20.861210 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2032/4183] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:20 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:21.238528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:21.239640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:21.250230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:21.251463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:21.252507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.254083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:21.255227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:21.256309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.561273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:21.562710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:21.570396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:21.571267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:21.571929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.572937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:21.573623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:21.574409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.624469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:21.634692 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a29cb35-028e-49a7-b512-6b018840fdc2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.403277 Aug 27 03:28:21.636090 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2152/4184] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:21 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:21.745538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:21.746821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:21.762538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:21.763793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:21.764790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.766359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:21.767419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:21.768455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.927651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:21.985513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:21.994556 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3315d5d5-0d93-4314-b9e1-16941b356eef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.437264 Aug 27 03:28:21.995175 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2033/4185] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:21 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:22.008501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:22.009373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:22.017028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.017800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.018445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.019885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.020603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.021203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.107302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:22.124207 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5781e960-d115-4d54-9aea-78587e77fe84 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1309 microversion: 2.1 time: 0.384496 Aug 27 03:28:22.125872 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2153/4186] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:21 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1309 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:22.153045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:22.165099 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5287e4d0-fd8a-487e-b4ab-459b7e648680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1273 microversion: 2.1 time: 0.168859 Aug 27 03:28:22.165696 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2034/4187] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:21 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:22.670521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:22.671440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:22.678059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.678620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.679052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.679763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.680279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.680705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.994375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:23.011614 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f2e9d57c-34f1-479c-88d1-e398ac8469ef tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.346550 Aug 27 03:28:23.013242 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2154/4188] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:22 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:23.019557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:23.020869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:23.034720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.035225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.035674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.036394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.036859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.037290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.171989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:23.171989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:23.197593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.198525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.200096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.201571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.203296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.204690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.267817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:23.283991 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c00b8421-01a1-4fdd-8afe-616a6a201e36 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.269682 Aug 27 03:28:23.285175 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2035/4189] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:23 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:23.319718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:23.320925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:23.331354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.332214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.333804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.335109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.335926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.336656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.520724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:23.532561 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b68cd0d5-1a15-4b23-977e-d87a2b2f256d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1309 microversion: 2.1 time: 0.370626 Aug 27 03:28:23.533743 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2155/4190] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:23 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:23.625791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-96011291-7439-46fb-92a6-88fd8bdd60d8 req-88174fd9-9251-45fd-a51f-d4bf32d465e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403261b4-7a18-4902-a794-43403cff3ef9", "tag": "aa2f1d85-ac39-4576-b588-1e6c99d5a59a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:23.650863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96011291-7439-46fb-92a6-88fd8bdd60d8 req-88174fd9-9251-45fd-a51f-d4bf32d465e1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.651674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96011291-7439-46fb-92a6-88fd8bdd60d8 req-88174fd9-9251-45fd-a51f-d4bf32d465e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.652462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-96011291-7439-46fb-92a6-88fd8bdd60d8 req-88174fd9-9251-45fd-a51f-d4bf32d465e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.661132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:23.677602 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-96011291-7439-46fb-92a6-88fd8bdd60d8 req-88174fd9-9251-45fd-a51f-d4bf32d465e1 service nova] Creating event network-changed:aa2f1d85-ac39-4576-b588-1e6c99d5a59a for instance 403261b4-7a18-4902-a794-43403cff3ef9 on n-h2-852086-5 Aug 27 03:28:23.685500 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-96011291-7439-46fb-92a6-88fd8bdd60d8 req-88174fd9-9251-45fd-a51f-d4bf32d465e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074543 Aug 27 03:28:23.686607 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2156/4191] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:23.690071 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75744c35-8d95-44b8-bed0-a999fcca865b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.392646 Aug 27 03:28:23.691463 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2036/4192] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:23 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:24.039009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:24.040473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:24.054030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.059229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.060439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.062546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.064934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.067128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.244808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e4e2e039-7822-4abb-a06f-638981f2bd55 req-d4854b35-6368-4dfb-8343-2ce2bced7a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3aaaa43-32ea-4b23-a28a-9bd35a335b5c", "name": "network-vif-plugged", "status": "completed", "tag": "42d99cfe-76bc-4827-94b2-246f286ea304"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:24.257254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e4e2e039-7822-4abb-a06f-638981f2bd55 req-d4854b35-6368-4dfb-8343-2ce2bced7a7e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.257901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e4e2e039-7822-4abb-a06f-638981f2bd55 req-d4854b35-6368-4dfb-8343-2ce2bced7a7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.258614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e4e2e039-7822-4abb-a06f-638981f2bd55 req-d4854b35-6368-4dfb-8343-2ce2bced7a7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.275661 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e4e2e039-7822-4abb-a06f-638981f2bd55 req-d4854b35-6368-4dfb-8343-2ce2bced7a7e service nova] Creating event network-vif-plugged:42d99cfe-76bc-4827-94b2-246f286ea304 for instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c on n-h1-852086-5 Aug 27 03:28:24.282242 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e4e2e039-7822-4abb-a06f-638981f2bd55 req-d4854b35-6368-4dfb-8343-2ce2bced7a7e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292676 Aug 27 03:28:24.286410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2157/4193] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:24.328573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:24.329290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:24.333207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:24.339094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.340306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.340768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.341537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.342150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.342803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.361645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:24.377513 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f9c8796-c4a2-490e-9a18-132a82d3f4fa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.342465 Aug 27 03:28:24.378102 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2037/4194] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:24 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:24.545231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:24.559336 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b9ef9d0-888b-41fc-be78-ac4f7f34a51e tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.236396 Aug 27 03:28:24.559934 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2158/4195] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:24 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:24.586547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:24.587634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:24.601753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.602898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.603913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.605650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.606598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.607603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.725864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:24.726759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:24.736856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.737720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.738543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.739796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.740566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.741307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.854121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:24.873134 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d6f8145d-8db8-4f61-a21e-9a8c46b15ab3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1309 microversion: 2.1 time: 0.292306 Aug 27 03:28:24.895177 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2038/4196] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:24 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1309 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:24.937231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:24.948022 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-893f8b4a-fa21-471c-be40-cd8969c3978e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.229549 Aug 27 03:28:24.948889 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2159/4197] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:24 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:25.413802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:25.415076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:25.427569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.428947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.429698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.430896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.431913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.432858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.586929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:25.587614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:25.605567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.606069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.606634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.607405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.607861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.609296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.634225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:25.652223 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d14a82af-b700-4ca2-bcd7-a977e3007d3e tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.239449 Aug 27 03:28:25.653377 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2039/4198] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:25 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:25.848456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:25.861451 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aaf8a855-ed47-4764-9222-3c6b62190ad1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.282936 Aug 27 03:28:25.862828 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2160/4199] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:25 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:25.911006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:25.912067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:25.920271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.920781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.921482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.922429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.922888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.923397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.975206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:25.976623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:25.983972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.984736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.985370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.986284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.986940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.987435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.133905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:26.148307 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb56d2c9-a8d9-44fb-b9ad-4f8161c8ed78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1491 microversion: 2.1 time: 0.240304 Aug 27 03:28:26.149731 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2040/4200] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:25 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1491 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:26.173794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:26.174505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:26.184488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.185369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.186138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.187582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.188536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.189414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.258897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:26.268125 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c56d6308-9741-40f2-a829-7f812cd502c0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.296727 Aug 27 03:28:26.282202 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2161/4201] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:25 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:26.397734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:26.411718 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-161cafde-021a-467a-bf54-625e31316a6d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1490 microversion: 2.1 time: 0.241972 Aug 27 03:28:26.413040 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2041/4202] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:26 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1490 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:26.447710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:26.448837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:26.459614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.460473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.461494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.462767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.464424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.465448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.675420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:26.676042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:26.683315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.683891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.684431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.685249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.685782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.686303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.859691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:26.870889 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c899716b-20d7-4c36-a17a-c5245c2dd316 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.199538 Aug 27 03:28:26.871993 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2042/4203] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:26 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:26.875855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:26.893243 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bab28d0d-521f-48f3-88ba-fc1c1228072e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1491 microversion: 2.1 time: 0.450778 Aug 27 03:28:26.898554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:26.899621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:26.907096 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2162/4204] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:26 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1491 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:26.908427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.909331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.909766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.911138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.912415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.914058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.917619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:26.918323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:26.928048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.929387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.930629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.931580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.932200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.932779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.972432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:28:27.101505 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44e5bc45-1dda-45a5-89a2-7c6f04b7f672 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 204 len: 0 microversion: 2.1 time: 0.188487 Aug 27 03:28:27.106318 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2163/4205] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:28:26 2022] DELETE /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:28:27.116917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:27.117943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:27.127193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.128265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.129172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:27.130541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.132075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.132955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:27.165453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:27.179078 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ca746f5-23e1-46ba-aed1-971dbea74bd0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.285011 Aug 27 03:28:27.180699 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2043/4206] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:26 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:27.301752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:27.302926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:27.312482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.312874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.313463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:27.314227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.314691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.315222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:27.358253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:27.367410 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7fce255-fc52-4816-b3a9-ebf4238fffb2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1497 microversion: 2.1 time: 0.258374 Aug 27 03:28:27.367998 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2164/4207] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:27 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:27.475903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:27.484128 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-164efb2a-a975-4855-88b9-f2cf9aa1d408 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.190406 Aug 27 03:28:27.485252 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2044/4208] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:27 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:27.908340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:27.909155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:27.917231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.917848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.918642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:27.919983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.920948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.922022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.207575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:28.209297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:28.220239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:28.220963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:28.221886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.223006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:28.223731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:28.224351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.437581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:28.456169 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53425c1c-1d46-40e9-a94b-aea2e9fc0281 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.253819 Aug 27 03:28:28.470201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2045/4209] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:28 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:28.473954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:28.476019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:28.483596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:28.484293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:28.484820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.485809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:28.487069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:28.487936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.549289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:28.571541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2ff98dd-9d16-4a66-b8fa-06ace176a613 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.668525 Aug 27 03:28:28.573008 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2165/4210] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:27 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:28.581538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:28.582680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:28.596569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:28.597149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:28.597547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.598365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:28.598833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:28.599263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.793217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:28.809129 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59b56311-1cb2-45f0-9517-51b0d1d240a2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.234224 Aug 27 03:28:28.810542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2166/4211] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:28 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:28.915279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:28.929294 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cdb67bac-eec2-4643-a58c-1f6f2e1630ba tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1497 microversion: 2.1 time: 0.462424 Aug 27 03:28:28.930460 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2046/4212] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:28 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1497 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:29.398495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:29.425136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:29.485218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:29.486032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:29.502718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:29.503320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:29.503768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:29.506348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:29.506348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:29.506809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:29.602100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:29.836400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:29.846295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:29.859900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:29.860746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:29.861409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:29.862790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:29.863616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:29.864278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:29.907555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:29.933602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:28:29.946773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:29.976452 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a94a355-4e50-4f3a-9562-a203ca4213cb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.495820 Aug 27 03:28:29.977209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2047/4213] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:29 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:29.995603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6cabec1a-083e-45da-a39e-0c2097877375 req-7dd3c301-4205-477f-a77f-194277e713ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3aaaa43-32ea-4b23-a28a-9bd35a335b5c", "name": "network-vif-deleted", "tag": "42d99cfe-76bc-4827-94b2-246f286ea304"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:30.006221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6cabec1a-083e-45da-a39e-0c2097877375 req-7dd3c301-4205-477f-a77f-194277e713ad service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.006895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6cabec1a-083e-45da-a39e-0c2097877375 req-7dd3c301-4205-477f-a77f-194277e713ad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.007526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6cabec1a-083e-45da-a39e-0c2097877375 req-7dd3c301-4205-477f-a77f-194277e713ad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.011931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:30.021125 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6cabec1a-083e-45da-a39e-0c2097877375 req-7dd3c301-4205-477f-a77f-194277e713ad service nova] Creating event network-vif-deleted:42d99cfe-76bc-4827-94b2-246f286ea304 for instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c on n-h1-852086-5 Aug 27 03:28:30.029048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6cabec1a-083e-45da-a39e-0c2097877375 req-7dd3c301-4205-477f-a77f-194277e713ad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037025 Aug 27 03:28:30.029988 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2048/4214] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:30.036382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:30.037336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:30.045517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.046117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.047216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.048035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.048753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.049437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.136095 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-345f7d7e-a13a-43f4-8d14-6934f20ec31f tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 204 len: 0 microversion: 2.42 time: 0.751333 Aug 27 03:28:30.137356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2167/4215] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:28:29 2022] DELETE /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:28:30.148535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:30.149502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:30.156801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.158100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.158696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.159646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.161370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.162041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.348725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:30.363368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2c0cd29-802d-461c-964f-10cda6f49bc6 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.330772 Aug 27 03:28:30.364579 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2049/4216] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:30 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:30.401714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:30.402837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:30.412894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.414930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.415648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.416963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.417983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.419055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.477782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.480211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.481258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.482192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lazy-loading 'fault' on Instance uuid b3aaaa43-32ea-4b23-a28a-9bd35a335b5c {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:30.530879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:30.541335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-178193bf-9911-4413-a425-0f3f13b21977 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.398615 Aug 27 03:28:30.542196 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2168/4217] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:30 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:30.547696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:30.548427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:30.555987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.556712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.557341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.558241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.558859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.559284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.584037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:30.628416 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c3281a0-26d8-4ce5-ba9e-a9a55fa68172 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1299 microversion: 2.1 time: 0.231146 Aug 27 03:28:30.630415 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2050/4218] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:30 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:30.929197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:30.939737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:30.941578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:30.943185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2101a4e-ea01-4d73-a4ab-915ab698763a tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2962 microversion: 2.42 time: 0.399623 Aug 27 03:28:30.944160 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2169/4219] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:30 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2962 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:30.999770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:31.000643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:31.011579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.012695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.013783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.015303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.016569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.017396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.018099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-cbd75961-f2f9-4802-a411-98150369ae82 req-cede6c3f-daad-4891-a927-f549ea35a566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403261b4-7a18-4902-a794-43403cff3ef9", "name": "network-vif-plugged", "status": "completed", "tag": "aa2f1d85-ac39-4576-b588-1e6c99d5a59a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:31.060442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cbd75961-f2f9-4802-a411-98150369ae82 req-cede6c3f-daad-4891-a927-f549ea35a566 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.063845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cbd75961-f2f9-4802-a411-98150369ae82 req-cede6c3f-daad-4891-a927-f549ea35a566 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.065432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cbd75961-f2f9-4802-a411-98150369ae82 req-cede6c3f-daad-4891-a927-f549ea35a566 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.113540 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-cbd75961-f2f9-4802-a411-98150369ae82 req-cede6c3f-daad-4891-a927-f549ea35a566 service nova] Creating event network-vif-plugged:aa2f1d85-ac39-4576-b588-1e6c99d5a59a for instance 403261b4-7a18-4902-a794-43403cff3ef9 on n-h2-852086-5 Aug 27 03:28:31.136963 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-cbd75961-f2f9-4802-a411-98150369ae82 req-cede6c3f-daad-4891-a927-f549ea35a566 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142846 Aug 27 03:28:31.141902 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2051/4220] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:28:31.402505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:31.404923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:31.413353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.414251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.415128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.415873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.416325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.416942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.622026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:31.629466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:31.637524 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68088d79-d14e-491e-895e-4d5fee021595 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.242856 Aug 27 03:28:31.646093 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-77aedeb5-29c8-48b2-a864-a19ac08c0361 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.650512 Aug 27 03:28:31.648025 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2170/4221] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:30 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:31.654941 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2052/4222] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:31 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:31.659285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:31.660740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:31.674368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.675224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:31.675369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.676162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.676291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:31.677861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.679254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.680041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.687658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.688282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.689002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.690204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.690961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.691907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.751177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.751679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.752276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.752932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lazy-loading 'fault' on Instance uuid b3aaaa43-32ea-4b23-a28a-9bd35a335b5c {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:31.832674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:31.844100 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44b681e5-e63e-42ef-bba2-0280a42b6b1a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1299 microversion: 2.1 time: 0.179048 Aug 27 03:28:31.844762 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2053/4223] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:31 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:31.949153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:31.960048 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-622bd398-6f93-46e5-9711-eb2d9b891dbc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.310027 Aug 27 03:28:31.961444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2171/4224] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:31 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:31.972849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:31.973761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:31.980678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.981173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.981624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.982411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.982912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.983344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.226136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:32.237289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:32.238958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:32.241175 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b985ee69-51ad-4a1f-971f-5cdc76205b26 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2962 microversion: 2.42 time: 0.272618 Aug 27 03:28:32.244173 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2054/4225] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:31 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2962 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:32.677565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:32.685781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:32.688031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:32.688621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:32.697788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.698463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.699301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.700052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.700517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.700952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.704676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.705937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.707119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.709159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.711395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.712529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.936132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:32.952695 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59b8bda7-6c94-421c-a163-bc36784a2eac tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.278148 Aug 27 03:28:32.953729 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2055/4226] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:32 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:32.963011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:32.964188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:32.974321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.975275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.976278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.977793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.978925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.979720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.990343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:33.000541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-89c6b2a3-1694-47c6-b826-6930e512ff66 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.327208 Aug 27 03:28:33.001940 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2172/4227] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:32 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:33.008526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:33.009810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:33.021438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.023395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.024462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:33.025877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.026883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.027620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:33.037780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.038642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.039280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:33.039920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lazy-loading 'fault' on Instance uuid b3aaaa43-32ea-4b23-a28a-9bd35a335b5c {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:33.130546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:33.146954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dfb03b6f-363e-4afc-a678-00d062696d8b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 200 len: 1299 microversion: 2.1 time: 0.191068 Aug 27 03:28:33.155016 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2056/4228] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:32 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:33.267727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:33.268574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:33.279917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.280883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.286434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:33.288588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.290346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.291362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:33.449772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:33.473134 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d0a9f92-c101-4e14-bab2-eaaceb133bcb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1315 microversion: 2.1 time: 0.468734 Aug 27 03:28:33.476253 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2173/4229] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:33 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:33.726571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:33.738497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:33.740047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:33.741515 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2146eca-242d-4bc6-b55f-8656db7e62b8 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2962 microversion: 2.42 time: 0.477808 Aug 27 03:28:33.746215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2057/4230] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:33 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2962 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:28:33.985019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:33.985944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:33.997224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.998258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.999273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.000616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.001104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.001547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.033176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:34.034388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:34.046083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.047305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.048095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.049403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.050319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.051115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.304497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:34.313677 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b44ed463-b8dd-446f-986f-ea6c6faa95c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.332360 Aug 27 03:28:34.315010 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2174/4231] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:33 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:34.321649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:34.322627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:34.330008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.331198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.331886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.332844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.333522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.334188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.351989 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c HTTP/1.1 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'b3aaaa43-32ea-4b23-a28a-9bd35a335b5c'} Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:34.357018 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:34.360781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:34.360781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:34.360781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:34.360781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:34.360781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:34.360781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:28:34.360781 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:34.363055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:34.364246 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-feeeb0d8-0eca-462d-a8c4-c4d7e24a9ae8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 404 len: 111 microversion: 2.1 time: 0.047979 Aug 27 03:28:34.364900 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2175/4232] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:34 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:28:34.374971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:34.375747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:34.386663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.387490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.388127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.394192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.394192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.394192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.403000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:34.417482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3a736ce-ea3e-4960-ad76-fe55c4d3f3d8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.394976 Aug 27 03:28:34.418085 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2058/4233] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:34 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:34.461676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:28:34.514655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:34.515171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:34.534152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.536867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.546742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.552476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.552612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.553573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.674130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11ba9bbf-43b3-4c84-93d7-4048177026ae tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 204 len: 0 microversion: 2.1 time: 0.301488 Aug 27 03:28:34.674130 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2176/4234] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:28:34 2022] DELETE /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:28:34.707181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:34.707932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:34.729219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.730099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.731208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.732835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.733574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.734184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.857908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:34.871241 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc464b7d-3aa3-4c38-a691-aeed31f46db4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1501 microversion: 2.1 time: 0.361666 Aug 27 03:28:34.872160 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2059/4235] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:34 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:34.878038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:34.878917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:34.888840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.889351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.889800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.890572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.891058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.891660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.925398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:34.939462 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1426cd99-9854-4e71-8566-87f96aab9b7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1496 microversion: 2.1 time: 0.258384 Aug 27 03:28:34.940739 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2177/4236] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:34 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1496 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:34.947281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7588d9f5-b944-40bc-a845-2f9907fe6275 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:34.954042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7588d9f5-b944-40bc-a845-2f9907fe6275 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:34.954710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7588d9f5-b944-40bc-a845-2f9907fe6275 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:34.955249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7588d9f5-b944-40bc-a845-2f9907fe6275 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.982789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7588d9f5-b944-40bc-a845-2f9907fe6275 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Going to try to stop instance {{(pid=122407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:28:35.041736 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7588d9f5-b944-40bc-a845-2f9907fe6275 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9/action" status: 202 len: 0 microversion: 2.1 time: 0.099601 Aug 27 03:28:35.042810 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2178/4237] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:34 2022] POST /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:35.056640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.057888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.066247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.066782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.067221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.067961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.068421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.069393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.279154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.297318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.299506 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14ee3e74-344c-4006-88b4-744ac3282918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.250830 Aug 27 03:28:35.300945 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2179/4238] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:35.321864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.323074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.328274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.336308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.336819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.337267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.337775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.337985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.338492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.338926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.343009 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5ccbf8c-47f5-41dd-961f-a8e430ada6cf tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2962 microversion: 2.42 time: 0.468657 Aug 27 03:28:35.344832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:35.351771 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2060/4239] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:34 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2962 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:35.363832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.366042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.376503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.377013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.377454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.378208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.380598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.381059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.383778 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4c9264c-daa4-4ef0-a450-d9a92444bfbe tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068231 Aug 27 03:28:35.385270 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2180/4240] 10.222.0.69 () {60 vars in 1343 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:35.450362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.451912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.459961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.460469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.460926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.461681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.462256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.462812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.670024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.682475 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-42f9c9c2-55ad-4df7-8348-9741bfa531fe tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.239120 Aug 27 03:28:35.687530 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2181/4241] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:35.693205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.694712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.705262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.706785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.707347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.708198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.709124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.711215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.761568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:28:35.791397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.811412 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c1d4743-3fb9-40f1-9a2b-39c413983ce4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.457405 Aug 27 03:28:35.824090 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2061/4242] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:35.919554 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-27cd59f4-ae65-4581-b71c-213233f3a29a tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 204 len: 0 microversion: 2.20 time: 0.226948 Aug 27 03:28:35.919554 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2182/4243] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:28:35 2022] DELETE /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:28:35.934122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.936071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.947012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.947987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.948736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.949963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.950780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.951506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.967283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.967610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.982938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.983439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.983881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.984600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.985058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.985483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.200863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.216064 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9472d91-ce72-49cb-bea5-9264204254cf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1496 microversion: 2.1 time: 0.252574 Aug 27 03:28:36.217475 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2183/4244] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1496 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:36.341864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:36.343035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:36.353144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.354018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.357493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.357493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.357493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.357493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.360251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.380292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.384359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.386830 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a72c0f5-6ea2-4cb5-84b9-2c21c2ce6c7e tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 0.461752 Aug 27 03:28:36.388108 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2062/4245] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:36.397473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:36.399513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:36.410152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.411480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.412606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.414327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.415431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.416097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.591733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.617359 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2af4d848-e3d7-47e0-afbe-07a4ba435a22 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.282232 Aug 27 03:28:36.631946 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2184/4246] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:36 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:36.710780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:36.712019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:36.723665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.724543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.725961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.727356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.728198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.728947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.736252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.752036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.753581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.754969 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f1ecb6dd-dfd2-44e8-8834-7fb4104147f0 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2920 microversion: 2.42 time: 0.365115 Aug 27 03:28:36.755597 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2063/4247] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:36 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2920 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:36.856577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:36.857341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:36.868072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.868938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.869915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.871779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.872796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.874724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.993036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:37.014585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff92ec54-4a29-469d-a962-c83303945b95 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.312298 Aug 27 03:28:37.015553 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2185/4248] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:36 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:37.188277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:37.202046 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9eace3c5-7279-4d92-856a-45b8da1bea0b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.351664 Aug 27 03:28:37.218695 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2064/4249] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:36 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:37.251491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:37.252245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:37.280199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.284198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.284662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.288482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.289185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.289763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.417173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:37.419042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:37.434731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.436096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.437048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.438949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.440205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.441401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.496412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:37.566949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:37.577096 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-06d0cf73-9656-4571-b02d-262df5c6b4f2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1496 microversion: 2.1 time: 0.333133 Aug 27 03:28:37.578437 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2186/4250] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:37 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1496 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:37.656097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:37.658975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:37.672032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.673254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.674699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.676496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.677531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.679281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.077277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.093802 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6beb289a-1616-4abe-bb6f-af68d6889364 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.444745 Aug 27 03:28:38.095061 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2187/4251] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:37 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:38.108310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:38.108941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:38.126225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.126764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.127211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.127954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.134118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.135433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.641374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.656287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.658748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.661130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aea0fd13-c997-4ffe-a74f-e7ae52a96c85 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2920 microversion: 2.42 time: 0.564723 Aug 27 03:28:38.708451 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2188/4252] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:38 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2920 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:38.719328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e0d0c9d6-fd82-47c4-8bdc-99dcc6672aca req-0b4f00ea-1fc5-459f-840b-11d452b62f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-unplugged", "status": "completed", "tag": "5483ccb2-45f0-4bdd-9b3b-a9b357359a2f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:38.743575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0d0c9d6-fd82-47c4-8bdc-99dcc6672aca req-0b4f00ea-1fc5-459f-840b-11d452b62f9a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.747004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0d0c9d6-fd82-47c4-8bdc-99dcc6672aca req-0b4f00ea-1fc5-459f-840b-11d452b62f9a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.750068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0d0c9d6-fd82-47c4-8bdc-99dcc6672aca req-0b4f00ea-1fc5-459f-840b-11d452b62f9a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.782067 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e0d0c9d6-fd82-47c4-8bdc-99dcc6672aca req-0b4f00ea-1fc5-459f-840b-11d452b62f9a service nova] Creating event network-vif-unplugged:5483ccb2-45f0-4bdd-9b3b-a9b357359a2f for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:38.804141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e0d0c9d6-fd82-47c4-8bdc-99dcc6672aca req-0b4f00ea-1fc5-459f-840b-11d452b62f9a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093080 Aug 27 03:28:38.805129 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2189/4253] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:38.814678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:38.816191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:38.827714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.827714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.827714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.828871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.829566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.830478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.975649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.986501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.988712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.991760 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21c3a5af-8d04-4f67-b220-10dc27a8ce9f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 1.581212 Aug 27 03:28:38.992730 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2065/4254] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:37 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:39.016876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:39.016876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:39.025216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.025724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.026195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.026906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.027359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.027789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.168492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:39.193339 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-66678daa-89c5-4c29-8e00-6d620e984354 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.386882 Aug 27 03:28:39.210246 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2190/4255] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:38 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:39.216537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:39.216537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:39.229325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.233228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.236204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.237162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.238374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.242837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.589825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:39.649875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5153d5dc-d846-4c0c-857f-bd61b68f8ad9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1496 microversion: 2.1 time: 0.446114 Aug 27 03:28:39.651286 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2191/4256] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:39 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1496 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:39.679374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:39.713340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:39.734716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.753348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.754878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.756669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.758370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.759508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.863535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:39.880082 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b4b3f83-21bf-474e-8875-22290b9b85fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.867683 Aug 27 03:28:39.882101 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2066/4257] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:39 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:39.892543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:39.893875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:39.909117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.910011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.911228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.913537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.915817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.916533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.034906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:40.059057 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7afed435-4ea7-40c0-8bc4-519c28e5d8ae tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.401858 Aug 27 03:28:40.061962 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2192/4258] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:39 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:40.106036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:40.109344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:40.135237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.138050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.140906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.142337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.145862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.151566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.838748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:40.863033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:40.864548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:40.890360 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba390db1-871a-429a-9dce-37a28f648ce4 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1722 microversion: 2.20 time: 0.826395 Aug 27 03:28:40.891245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2193/4259] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:40 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1722 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:40.906058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:40.907024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:40.914509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.916294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.917001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.917923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.918588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.919317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.999683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.023560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.035204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.044275 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0772f5fd-42c8-4bb8-9383-b78f73154f0b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2873 microversion: 2.42 time: 1.157740 Aug 27 03:28:41.067227 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2067/4260] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:39 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2873 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:41.083393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d48d4f7d-e004-4cdb-af18-295ab68b9434 req-bee8b555-0440-4eae-aaee-36a9131c434d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-deleted", "tag": "b615d33f-ac86-45b7-ba09-719b4d74a4d5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:41.108027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d48d4f7d-e004-4cdb-af18-295ab68b9434 req-bee8b555-0440-4eae-aaee-36a9131c434d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.108904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d48d4f7d-e004-4cdb-af18-295ab68b9434 req-bee8b555-0440-4eae-aaee-36a9131c434d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.109619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d48d4f7d-e004-4cdb-af18-295ab68b9434 req-bee8b555-0440-4eae-aaee-36a9131c434d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.141236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d48d4f7d-e004-4cdb-af18-295ab68b9434 req-bee8b555-0440-4eae-aaee-36a9131c434d service nova] Creating event network-vif-deleted:b615d33f-ac86-45b7-ba09-719b4d74a4d5 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:41.150095 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d48d4f7d-e004-4cdb-af18-295ab68b9434 req-bee8b555-0440-4eae-aaee-36a9131c434d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082700 Aug 27 03:28:41.152975 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2068/4261] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:41.162009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:41.163968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:41.192226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.193028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.200181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.201642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.202509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.203120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.324369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.348441 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-24d0f7ff-393d-4b05-9ae5-65de8f230206 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.450220 Aug 27 03:28:41.362189 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2194/4262] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:40 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:41.393576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-unplugged", "status": "completed", "tag": "bdd5d6d2-7f93-4496-91ad-112ae37f48c3"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-unplugged", "status": "completed", "tag": "b615d33f-ac86-45b7-ba09-719b4d74a4d5"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-unplugged", "status": "completed", "tag": "b03b9929-c210-4a99-9b50-66c9f9836740"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-unplugged", "status": "completed", "tag": "4dfc9eee-0466-4eae-8cc0-7ba5ff267227"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:41.422567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.423399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.432740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.450849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Creating event network-vif-unplugged:bdd5d6d2-7f93-4496-91ad-112ae37f48c3 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:41.452061 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Creating event network-vif-unplugged:b615d33f-ac86-45b7-ba09-719b4d74a4d5 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:41.453444 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Creating event network-vif-unplugged:b03b9929-c210-4a99-9b50-66c9f9836740 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:41.454337 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] Creating event network-vif-unplugged:4dfc9eee-0466-4eae-8cc0-7ba5ff267227 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:41.463504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3259ae22-357a-4944-9119-1f2b111bfc81 req-90beed7b-8e84-4adc-a0da-298d639cf73a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.109577 Aug 27 03:28:41.464697 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2195/4263] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:41.466725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.476472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:41.477444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:41.485972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:41.489102 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c85f4eb6-3862-4d93-a88d-16eb806ebb57 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 200 len: 1454 microversion: 2.1 time: 0.334052 Aug 27 03:28:41.489931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.493076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.493485 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2069/4264] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:41 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 1454 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:41.494400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.495650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.496336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.497819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.512270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:41.512984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:41.521211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.522274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.522952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.524078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.524919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.525579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.555478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:41.788975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.799247 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-400ce812-5e42-427e-82ca-95e7255663d8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.332331 Aug 27 03:28:41.799865 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2196/4265] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:41 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:41.929574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:41.932591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:41.944293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.945915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.946622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.947811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.948656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.949830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.012639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:42.027067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f335577c-de12-434d-9673-1da192f57261 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.529326 Aug 27 03:28:42.053850 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2070/4266] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:41 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:42.078386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:42.109015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:42.110704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:42.111962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:42.132746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:42.136504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7e3227c3-f0c8-4426-b1f1-b24647776793 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1654 microversion: 2.20 time: 0.217872 Aug 27 03:28:42.167208 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2197/4267] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:41 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1654 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:42.171191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.172820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.174502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.176352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.177137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.177983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.375119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:42.375788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:42.391327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.391931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.392382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.393120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.393592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.394047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.625508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:42.636840 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e404514b-d969-481f-b5d4-e4822cc0064b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.266476 Aug 27 03:28:42.637851 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2198/4268] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:42 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:42.647323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:42.649211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:42.662785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.663987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.664989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.666902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.667667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.668417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.704943 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 HTTP/1.1 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7972c949-6a4f-44e5-908b-e7ef35f7b275'} Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:42.707943 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:42.711556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9871fc37-5687-4b28-a476-7023e7eda82d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 404 len: 111 microversion: 2.1 time: 0.071829 Aug 27 03:28:42.713122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2199/4269] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:42 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:28:42.828918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:42.829844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:42.837513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.839842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.840767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.841751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.842358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.843646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.025368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.044639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.049737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.057406 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e26b203-35b2-457b-870e-b6e236bd1b12 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2712 microversion: 2.42 time: 0.954014 Aug 27 03:28:43.071992 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2071/4270] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:42 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2712 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:43.071992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1834964920", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "2b04f773-2696-4ad3-94c1-bcf6bb04ac97"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:43.096113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.106262 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c5cb8173-f914-40f9-98f1-bcdfc3dbc504 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.285792 Aug 27 03:28:43.111433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2200/4271] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:42 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:43.113881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:43.126507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:43.127542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:43.137953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:43.138753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:43.140817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.141569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:43.142041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:43.142484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.205181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:28:43.483849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.498092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b1798bc4-b141-4c6f-93a8-37710af8acc8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.385223 Aug 27 03:28:43.499585 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2201/4272] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:43 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:43.513735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:43.518438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:43.557170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:43.557686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:43.558133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.563330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:43.564339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:43.565001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.629163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:43.630050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:43.630821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.632810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lazy-loading 'fault' on Instance uuid 50ae66e7-4995-4f43-8509-afcb80b64503 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:43.718770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.731427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.732896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ab173f6fa384800afe3fcafea2a628b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53131cd9e41486b88777602871e8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.734094 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d9f3122-9b8a-45c5-96ad-d014afb9264f tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 200 len: 1370 microversion: 2.20 time: 0.232380 Aug 27 03:28:43.755565 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2202/4273] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:43 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:44.060649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-92f547bd-81b4-41f2-bf30-dae0c639e66a req-3993aa05-33e9-4cd1-9529-47769a853a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7972c949-6a4f-44e5-908b-e7ef35f7b275", "name": "network-vif-deleted", "tag": "22852294-181a-40e1-87c8-8f529beb5507"}, {"server_uuid": "50ae66e7-4995-4f43-8509-afcb80b64503", "name": "network-vif-deleted", "tag": "659168e3-652f-456d-bc74-1380601fede5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:44.091169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-92f547bd-81b4-41f2-bf30-dae0c639e66a req-3993aa05-33e9-4cd1-9529-47769a853a81 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.098902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-92f547bd-81b4-41f2-bf30-dae0c639e66a req-3993aa05-33e9-4cd1-9529-47769a853a81 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.099558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-92f547bd-81b4-41f2-bf30-dae0c639e66a req-3993aa05-33e9-4cd1-9529-47769a853a81 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.157681 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-92f547bd-81b4-41f2-bf30-dae0c639e66a req-3993aa05-33e9-4cd1-9529-47769a853a81 service nova] Creating event network-vif-deleted:22852294-181a-40e1-87c8-8f529beb5507 for instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 on n-h2-852086-5 Aug 27 03:28:44.159317 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-92f547bd-81b4-41f2-bf30-dae0c639e66a req-3993aa05-33e9-4cd1-9529-47769a853a81 service nova] Creating event network-vif-deleted:659168e3-652f-456d-bc74-1380601fede5 for instance 50ae66e7-4995-4f43-8509-afcb80b64503 on n-h1-852086-5 Aug 27 03:28:44.200749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-92f547bd-81b4-41f2-bf30-dae0c639e66a req-3993aa05-33e9-4cd1-9529-47769a853a81 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.443465 Aug 27 03:28:44.204026 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2203/4274] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:44.228021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:44.229624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:44.249838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.251390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.253549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.257479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.259889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.260873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.425727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:28:44.426462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:28:44.426918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:28:44.427329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:28:44.428619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:28:44.450044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.450980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.451639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.452661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.453370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.454017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.493870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:28:44.500257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:28:44.527661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:28:44.530695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:28:44.618870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:44.636653 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-902136c3-8dac-48a3-ba6c-41914de2725b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.429096 Aug 27 03:28:44.637854 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2204/4275] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:44 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:44.644397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:44.645216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:44.651513 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5480c41a-ab22-414e-ad44-1c75eab0190d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.587567 Aug 27 03:28:44.654788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.655779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.656560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.657829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.658719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.659602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.662944 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2072/4276] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:28:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:28:44.683901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:44.684707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:44.702503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.703978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.704860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.707950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.709682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.713000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.047418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.070316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.075465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.096277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59657283-8ed9-4dc1-a48d-190754bb8ed1 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2665 microversion: 2.42 time: 0.442009 Aug 27 03:28:45.101839 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2205/4277] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:44 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2665 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:45.128685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:45.133648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:45.159779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.160609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.161607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.172224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.178005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.187527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.312147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.324715 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2fd4794d-377f-43a7-a30d-604abf6e1264 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.659976 Aug 27 03:28:45.330938 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2073/4278] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:44 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:45.346304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2aab375-4be0-43d4-8196-98b2fbd35a5f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:45.347315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2aab375-4be0-43d4-8196-98b2fbd35a5f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:45.574506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.606637 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04a1b929-2bae-44b0-9abf-98d6e0f695b8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.496499 Aug 27 03:28:45.607444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2206/4279] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:45 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:45.611391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2aab375-4be0-43d4-8196-98b2fbd35a5f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:45.618140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:45.618803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:45.638647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.639156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.639608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.640338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.640807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.641207 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2aab375-4be0-43d4-8196-98b2fbd35a5f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1209 microversion: 2.1 time: 0.308273 Aug 27 03:28:45.641379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.641808 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2074/4280] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:45 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1209 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:45.664629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:45.665479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:45.681675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.682209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.682806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.683627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:45.684092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:45.685321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:45.685456 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] HTTP exception thrown: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Request method failure captured: Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 HTTP/1.1 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1_-frECvJRu6gyJxGas2hkTJXzz3t2YzowVcKt2W3M8ZaNzRIEXLvtbw6AWrKEULaABBYGgHa2oNDHxiqgVh6nr9n4rA1iZ28TloF9t2PDrbcSRlJORsLfzNe6ZIOHDXjgiWCFyRr1W5p-VG7RTaOP11VXue-qZJ7tTxE9K8DsXVg Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f53131cd9e41486b88777602871e8c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f53131cd9e41486b88777602871e8c96", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}] Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7ab173f6fa384800afe3fcafea2a628b Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '50ae66e7-4995-4f43-8509-afcb80b64503'} Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:45.688223 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Returning 404 to user: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:45.691936 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c5b90048-c779-446b-ae87-4d32f6a73928 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 404 len: 111 microversion: 2.20 time: 0.081630 Aug 27 03:28:45.699900 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2207/4281] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:45 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:28:45.710701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4055efdf-f7d7-47db-92f8-535659d9cb70 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '.version_select at 0x7fe4602cc550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:45.753108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4055efdf-f7d7-47db-92f8-535659d9cb70 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763094187" status: 204 len: 0 microversion: 2.20 time: 0.047380 Aug 27 03:28:45.753811 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2208/4282] 10.222.0.69 () {60 vars in 1259 bytes} [Sat Aug 27 03:28:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763094187 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:28:46.018777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:46.036277 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2145caa2-2803-4424-aa87-db47a91e6b18 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.375487 Aug 27 03:28:46.042523 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2075/4283] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:45 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:46.161597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:46.164033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:46.220301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:46.221406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:46.222035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:46.223099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:46.223728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:46.224326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:46.258134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ba8049a4-8131-4baf-a408-12e457446637 req-dcb83b8d-9ba3-4f53-861d-80d4da4dd73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-deleted", "tag": "5483ccb2-45f0-4bdd-9b3b-a9b357359a2f"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-deleted", "tag": "bdd5d6d2-7f93-4496-91ad-112ae37f48c3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:46.299243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ba8049a4-8131-4baf-a408-12e457446637 req-dcb83b8d-9ba3-4f53-861d-80d4da4dd73a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:46.300479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ba8049a4-8131-4baf-a408-12e457446637 req-dcb83b8d-9ba3-4f53-861d-80d4da4dd73a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:46.311744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ba8049a4-8131-4baf-a408-12e457446637 req-dcb83b8d-9ba3-4f53-861d-80d4da4dd73a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:46.353005 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ba8049a4-8131-4baf-a408-12e457446637 req-dcb83b8d-9ba3-4f53-861d-80d4da4dd73a service nova] Creating event network-vif-deleted:5483ccb2-45f0-4bdd-9b3b-a9b357359a2f for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:46.356182 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ba8049a4-8131-4baf-a408-12e457446637 req-dcb83b8d-9ba3-4f53-861d-80d4da4dd73a service nova] Creating event network-vif-deleted:bdd5d6d2-7f93-4496-91ad-112ae37f48c3 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:46.414366 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ba8049a4-8131-4baf-a408-12e457446637 req-dcb83b8d-9ba3-4f53-861d-80d4da4dd73a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.157313 Aug 27 03:28:46.435933 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2076/4284] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:46.472784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:46.476642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:46.492925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:46.493958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:46.495004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:46.496365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:46.497335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:46.498201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:46.756987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:46.767698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:46.769147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:46.770466 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d6c42e8-8160-4f46-8f3a-9e56c2afed84 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 2618 microversion: 2.42 time: 0.623535 Aug 27 03:28:46.775713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2209/4285] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:46 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 2618 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:46.786071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:46.787058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:46.795419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:46.796155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:46.797100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:46.798108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:46.798850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:46.799490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.034672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:47.057582 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68412464-bd71-4773-a014-b2203c53f0d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.614930 Aug 27 03:28:47.076111 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2077/4286] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:46 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:47.087016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:47.088470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:47.109733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.113130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.114064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.117469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.117965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.118442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.262929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:47.275140 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25b46b11-5783-4a5a-b176-3860091f39e1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1261 microversion: 2.1 time: 0.197370 Aug 27 03:28:47.276542 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2078/4287] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:47 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:47.285258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:47.287370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:47.297867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.298899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.299549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.300487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.301158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.301938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.646094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:47.660454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:47.668221 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6799dc34-75cd-4373-8c2e-19e84b32d60b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.890681 Aug 27 03:28:47.669211 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2210/4288] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:46 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:47.690790 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9febfe2-7f48-4a5c-beef-1f76d2f2bc02 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.411353 Aug 27 03:28:47.696578 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2079/4289] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:47 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:47.818574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:47.819741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:47.848958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.850611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.850756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:47.853860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:47.858094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:47.858816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.031304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:48.081536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:48.084941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:48.094108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:48.095126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:48.104735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-851e9923-424d-4ec8-9fda-48fca9c3e4cd tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.290343 Aug 27 03:28:48.105824 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2211/4290] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:47 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:48.111406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.111921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.112524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.113454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.114543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.115173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.297263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:48.298192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:48.307475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.309308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.313828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.314998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.315756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.316392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.426206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:48.437882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-043da045-6281-40f2-993f-1f8693962624 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1267 microversion: 2.1 time: 0.144756 Aug 27 03:28:48.438858 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2212/4291] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:48 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:48.535365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6598459f-a0df-430c-bfb5-bb74c8ce9028 req-a13164cb-f56c-4cb9-ac81-266d9f64fa1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-deleted", "tag": "b03b9929-c210-4a99-9b50-66c9f9836740"}, {"server_uuid": "e2cfd62f-a91a-4907-8e38-19876adf83f8", "name": "network-vif-deleted", "tag": "4dfc9eee-0466-4eae-8cc0-7ba5ff267227"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:48.563073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6598459f-a0df-430c-bfb5-bb74c8ce9028 req-a13164cb-f56c-4cb9-ac81-266d9f64fa1d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.565813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6598459f-a0df-430c-bfb5-bb74c8ce9028 req-a13164cb-f56c-4cb9-ac81-266d9f64fa1d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.567126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6598459f-a0df-430c-bfb5-bb74c8ce9028 req-a13164cb-f56c-4cb9-ac81-266d9f64fa1d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.597250 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6598459f-a0df-430c-bfb5-bb74c8ce9028 req-a13164cb-f56c-4cb9-ac81-266d9f64fa1d service nova] Creating event network-vif-deleted:b03b9929-c210-4a99-9b50-66c9f9836740 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:48.599425 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6598459f-a0df-430c-bfb5-bb74c8ce9028 req-a13164cb-f56c-4cb9-ac81-266d9f64fa1d service nova] Creating event network-vif-deleted:4dfc9eee-0466-4eae-8cc0-7ba5ff267227 for instance e2cfd62f-a91a-4907-8e38-19876adf83f8 on n-h1-852086-5 Aug 27 03:28:48.601800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:48.611010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6598459f-a0df-430c-bfb5-bb74c8ce9028 req-a13164cb-f56c-4cb9-ac81-266d9f64fa1d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080236 Aug 27 03:28:48.618354 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2213/4292] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:48.639629 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7288c0ac-5189-43a1-8fdb-cd94ef676a7c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.552233 Aug 27 03:28:48.640420 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2080/4293] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:48 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:48.707911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:48.710152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:48.721423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.722139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.722727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.725300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.726035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.726751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.738031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:48.738804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:48.753542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.754338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.754804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.761925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:48.762501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:48.762964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:48.987534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:49.001609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab55b5bf-6198-42ba-b0ee-ae9116be833c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.300277 Aug 27 03:28:49.003670 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2214/4294] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:48 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:49.143297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:49.148495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:49.151417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:49.177288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:49.178411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:49.179212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:49.179359 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df2085e0-3841-40b8-a8ed-acf75c70cc1a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.448273 Aug 27 03:28:49.180339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:49.181074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:49.181927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:49.195727 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2081/4295] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:48 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:49.330425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:49.349397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:49.351694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:49.354335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f3cf027-296d-42fc-859d-e1109094ad21 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.220163 Aug 27 03:28:49.363402 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2215/4296] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:49 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:49.484049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:49.484815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:49.499074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:49.504153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:49.504821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:49.506906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:49.509895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:49.510509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:49.661815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:49.662673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:49.676560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:49.680045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:49.680641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:49.681489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:49.683530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:49.684194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:49.756384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:50.072803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:50.093240 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-93b88886-8a29-4504-8f44-f017e404e1a0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.435733 Aug 27 03:28:50.106196 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2216/4297] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:49 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:50.110626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:50.111416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:50.122236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:50.122752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:50.123197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:50.124553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:50.125243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:50.138893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:50.434241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:50.438261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:50.446372 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13226a44-d5f9-4e2f-907f-38e9fd48c225 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.967170 Aug 27 03:28:50.451166 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc2bb8e1-e9f2-4e5c-bfa1-3286367a1cad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.354599 Aug 27 03:28:50.452349 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2217/4298] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:50 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:50.465438 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2082/4299] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:49 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:50.470821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:50.474521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:50.476946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:50.477672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:50.485940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:50.486544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:50.487211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:50.488120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:50.488806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:50.489395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:50.502135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:50.503629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:50.508274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:50.513041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:50.514602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:50.518396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:50.689916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:50.704341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:50.706749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:50.708040 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50d00db1-3999-4795-bc62-1c00575fed19 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.241352 Aug 27 03:28:50.708909 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2083/4300] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:50 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:50.775442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:50.789845 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a8b61ae6-6570-47c3-ad63-02749ad70904 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.336100 Aug 27 03:28:50.790832 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2218/4301] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:50 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:51.133835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:51.134534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:51.147914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.148857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.149873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.150938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.152407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.153033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.390939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:51.391835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:51.415408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.416275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.417037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.430463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.431857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.432837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.458609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] HTTP exception thrown: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Request method failure captured: Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 HTTP/1.1 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1_-frECvJRu6gyJxGas2hkTJXzz3t2YzowVcKt2W3M8ZaNzRIEXLvtbw6AWrKEULaABBYGgHa2oNDHxiqgVh6nr9n4rA1iZ28TloF9t2PDrbcSRlJORsLfzNe6ZIOHDXjgiWCFyRr1W5p-VG7RTaOP11VXue-qZJ7tTxE9K8DsXVg Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f53131cd9e41486b88777602871e8c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f53131cd9e41486b88777602871e8c96", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}] Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7ab173f6fa384800afe3fcafea2a628b Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '50ae66e7-4995-4f43-8509-afcb80b64503'} Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:51.461275 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.466048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.468400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Returning 404 to user: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:51.469543 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-88f52321-f413-4921-ad24-577d97d67915 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 404 len: 111 microversion: 2.20 time: 0.086430 Aug 27 03:28:51.470702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2219/4302] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:28:51 2022] DELETE /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:28:51.481491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:51.483118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:51.493760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.494601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.495224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.496144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.496781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.497850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.683841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:51.690564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:51.695690 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c73003f6-30f6-4fcb-aa6f-5cf823ff56af tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.570523 Aug 27 03:28:51.701326 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2084/4303] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:51 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:51.711319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:51.712159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:51.727893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:51.731550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.732462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.733092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.735314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.737946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.739533 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51762d29-93d4-49cb-b3f7-31bcc9f60998 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.267478 Aug 27 03:28:51.740753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.741381 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2220/4304] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:51 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:51.760841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:51.761957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: 50ae66e7-4995-4f43-8509-afcb80b64503] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:51.781220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.784185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.787181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.789946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.790992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.792816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.811034 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] HTTP exception thrown: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Request method failure captured: Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 HTTP/1.1 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1_-frECvJRu6gyJxGas2hkTJXzz3t2YzowVcKt2W3M8ZaNzRIEXLvtbw6AWrKEULaABBYGgHa2oNDHxiqgVh6nr9n4rA1iZ28TloF9t2PDrbcSRlJORsLfzNe6ZIOHDXjgiWCFyRr1W5p-VG7RTaOP11VXue-qZJ7tTxE9K8DsXVg Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f53131cd9e41486b88777602871e8c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f53131cd9e41486b88777602871e8c96", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}] Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7ab173f6fa384800afe3fcafea2a628b Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '50ae66e7-4995-4f43-8509-afcb80b64503'} Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.812757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Returning 404 to user: Instance 50ae66e7-4995-4f43-8509-afcb80b64503 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7d94e356-547d-4563-aa86-f5868ce61559 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503" status: 404 len: 111 microversion: 2.20 time: 0.071502 Aug 27 03:28:51.817082 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2221/4305] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:51 2022] GET /compute/v2.1/servers/50ae66e7-4995-4f43-8509-afcb80b64503 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:28:51.823242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:51.823871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:51.830631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.831135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.831585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.832969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:51.833457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:51.833925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:51.961047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:51.991645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:51.993766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:51.997879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65d082c6-8315-4719-8b75-fbf9c8fa71fa tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.181551 Aug 27 03:28:52.015537 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2222/4306] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:51 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:52.020724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:52.021346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:52.040922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:52.041742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:52.042523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:52.043545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:52.044015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:52.044449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:52.183509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:52.204510 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-998c32ff-653b-4c79-8b97-4c06bb68471e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.501663 Aug 27 03:28:52.216124 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2085/4307] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:51 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:52.405979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:52.418026 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ca87606-3774-434b-a276-f77792754ff3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.400906 Aug 27 03:28:52.419115 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2223/4308] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:52 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:52.739034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:52.740838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:52.753729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:52.755513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:52.756634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:52.763511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:52.764228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:52.764852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:52.773383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:52.773383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:52.791896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:52.795395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:52.798515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:52.800707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:52.807079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:52.809136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.062018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:53.086093 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cbff74f-bf19-49f2-840e-122c00961101 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1521 microversion: 2.1 time: 0.351375 Aug 27 03:28:53.109169 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2086/4309] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:52 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:53.118298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:53.123380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:53.144599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:53.145916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:53.148161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.152418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:53.153235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:53.154232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.242790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:53.265976 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5052521c-0bd6-4760-a83f-cfd7f77c9a11 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.496213 Aug 27 03:28:53.267282 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2224/4310] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:52 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:53.280205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:53.281110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:53.294519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:53.300289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:53.300948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.303714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:53.306012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:53.309271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.392832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:53.426359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:53.435005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:53.436017 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b955a0b6-9aa7-4bc6-9800-d3b3cfd3a318 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.325422 Aug 27 03:28:53.436724 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2087/4311] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:53 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:53.453177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-61771d0e-b89a-4fdf-94ea-a3d8f408be6f req-62feaf2c-c9ca-4a2d-aca9-bff6bd5f7163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e527ec-0282-46ce-8edf-43ea349b10dc", "tag": "4b6a1159-cbd3-487f-81c0-ede3ca696fc6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:53.484676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61771d0e-b89a-4fdf-94ea-a3d8f408be6f req-62feaf2c-c9ca-4a2d-aca9-bff6bd5f7163 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:53.492391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61771d0e-b89a-4fdf-94ea-a3d8f408be6f req-62feaf2c-c9ca-4a2d-aca9-bff6bd5f7163 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:53.493510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61771d0e-b89a-4fdf-94ea-a3d8f408be6f req-62feaf2c-c9ca-4a2d-aca9-bff6bd5f7163 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.538637 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-61771d0e-b89a-4fdf-94ea-a3d8f408be6f req-62feaf2c-c9ca-4a2d-aca9-bff6bd5f7163 service nova] Creating event network-changed:4b6a1159-cbd3-487f-81c0-ede3ca696fc6 for instance 50e527ec-0282-46ce-8edf-43ea349b10dc on n-h1-852086-5 Aug 27 03:28:53.558408 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-61771d0e-b89a-4fdf-94ea-a3d8f408be6f req-62feaf2c-c9ca-4a2d-aca9-bff6bd5f7163 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117434 Aug 27 03:28:53.562402 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2088/4312] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:53.576903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:53.582739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:53.600057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:53.601513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:53.602248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.603294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:53.604006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:53.606446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:53.708166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:53.722460 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-972f2504-f3fb-4b60-bf06-13fe7511ca0a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.452681 Aug 27 03:28:53.724192 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2225/4313] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:53 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:54.003791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.018194 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fc421c9-d4f7-49f5-b324-3d03af5b5ee8 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.454102 Aug 27 03:28:54.019197 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2089/4314] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:53 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:54.121236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:54.121847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.130539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.131367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.131960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.133016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.133566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.134274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.309142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:54.315113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.334600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.335227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.335714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.336434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.337063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.337639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.375067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.384130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-977097be-a309-4de5-941a-5eb37b3e8092 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1501 microversion: 2.1 time: 0.267030 Aug 27 03:28:54.387391 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2226/4315] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:54 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:54.419846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:54.420916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.430469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.431261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.431878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.432777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.433413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.433999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.465305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:54.623660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.638955 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-106e7c0a-66ad-4dd5-822e-0a1e4a1e1fe7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.334138 Aug 27 03:28:54.652301 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2090/4316] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:54 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:54.662060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:54.664131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.673576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.674314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.675169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.676177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.676949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.677502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.700298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.710503 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bbfa3131-2a1c-4570-a16b-b2f3c73d1a6b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1514 microversion: 2.1 time: 0.294390 Aug 27 03:28:54.715215 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2227/4317] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:54 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:54.733112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a957d6de-a1c3-419d-880d-c12731d41868 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:54.736198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a957d6de-a1c3-419d-880d-c12731d41868 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.743636 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a957d6de-a1c3-419d-880d-c12731d41868 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Instance 2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc could not be found. Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a957d6de-a1c3-419d-880d-c12731d41868 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc/action HTTP/1.1 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 14 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: {"rescue": {}} Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc could not be found. Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc', 'body': {'rescue': {}}} Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc could not be found. Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc could not be found. Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:54.752241 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc could not be found. Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a957d6de-a1c3-419d-880d-c12731d41868 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 404 to user: Instance 2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a957d6de-a1c3-419d-880d-c12731d41868 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc/action" status: 404 len: 111 microversion: 2.1 time: 0.022327 Aug 27 03:28:54.761579 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2228/4318] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:54 2022] POST /compute/v2.1/servers/2d0d66a0-2ed4-4884-8a42-f5afeec9d5cc/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:28:54.768226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:54.770218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.774998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.780360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.781558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.781998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.782745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.783299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.783864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.788198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.789594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.791144 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdd48d91-8d48-4376-9be6-625628b4a813 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.137437 Aug 27 03:28:54.791912 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2091/4319] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:54 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:54.796782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:54.797332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.804243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.804968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.805592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.806495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.807174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.807759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.906349 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8990b63d-b1ef-45f8-8918-624c376bebfe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action" status: 202 len: 0 microversion: 2.1 time: 0.113029 Aug 27 03:28:54.907443 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2092/4320] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:54 2022] POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:54.924476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:54.926105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.942623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.945857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.947148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.948661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.949902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.951077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.959393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:54.971124 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f88fedbd-9272-41ef-a62e-68f79e887105 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.216120 Aug 27 03:28:54.972277 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2229/4321] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:54 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:55.052333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:55.055165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:55.067668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:55.068918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:55.069638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:55.071831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:55.073308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:55.074023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:55.193797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:55.207039 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-651609e6-ade8-4939-89a9-9d30a1afb966 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1519 microversion: 2.1 time: 0.294981 Aug 27 03:28:55.208511 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2093/4322] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:54 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1519 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:55.364799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:55.376004 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c54cf1e5-aaf5-4bbc-84a2-1ba978f38fa5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.329892 Aug 27 03:28:55.376677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2230/4323] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:55 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:55.665732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:55.666564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:55.669804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:55.681044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:55.681628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:55.682916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:55.684432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:55.685222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:55.685954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:55.818921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:55.819646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:55.829278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:55.830346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:55.831615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:55.832750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:55.833432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:55.834238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:55.940988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:55.961389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:55.964568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:55.966542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-03a7e384-8ac4-4631-893f-f3a51c5b6d86 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.153143 Aug 27 03:28:55.987179 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2231/4324] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:55 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:56.007456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:56.010517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:56.020117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.021968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.023257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.024956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.026385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.026859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.056941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:56.072647 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85633aff-954a-4d6c-be77-b70230a04431 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.411898 Aug 27 03:28:56.074997 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2094/4325] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:55 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:56.239659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:56.240585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:56.263320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.263968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.264452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.268769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.269730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.272470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.279130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:56.295434 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-422ccd30-d884-4f5f-af3e-17ff5f84e16d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.293623 Aug 27 03:28:56.297049 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2232/4326] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:55 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:56.405443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:56.407547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:56.427181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.428977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.429537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.432691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.433897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.437875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.625615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:56.647472 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd77931d-cef7-4253-ad8b-90472e5e5f50 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1499 microversion: 2.1 time: 0.410661 Aug 27 03:28:56.648459 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2095/4327] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:56 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1499 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:56.672885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:56.674808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:56.680603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:56.688463 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f02226e4-3fb5-434c-b37d-9e2294dd85e2 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.287126 Aug 27 03:28:56.689792 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2233/4328] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:56 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:56.697780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.699141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.699943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.701267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.702302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.703436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.767527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'flavor' on Instance uuid 6149aa8e-84bb-4a4c-933c-da6b1c15a90e {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:28:56.799780 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Cannot 'rescue' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state paused Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action HTTP/1.1 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 14 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: {"rescue": {}} Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'rescue' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state paused Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6149aa8e-84bb-4a4c-933c-da6b1c15a90e', 'body': {'rescue': {}}} Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e in vm_state paused. Cannot rescue while the instance is in this state. Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state paused Aug 27 03:28:56.804230 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state paused Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 409 to user: Cannot 'rescue' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state paused {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-871e4611-0b84-41e9-9dfd-6d6814ad0244 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action" status: 409 len: 144 microversion: 2.1 time: 0.140549 Aug 27 03:28:56.809803 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2096/4329] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:56 2022] POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action => generated 144 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 03:28:56.824687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:56.827377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:56.847515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.848825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.850102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.851396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.852479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.853895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.971124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:57.013536 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c29e9ea1-1dc6-4870-b197-f68020c8a7fa tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action" status: 202 len: 0 microversion: 2.1 time: 0.199508 Aug 27 03:28:57.015043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:57.017269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:57.021029 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2234/4330] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:56 2022] POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:57.038876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.038876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.038876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.038876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.038876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.038876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.054443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:57.056186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:57.068449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.069704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.070787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.072202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.073348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.074255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.232724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:57.262119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:57.267176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:57.271374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5baf56f-087a-4354-a998-0f689488275d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.272974 Aug 27 03:28:57.289592 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2097/4331] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:56 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:28:57.315994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:57.317197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:57.334773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.336087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.337178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.339080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.340241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.341305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.493535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:57.505043 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e03e9023-f1b2-4e4d-b863-be6375889169 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1506 microversion: 2.1 time: 0.477519 Aug 27 03:28:57.518209 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2235/4332] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:57 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:57.525865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:57.527520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:57.539567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.539567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.542030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.543949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.545431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.547332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.846324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:57.857487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-101e1fd6-134c-4caf-8e48-5a2db18a0898 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.563331 Aug 27 03:28:57.858772 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2098/4333] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:57 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:57.867453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:57.879012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:57.898273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.898622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.903658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.905150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.905933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.906721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.961800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:57.981403 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d13528f8-0334-4d92-9b49-0d87980c2d04 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.471901 Aug 27 03:28:57.982388 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2236/4334] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:57 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:58.247900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:58.259392 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7193e85-276c-416f-b41a-0431669eb2d4 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.398499 Aug 27 03:28:58.260773 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2099/4335] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:57 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:58.321974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:58.325421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:58.337519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.338507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.339199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.340830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.341748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.342406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.497903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:58.509815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:58.511973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:58.514292 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba6f16ed-5c29-4aff-8515-186bfea02a09 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.197343 Aug 27 03:28:58.532143 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2237/4336] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:58 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:28:58.563514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:58.566382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:58.582684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.584421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.587374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.588926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.589945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.590952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.898677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:58.902329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:58.924008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.924934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.925748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.926887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.927580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.928225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.968258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:58.982855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb7a4021-c05b-4b96-8ea8-14b9cef638fd tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1514 microversion: 2.1 time: 0.428740 Aug 27 03:28:58.984728 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2100/4337] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:58 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:59.013526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:59.015116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:59.051090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:59.052016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:59.053971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:59.054979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:59.055663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:59.058277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:59.072224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:59.298798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:59.323822 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fa0b93e5-de59-4596-9c4d-f50eb7a3b07d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.433990 Aug 27 03:28:59.325186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2238/4338] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:58 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:59.339240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:59.340592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:59.365534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:59.371242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:59.372466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:59.373508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:59.375158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:59.376255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:59.379620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:59.399280 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95f13215-5649-4a0f-9ea2-1ff42685be3a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.394461 Aug 27 03:28:59.402958 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2101/4339] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:59 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:59.540516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:59.541480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:59.563682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:59.565943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:59.570702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:59.574241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:59.577570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:59.581099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:59.649792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:59.683556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-186c9e53-9805-49d5-9b90-693cfc6948c9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.356126 Aug 27 03:28:59.698917 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2239/4340] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:59 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:59.822279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:59.843514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:59.845261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:59.846685 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d377de0-2c66-451b-b5f1-ceb179eb4d54 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.311986 Aug 27 03:28:59.858340 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2102/4341] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:28:59 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:00.301607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-9f2c5d6a-7b71-4b2d-bb2e-1de34b3706f3 req-0b7e5c25-ab30-46f5-8484-700d6bb7f4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e527ec-0282-46ce-8edf-43ea349b10dc", "name": "network-vif-plugged", "status": "completed", "tag": "4b6a1159-cbd3-487f-81c0-ede3ca696fc6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:00.335999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9f2c5d6a-7b71-4b2d-bb2e-1de34b3706f3 req-0b7e5c25-ab30-46f5-8484-700d6bb7f4a6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.336795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9f2c5d6a-7b71-4b2d-bb2e-1de34b3706f3 req-0b7e5c25-ab30-46f5-8484-700d6bb7f4a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.337417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9f2c5d6a-7b71-4b2d-bb2e-1de34b3706f3 req-0b7e5c25-ab30-46f5-8484-700d6bb7f4a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.353055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:00.354147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:00.357710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-9f2c5d6a-7b71-4b2d-bb2e-1de34b3706f3 req-0b7e5c25-ab30-46f5-8484-700d6bb7f4a6 service nova] Creating event network-vif-plugged:4b6a1159-cbd3-487f-81c0-ede3ca696fc6 for instance 50e527ec-0282-46ce-8edf-43ea349b10dc on n-h1-852086-5 Aug 27 03:29:00.364572 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-9f2c5d6a-7b71-4b2d-bb2e-1de34b3706f3 req-0b7e5c25-ab30-46f5-8484-700d6bb7f4a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070195 Aug 27 03:29:00.366034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2240/4342] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:00.377041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.377854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.379154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.380838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.383197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.383656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.430473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:00.435763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:00.460109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.460659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.461113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.461847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.462832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.463298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.841455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:00.857358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e13802f2-f158-4894-a75a-6519cad01383 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.439514 Aug 27 03:29:00.858490 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2241/4343] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:00 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:00.882816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:00.884613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:00.901581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.902486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.903172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.904118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.913304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.914116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.940918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:00.971841 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc5a4ae2-54a8-44ce-a44e-89b1b701ec21 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.621125 Aug 27 03:29:00.973034 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2103/4344] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:00 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:00.984214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:00.985220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:01.013635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.014481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.015224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.016049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.016528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.016982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.203504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:01.222456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:01.228180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:01.230379 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8702d8a8-9976-4b60-871f-486f2ca21e66 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.253259 Aug 27 03:29:01.231832 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2104/4345] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:00 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:01.240653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:01.241475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:01.254270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.255174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.256560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.257963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.258804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.259450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.298817 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] HTTP exception thrown: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Request method failure captured: Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f HTTP/1.1 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY1_-frECvJRu6gyJxGas2hkTJXzz3t2YzowVcKt2W3M8ZaNzRIEXLvtbw6AWrKEULaABBYGgHa2oNDHxiqgVh6nr9n4rA1iZ28TloF9t2PDrbcSRlJORsLfzNe6ZIOHDXjgiWCFyRr1W5p-VG7RTaOP11VXue-qZJ7tTxE9K8DsXVg Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f53131cd9e41486b88777602871e8c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f53131cd9e41486b88777602871e8c96", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}] Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 7ab173f6fa384800afe3fcafea2a628b Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b3889386-64a2-4858-af6e-009e8606df9f'} Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:01.303507 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.309719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Returning 404 to user: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:01.310412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:01.316863 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbec6349-efbc-41fe-b205-93391b7d1ad5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.445392 Aug 27 03:29:01.327072 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2242/4346] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:00 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:01.327483 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdec184f-ed66-4ab5-b211-8fb105165f2d tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 404 len: 111 microversion: 2.20 time: 0.093688 Aug 27 03:29:01.328601 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2105/4347] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:29:01 2022] DELETE /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:29:01.338082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:01.339229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] [instance: b3889386-64a2-4858-af6e-009e8606df9f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:01.347027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.348172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.348885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.350626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.351485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.352363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.376453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] HTTP exception thrown: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Request method failure captured: Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f HTTP/1.1 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY1_-frECvJRu6gyJxGas2hkTJXzz3t2YzowVcKt2W3M8ZaNzRIEXLvtbw6AWrKEULaABBYGgHa2oNDHxiqgVh6nr9n4rA1iZ28TloF9t2PDrbcSRlJORsLfzNe6ZIOHDXjgiWCFyRr1W5p-VG7RTaOP11VXue-qZJ7tTxE9K8DsXVg Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f53131cd9e41486b88777602871e8c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f53131cd9e41486b88777602871e8c96", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f53131cd9e41486b88777602871e8c96"}]}] Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f53131cd9e41486b88777602871e8c96 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2071035379 Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 7ab173f6fa384800afe3fcafea2a628b Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2071035379-project Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'b3889386-64a2-4858-af6e-009e8606df9f'} Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.378195 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] Returning 404 to user: Instance b3889386-64a2-4858-af6e-009e8606df9f could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c88a9c11-2250-4c8e-8b9f-1a61154c7b40 tempest-AttachVolumeShelveTestJSON-2071035379 tempest-AttachVolumeShelveTestJSON-2071035379-project] 10.222.0.69 "GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f" status: 404 len: 111 microversion: 2.20 time: 0.046369 Aug 27 03:29:01.391857 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2243/4348] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:01 2022] GET /compute/v2.1/servers/b3889386-64a2-4858-af6e-009e8606df9f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:29:01.889215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:01.890366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:01.917946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.918794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.924603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.925858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.926716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.927529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.996694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:01.998479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:02.026596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:02.042853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.047586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.048415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.054085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.059050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.059754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.460965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:02.474270 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-190edd67-ac42-4136-a6fe-8d3d6b7abf82 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1309 microversion: 2.1 time: 0.484652 Aug 27 03:29:02.490873 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2244/4349] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:01 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1309 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:02.496762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:02.497654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:02.513447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.514760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.515576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.516578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.517281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.518030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.689427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:02.691253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:02.710447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:02.714328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:02.718924 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6246423-1b7e-4c04-bd56-fe1aad189a6d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.223337 Aug 27 03:29:02.719153 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2245/4350] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:02 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:02.736294 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2436929d-e208-4529-be2f-30980f9a8686 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.857763 Aug 27 03:29:02.745520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:02.746525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:02.751726 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2106/4351] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:01 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:02.760694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.761822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.762325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.763671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.764311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.765212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.996807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:03.003638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:03.033148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.048716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.049514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.051486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.053942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.063156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.156381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:03.168453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6bc75fab-0b62-44b7-8d1b-841957d2d444 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.430424 Aug 27 03:29:03.169679 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2246/4352] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:02 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:03.187107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'flavor' on Instance uuid 6149aa8e-84bb-4a4c-933c-da6b1c15a90e {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:29:03.348464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d9c237e-3d32-4870-bd3e-5693f9b964de tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action" status: 200 len: 32 microversion: 2.1 time: 0.355790 Aug 27 03:29:03.349096 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2107/4353] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:02 2022] POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:03.362451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:03.363526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:03.377745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.383454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.384461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.385433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.386276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.386946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.507983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:03.509466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:03.558750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.561327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.562077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.563682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.564702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.565666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.665067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:03.675117 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-75c2d51a-74bc-4373-9dca-a145c2ae5fd2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.317606 Aug 27 03:29:03.678631 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2247/4354] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:03 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:03.746298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:03.746931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:03.760434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.762214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.762795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.763853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.766847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.767395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.866951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:03.881416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:03.883660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:03.885121 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc7eb8a3-5823-4536-86fc-5566d695a100 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.143398 Aug 27 03:29:03.886277 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2248/4355] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:03 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:03.892867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:03.893724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:03.901397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.903371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.904041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.905095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.905757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.906394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.914816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:03.924522 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6868918d-4100-4399-b976-68e7a57a9991 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1490 microversion: 2.1 time: 0.429278 Aug 27 03:29:03.929897 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2108/4356] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:03 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1490 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:03.954104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:03.958268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:03.979480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.980187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.980874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.981971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.982611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.983260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:04.150988 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e26651a-7f85-49af-b0dd-8ef202a16a0e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "PUT /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1085 microversion: 2.1 time: 0.200469 Aug 27 03:29:04.162882 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2109/4357] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:29:03 2022] PUT /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1085 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:04.183926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:04.184801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:04.197946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.198744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.199363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:04.200815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.201652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.202358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:04.268671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:04.310922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cf3a9216-dc2b-40d9-b04e-a7f4dfdc3970 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.420101 Aug 27 03:29:04.310922 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2249/4358] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:03 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:04.341785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:04.342815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:04.361025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.361535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.361984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:04.366605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.368275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.368824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:04.768790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:04.793165 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d61b0d5-2638-43ca-897c-886c4eff9b15 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.481241 Aug 27 03:29:04.794361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2250/4359] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:04 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:04.809915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:04.811291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:04.823801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.824773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.825234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:04.826001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.826506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.826946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.084362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.100791 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-96a348e4-3e49-44f8-977a-99794db6dfde tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.298910 Aug 27 03:29:05.114538 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2251/4360] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:04 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:05.114538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.114538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.114538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.114538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.114538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.115994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.115994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.116489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.139813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:05.205399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.233454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.236222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.239040 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ada4d47-09a9-451a-8a85-b7fff1431e4e tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.136316 Aug 27 03:29:05.241398 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2252/4361] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:05.348541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.350151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.362506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.362506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.362886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.363835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.364501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.365656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.365882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.389846 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3fc9ebd8-9790-4e79-8239-18af475392cc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1511 microversion: 2.1 time: 1.212134 Aug 27 03:29:05.393364 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2110/4362] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:04 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1511 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:05.441353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.453378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.488774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.491463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.492910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.497679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.501585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.502352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.646841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.656875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46230302-7996-45b1-b8a7-0eae57c519f5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.312609 Aug 27 03:29:05.657813 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2253/4363] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:05.822109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.823855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.836270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.837675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.839014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.840629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.841855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.842926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.133269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.140432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.142995 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2442573-aec5-496d-a9a5-423bd261d78b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1511 microversion: 2.1 time: 0.719127 Aug 27 03:29:06.149108 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2111/4364] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1511 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:06.153707 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-297ec570-0af4-4234-bbb5-74cb88ca49f3 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.339536 Aug 27 03:29:06.155585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:06.161245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:06.167683 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2254/4365] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:06.181811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.190420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.191288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.192487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.193286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.194038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.199159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:06.199867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:06.211906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.213319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.214450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.216000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.216772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.217726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.294898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:29:06.414067 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d1df8f5b-7635-493b-b829-bebd4e1de679 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 204 len: 0 microversion: 2.1 time: 0.220750 Aug 27 03:29:06.416380 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2255/4366] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:29:06 2022] DELETE /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:29:06.426670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:06.428387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:06.438087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.438959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.440123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.441323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.442155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.442899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.539640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.551669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.554274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.555745 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d2a3740-7f22-41ec-8720-f3a6a4343a5d tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.137382 Aug 27 03:29:06.556597 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2256/4367] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:06 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:06.580179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:06.582256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:06.590462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.591518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.592310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.593270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.593921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.594572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.653627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.676595 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83b17bc9-8320-4015-9eea-0681ebc42fee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.525883 Aug 27 03:29:06.677746 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2112/4368] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:06 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:06.693677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:06.694606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:06.706891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.708003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.709218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.715273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:06.716213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:06.717125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.831267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.841763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c489a5fc-9cda-4e7a-87c9-8e22048f120e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1517 microversion: 2.1 time: 0.269405 Aug 27 03:29:06.842893 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2257/4369] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:06 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:07.164100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:07.183597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:07.184378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:07.184502 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-993f63dd-8d1e-4bb5-a13e-25b53bec1d9f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.495315 Aug 27 03:29:07.185551 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2113/4370] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:06 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:07.208294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.209317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.211178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.213045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.213961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.214765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.589570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:07.590235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:07.600212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:07.604712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:07.613843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df54f4d1-7ff4-4e56-b5ab-e739f21954a9 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1486 microversion: 2.1 time: 0.434806 Aug 27 03:29:07.614337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.617104 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2258/4371] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:07 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1486 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:07.618195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.619035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.620526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.627238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.628290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.656403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:07.656403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:07.682081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.683648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.684132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.694866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.697795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.697795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.813758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:07.833368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:07.836992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:07.839624 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6e297d7-1360-4bb1-9ddc-f1f1a3482db7 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.256730 Aug 27 03:29:07.840902 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2114/4372] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:07 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:07.855839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:07.857379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:07.888848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.890054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.891092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.892668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.893735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.893926 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f7e65c24-a5be-4bfc-85d1-a8ea56931a51 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "POST /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e/action" status: 202 len: 0 microversion: 2.1 time: 0.249397 Aug 27 03:29:07.911171 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2259/4373] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:07 2022] POST /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:29:07.919981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.930435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:07.934078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:07.962125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.962671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.963136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.963890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.964360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.964795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:08.602568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:08.630100 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1d15ddec-4dd4-4049-a999-69875c75c90b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1517 microversion: 2.1 time: 0.716601 Aug 27 03:29:08.631737 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2260/4374] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:07 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1517 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:08.644552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:08.648667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:08.653353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:08.656612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:08.675185 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e25b5140-8d41-4854-b32c-d0ae586e51ee tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.832600 Aug 27 03:29:08.676740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:08.678381 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2115/4375] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:07 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:08.680570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:08.681556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:08.682599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:08.686710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:08.687526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:08.688204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:08.694223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:08.705762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:08.709711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:08.711649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:08.714683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:08.717819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:08.725374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.390005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:09.419654 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-259125fb-0b9d-4ca7-90eb-c9bffdc87dbf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.733147 Aug 27 03:29:09.430661 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2116/4376] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:08 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:09.432287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:09.437492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:09.439086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:09.464117 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f3d61c8f-285a-4654-9855-f1027023e5cb tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1494 microversion: 2.1 time: 0.826807 Aug 27 03:29:09.465005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.465665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.466358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.467264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.469915 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2261/4377] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:08 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1494 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:09.479560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.480096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.640248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:09.661629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:09.664750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:09.667087 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58f3df0b-2180-44fe-9732-b9f08d13ec8b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.234659 Aug 27 03:29:09.668083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2117/4378] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:09 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:09.706943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:09.707927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:09.728046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:09.729395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:09.732796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.733712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.734393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.735315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.735945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.736658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.738262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.739018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.739569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.741636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.742287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.742925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.880002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:09.890280 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32698687-3423-4538-88e0-7bcb7ce66827 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 200 len: 1475 microversion: 2.1 time: 0.192133 Aug 27 03:29:09.903529 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2262/4379] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:09 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 1475 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:10.124920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-05865c81-d4e7-46e9-9f84-0f8c4f5cc902 req-574d8efb-f08f-4f42-839b-c0932ddc565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e527ec-0282-46ce-8edf-43ea349b10dc", "name": "network-vif-deleted", "tag": "4b6a1159-cbd3-487f-81c0-ede3ca696fc6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:10.162632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-05865c81-d4e7-46e9-9f84-0f8c4f5cc902 req-574d8efb-f08f-4f42-839b-c0932ddc565f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.163713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-05865c81-d4e7-46e9-9f84-0f8c4f5cc902 req-574d8efb-f08f-4f42-839b-c0932ddc565f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.164827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-05865c81-d4e7-46e9-9f84-0f8c4f5cc902 req-574d8efb-f08f-4f42-839b-c0932ddc565f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.182718 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-05865c81-d4e7-46e9-9f84-0f8c4f5cc902 req-574d8efb-f08f-4f42-839b-c0932ddc565f service nova] Creating event network-vif-deleted:4b6a1159-cbd3-487f-81c0-ede3ca696fc6 for instance 50e527ec-0282-46ce-8edf-43ea349b10dc on n-h1-852086-5 Aug 27 03:29:10.201211 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-05865c81-d4e7-46e9-9f84-0f8c4f5cc902 req-574d8efb-f08f-4f42-839b-c0932ddc565f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084505 Aug 27 03:29:10.205644 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2263/4380] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:10.287701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:10.312976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab921c9b-9e67-4412-b2f3-9591c77e959b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.597135 Aug 27 03:29:10.327223 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2118/4381] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:09 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:10.467613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:10.468360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:10.502484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:10.504300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:10.516585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.518771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.519767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.520484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.521663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.522324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.525501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.527371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.528073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.529857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.530582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.538786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.001995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:11.017051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ba5584c-6a3a-470c-b2f4-da32fd5556ad tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1494 microversion: 2.1 time: 0.518441 Aug 27 03:29:11.035358 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2119/4382] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:10 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1494 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:11.053936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:11.055354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:11.078449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.081914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.085292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.086944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.089781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.091627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.345127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:11.410113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:11.416233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:11.425884 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6f55e04-8fee-4e1b-9d2d-70c0e58a192b tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.380953 Aug 27 03:29:11.426834 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2120/4383] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:11 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:11.441646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:11.447922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:11.472237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.472758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.473886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.475678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.476164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.476608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.503786 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc HTTP/1.1 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '50e527ec-0282-46ce-8edf-43ea349b10dc'} Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:11.507599 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:11.511453 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:11.511453 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:11.511453 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:11.511453 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:11.511453 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:11.511453 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:29:11.511453 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:11.515616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:11.516956 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42260671-e9be-41b9-b604-f0608c5024f1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 404 len: 111 microversion: 2.1 time: 0.085953 Aug 27 03:29:11.523055 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2121/4384] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:11 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:11.530699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:11.534570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:11.547943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.548646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.549231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.550781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.551252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.551691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.698563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:11.717326 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a29d32bd-47ff-4168-b907-eca62deecd29 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 1.261240 Aug 27 03:29:11.738614 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2264/4385] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:10 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:11.851623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1448680110", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "2b04f773-2696-4ad3-94c1-bcf6bb04ac97"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:11.952210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] validate_networks() for [('2b04f773-2696-4ad3-94c1-bcf6bb04ac97', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:29:12.189970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:12.199045 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6dbdd77f-c452-4872-82fb-e5c26e340994 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.676460 Aug 27 03:29:12.200073 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2122/4386] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:11 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:12.220569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:12.221625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:12.262200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:12.263343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:12.275215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:12.278425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:12.282089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:12.284784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:12.816904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:12.838712 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3642e54e-7ae7-47e9-8aa4-438925e50589 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1500 microversion: 2.1 time: 0.630674 Aug 27 03:29:12.850950 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2123/4387] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:12 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1500 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:12.887398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:12.888042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:12.899371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:12.900403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:12.904308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:12.906649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:12.911028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:12.915316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.175867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:13.177040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:13.178237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:13.179180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:13.180267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:13.197097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.197995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.198481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.199271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.200213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.200906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.235570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:13.239197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Getting quotas for user c309dc0978744766aedfe3fe40fb901c and project 4ea760eafe494a01bbde27f0465bcbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:13.260826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:29:13.263536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:29:13.314882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:13.341201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:13.344300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:13.347133 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2feb47a0-232d-4722-8f1c-fe460175b9dc tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1605 microversion: 2.42 time: 0.495048 Aug 27 03:29:13.351887 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2124/4388] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:12 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1605 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:13.366730 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38ef81e4-71ba-4f30-b9ac-0e3bf23b8a03 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.519186 Aug 27 03:29:13.380350 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2265/4389] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:13.392259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:13.393248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:13.393557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:13.398571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:13.402092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.403173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.404390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.405640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.406467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.407441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.421852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.428499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.429073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.430423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.435763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.436410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.504970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:29:13.629590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:13.731936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:13.744632 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7463715f-cc2d-4b92-bab2-afdc7e6d2eaa tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "DELETE /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 204 len: 0 microversion: 2.1 time: 0.361089 Aug 27 03:29:13.747581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4dc640cb-d8f6-4976-92b2-b7bfd1bfada7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.394046 Aug 27 03:29:13.749148 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2125/4390] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:13 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:13.752464 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2266/4391] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:29:13 2022] DELETE /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:29:13.757288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:13.757765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:13.764565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a8a8308-1a58-4b08-8738-68851d891e15 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:13.768809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.769628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.770654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.773667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.774103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.775529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.776892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a8a8308-1a58-4b08-8738-68851d891e15 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:13.915728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5a8a8308-1a58-4b08-8738-68851d891e15 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:13.929194 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a8a8308-1a58-4b08-8738-68851d891e15 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1209 microversion: 2.1 time: 0.175270 Aug 27 03:29:13.933208 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2267/4392] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:13 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1209 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:13.947838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:13.948469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:13.965403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.966115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.966646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.969239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.970606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.971607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.220152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:14.244078 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5ca00c5-1174-454d-938a-76674adadd59 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.492786 Aug 27 03:29:14.246224 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2126/4393] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:13 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:14.247261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:14.263335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c902330-934a-4a68-a06f-6e0b43f8cf0a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.322440 Aug 27 03:29:14.267530 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2268/4394] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:13 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:14.379085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.379696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:14.408594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.416835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:14.417834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.418693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.420082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:14.423043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.466925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.467440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:14.467888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.468363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lazy-loading 'fault' on Instance uuid e2cfd62f-a91a-4907-8e38-19876adf83f8 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:29:14.561719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:14.582153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:14.586537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b67f8082c2419098485d8b4d4b357d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8f558929244e14a1be6a10a440112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:14.589323 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60983dc4-4c81-4127-8b3a-68d167c39614 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 200 len: 1610 microversion: 2.42 time: 0.214819 Aug 27 03:29:14.590538 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2127/4395] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:14 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 1610 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:14.787940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.789052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:14.807213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.807887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:14.808409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.809580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.810047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:14.810600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.968471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.972135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:14.996588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.999035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.003768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.006480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.007989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.014143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.134532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:15.157308 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d5de01b-b05b-4a1c-8915-ef1531e54ffb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.373533 Aug 27 03:29:15.174207 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2269/4396] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:14 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:15.276858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:15.277701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:15.292848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.293361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.293820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.294572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.304967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.305458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.315214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:15.351227 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fbe79c5b-b811-4a78-b205-6513e96a2a8d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1205 microversion: 2.1 time: 0.398092 Aug 27 03:29:15.353960 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2128/4397] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:14 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1205 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:15.359890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:15.360518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:15.377162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.378093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.378791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.379698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.381138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.381777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.601501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:15.613868 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-224db8e0-dbdd-4a92-8206-0f335072cd46 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.258437 Aug 27 03:29:15.614506 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2129/4398] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:15 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:15.641111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:15.643527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:15.644470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:15.653616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.654325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.655100 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-975bf23e-2f84-4956-ad58-06a3a4563b5a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.384401 Aug 27 03:29:15.655286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.656244 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2270/4399] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:15 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:15.656419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.657310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.658554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.685288 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] HTTP exception thrown: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Request method failure captured: Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 HTTP/1.1 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY3AN38skMR1sC0edT_FqiZSc3LvhDTIGYFkk_iSiUZE2-z43f4pqZ0760E8ub1EaUdyEgurszv--5Y-S_7h43s18Nir8CXzBaBn63esUkYmQcRil-ToAjckai35UFnU9lesWhSjR217CfTRHF8e17434t-ctlpl6Crb5jSlpMMsdMs Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9f8f558929244e14a1be6a10a440112a Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9f8f558929244e14a1be6a10a440112a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9f8f558929244e14a1be6a10a440112a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9f8f558929244e14a1be6a10a440112a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9f8f558929244e14a1be6a10a440112a"}]}] Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9f8f558929244e14a1be6a10a440112a Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TaggedBootDevicesTest_v242-476816604-project Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 29b67f8082c2419098485d8b4d4b357d Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TaggedBootDevicesTest_v242-476816604-project Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'e2cfd62f-a91a-4907-8e38-19876adf83f8'} Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:15.687302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Returning 404 to user: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-074ca954-cf34-4879-a40e-69dafb1d7807 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 404 len: 111 microversion: 2.42 time: 0.047848 Aug 27 03:29:15.698030 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2130/4400] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:15 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:29:15.701248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f254412-9b0f-43dd-bb9f-a89e7a1f5735 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '.version_select at 0x7fe4579bec10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:15.726212 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f254412-9b0f-43dd-bb9f-a89e7a1f5735 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522112289" status: 204 len: 0 microversion: 2.42 time: 0.027843 Aug 27 03:29:15.731120 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2271/4401] 10.222.0.69 () {60 vars in 1262 bytes} [Sat Aug 27 03:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522112289 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:29:16.194962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:16.197546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:16.212487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.213729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.214405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.215349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.216364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.217177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.384281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:16.384898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:16.395012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.395749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.398704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.399665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.400343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.401001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.492448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:16.503418 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8e49462c-076d-4eb0-855e-fd4784a8e184 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1267 microversion: 2.1 time: 0.129800 Aug 27 03:29:16.504025 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2272/4402] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:16 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:16.649638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:16.650900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:16.662450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.664816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.665711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.666714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.667683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.668375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.867124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:16.885963 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8889e28c-e170-480b-808e-3f293f94c9cf tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.244071 Aug 27 03:29:16.886770 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2273/4403] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:16 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:16.900753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:16.901650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:16.909204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.910624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.911941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.913801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.914981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.915178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.113871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:17.125646 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a504ead4-84c4-4593-b19e-b08e92c5a62a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 0.935736 Aug 27 03:29:17.126927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2131/4404] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:16 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:17.496685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:17.506121 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6e5471c-0f71-4981-bee5-3388bd69acc3 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.616775 Aug 27 03:29:17.513184 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2274/4405] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:16 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:17.541112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.547941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:17.570777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.572779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.574102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.576461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.577685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.578605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.713806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:17.727706 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21e1f11b-6604-4c12-99de-1373b5b93833 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1267 microversion: 2.1 time: 0.202039 Aug 27 03:29:17.728763 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2132/4406] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:17 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:17.928505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.935674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:17.950269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.957420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.958132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.963944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.964682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.965330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:18.160759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.164035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:18.182800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.184420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.185724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:18.188405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.189779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.190923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:18.238631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:18.667203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:18.682142 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2cb3889-c6d9-4b5f-9ea4-0c728c5f6479 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.767703 Aug 27 03:29:18.682963 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2275/4407] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:17 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:18.704094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.704898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:18.719131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.719878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.721594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:18.722723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.723392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.725051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:19.009862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:19.023358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5fcc55d-9a06-49c4-bd91-e56ffd478173 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.339223 Aug 27 03:29:19.028658 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2276/4408] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:18 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:19.040248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:19.043115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:19.059897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:19.060766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:19.061631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:19.062629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:19.063601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:19.068155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:19.200701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:19.233898 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef7486aa-0e0b-49ab-b6f8-bd33dd4825b4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1511 microversion: 2.1 time: 1.081740 Aug 27 03:29:19.235286 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2133/4409] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:18 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1511 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:19.457054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:19.468205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3cc276b6-9e8d-4f28-91df-a187461f2503 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.437901 Aug 27 03:29:19.469781 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2277/4410] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:19 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:19.704970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:19.705583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:19.727480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:19.728259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:19.728705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:19.729428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:19.729891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:19.730358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.049772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.050487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:20.063050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.063554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.064885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.068182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.069554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.071595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.171495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:20.187613 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f9a2e15-4b03-4839-963e-d116f9e4cf97 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1506 microversion: 2.1 time: 0.485461 Aug 27 03:29:20.188233 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2134/4411] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:19 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:20.258008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.258795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:20.274233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.275435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.276316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.279880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.280360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.280800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.550633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:20.568129 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff8d8071-13e0-4e78-9749-a94b4174e5ef tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.522115 Aug 27 03:29:20.586153 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2278/4412] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:20 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:20.596468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.597365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:20.605147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:20.609081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.609885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.610808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.611781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.612459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.613231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.702515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:20.716778 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af541582-cd8e-4d99-ac18-69f7c1a5a161 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1488 microversion: 2.1 time: 0.464960 Aug 27 03:29:20.728078 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2135/4413] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:20 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1488 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:20.745199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:20.754551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:20.763498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.764311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.764989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.765968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.768423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.769250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.859555 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7795f2e3-8739-49de-9eb0-f679777a2710 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 200 len: 153 microversion: 2.1 time: 0.119896 Aug 27 03:29:20.865612 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2136/4414] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:20 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 153 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:20.887107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.887827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:20.905592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.906091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.915871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.916851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.917349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.917798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.148315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:21.162483 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-971b15bb-6f5d-4719-838e-a48b014aa0fb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.573642 Aug 27 03:29:21.163434 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2279/4415] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:20 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:21.212036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.213046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:21.220319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.221363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.222855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.224703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.225730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.226461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.334916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:21.346238 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-25331eac-be17-4d71-835f-ede81bb64d44 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 200 len: 1464 microversion: 2.1 time: 0.141016 Aug 27 03:29:21.351868 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2280/4416] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:21 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:21.358678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-528c26c6-e3fb-4ea9-b225-3f801ebcbbdc req-5f91650a-28cd-4bfd-a41a-7774a7a0d717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33451c2d-e89b-421d-a61c-0c15ff478c9e", "name": "network-vif-deleted", "tag": "2888e755-20a0-4360-bd78-65bf9c376320"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:21.390973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-528c26c6-e3fb-4ea9-b225-3f801ebcbbdc req-5f91650a-28cd-4bfd-a41a-7774a7a0d717 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.391471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-528c26c6-e3fb-4ea9-b225-3f801ebcbbdc req-5f91650a-28cd-4bfd-a41a-7774a7a0d717 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.391910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-528c26c6-e3fb-4ea9-b225-3f801ebcbbdc req-5f91650a-28cd-4bfd-a41a-7774a7a0d717 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.409693 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-528c26c6-e3fb-4ea9-b225-3f801ebcbbdc req-5f91650a-28cd-4bfd-a41a-7774a7a0d717 service nova] Creating event network-vif-deleted:2888e755-20a0-4360-bd78-65bf9c376320 for instance 33451c2d-e89b-421d-a61c-0c15ff478c9e on n-h2-852086-5 Aug 27 03:29:21.416761 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-528c26c6-e3fb-4ea9-b225-3f801ebcbbdc req-5f91650a-28cd-4bfd-a41a-7774a7a0d717 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062998 Aug 27 03:29:21.417641 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2281/4417] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:21.549506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:21.570207 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8c8bf60-0bd8-4bbe-b676-d476ae26abc3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.699719 Aug 27 03:29:21.585039 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2137/4418] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:20 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:21.593407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.594100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:21.602273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.602893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:21.632879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.634697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.635234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.635769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.638925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.639285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.641267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.641773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.642903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.643304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.647286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.650416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.030031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.039467 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7c14a2c6-b857-4f00-bc66-48a557f228c4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.450212 Aug 27 03:29:22.045098 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2282/4419] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:21 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:22.185120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.187155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.198981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.200609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.201797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.204077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.207407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.209455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.277407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.290457 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e58a10c1-a845-4c9f-922c-b43be14a3f3d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.688185 Aug 27 03:29:22.291182 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2138/4420] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:21 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:22.312579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.313481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.328502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.330849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.334204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.340145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.340871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.345249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.512872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.524536 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02c99786-701e-4936-b572-1ba548d81965 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.343579 Aug 27 03:29:22.525144 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2283/4421] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:22 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:22.552849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.553568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 33451c2d-e89b-421d-a61c-0c15ff478c9e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.561289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.562049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.562687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.563587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.564208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.564794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.607237 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] HTTP exception thrown: Instance 33451c2d-e89b-421d-a61c-0c15ff478c9e could not be found. Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Request method failure captured: Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e HTTP/1.1 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY8F62-3LgdqI2qucerHqG6VJpBK8e3e8h4Jb4SeKBSlSwGmKfxoRXY-uq6QNMrV0axsU01K_O5ALZ-5psGMSb7xAjKAka_fHjHQlUR0xy5wRBdmWDV1Rwa99AJOyFNUm54NLPMvFWQFB_oNYj2z0G0xJy4wSDNYwCojxN7Ct9KZG8w Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 64ead14cbaec48cea0f7317e81ea8325 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerRescueTestJSON-1789858375 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/64ead14cbaec48cea0f7317e81ea8325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/64ead14cbaec48cea0f7317e81ea8325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_64ead14cbaec48cea0f7317e81ea8325", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/64ead14cbaec48cea0f7317e81ea8325"}]}] Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerRescueTestJSON-1789858375 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 64ead14cbaec48cea0f7317e81ea8325 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerRescueTestJSON-1789858375 Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerRescueTestJSON-1789858375-project Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: e198e17424c9429381bccc4b8ce7ce6b Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerRescueTestJSON-1789858375-project Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 33451c2d-e89b-421d-a61c-0c15ff478c9e could not be found. Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '33451c2d-e89b-421d-a61c-0c15ff478c9e'} Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33451c2d-e89b-421d-a61c-0c15ff478c9e could not be found. Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33451c2d-e89b-421d-a61c-0c15ff478c9e could not be found. Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:22.611259 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:22.617162 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:22.617162 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:22.617162 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:22.617162 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:22.617162 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:22.617162 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33451c2d-e89b-421d-a61c-0c15ff478c9e could not be found. Aug 27 03:29:22.617162 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:22.621242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Returning 404 to user: Instance 33451c2d-e89b-421d-a61c-0c15ff478c9e could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:22.622143 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e56c55ba-491d-4aaa-b93e-a815ac3c725a tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e" status: 404 len: 111 microversion: 2.1 time: 0.074687 Aug 27 03:29:22.622978 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2284/4422] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:22 2022] GET /compute/v2.1/servers/33451c2d-e89b-421d-a61c-0c15ff478c9e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:22.635625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.637552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.644880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.645985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.646886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.647853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.648685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.650446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.688222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:29:22.720163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:22.849887 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d691a8f-5623-4f76-a0a9-5a024a3fa27b tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "DELETE /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 204 len: 0 microversion: 2.1 time: 0.221914 Aug 27 03:29:22.852341 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2285/4423] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:29:22 2022] DELETE /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:29:22.868192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.869450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.887035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.889559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.891879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.892913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.897126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.897640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.909501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.925247 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-040302b4-5729-49cf-b932-b1d9b4788fdd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.617091 Aug 27 03:29:22.926423 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2139/4424] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:22 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:22.947064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.947696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.962784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.963781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.964638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.965521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.966298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.966894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.186219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:23.202389 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80ff38b1-cb11-4a10-b07d-aeae090027b2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.259718 Aug 27 03:29:23.207063 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2140/4425] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:22 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:23.212434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:23.214078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.214962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:23.222220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.223746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.225460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.227187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.228390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.230424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.255895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:23.270909 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-475c5f44-b34b-4a40-be1e-58cd64253927 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1491 microversion: 2.1 time: 0.413351 Aug 27 03:29:23.271516 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2286/4426] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:22 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1491 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.388213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-113913393", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "05166925-98fa-4fca-b74f-85bb13110797"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:23.471687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:23.490835 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0cebf05-e98d-45c2-a450-4cbe70afd9d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.279610 Aug 27 03:29:23.493494 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2141/4427] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:23 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.502790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-aa2ecffa-994e-4ffe-b45c-fef0d314913e req-91b92043-3d75-4364-bd7f-97c290c8e08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d37617-dff4-44f7-9a57-b0a9f37d9b55", "tag": "cb709c54-fe08-476d-9c96-181093d5394b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:23.520827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-aa2ecffa-994e-4ffe-b45c-fef0d314913e req-91b92043-3d75-4364-bd7f-97c290c8e08c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.522323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-aa2ecffa-994e-4ffe-b45c-fef0d314913e req-91b92043-3d75-4364-bd7f-97c290c8e08c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.523377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-aa2ecffa-994e-4ffe-b45c-fef0d314913e req-91b92043-3d75-4364-bd7f-97c290c8e08c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.542150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] validate_networks() for [('05166925-98fa-4fca-b74f-85bb13110797', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:29:23.557634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-aa2ecffa-994e-4ffe-b45c-fef0d314913e req-91b92043-3d75-4364-bd7f-97c290c8e08c service nova] Creating event network-changed:cb709c54-fe08-476d-9c96-181093d5394b for instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 on n-h1-852086-5 Aug 27 03:29:23.569934 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-aa2ecffa-994e-4ffe-b45c-fef0d314913e req-91b92043-3d75-4364-bd7f-97c290c8e08c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070803 Aug 27 03:29:23.579012 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2142/4428] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:23.590185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.592037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:23.604263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.605484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.609845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.614616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.614616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.615508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.890624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:23.902446 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6462dea8-a95b-49b1-8fb6-0ba0c4f67e9d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.320459 Aug 27 03:29:23.904413 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2143/4429] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:23 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.920286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:24.297836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:24.299701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:24.314296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.314800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.315451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:24.328344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.331968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.339121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:24.742579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:24.766526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26f1ba91-6bd7-43e7-94e5-ca6148a5236f tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1491 microversion: 2.1 time: 0.475761 Aug 27 03:29:24.771290 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2144/4430] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:24 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1491 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:24.778354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:24.779239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:24.803705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.804364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.804880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:24.806341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.806919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.807448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:25.220197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:25.221594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:25.222295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:25.222880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:25.223447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:25.250114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.252144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.253335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:25.254906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.257665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.258917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:25.309898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:25.327505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for user 89f850adf9a7432798f86fe9d2d17b79 and project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:25.367193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:29:25.370361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:29:25.533765 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-743797bd-b636-4100-96d0-4376fb0eedc7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149330 Aug 27 03:29:25.535031 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2287/4431] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:25.548862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:25.549735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:25.558538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.559691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.560327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:25.561439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.562063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.562688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:25.860216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:25.882042 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91d68ca3-eeb5-4a66-90c5-15ba9ba55c31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 1.108459 Aug 27 03:29:25.889359 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2145/4432] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:24 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:25.900400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-702345c2-67b7-48af-a1c5-3453eae8f57d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:25.908548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-702345c2-67b7-48af-a1c5-3453eae8f57d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:25.955498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:25.968667 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17640186-8b11-4fad-8641-ca0ffebbbcd7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.430226 Aug 27 03:29:25.975770 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2288/4433] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:25 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:25.981128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:25.983723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:26.003136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:26.005865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:26.007378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:26.014544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:26.015380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:26.016067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:26.214004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-702345c2-67b7-48af-a1c5-3453eae8f57d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:26.222307 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-702345c2-67b7-48af-a1c5-3453eae8f57d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1214 microversion: 2.1 time: 0.330058 Aug 27 03:29:26.230339 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2146/4434] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:25 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:26.354668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:26.363900 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad8e7970-8589-44b4-8c28-f1a8a403ea60 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1491 microversion: 2.1 time: 0.386561 Aug 27 03:29:26.369562 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2289/4435] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:25 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1491 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:26.914062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:26.915307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:26.945038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:26.950528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:26.952072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:26.956756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:26.957568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:26.959845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.000486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.004110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.026080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.031785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.032428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.035837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.040226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.041086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.303096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.318598 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd54617f-33e6-4f7f-92f9-6f9a5bd985e0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.323848 Aug 27 03:29:27.319501 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2290/4436] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:26 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:27.393017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.420245 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37ec155e-2f12-443c-95fc-d9668a31bc6f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1500 microversion: 2.1 time: 0.511611 Aug 27 03:29:27.428729 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2147/4437] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:26 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1500 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:27.440285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.443168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.454232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.455635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.456835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.457984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.459038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.460318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.624391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-803d4740-6db8-4bd5-98b3-3198b4d8ab86 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: .version_select at 0x7fe457a7f820>, body: {"keypair": {"name": "tempest-keypair-2032193520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeAPdBNO6Zb1R4Y35VdcnVR20NskXd4/Ux3YYg/Etim8mwHEc20TCaHEY8K06ZGkcFBHBmeu/l8P/m//kTMDGFzDvslk2ouscmQw+WmjuLAjZSrTkB1sge/hFc+KpglWw=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:27.651940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-803d4740-6db8-4bd5-98b3-3198b4d8ab86 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:27.659468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-803d4740-6db8-4bd5-98b3-3198b4d8ab86 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:27.691033 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-803d4740-6db8-4bd5-98b3-3198b4d8ab86 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.365139 Aug 27 03:29:27.692218 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2291/4438] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:29:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:27.698476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.699586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.707207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.707820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.708750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.709983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.710705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.711422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.803357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.815438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e198e17424c9429381bccc4b8ce7ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ead14cbaec48cea0f7317e81ea8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.825533 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d1a6afb-9145-41b1-9600-c1e92649f782 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 200 len: 1449 microversion: 2.1 time: 0.131416 Aug 27 03:29:27.828928 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe649c6b-a6ab-45b3-89b6-a9cf943b1421 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1266 microversion: 2.1 time: 0.396938 Aug 27 03:29:27.829672 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2148/4439] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:27 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:27.834385 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2292/4440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:27 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:27.871149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94431a67-7857-48a1-84d9-49774e316da3"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:27.876836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.893375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.894194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.896241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.897142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.898865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.899706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.900083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.900268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.913197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.913704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.914142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.914882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.915337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.915768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.960618 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Cannot 'attach_volume' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state rescued Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/os-volume_attachments HTTP/1.1 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 74 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: {"volumeAttachment": {"volumeId": "94431a67-7857-48a1-84d9-49774e316da3"}} Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'attach_volume' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state rescued Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': '6149aa8e-84bb-4a4c-933c-da6b1c15a90e', 'body': {'volumeAttachment': {'volumeId': '94431a67-7857-48a1-84d9-49774e316da3'}}} Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 27 03:29:27.963776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state rescued Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state rescued Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 409 to user: Cannot 'attach_volume' instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e while it is in vm_state rescued {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:27.971433 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a88ee5cc-5ff6-43a1-a4e2-709695709a80 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121272 Aug 27 03:29:27.974337 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2149/4441] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:29:27 2022] POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/os-volume_attachments => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:29:27.979118 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] HTTP exception thrown: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Request method failure captured: Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 HTTP/1.1 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY3AN38skMR1sC0edT_FqiZSc3LvhDTIGYFkk_iSiUZE2-z43f4pqZ0760E8ub1EaUdyEgurszv--5Y-S_7h43s18Nir8CXzBaBn63esUkYmQcRil-ToAjckai35UFnU9lesWhSjR217CfTRHF8e17434t-ctlpl6Crb5jSlpMMsdMs Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9f8f558929244e14a1be6a10a440112a Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9f8f558929244e14a1be6a10a440112a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9f8f558929244e14a1be6a10a440112a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9f8f558929244e14a1be6a10a440112a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9f8f558929244e14a1be6a10a440112a"}]}] Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9f8f558929244e14a1be6a10a440112a Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TaggedBootDevicesTest_v242-476816604-project Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 29b67f8082c2419098485d8b4d4b357d Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TaggedBootDevicesTest_v242-476816604-project Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'e2cfd62f-a91a-4907-8e38-19876adf83f8'} Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:27.981022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Returning 404 to user: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:27.986840 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f76351c-7fb5-4434-9837-e09e7db73ffe tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 404 len: 111 microversion: 2.42 time: 0.087494 Aug 27 03:29:27.990689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:27.990689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.990889 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2293/4442] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:29:27 2022] DELETE /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:29:27.994283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.995924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.996530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.997097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.997931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.998626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.999155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.002805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] [instance: e2cfd62f-a91a-4907-8e38-19876adf83f8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:28.024800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.025562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.026312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.027261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.027900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.028480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.067571 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] HTTP exception thrown: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Request method failure captured: Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 HTTP/1.1 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY3AN38skMR1sC0edT_FqiZSc3LvhDTIGYFkk_iSiUZE2-z43f4pqZ0760E8ub1EaUdyEgurszv--5Y-S_7h43s18Nir8CXzBaBn63esUkYmQcRil-ToAjckai35UFnU9lesWhSjR217CfTRHF8e17434t-ctlpl6Crb5jSlpMMsdMs Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9f8f558929244e14a1be6a10a440112a Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9f8f558929244e14a1be6a10a440112a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9f8f558929244e14a1be6a10a440112a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9f8f558929244e14a1be6a10a440112a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9f8f558929244e14a1be6a10a440112a"}]}] Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9f8f558929244e14a1be6a10a440112a Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-476816604 Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TaggedBootDevicesTest_v242-476816604-project Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 29b67f8082c2419098485d8b4d4b357d Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TaggedBootDevicesTest_v242-476816604-project Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'e2cfd62f-a91a-4907-8e38-19876adf83f8'} Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:28.081557 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. Aug 27 03:29:28.085954 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:28.088419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] Returning 404 to user: Instance e2cfd62f-a91a-4907-8e38-19876adf83f8 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:28.089559 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6453585c-fec6-4c49-af53-77cb78ba3892 tempest-TaggedBootDevicesTest_v242-476816604 tempest-TaggedBootDevicesTest_v242-476816604-project] 10.222.0.69 "GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8" status: 404 len: 111 microversion: 2.42 time: 0.100347 Aug 27 03:29:28.090654 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2294/4443] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:27 2022] GET /compute/v2.1/servers/e2cfd62f-a91a-4907-8e38-19876adf83f8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:29:28.097784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5f51a609-d94f-4dd3-8dec-c70f8879c8cf req-754bdd0f-84eb-4bb1-a480-47a2c741e3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278f5a6c-e268-45f3-a572-95a9b8dc22e6", "name": "network-vif-deleted", "tag": "b0983c98-ddb3-4184-a19f-d336ddd97586"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:28.110063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5f51a609-d94f-4dd3-8dec-c70f8879c8cf req-754bdd0f-84eb-4bb1-a480-47a2c741e3f7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.111162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5f51a609-d94f-4dd3-8dec-c70f8879c8cf req-754bdd0f-84eb-4bb1-a480-47a2c741e3f7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.111799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5f51a609-d94f-4dd3-8dec-c70f8879c8cf req-754bdd0f-84eb-4bb1-a480-47a2c741e3f7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.125592 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5f51a609-d94f-4dd3-8dec-c70f8879c8cf req-754bdd0f-84eb-4bb1-a480-47a2c741e3f7 service nova] Creating event network-vif-deleted:b0983c98-ddb3-4184-a19f-d336ddd97586 for instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 on n-h1-852086-5 Aug 27 03:29:28.131719 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5f51a609-d94f-4dd3-8dec-c70f8879c8cf req-754bdd0f-84eb-4bb1-a480-47a2c741e3f7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039533 Aug 27 03:29:28.133037 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2295/4444] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:28.173894 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65f4f057-fc2c-4668-bdf4-ecedaed64ae7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action" status: 202 len: 0 microversion: 2.1 time: 0.197838 Aug 27 03:29:28.184437 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2150/4445] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:27 2022] POST /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:29:28.189131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:28.191657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:28.212067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.216147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.218711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.220324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.223152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.225535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.356410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:28.358589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:28.382260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.392381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.393224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.394864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.395540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.400451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.441130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:28.981203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:28.994453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c60fd947-f8e6-42d5-bb9d-e459ffcd9ede tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1508 microversion: 2.1 time: 0.809651 Aug 27 03:29:28.998887 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2296/4446] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:28 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1508 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:29.009992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:29.017587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:29.036694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.037575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.042897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.043922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.044832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.045437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.224806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:29.235914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ed21bf7-c4dc-4c86-b21b-a188d2425318 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1272 microversion: 2.1 time: 0.235690 Aug 27 03:29:29.238847 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2297/4447] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:28 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:29.250827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:29.252863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] [instance: 278f5a6c-e268-45f3-a572-95a9b8dc22e6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:29.267228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.267965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.268544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.269401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.280025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.280669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.296204 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] HTTP exception thrown: Instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 could not be found. Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Request method failure captured: Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 HTTP/1.1 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY8F62-3LgdqI2qucerHqG6VJpBK8e3e8h4Jb4SeKBSlSwGmKfxoRXY-uq6QNMrV0axsU01K_O5ALZ-5psGMSb7xAjKAka_fHjHQlUR0xy5wRBdmWDV1Rwa99AJOyFNUm54NLPMvFWQFB_oNYj2z0G0xJy4wSDNYwCojxN7Ct9KZG8w Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 64ead14cbaec48cea0f7317e81ea8325 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerRescueTestJSON-1789858375 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/64ead14cbaec48cea0f7317e81ea8325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/64ead14cbaec48cea0f7317e81ea8325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_64ead14cbaec48cea0f7317e81ea8325", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/64ead14cbaec48cea0f7317e81ea8325"}]}] Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerRescueTestJSON-1789858375 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 64ead14cbaec48cea0f7317e81ea8325 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerRescueTestJSON-1789858375 Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerRescueTestJSON-1789858375-project Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: e198e17424c9429381bccc4b8ce7ce6b Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerRescueTestJSON-1789858375-project Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 could not be found. Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '278f5a6c-e268-45f3-a572-95a9b8dc22e6'} Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 could not be found. Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 could not be found. Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:29:29.303400 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:29.307627 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:29:29.307627 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:29:29.307627 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:29:29.307627 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:29:29.307627 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:29:29.307627 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 could not be found. Aug 27 03:29:29.307627 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:29:29.312260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] Returning 404 to user: Instance 278f5a6c-e268-45f3-a572-95a9b8dc22e6 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:29:29.315433 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f149d533-90d6-4ac3-9074-a8d849d2c9a5 tempest-ServerRescueTestJSON-1789858375 tempest-ServerRescueTestJSON-1789858375-project] 10.222.0.69 "GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6" status: 404 len: 111 microversion: 2.1 time: 0.072106 Aug 27 03:29:29.317292 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2298/4448] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:29 2022] GET /compute/v2.1/servers/278f5a6c-e268-45f3-a572-95a9b8dc22e6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:29.468146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:29.490725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a0e5f17-e838-4fa9-bb42-c359791f66e5 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 1.144504 Aug 27 03:29:29.496011 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2151/4449] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:28 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:30.031188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:30.032800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:30.088025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.088025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.089725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.094097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.097171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.100267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.263691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:30.264531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:30.307993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.310657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.311207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.314449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.314952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.318902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.754523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.767614 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b014cc70-d58d-4754-9572-48430493f22c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1508 microversion: 2.1 time: 0.753482 Aug 27 03:29:30.768896 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2299/4450] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:30 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1508 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:30.784810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:30.785861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:30.804468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.804973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.805425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.806149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.806641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.807070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:31.581892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.602956 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6c6425e-acb4-4b66-83af-fca78ebc409d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1314 microversion: 2.1 time: 1.345141 Aug 27 03:29:31.619914 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2152/4451] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:30 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1314 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:31.667796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:31.684627 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5f1a06d-f4d5-4906-8d7e-66e353b3e1bb tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.914454 Aug 27 03:29:31.694561 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2300/4452] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:30 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:31.790396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:31.790969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:31.804687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:31.805489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:31.806687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:31.809479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:31.810138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:31.810774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:32.268477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.282476 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab3ee35b-5b27-40af-9331-9cd8ae146166 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1514 microversion: 2.1 time: 0.496345 Aug 27 03:29:32.286781 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2153/4453] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:31 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1514 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:32.640735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:32.641808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:32.656084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:32.656821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:32.657425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:32.658991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:32.660733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:32.663859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:32.716077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:32.717749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:32.746328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:32.747323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:32.751197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:32.752426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:32.755190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:32.755906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:33.305873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.319390 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f641ebe1-0356-48ad-a36f-9463cdcb416d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.612159 Aug 27 03:29:33.324753 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2154/4454] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:32 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:33.548944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8ff9aded-8a28-4d62-808c-5ca3eac0eedd req-26d7ee8c-ac2c-4140-b5d0-564aedfc8b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0c11ae-a7c0-4357-9a52-f9f88968dd51", "tag": "cb74d178-d308-49fb-b21f-7934d0b01bd7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:33.581081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ff9aded-8a28-4d62-808c-5ca3eac0eedd req-26d7ee8c-ac2c-4140-b5d0-564aedfc8b12 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:33.581575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ff9aded-8a28-4d62-808c-5ca3eac0eedd req-26d7ee8c-ac2c-4140-b5d0-564aedfc8b12 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:33.582011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ff9aded-8a28-4d62-808c-5ca3eac0eedd req-26d7ee8c-ac2c-4140-b5d0-564aedfc8b12 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:33.621855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8ff9aded-8a28-4d62-808c-5ca3eac0eedd req-26d7ee8c-ac2c-4140-b5d0-564aedfc8b12 service nova] Creating event network-changed:cb74d178-d308-49fb-b21f-7934d0b01bd7 for instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 on n-h2-852086-5 Aug 27 03:29:33.630895 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8ff9aded-8a28-4d62-808c-5ca3eac0eedd req-26d7ee8c-ac2c-4140-b5d0-564aedfc8b12 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086084 Aug 27 03:29:33.643034 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2155/4455] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:33.843978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.863686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fbf31335-4756-441b-ad72-0088630bf201 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1314 microversion: 2.1 time: 1.227194 Aug 27 03:29:33.865190 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2301/4456] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:32 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:34.349747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:34.351305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:34.376453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.376964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.377419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:34.381261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.382909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.384146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:34.396948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fb59408b-6e62-4877-8802-cfb38a5483c1 req-ec4fd750-8eb4-40b8-bc9a-f8e2b1ca3b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d37617-dff4-44f7-9a57-b0a9f37d9b55", "name": "network-vif-plugged", "status": "completed", "tag": "cb709c54-fe08-476d-9c96-181093d5394b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:34.437862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb59408b-6e62-4877-8802-cfb38a5483c1 req-ec4fd750-8eb4-40b8-bc9a-f8e2b1ca3b1b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.439091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb59408b-6e62-4877-8802-cfb38a5483c1 req-ec4fd750-8eb4-40b8-bc9a-f8e2b1ca3b1b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.452279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb59408b-6e62-4877-8802-cfb38a5483c1 req-ec4fd750-8eb4-40b8-bc9a-f8e2b1ca3b1b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:34.505961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fb59408b-6e62-4877-8802-cfb38a5483c1 req-ec4fd750-8eb4-40b8-bc9a-f8e2b1ca3b1b service nova] Creating event network-vif-plugged:cb709c54-fe08-476d-9c96-181093d5394b for instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 on n-h1-852086-5 Aug 27 03:29:34.565981 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fb59408b-6e62-4877-8802-cfb38a5483c1 req-ec4fd750-8eb4-40b8-bc9a-f8e2b1ca3b1b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175241 Aug 27 03:29:34.567043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2302/4457] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:34.626560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2109470345", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37d2c35e-4ba5-4e30-b147-136ed6948e64"}], "security_groups": [{"name": "tempest-securitygroup--955231717"}], "key_name": "tempest-keypair-2032193520", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:34.747310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:34.779973 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34c3cb99-1b94-4ea9-87f8-bbaf6762fbcf tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.435411 Aug 27 03:29:34.785463 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2156/4458] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:34 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:34.886766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:34.887830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:34.898197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.902903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.905396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:34.907375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.908883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.910296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:35.288960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:35.294213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] validate_networks() for [('37d2c35e-4ba5-4e30-b147-136ed6948e64', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:29:35.463695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:35.496536 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e4c3a78-b01f-4f42-a1b2-7254ec0c418b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1314 microversion: 2.1 time: 0.606856 Aug 27 03:29:35.501638 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2157/4459] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:34 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:35.509052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a813f9a-bc5a-4941-8e2e-e1f29af51158 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'create', calling method: .version_select at 0x7fe45c749ca0>, body: {"keypair": {"name": "tempest-keypair-390326366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyty5hy7tKmbRNZR19meM7kl//x8ue8Cut3LmU79CwCqACTL20Cw6KyKRiH03GEMMez09DPHsolhLcHoJJtBP2iSX8UpXlydQz2Tq2H9OTUmfK+yEIzsNUWS6fcXrCT+g=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:35.539540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1a813f9a-bc5a-4941-8e2e-e1f29af51158 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:35.546460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1a813f9a-bc5a-4941-8e2e-e1f29af51158 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for user 8e78ab2dacae4a25803ea9f0cf512b87 and project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:35.577020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:35.593311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a813f9a-bc5a-4941-8e2e-e1f29af51158 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089887 Aug 27 03:29:35.594844 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2158/4460] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:29:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:35.818813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:35.820235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:35.845628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:35.850476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:35.851664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:35.856176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:35.867107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:35.867892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:36.804474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.815659 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1be75a7e-e441-4bb2-b2c9-a1530b6db500 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 1.003791 Aug 27 03:29:36.823471 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2159/4461] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:35 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:36.836166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:36.840888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:36.854110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:36.855000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:36.855670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:36.856627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:36.862103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:36.862960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:36.945187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:36.946419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:36.947136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:36.947790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:36.948432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:36.982881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:36.983387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:36.983838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:36.984868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:36.985351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:36.985788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:37.043965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:37.071982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:37.088113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:29:37.091731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:29:37.247436 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c7b2e28-2f7f-4be8-8f17-26d6b66276b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.625957 Aug 27 03:29:37.254067 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2303/4462] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:29:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:37.271103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6726b220-9019-43a0-90cf-597bfd05a276 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:37.272130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6726b220-9019-43a0-90cf-597bfd05a276 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:37.458083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6726b220-9019-43a0-90cf-597bfd05a276 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.466464 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6726b220-9019-43a0-90cf-597bfd05a276 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1242 microversion: 2.1 time: 0.207762 Aug 27 03:29:37.467055 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2304/4463] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:37 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:37.545158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.567176 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f5b9982-21fb-4b6d-9574-9833a3a7a40d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1314 microversion: 2.1 time: 0.742146 Aug 27 03:29:37.580653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2160/4464] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:36 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:37.846504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:37.847211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:37.870041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:37.874947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:37.877015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:37.882241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:37.884585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:37.885282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:37.886950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:38.488686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:38.490619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:38.515533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:38.518042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:38.519108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:38.523882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:38.524942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:38.538618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:38.782788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.796444 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-658b90fd-4d46-492d-9896-2bc3ea8ec078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1246 microversion: 2.1 time: 0.310009 Aug 27 03:29:38.797850 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2161/4465] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:38 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1246 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:38.816588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:38.832743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:38.835759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:38.852527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c4d5c51c-b71a-4caa-a92d-ba572a475fc0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1491 microversion: 2.1 time: 1.009234 Aug 27 03:29:38.856074 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2305/4466] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:37 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1491 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:38.904766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:38.907424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:38.907907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:38.912057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:38.912533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:38.913470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:38.923000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-448327999"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:38.939609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:38.998455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.005615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.006872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.009948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.013304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.016008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.303755 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7e18613-b7b6-4306-b619-a0e5d940e814 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "PUT /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1075 microversion: 2.1 time: 0.383648 Aug 27 03:29:39.312646 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2306/4467] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:29:38 2022] PUT /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1075 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:39.350982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:39.355599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:39.387291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.394404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.395471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.399296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.400055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.404145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.413026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:39.487825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:39.503609 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-667f20fa-0faa-4ee2-9084-ae7d585ce4d5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1314 microversion: 2.1 time: 0.688347 Aug 27 03:29:39.506477 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2162/4468] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:38 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:39.822286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:39.823185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:39.837694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.839656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.841364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.842432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.843135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.844651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.867324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:39.885948 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc3b0552-7edc-4e36-9467-ae4d80eb347d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1501 microversion: 2.1 time: 0.563561 Aug 27 03:29:39.889651 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2307/4469] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:39 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1501 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:39.936385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:39.939975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:39.962135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.965672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.967345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.971699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:39.980067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:39.980910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:40.084831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.105635 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57f8a5ab-faff-44de-9967-595706d65016 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1294 microversion: 2.1 time: 0.288306 Aug 27 03:29:40.107290 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2163/4470] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:39 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1294 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:40.541551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:40.543279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:40.551361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:40.553645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:40.554594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:40.559240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:40.560959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:40.561645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:40.861268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.873458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-972b1932-ff21-41ab-b2e7-6168cc581792 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1501 microversion: 2.1 time: 0.946679 Aug 27 03:29:40.890495 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2308/4471] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:39 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1501 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:40.906966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f96777a-5855-45f3-93a6-1a074518d263 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:40.924308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f96777a-5855-45f3-93a6-1a074518d263 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:40.925433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f96777a-5855-45f3-93a6-1a074518d263 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:40.926219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f96777a-5855-45f3-93a6-1a074518d263 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:40.965777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f96777a-5855-45f3-93a6-1a074518d263 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Going to try to stop instance {{(pid=122407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:29:41.053278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f96777a-5855-45f3-93a6-1a074518d263 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "POST /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55/action" status: 202 len: 0 microversion: 2.1 time: 0.157528 Aug 27 03:29:41.070667 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2309/4472] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:40 2022] POST /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:29:41.077452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:41.078155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:41.089580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:41.091972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:41.094245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:41.095081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:41.096746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:41.099422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:41.305480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.334867 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d3a23e4-4b42-4936-9fc7-36ee2fa802ab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1314 microversion: 2.1 time: 0.809473 Aug 27 03:29:41.336238 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2164/4473] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:40 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:41.343518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:41.344527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:41.352396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:41.353241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:41.353910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:41.356180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:41.356869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:41.358750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:41.424098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.437553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f94be410-5485-4f83-9589-d0b2b47c312f tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.365353 Aug 27 03:29:41.440759 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2310/4474] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:41 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:41.531210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7dab91e0-0f02-4c4f-bce1-c1f1974c9bd3 req-ec190694-494c-4b02-b3d7-28d1e821b7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0c11ae-a7c0-4357-9a52-f9f88968dd51", "name": "network-vif-plugged", "status": "completed", "tag": "cb74d178-d308-49fb-b21f-7934d0b01bd7"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:41.532195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.552448 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9466374f-904f-4257-b964-456ba5506570 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1300 microversion: 2.1 time: 0.213866 Aug 27 03:29:41.554586 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2165/4475] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:41 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1300 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:41.555152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7dab91e0-0f02-4c4f-bce1-c1f1974c9bd3 req-ec190694-494c-4b02-b3d7-28d1e821b7a8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:41.555800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7dab91e0-0f02-4c4f-bce1-c1f1974c9bd3 req-ec190694-494c-4b02-b3d7-28d1e821b7a8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:41.556257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7dab91e0-0f02-4c4f-bce1-c1f1974c9bd3 req-ec190694-494c-4b02-b3d7-28d1e821b7a8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:41.629219 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7dab91e0-0f02-4c4f-bce1-c1f1974c9bd3 req-ec190694-494c-4b02-b3d7-28d1e821b7a8 service nova] Creating event network-vif-plugged:cb74d178-d308-49fb-b21f-7934d0b01bd7 for instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 on n-h2-852086-5 Aug 27 03:29:41.636395 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7dab91e0-0f02-4c4f-bce1-c1f1974c9bd3 req-ec190694-494c-4b02-b3d7-28d1e821b7a8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113901 Aug 27 03:29:41.637771 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2311/4476] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:42.191384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1198878424", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8616c99f-523a-4e1f-805f-fcb7d85c9627"}], "security_groups": [{"name": "tempest-securitygroup--1341478558"}], "key_name": "tempest-keypair-390326366", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:42.361396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:42.362805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:42.381957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:42.382748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:42.383380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:42.386851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:42.387647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:42.388262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:42.741372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] validate_networks() for [('8616c99f-523a-4e1f-805f-fcb7d85c9627', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:29:42.765514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.777686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8530708b-ca9b-44e1-9630-6488cfffef05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1314 microversion: 2.1 time: 0.420458 Aug 27 03:29:42.782573 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2312/4477] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:42 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:42.788986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:42.798102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:42.805982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:42.807524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:42.807985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:42.808708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:42.809170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:42.809592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.100460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:43.114086 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-27d92120-b3fd-40e5-bd70-cd65647674d8 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.329798 Aug 27 03:29:43.124176 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2313/4478] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:42 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:43.143075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.144099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:43.154300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.155237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.156315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.157834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.158762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.159619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.529860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:43.548856 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3671b5de-9b1f-4cd1-bb6e-a967e404d3e5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1367 microversion: 2.1 time: 0.422624 Aug 27 03:29:43.559137 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2314/4479] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:43 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:43.806688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.807725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:43.827865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.829383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.830434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.831810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.832658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.834314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.106366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:44.118789 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce15a66a-b7ff-42d7-b8cc-075fd949367c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1500 microversion: 2.1 time: 0.318598 Aug 27 03:29:44.132360 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2315/4480] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:43 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1500 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:44.326472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1808331037", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": "none"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:44.394726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:44.396622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:44.397136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:44.402512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:44.403004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:44.436793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.437583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.438217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.439510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.440315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.441252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.470546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:44.470974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:44.471457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:44.471867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:44.472279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:44.479441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:44.487513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Getting quotas for user 8e78ab2dacae4a25803ea9f0cf512b87 and project 626a7fac21be48c7a265dc3441c0a66a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:44.500388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.501135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.501728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.502687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.503314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.503893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.507192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:29:44.510788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:29:44.551606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Getting quotas for project 9dacb0d82cf64aa8a1754545ca7515b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:44.561702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Getting quotas for user 153c655e31c24f7883784a4ad9a820d0 and project 9dacb0d82cf64aa8a1754545ca7515b1. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:44.594402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:29:44.598726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:29:44.609235 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-746e32e3-962a-43c5-974c-2050be3b9b04 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.426425 Aug 27 03:29:44.611909 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2166/4481] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:29:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:44.638076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:44.655660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:44.683680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.687648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.688223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.689078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.690835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.693740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.753062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad5f983d-f31e-471c-b580-d9eb58357040 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.625253 Aug 27 03:29:44.755565 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2316/4482] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:29:44.760732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:44.767002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:44.774634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.775420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.776112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.777061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.777705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.778360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.784464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c4f6bed-41e9-4cbd-9016-edcb931c6cf9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.171019 Aug 27 03:29:44.788495 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2167/4483] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:44 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:44.793080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1a6728b8-bd02-4367-925a-fa9ad035684b req-6f8edb57-f50b-4870-9acd-9093cb24b8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a62a379-69d5-41ac-ad6a-7d481ff57538", "tag": "c89f6834-6ff4-42a0-91fb-7bd99e89753b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:44.813494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a6728b8-bd02-4367-925a-fa9ad035684b req-6f8edb57-f50b-4870-9acd-9093cb24b8fd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.814300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a6728b8-bd02-4367-925a-fa9ad035684b req-6f8edb57-f50b-4870-9acd-9093cb24b8fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.814956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a6728b8-bd02-4367-925a-fa9ad035684b req-6f8edb57-f50b-4870-9acd-9093cb24b8fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.836049 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1a6728b8-bd02-4367-925a-fa9ad035684b req-6f8edb57-f50b-4870-9acd-9093cb24b8fd service nova] Creating event network-changed:c89f6834-6ff4-42a0-91fb-7bd99e89753b for instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 on n-h1-852086-5 Aug 27 03:29:44.842551 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1a6728b8-bd02-4367-925a-fa9ad035684b req-6f8edb57-f50b-4870-9acd-9093cb24b8fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054907 Aug 27 03:29:44.843399 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2168/4484] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:44.849101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:44.850338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:44.858488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.859351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.860008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.860934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:44.861736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:44.862866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:45.164907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.179414 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41769a6d-06d7-412d-a817-412f580ebca9 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.422089 Aug 27 03:29:45.194990 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2317/4485] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:44 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.201674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f83d9e31-2d4d-4821-81cc-42c47252e4c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:45.202765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f83d9e31-2d4d-4821-81cc-42c47252e4c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:45.297544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f83d9e31-2d4d-4821-81cc-42c47252e4c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.316650 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f83d9e31-2d4d-4821-81cc-42c47252e4c9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1245 microversion: 2.1 time: 0.120017 Aug 27 03:29:45.318698 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2318/4486] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:45 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.326843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9bd0ffe-586b-4e51-8dd0-d7488606c4b5 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:45.328713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c9bd0ffe-586b-4e51-8dd0-d7488606c4b5 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:45.467906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9bd0ffe-586b-4e51-8dd0-d7488606c4b5 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.484030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9bd0ffe-586b-4e51-8dd0-d7488606c4b5 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.488248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9bd0ffe-586b-4e51-8dd0-d7488606c4b5 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.490553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9bd0ffe-586b-4e51-8dd0-d7488606c4b5 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1278 microversion: 2.54 time: 0.170653 Aug 27 03:29:45.506063 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2319/4487] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:45 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:45.628649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.638721 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f21e0b16-bdfd-4739-b506-c7925e63c2ab tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1367 microversion: 2.1 time: 0.793839 Aug 27 03:29:45.646117 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2169/4488] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:44 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1367 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.807613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:45.813071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:45.847340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:45.847618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:45.848238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:45.849694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:45.850522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:45.851120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:45.934551 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6a22834-8bef-4305-9d7b-01ed28700191 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.140982 Aug 27 03:29:45.935583 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2320/4489] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:45 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:46.215576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.216193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:46.225102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.225601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.226042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.226812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.227270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.227698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.352685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.355220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:46.389398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.395378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.398007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.399494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.402970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.408954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.531950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.541505 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82f0779f-d8aa-499a-91aa-576a1eb12a37 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1297 microversion: 2.1 time: 0.203419 Aug 27 03:29:46.554266 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2321/4490] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:46 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1297 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:46.557794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.558003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.558527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:46.580565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.581460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.582317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.583725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.585274 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7eeb6dd0-da40-476e-adb8-ef776c2dd252 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.374030 Aug 27 03:29:46.586216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.587130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.588575 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2170/4491] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:46 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:46.668062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.669042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:46.679499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.685582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.686387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.686997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.687477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.687919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.721047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.741934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.744788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:46.745069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.748000 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-be44d6a3-0dd8-460e-bb2c-22408d36685a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1330 microversion: 2.54 time: 0.200745 Aug 27 03:29:46.770195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2322/4492] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:46 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1330 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:46.947251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:46.950657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:46.973005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.974057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.974545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.975290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.976350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.976350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.001686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.011427 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-580edd93-8ae8-4f49-96d5-3f2b948c0f41 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1367 microversion: 2.1 time: 0.347428 Aug 27 03:29:47.025272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2171/4493] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:46 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:47.122773 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7818c06a-cd49-443d-9f3d-6ba64e46c061 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.179658 Aug 27 03:29:47.126981 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2323/4494] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:46 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:47.565482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.566607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:47.574064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.574642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.575312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.576048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.576677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.577298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.621554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.622303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:47.646939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.653298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.654628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.658368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.660496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.669056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.749018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.765330 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3be8c0a0-687f-42fc-a603-9f835326cbb9 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1303 microversion: 2.1 time: 0.204017 Aug 27 03:29:47.765957 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2172/4495] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:47 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:47.782264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.785457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:47.808995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.809885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.810572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.811493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.812138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.812765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.930031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.951853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.953032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.960386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:47.962367 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa2a1cfe-ac9b-402a-9e6d-eec260274b75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1336 microversion: 2.54 time: 0.184877 Aug 27 03:29:47.964714 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2173/4496] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:47 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1336 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:29:47.982939 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f048318-ce7f-4a8c-9e12-64c640e98c1b tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.366812 Aug 27 03:29:47.983729 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2324/4497] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:47 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:48.034484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.035370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:48.049165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.049810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.051287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.052366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.055442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.056180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.135952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:48.138550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:48.158628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.159554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.160151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.161926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.162834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.164270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.813402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.823308 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34fe156c-1a82-45df-9b4e-763db0419d97 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1367 microversion: 2.1 time: 0.792943 Aug 27 03:29:48.840642 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2174/4498] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:48 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1367 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:48.862566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.864463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:48.886229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.888073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.889842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.892922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.894607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.896919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.075539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.091972 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-970925a8-6a26-40d0-9afb-5f0d3dc5805d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1303 microversion: 2.1 time: 0.248113 Aug 27 03:29:49.093522 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2175/4499] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:48 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:49.100604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.107247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:49.132801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.136357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.137080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.140375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.143319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.143831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.206381 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17f5b5ab-44d6-42e5-b713-e529a55799ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 1.074937 Aug 27 03:29:49.213208 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2325/4500] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:48 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:49.228696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.231707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:49.280193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.281144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.287835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.288946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.289607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.290091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.360636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.382516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.383994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.385196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e315df3-18e4-4939-94d4-3e68df7b79cc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1336 microversion: 2.54 time: 0.290437 Aug 27 03:29:49.403635 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2176/4501] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:49 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1336 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:49.752488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.765241 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-901c244d-722e-4b0f-8f50-22de3966587c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.549851 Aug 27 03:29:49.766085 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2326/4502] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:49 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:49.847479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.849339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:49.856634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.857456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.858185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.859164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.859847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.860497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.123256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:50.130753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:50.132488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:50.143665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abcad270-0f56-46a1-bf72-8dea663175a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1367 microversion: 2.1 time: 0.297710 Aug 27 03:29:50.158195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2177/4503] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:49 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:50.158421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.158421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.158421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.158421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.158421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.158421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.166007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:50.225571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:50.230813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:50.257902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.258802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.259644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.261196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.262025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.263063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.600218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:50.624396 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-677bbf04-0478-4668-8b09-9a30aa7e3a66 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.507883 Aug 27 03:29:50.626395 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2327/4504] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:50 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:50.638473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e0bf0895-ccc4-44da-ac35-ec23c66ac63f req-96cb1193-68e9-4808-a691-ab737a9759e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a62a379-69d5-41ac-ad6a-7d481ff57538", "name": "network-vif-plugged", "status": "completed", "tag": "c89f6834-6ff4-42a0-91fb-7bd99e89753b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:50.641714 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c9da7b9c-c63e-4bb1-9e7d-2cc3a8c71d34 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.422663 Aug 27 03:29:50.642733 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2178/4505] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:50 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:50.649681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:50.651024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:50.670346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0bf0895-ccc4-44da-ac35-ec23c66ac63f req-96cb1193-68e9-4808-a691-ab737a9759e0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.672354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0bf0895-ccc4-44da-ac35-ec23c66ac63f req-96cb1193-68e9-4808-a691-ab737a9759e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.673886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0bf0895-ccc4-44da-ac35-ec23c66ac63f req-96cb1193-68e9-4808-a691-ab737a9759e0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.674382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.677421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.688936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.696039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.696870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.697610 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e0bf0895-ccc4-44da-ac35-ec23c66ac63f req-96cb1193-68e9-4808-a691-ab737a9759e0 service nova] Creating event network-vif-plugged:c89f6834-6ff4-42a0-91fb-7bd99e89753b for instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 on n-h1-852086-5 Aug 27 03:29:50.698663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.708375 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e0bf0895-ccc4-44da-ac35-ec23c66ac63f req-96cb1193-68e9-4808-a691-ab737a9759e0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078397 Aug 27 03:29:50.719084 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2328/4506] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:50.725402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-edd80b9c-e55f-46a9-b0f2-532692f19cfb req-835c498d-08f3-4b14-a6e1-a210854bb23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8427f5b-2531-4195-b370-6e0a7564ad16", "tag": "310d8927-f16a-452d-a9f4-b6563414334b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:50.757762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-edd80b9c-e55f-46a9-b0f2-532692f19cfb req-835c498d-08f3-4b14-a6e1-a210854bb23b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.766641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-edd80b9c-e55f-46a9-b0f2-532692f19cfb req-835c498d-08f3-4b14-a6e1-a210854bb23b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.770399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-edd80b9c-e55f-46a9-b0f2-532692f19cfb req-835c498d-08f3-4b14-a6e1-a210854bb23b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.820054 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-edd80b9c-e55f-46a9-b0f2-532692f19cfb req-835c498d-08f3-4b14-a6e1-a210854bb23b service nova] Creating event network-changed:310d8927-f16a-452d-a9f4-b6563414334b for instance d8427f5b-2531-4195-b370-6e0a7564ad16 on n-h2-852086-5 Aug 27 03:29:50.825036 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-edd80b9c-e55f-46a9-b0f2-532692f19cfb req-835c498d-08f3-4b14-a6e1-a210854bb23b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104598 Aug 27 03:29:50.826724 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2329/4507] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:50.834224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:50.834982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:50.843751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.844260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.844699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.845418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.845877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.846353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.984529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.003369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.007409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.009865 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40406880-37ad-4a5f-aafb-552600a30ce1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1336 microversion: 2.54 time: 0.365675 Aug 27 03:29:51.011177 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2179/4508] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:50 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1336 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:51.174600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:51.175509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:51.184758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.188724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:51.189585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:51.190356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:51.191806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:51.193620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:51.194767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:51.204541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-99c1e453-269d-4e53-a893-6eee4d19028c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.376228 Aug 27 03:29:51.205723 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2330/4509] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:50 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:51.607974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.619518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-166d96d6-6830-402f-968a-a8b78ff44765 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1367 microversion: 2.1 time: 0.449832 Aug 27 03:29:51.623946 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2180/4510] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:51 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:51.661750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:51.664796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:51.666573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:51.669380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:51.682829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:51.687238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:51.688090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:51.688717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:51.689554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:51.689941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:51.690563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:51.691230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:51.692782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:51.693436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:51.693909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:51.695935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:51.762421 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41d35425-a28e-48cd-9406-9b27c8df30a9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.108233 Aug 27 03:29:51.765610 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2331/4511] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:51 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:52.035386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:52.037440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:52.059498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.060643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.061254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.064121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.065091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.065752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.068648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.075495 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d6ae8e3-a515-4b40-97bb-5bd90de7d426 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.417314 Aug 27 03:29:52.090182 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2181/4512] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:51 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:52.191565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.212189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.214716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.216463 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c680c837-e1aa-4a5e-89d7-8c64606df5e1 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1357 microversion: 2.54 time: 0.186503 Aug 27 03:29:52.217205 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2332/4513] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:52 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:29:52.243339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c3aa634-4b94-480a-a8fd-dd874ebbc278 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Action: 'create', calling method: .version_select at 0x7fe457c115e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1099709252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB6hC1dYCp8Fq6J+YE9baENNHffFktd188m/zIpH1A5VerfAlHrk+OomUUVg0M+iPVQmGNyfwOSLxSS+YBnfFAITrfljM/6hBn9VqhFC5saj5JYCTNfJzRJJsQEL1q84g=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:52.244448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:52.247109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:52.272763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9c3aa634-4b94-480a-a8fd-dd874ebbc278 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Getting quotas for project 9dacb0d82cf64aa8a1754545ca7515b1. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:52.280914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9c3aa634-4b94-480a-a8fd-dd874ebbc278 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Getting quotas for user 153c655e31c24f7883784a4ad9a820d0 and project 9dacb0d82cf64aa8a1754545ca7515b1. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:52.283474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.285338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.287320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.289865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.293629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.294092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.330569 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c3aa634-4b94-480a-a8fd-dd874ebbc278 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.091667 Aug 27 03:29:52.338217 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2333/4514] 10.222.0.69 () {62 vars in 1200 bytes} [Sat Aug 27 03:29:52 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 03:29:52.345872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1099709252", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:52.353778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:52.368425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.371794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.372392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.373456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.374140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.377494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.531830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:52.533031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:52.533884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:52.534603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:52.535315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:52.586122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.601374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-017bea5d-8a1f-4d6a-b0f6-7bad2bffd574 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.364895 Aug 27 03:29:52.602850 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2182/4515] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:52 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:52.657241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:52.658342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:52.671263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.672547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.674091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.675562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.677505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.678694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.717082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:52.736857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.740094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.740566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.741520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.742011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.742472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.812505 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-57ef71e0-8d13-4f73-8e8b-d98834404fc6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "POST /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d/action" status: 202 len: 1140 microversion: 2.54 time: 0.472490 Aug 27 03:29:52.813140 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2334/4516] 10.222.0.69 () {62 vars in 1320 bytes} [Sat Aug 27 03:29:52 2022] POST /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d/action => generated 1140 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 03:29:52.827489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:52.832385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:52.857498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.858304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.859300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.860389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.861018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.861619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.008195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.017359 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb494d92-4492-4940-a3eb-7b612bbefae1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1557 microversion: 2.1 time: 0.364925 Aug 27 03:29:53.026388 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2183/4517] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:52 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1557 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:53.036343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.038379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:53.046062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.047637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.048125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.049004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.049469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.049901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.125156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.134730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.136375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.138078 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63bcdea7-61c5-4802-b204-53fabbdb874c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.118332 Aug 27 03:29:53.138779 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2184/4518] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:53 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:53.146520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.147378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:53.155374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.156187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.156899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.158147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.158890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.159545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.285239 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a827991-7aa8-4bfb-a176-29a2313b2687 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144443 Aug 27 03:29:53.287343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2185/4519] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:29:53 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:53.292661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.293289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:53.301227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.302853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.303376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.304117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.304587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.305288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.597697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.661973 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e60d8e7f-c6a9-464c-a2a8-116b645da386 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.836507 Aug 27 03:29:53.681635 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2335/4520] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:52 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:53.684110 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-225edd8d-d22b-4b27-8095-30310d26a7a8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.394658 Aug 27 03:29:53.704861 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2186/4521] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:53 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:53.728076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.729333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:53.788265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.791827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.793455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.796248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.797525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.798390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.174730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:54.175728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:54.207118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.211659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.215422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.224112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.225715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.226467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.430114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.460425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.464879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.467149 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44c36c3e-f3df-4d57-b243-bbfa9955f790 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.298165 Aug 27 03:29:54.468159 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2187/4522] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:54 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:54.517071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:54.656299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.677442 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7806fc33-54b9-4a43-a56c-1706d2aabc76 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.992926 Aug 27 03:29:54.679035 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2336/4523] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:53 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:54.700154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:54.710595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:54.729345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:54.730867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:54.734522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.735638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.737375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.739360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.740818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.741442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:54.742454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:54.744131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.757414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.758473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.759669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.762748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.763838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.780329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.866359 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a319faa-f198-4c5c-94b7-0f4aa09a297e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.189023 Aug 27 03:29:54.868628 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2188/4524] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:54 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:55.363581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:55.389344 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2bd51f51-6b66-4da8-b06c-d5665f264c21 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.662910 Aug 27 03:29:55.390559 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2337/4525] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:54 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:55.499738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:55.500908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:55.541886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.543326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.544255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.545563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.546595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.548522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.560621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:55.716397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:55.716826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:55.717142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:55.729904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:55.733004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.733516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.733966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.735119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.735590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.736022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.759703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:55.761258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:55.762718 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c86f903-f5f8-4e59-aa07-4ef0d96bf2e7 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.272819 Aug 27 03:29:55.763858 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2189/4526] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:55 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:55.885513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:55.892061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:55.910053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.914328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.915039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.915806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.916280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.916712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.033050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5e5a07d-b7bf-4b7a-8ca1-c0d92160610b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.152894 Aug 27 03:29:56.035230 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2190/4527] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:55 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:56.057711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.080307 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9ff9a64f-8f6d-472a-a24f-80f76d6ac6fa tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.366814 Aug 27 03:29:56.083161 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2338/4528] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:55 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:56.424928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:56.425708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:56.436174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.440926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.441533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.443126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.443715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.444251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.450792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3773f07a-e7ff-47f9-925b-d7b5cfb2b610 req-fd3f2ec9-bf97-4ac8-8447-ab575e542588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a62a379-69d5-41ac-ad6a-7d481ff57538", "tag": "c89f6834-6ff4-42a0-91fb-7bd99e89753b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:56.471418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3773f07a-e7ff-47f9-925b-d7b5cfb2b610 req-fd3f2ec9-bf97-4ac8-8447-ab575e542588 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.472649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3773f07a-e7ff-47f9-925b-d7b5cfb2b610 req-fd3f2ec9-bf97-4ac8-8447-ab575e542588 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.473804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3773f07a-e7ff-47f9-925b-d7b5cfb2b610 req-fd3f2ec9-bf97-4ac8-8447-ab575e542588 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.497587 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3773f07a-e7ff-47f9-925b-d7b5cfb2b610 req-fd3f2ec9-bf97-4ac8-8447-ab575e542588 service nova] Creating event network-changed:c89f6834-6ff4-42a0-91fb-7bd99e89753b for instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 on n-h1-852086-5 Aug 27 03:29:56.507102 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3773f07a-e7ff-47f9-925b-d7b5cfb2b610 req-fd3f2ec9-bf97-4ac8-8447-ab575e542588 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180450 Aug 27 03:29:56.510103 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2191/4529] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:56.731558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:56.746415 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51212e41-d359-408e-87f0-d9c718419b00 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.325436 Aug 27 03:29:56.747556 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2339/4530] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:56 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:56.808390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:56.810226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:56.822741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.824003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.824884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.825809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.826524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.827125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.012028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.027601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.030181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.049082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:57.052597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:57.060010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecd6a506-583b-473d-bbc2-f6d0f2dbd8aa tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.252247 Aug 27 03:29:57.072986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.074136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.074777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.076651 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2192/4531] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:56 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:57.077837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.079043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.079684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.109376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.110490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:57.129364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.130227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.130661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.131590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.132225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.132822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.144595 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dddc88dd-f136-42e9-bf2a-ba0cdfb54dd3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.099471 Aug 27 03:29:57.152145 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2340/4532] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:57 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:57.787821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.788609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:57.810940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.811952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.812967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.814211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.814699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.815139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.836479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.854291 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dadc6259-ad66-4510-99a4-c6c5cb693dbe tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.749680 Aug 27 03:29:57.857254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2193/4533] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:57 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:57.913863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0a5bb069-ca36-44ba-8e70-0adb1f6231e2 req-daa4705a-ce73-4ab6-b0bb-c0e62a155d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8427f5b-2531-4195-b370-6e0a7564ad16", "name": "network-vif-plugged", "status": "completed", "tag": "310d8927-f16a-452d-a9f4-b6563414334b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:57.932883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0a5bb069-ca36-44ba-8e70-0adb1f6231e2 req-daa4705a-ce73-4ab6-b0bb-c0e62a155d7b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.933546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0a5bb069-ca36-44ba-8e70-0adb1f6231e2 req-daa4705a-ce73-4ab6-b0bb-c0e62a155d7b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.934298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0a5bb069-ca36-44ba-8e70-0adb1f6231e2 req-daa4705a-ce73-4ab6-b0bb-c0e62a155d7b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.958628 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0a5bb069-ca36-44ba-8e70-0adb1f6231e2 req-daa4705a-ce73-4ab6-b0bb-c0e62a155d7b service nova] Creating event network-vif-plugged:310d8927-f16a-452d-a9f4-b6563414334b for instance d8427f5b-2531-4195-b370-6e0a7564ad16 on n-h2-852086-5 Aug 27 03:29:57.981315 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0a5bb069-ca36-44ba-8e70-0adb1f6231e2 req-daa4705a-ce73-4ab6-b0bb-c0e62a155d7b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072060 Aug 27 03:29:57.992654 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2194/4534] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:58.108082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.108924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:58.134680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.135780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.136664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.139104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.140100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.140829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.177114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.187163 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34325508-e4d0-4240-b752-91b041ddea93 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.412360 Aug 27 03:29:58.188473 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2341/4535] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:57 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:58.334455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.349963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.353030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.355237 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19fa3f24-332d-420e-b2c9-f12560672ed3 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.254210 Aug 27 03:29:58.366259 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2195/4536] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:58 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:58.381278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:58.385828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:58.399766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.400848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.401743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.403468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.404518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.405354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.417293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.417814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:58.429444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.429949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.430445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.431174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.431718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.432158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.466826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:29:58.493980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4c29051-6fae-4b48-860f-c14ae1eec997 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 14 microversion: 2.1 time: 0.125191 Aug 27 03:29:58.498561 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2196/4537] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:58 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:29:58.572541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0836591-ffcd-47d6-ab9e-e2aa564d1e2f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 204 len: 0 microversion: 2.32 time: 0.381924 Aug 27 03:29:58.573725 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2342/4538] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:29:58 2022] DELETE /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:29:58.593051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.595941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:58.609204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.609810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.610307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.611366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.612714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.614068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.901557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.902556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:58.911104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.912079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.912714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.913600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.915611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.917181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.971273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:59.154722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.159597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.168853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.178789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.178789 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20cc49c7-be6b-4bff-a57d-71fb3f747f8e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2957 microversion: 2.32 time: 0.591351 Aug 27 03:29:59.178789 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2197/4539] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:58 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2957 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:29:59.184024 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45f0f240-bee6-4c2e-908d-6ad743bf95a2 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.292433 Aug 27 03:29:59.186307 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2343/4540] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:58 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:59.234824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:59.242828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:59.256921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.257534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.258278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.259360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.259968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.260687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.384571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:59.385533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:59.405548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.406862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.409020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.411761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.413894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.415198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.550324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.564807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.566618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.567962 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-269760a0-60d5-42bf-ac55-a32adf62146a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.189199 Aug 27 03:29:59.578607 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2344/4541] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:29:59 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:29:59.578607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:59.578607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:59.585459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.585969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.586448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.587183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.587645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.588074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.611821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.623637 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4626b62e-78f5-46ee-8237-b429488406fe tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.404972 Aug 27 03:29:59.625028 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2198/4542] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:59 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:00.221060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:00.224686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:00.236931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:00.240312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:00.241468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:00.242383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:00.243753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:00.245655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:00.247542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:00.625374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:00.641514 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5616a0b4-fa87-4128-863f-1c8613dc661e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.429770 Aug 27 03:30:00.643520 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2199/4543] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:00 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:00.651614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:00.654143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:00.663301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:00.664406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:00.664992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:00.665924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:00.666725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:00.667340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.114735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.129226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.133117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.136282 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42ca79b6-83b4-4789-92e7-b058a6d5e4a3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2957 microversion: 2.32 time: 0.491226 Aug 27 03:30:01.137996 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2200/4544] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:00 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2957 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:01.169244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:01.171920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:01.184973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:01.185828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:01.186989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.188370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:01.189159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:01.190010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.332099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.350247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.352383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.353612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b6ffc94-f06e-46fa-ad90-e0d0fa47dcf8 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.214844 Aug 27 03:30:01.354709 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2201/4545] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:01 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:01.364992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:01.365851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:01.375091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:01.375843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:01.376435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.377337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:01.379227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:01.380766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.696697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.710868 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5a0058a-495c-490b-b666-6e5d94c57e4b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.353747 Aug 27 03:30:01.722254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2202/4546] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:01 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:01.722254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:01.722254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:01.730741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:01.730741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:01.730741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.730741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:01.731202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:01.731202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.941594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.951859 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d01fbeeb-3f1a-4f41-9df6-30cd6afa9200 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.238886 Aug 27 03:30:01.953425 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2203/4547] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:01 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:02.177949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:02.178992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:02.186377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:02.187284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:02.189049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:02.189049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:02.189526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:02.189708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:02.290389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=32 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:02.564929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-22f95951-b49d-4aa6-9c6c-b8c9911e1ffe tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action" status: 200 len: 8199 microversion: 2.1 time: 2.993719 Aug 27 03:30:02.568611 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2345/4548] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:59 2022] POST /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51/action => generated 8199 bytes in 2999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:02.583659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:02.586735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:02.631009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:02.639242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:02.640044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:02.642547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:02.659926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:02.661182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:02.923543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.973832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.981381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.987803 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae82092d-1cd0-490d-87fc-9b7c62c492f7 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2957 microversion: 2.32 time: 0.809738 Aug 27 03:30:03.002797 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2204/4549] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:02 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2957 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:03.020511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.027265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:03.032223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:03.038335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.044470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.047639 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d2691fe2-1c0f-474a-95ed-827646d465c6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.475924 Aug 27 03:30:03.049201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2346/4550] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:02 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:03.058502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:03.059838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:03.076225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.077366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.078702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.080279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.080937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.081521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.081702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.082127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.083470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.087451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.088341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.088947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.513518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.532902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-966fd71d-3cb9-42e6-a727-1c75b03898ed tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1371 microversion: 2.1 time: 0.482365 Aug 27 03:30:03.549427 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2347/4551] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:03 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:03.555316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:03.555931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:03.564738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.565235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.565668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.566402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.567731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.569386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.733766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.761957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b146dc94-e2ee-4b37-ac15-632e800e3972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.753941 Aug 27 03:30:03.779768 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2205/4552] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:03 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:03.811679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:03.812857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:03.823781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.824795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.825773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.826869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.827781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.828841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.829570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.837667 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed4ea0b7-ac61-40e5-a05a-3429b45ef979 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.286730 Aug 27 03:30:03.838485 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2348/4553] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:03 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:04.027032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.030118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:04.056339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.057496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.058706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.060670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.061710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.062885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.383099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.401247 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f6acb0c-c201-42ed-805a-4d3c6166bb2d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.596941 Aug 27 03:30:04.402310 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2206/4554] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:03 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:04.421014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.427728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:04.448086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.448942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.450479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.450479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.450757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.451223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.498199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.509796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.511557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.513472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6c09b36-103d-4918-a50b-7c63cf28a0c5 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2957 microversion: 2.32 time: 0.495924 Aug 27 03:30:04.514908 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2349/4555] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:04 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2957 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:04.520952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.521953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:04.530260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.531087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.532125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.533783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.534889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.536815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.607803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.613598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:04.625014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.627837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.629139 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a679d6e5-6d25-4be2-babb-2e970d916c76 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.225523 Aug 27 03:30:04.631159 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2207/4556] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:04 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:04.648362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.649265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:04.665156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.666136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.666828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.668007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.668825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.669511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.802425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.818766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-604b1d9a-e6ba-4a96-93c4-4b91cc6919af tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.301381 Aug 27 03:30:04.820416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2350/4557] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:04 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:04.856314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.858402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:04.870290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.871752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.872853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.874214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.875438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.876536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.159402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.166941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.170535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5be24a15-29e2-484f-b450-b550962b8ba6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.322590 Aug 27 03:30:05.171558 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2351/4558] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:04 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:05.177567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.178415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:05.180998 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e2760f1-ba79-4db4-93d1-26b73d308968 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1564 microversion: 2.1 time: 0.548571 Aug 27 03:30:05.182032 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2208/4559] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:04 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1564 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:05.200622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.201121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.201560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.202900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.203537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.204128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.212596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:05.215206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:05.230049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.231205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.235418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.237452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.239489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.241019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.341990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Locking {{(pid=122408) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 27 03:30:05.453417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.458099 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f40b3035-7542-4a1d-8145-ac1fe9c03d24 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.254955 Aug 27 03:30:05.461762 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2209/4560] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:05 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:05.472196 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6302cdae-1039-46dd-93de-e821c8135b46 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1511 microversion: 2.1 time: 0.298808 Aug 27 03:30:05.475328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.478882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:05.487575 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2352/4561] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:05 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:05.498570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.499346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.499988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.500700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.501315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.501901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.524474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.531547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:05.563382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.564246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.568836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.570549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.571773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.575050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.727417 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8981819-edcf-4afc-b65c-f20070876b55 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.264014 Aug 27 03:30:05.737901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2210/4562] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:30:05 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:05.750482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.751380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:05.761227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.761950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.762443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.763162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.763614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.764041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.967721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.980643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b30f9d6-c914-469b-befb-71ff6341df40 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.490498 Aug 27 03:30:05.982300 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2353/4563] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:05 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:05.989287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.990486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:06.014115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.016291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.017013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.019008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.019755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.020321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.169232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.199299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.202719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.204999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-73fe28ad-e709-4304-80c0-e0f49b5c7872 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.220140 Aug 27 03:30:06.205837 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2354/4564] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:05 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:06.248288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:06.255439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.256737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.257434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.312287 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] HTTP exception thrown: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec is locked Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Request method failure captured: Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action HTTP/1.1 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 15 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6PyU9G282NEdwSwHsiROIz1Eu_XdsqX3gr0HhwBWpaVMzo466A22nQxIVm50JlaNZzes4ofckv_xopoFJrGs3_EIks4LyAEi7CyHYtIbyI8n8LwBG44Uyy1pgMqyhAoHyAskI44CnCaGYD1OQ3yW99l2rNGNLuz0cPhfen0pBuFP4 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a0cf74946f704a99a6878baa30bbac4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}] Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-422182183 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89f850adf9a7432798f86fe9d2d17b79 Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: {"os-stop": {}} Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec is locked Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd79642ca-ff1b-4d0b-b6d7-574372aa25ec', 'body': {'os-stop': {}}} Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec is locked Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec is locked Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec is locked Aug 27 03:30:06.316002 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:06.321736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Returning 409 to user: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec is locked {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:06.321736 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e8aa83b-370d-4341-850d-c3df49171cd4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 409 len: 107 microversion: 2.1 time: 0.088176 Aug 27 03:30:06.321736 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2355/4565] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:06 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 107 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:30:06.334533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:06.335428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:06.344922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.345953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.346993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.349872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.351416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.352672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.428626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Unlocking {{(pid=122407) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 03:30:06.574293 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b4cf3ed-ec7a-47ae-853d-17c0118140b0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.249261 Aug 27 03:30:06.575654 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2356/4566] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:06 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:06.582500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:06.587717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:06.602092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.603249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.604171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.605598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.606495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.607736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.806744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.836539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.838295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.841047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9f0293d-5378-45bc-9b50-cdbbd70cfb1c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2957 microversion: 2.32 time: 1.111012 Aug 27 03:30:06.841535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:06.844494 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2211/4567] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:05 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2957 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:06.861090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-259aae09-acd0-4d35-817f-b0bddededaf1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:06.873414 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21ef2839-8a0e-498f-8173-e52d672e3261 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1488 microversion: 2.1 time: 0.295288 Aug 27 03:30:06.873885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259aae09-acd0-4d35-817f-b0bddededaf1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.874564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259aae09-acd0-4d35-817f-b0bddededaf1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.876013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259aae09-acd0-4d35-817f-b0bddededaf1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.887209 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2357/4568] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:06 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1488 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:06.918211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-535585521"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:06.920834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:06.928847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.929402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.929762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.930555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.930993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.931421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.934861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:07.038004 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58fc0f05-0c71-47d9-8a63-efb7cdaeb718 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "PUT /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1061 microversion: 2.1 time: 0.128238 Aug 27 03:30:07.054679 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2358/4569] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:30:06 2022] PUT /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1061 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:07.057084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-259aae09-acd0-4d35-817f-b0bddededaf1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:30:07.062083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.063261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:07.073667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.074547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.075230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.076252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.076981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.077643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.181196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-259aae09-acd0-4d35-817f-b0bddededaf1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.334280 Aug 27 03:30:07.183004 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2212/4570] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:06 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:07.239827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.241512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:07.282661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.287698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.288543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.293483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.296882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.304383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.315077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.345006 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-93eff560-02de-4105-9ea3-bc13a1f38091 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1488 microversion: 2.1 time: 0.287860 Aug 27 03:30:07.364108 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2359/4571] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:07 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1488 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:07.408868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.412418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:07.423688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.424451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.425313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.427863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.429178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.430887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.596099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.610931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.615002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.618098 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ae2631c-fa39-4350-a88c-29005511eb1c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.252090 Aug 27 03:30:07.625314 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2360/4572] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:07 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:07.652272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.653457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:07.670045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.671459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.672631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.674143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.674928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.675598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.862673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.873394 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd72a5a4-4504-4911-9884-8b9056b76b08 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.683130 Aug 27 03:30:07.874004 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2213/4573] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:07 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:07.894550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:07.895599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:07.902092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.903344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.904432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.905689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:07.906614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:07.907405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.011504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:08.043931 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-087404d8-579d-4155-86ee-643ff1c73564 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1488 microversion: 2.1 time: 0.413840 Aug 27 03:30:08.062668 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2361/4574] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:07 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1488 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:08.080403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.080812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:08.088926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.089571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.090019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.090844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.091539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.091978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.151326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:30:08.327868 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e112381f-4c55-4d5b-ba92-66f0d4f38767 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 204 len: 0 microversion: 2.1 time: 0.251741 Aug 27 03:30:08.331887 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2362/4575] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:08 2022] DELETE /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:30:08.338385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-06805284-98b5-4ea0-a83b-5a4950d6436e req-455e87af-67d0-4aca-9f52-9df4a02be39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-unplugged", "status": "completed", "tag": "74829acf-8c1f-4b9d-9058-e4429ee36c60"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:08.353371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06805284-98b5-4ea0-a83b-5a4950d6436e req-455e87af-67d0-4aca-9f52-9df4a02be39e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.354047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06805284-98b5-4ea0-a83b-5a4950d6436e req-455e87af-67d0-4aca-9f52-9df4a02be39e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.354529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06805284-98b5-4ea0-a83b-5a4950d6436e req-455e87af-67d0-4aca-9f52-9df4a02be39e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.380729 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-06805284-98b5-4ea0-a83b-5a4950d6436e req-455e87af-67d0-4aca-9f52-9df4a02be39e service nova] Creating event network-vif-unplugged:74829acf-8c1f-4b9d-9058-e4429ee36c60 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:08.395086 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-06805284-98b5-4ea0-a83b-5a4950d6436e req-455e87af-67d0-4aca-9f52-9df4a02be39e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060649 Aug 27 03:30:08.397386 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2363/4576] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:08.433350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.437580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:08.475295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.475295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.475295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.475620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.476237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.476912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.864537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:08.876727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a61aab0-da39-449f-9ab6-3250110ee82e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1494 microversion: 2.1 time: 0.478250 Aug 27 03:30:08.878892 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2364/4577] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:08 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1494 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:08.905223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.905852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:08.936792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.937800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.938225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.939309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.943716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.944294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.981998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.008402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.010562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.013076 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65b23bd0-d70b-4649-8716-b72585d447f2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2936 microversion: 2.32 time: 1.137769 Aug 27 03:30:09.023297 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2214/4578] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:07 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2936 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:09.060742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:09.070451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:09.107853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.111126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.111780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:09.112934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.127552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.128771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:09.210352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.240014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.251917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.257839 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c051ea56-0b9c-4dad-8a23-ee03f9bb5859 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.372313 Aug 27 03:30:09.259976 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2365/4579] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:08 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:09.909830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.914658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:09.920929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:09.942563 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8732d668-241a-4cf8-b960-2ee3730e92cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.913020 Aug 27 03:30:09.943576 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2215/4580] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:09 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:09.953175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.954092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.954910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:09.969668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.970905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.978444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.055441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:10.056720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:10.078086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.078779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.079261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.080005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.080649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.081117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.533394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.558217 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-be9102c0-4065-4b51-8d37-35e97967bb48 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1494 microversion: 2.1 time: 0.654965 Aug 27 03:30:10.562680 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2366/4581] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:09 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1494 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:10.583470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cf0deda4-b886-4f77-94af-e944700b936e req-1bc01d17-55c3-42f4-b04f-1cdcfc15c131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8427f5b-2531-4195-b370-6e0a7564ad16", "tag": "310d8927-f16a-452d-a9f4-b6563414334b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:10.609203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cf0deda4-b886-4f77-94af-e944700b936e req-1bc01d17-55c3-42f4-b04f-1cdcfc15c131 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.610068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cf0deda4-b886-4f77-94af-e944700b936e req-1bc01d17-55c3-42f4-b04f-1cdcfc15c131 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.611101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cf0deda4-b886-4f77-94af-e944700b936e req-1bc01d17-55c3-42f4-b04f-1cdcfc15c131 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.643115 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cf0deda4-b886-4f77-94af-e944700b936e req-1bc01d17-55c3-42f4-b04f-1cdcfc15c131 service nova] Creating event network-changed:310d8927-f16a-452d-a9f4-b6563414334b for instance d8427f5b-2531-4195-b370-6e0a7564ad16 on n-h2-852086-5 Aug 27 03:30:10.656919 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cf0deda4-b886-4f77-94af-e944700b936e req-1bc01d17-55c3-42f4-b04f-1cdcfc15c131 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090169 Aug 27 03:30:10.656919 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2367/4582] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:10.669182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:10.670513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:10.685377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.686280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.687427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.690016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.691109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.692662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.005714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.026947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.031144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.033869 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d103c4e-ee32-416c-8b31-824004af5c5c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2915 microversion: 2.32 time: 0.984573 Aug 27 03:30:11.043706 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2216/4583] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:10 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2915 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:11.085454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6121be0a-7080-4df4-9620-5d89c247be86 req-993deace-f452-4881-a880-65ded06dade3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-unplugged", "status": "completed", "tag": "7c4f392d-0ced-41e9-b62c-450fb4af76a2"}, {"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-unplugged", "status": "completed", "tag": "5a0b4c7a-a135-4d68-b8d3-a8cd69119f06"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:11.109256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6121be0a-7080-4df4-9620-5d89c247be86 req-993deace-f452-4881-a880-65ded06dade3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.124238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6121be0a-7080-4df4-9620-5d89c247be86 req-993deace-f452-4881-a880-65ded06dade3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.125465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6121be0a-7080-4df4-9620-5d89c247be86 req-993deace-f452-4881-a880-65ded06dade3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.221648 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6121be0a-7080-4df4-9620-5d89c247be86 req-993deace-f452-4881-a880-65ded06dade3 service nova] Creating event network-vif-unplugged:7c4f392d-0ced-41e9-b62c-450fb4af76a2 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:11.227250 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6121be0a-7080-4df4-9620-5d89c247be86 req-993deace-f452-4881-a880-65ded06dade3 service nova] Creating event network-vif-unplugged:5a0b4c7a-a135-4d68-b8d3-a8cd69119f06 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:11.255341 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6121be0a-7080-4df4-9620-5d89c247be86 req-993deace-f452-4881-a880-65ded06dade3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.209461 Aug 27 03:30:11.260888 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2217/4584] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:11.279310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.282500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:11.313125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.313885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.314672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.315936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.325277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.326139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.364162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.399919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.402829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.413757 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-578292c1-6415-496a-8740-8d64555d23d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.755173 Aug 27 03:30:11.419883 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2368/4585] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:10 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:11.601834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.605110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:11.637442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.638195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.646088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.649527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.650199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.650829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:12.203547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:12.213628 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1edd52c7-8ea4-4af7-93b0-a5ddf6c83fb7 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.950001 Aug 27 03:30:12.219483 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2218/4586] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:11 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:12.225244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:12.225863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:12.263756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:12.264591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:12.272225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:12.280117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:12.281818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:12.282801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:12.905805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:12.922042 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-07b2c61c-e892-4d5e-9012-f366f03b33f7 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1494 microversion: 2.1 time: 1.328308 Aug 27 03:30:12.933906 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2369/4587] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:11 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1494 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:12.939171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:12.939793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:12.966460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:12.966460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:12.966460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:12.966460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:12.966460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:12.966460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:13.102993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.119401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.128223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.129634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e8a2201-7e62-401a-b57f-3493cdf630fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2915 microversion: 2.32 time: 0.909068 Aug 27 03:30:13.140992 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2219/4588] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:12 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2915 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:13.247910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:13.248974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:13.275874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:13.277217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:13.278329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:13.279568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:13.280582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:13.281577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:13.809711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.957259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.967194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:13.972390 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-167d5770-0bf2-4bef-ac35-428e16296c6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 1.036818 Aug 27 03:30:13.975087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2370/4589] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:12 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:14.014926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c839fccf-bd4f-475d-8556-b562bd615149 req-0e685fda-c1b8-4eba-b954-1f50440353d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-unplugged", "status": "completed", "tag": "ae27ab8a-5ee1-4b13-ba45-faab9b193597"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:14.067883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c839fccf-bd4f-475d-8556-b562bd615149 req-0e685fda-c1b8-4eba-b954-1f50440353d2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:14.079896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c839fccf-bd4f-475d-8556-b562bd615149 req-0e685fda-c1b8-4eba-b954-1f50440353d2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:14.080670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c839fccf-bd4f-475d-8556-b562bd615149 req-0e685fda-c1b8-4eba-b954-1f50440353d2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:14.134542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c839fccf-bd4f-475d-8556-b562bd615149 req-0e685fda-c1b8-4eba-b954-1f50440353d2 service nova] Creating event network-vif-unplugged:ae27ab8a-5ee1-4b13-ba45-faab9b193597 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:14.147474 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c839fccf-bd4f-475d-8556-b562bd615149 req-0e685fda-c1b8-4eba-b954-1f50440353d2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167916 Aug 27 03:30:14.148048 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2371/4590] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:14.163530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5c1b94cc-1f13-4ad6-ba2b-a9e12d243159 req-3a871b0c-2d9b-400c-9940-827e748457c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d37617-dff4-44f7-9a57-b0a9f37d9b55", "name": "network-vif-deleted", "tag": "cb709c54-fe08-476d-9c96-181093d5394b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:14.205737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5c1b94cc-1f13-4ad6-ba2b-a9e12d243159 req-3a871b0c-2d9b-400c-9940-827e748457c1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:14.210764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5c1b94cc-1f13-4ad6-ba2b-a9e12d243159 req-3a871b0c-2d9b-400c-9940-827e748457c1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:14.213043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5c1b94cc-1f13-4ad6-ba2b-a9e12d243159 req-3a871b0c-2d9b-400c-9940-827e748457c1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:14.283556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5c1b94cc-1f13-4ad6-ba2b-a9e12d243159 req-3a871b0c-2d9b-400c-9940-827e748457c1 service nova] Creating event network-vif-deleted:cb709c54-fe08-476d-9c96-181093d5394b for instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 on n-h1-852086-5 Aug 27 03:30:14.291925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5c1b94cc-1f13-4ad6-ba2b-a9e12d243159 req-3a871b0c-2d9b-400c-9940-827e748457c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133334 Aug 27 03:30:14.292904 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2372/4591] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:14.300443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:14.302835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:14.319738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:14.323026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:14.324554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:14.326258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:14.327914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:14.329392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:14.393709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:14.394716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:14.395745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:14.396472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lazy-loading 'fault' on Instance uuid a7d37617-dff4-44f7-9a57-b0a9f37d9b55 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:30:14.536210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.560457 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fcc2d8f-c74b-41c1-a99c-a8368253fb7a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 200 len: 1309 microversion: 2.1 time: 0.265973 Aug 27 03:30:14.565074 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2373/4592] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:14 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:14.596145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:14.598996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:14.619550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:14.620768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:14.623043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:14.627886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:14.631667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:14.635240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.236146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.323349 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebbf1f61-0a90-4e74-ba83-e8f0adcb4199 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 2.082021 Aug 27 03:30:15.328679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2220/4593] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:13 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:15.377444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.384314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:15.394721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.402052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:15.417383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.430796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.435415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.437776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.437984 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5406282c-4db1-4059-9655-3e112cf28b7d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2868 microversion: 2.32 time: 0.865953 Aug 27 03:30:15.439764 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2374/4594] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:14 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2868 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:15.449703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.456391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.457228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.459067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.607963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.611857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:15.637662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.641407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.642906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.644229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.651035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.652392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.712816 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 HTTP/1.1 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'a7d37617-dff4-44f7-9a57-b0a9f37d9b55'} Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:15.727966 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.740423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:15.740423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:15.740423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:15.740423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:15.740423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:15.740423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.740423 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.743680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:15.751494 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d2ea456-0b2f-48c8-aec8-cfa2c0b73a95 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 404 len: 111 microversion: 2.1 time: 0.154228 Aug 27 03:30:15.752890 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2375/4595] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:15 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:15.786315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.787517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:15.799094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.800978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.802131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.803238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.804760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.806044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.807114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.826581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:15.851845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.854083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.857097 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff49a857-c910-4797-a929-8b6aaf0d358d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.521624 Aug 27 03:30:15.871516 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2221/4596] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:15 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:15.882663 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 HTTP/1.1 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'a7d37617-dff4-44f7-9a57-b0a9f37d9b55'} Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:15.886104 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:15.892332 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b39f234a-37eb-47b2-a1c0-95933ad313bc tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 404 len: 111 microversion: 2.1 time: 0.118704 Aug 27 03:30:15.893734 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2376/4597] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:15 2022] DELETE /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:15.916784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.917776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: a7d37617-dff4-44f7-9a57-b0a9f37d9b55] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:15.945879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.946421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.947169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.948386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.949062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.949825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.999414 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 HTTP/1.1 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'a7d37617-dff4-44f7-9a57-b0a9f37d9b55'} Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.020154 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.029243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.029243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.029243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.029243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:16.029243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:16.029243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. Aug 27 03:30:16.029243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.035067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance a7d37617-dff4-44f7-9a57-b0a9f37d9b55 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:16.035067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7afcef4e-6a07-4d02-8adf-dd492629bd19 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55" status: 404 len: 111 microversion: 2.1 time: 0.131931 Aug 27 03:30:16.037017 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2222/4598] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:15 2022] GET /compute/v2.1/servers/a7d37617-dff4-44f7-9a57-b0a9f37d9b55 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:16.052605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.053684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.067367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.068616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.069535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.071089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.072205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.072911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.100873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc HTTP/1.1 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '50e527ec-0282-46ce-8edf-43ea349b10dc'} Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:16.104290 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.110809 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.114998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:16.116919 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-661a36af-74b4-4874-a11f-6ad889b676ce tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 404 len: 111 microversion: 2.1 time: 0.075102 Aug 27 03:30:16.118276 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2377/4599] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:16 2022] DELETE /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:16.129503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.131255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 50e527ec-0282-46ce-8edf-43ea349b10dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.146955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.148205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.148891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.150147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.150947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.152065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.196642 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc HTTP/1.1 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '50e527ec-0282-46ce-8edf-43ea349b10dc'} Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.198504 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.202488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.202488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.202488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.202488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:16.202488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:16.202488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. Aug 27 03:30:16.202488 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.208395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 50e527ec-0282-46ce-8edf-43ea349b10dc could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:16.209604 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b439ce62-204e-493d-88e8-dbd545d5d85e tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc" status: 404 len: 111 microversion: 2.1 time: 0.085607 Aug 27 03:30:16.213940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2223/4600] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:16 2022] GET /compute/v2.1/servers/50e527ec-0282-46ce-8edf-43ea349b10dc => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:16.219953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.220459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.231037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.235618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.236164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.243941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.245080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.249085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.281121 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c HTTP/1.1 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'b3aaaa43-32ea-4b23-a28a-9bd35a335b5c'} Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:16.286657 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.290526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:16.291178 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-88bb0c25-65e0-4892-99fc-df677e22088c tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 404 len: 111 microversion: 2.1 time: 0.075081 Aug 27 03:30:16.294814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2378/4601] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:16 2022] DELETE /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:30:16.303659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.304298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: b3aaaa43-32ea-4b23-a28a-9bd35a335b5c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.318563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.319227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.319817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.320457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.320937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.321379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.336910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-95224d9e-2bc9-4dfd-98b1-b2dd547fe1d1 req-d229cd60-b5bd-4cb3-b0cd-0f16ab7fbfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-unplugged", "status": "completed", "tag": "d78d7323-5afa-431c-9cd9-c6983436a16d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:16.371646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-95224d9e-2bc9-4dfd-98b1-b2dd547fe1d1 req-d229cd60-b5bd-4cb3-b0cd-0f16ab7fbfde service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.372295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-95224d9e-2bc9-4dfd-98b1-b2dd547fe1d1 req-d229cd60-b5bd-4cb3-b0cd-0f16ab7fbfde service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.373648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-95224d9e-2bc9-4dfd-98b1-b2dd547fe1d1 req-d229cd60-b5bd-4cb3-b0cd-0f16ab7fbfde service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.377895 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c HTTP/1.1 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'b3aaaa43-32ea-4b23-a28a-9bd35a335b5c'} Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.386885 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance b3aaaa43-32ea-4b23-a28a-9bd35a335b5c could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:16.393759 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06473c66-7e73-4cb3-9d8c-ffa1ed6c8189 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c" status: 404 len: 111 microversion: 2.1 time: 0.092068 Aug 27 03:30:16.395410 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2224/4602] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:16 2022] GET /compute/v2.1/servers/b3aaaa43-32ea-4b23-a28a-9bd35a335b5c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:30:16.405238 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-95224d9e-2bc9-4dfd-98b1-b2dd547fe1d1 req-d229cd60-b5bd-4cb3-b0cd-0f16ab7fbfde service nova] Creating event network-vif-unplugged:d78d7323-5afa-431c-9cd9-c6983436a16d for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:16.408738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.409640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.417324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.418241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.418886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.419803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.420439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.421186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.421312 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-95224d9e-2bc9-4dfd-98b1-b2dd547fe1d1 req-d229cd60-b5bd-4cb3-b0cd-0f16ab7fbfde service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087545 Aug 27 03:30:16.423509 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2379/4603] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:30:16.435726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.439397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.449489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.450305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.451058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.451901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.452760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.453559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.474959 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 HTTP/1.1 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7972c949-6a4f-44e5-908b-e7ef35f7b275'} Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:16.477308 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:16.481417 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:16.485125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:16.486287 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3048c3fe-d6f8-450b-99dd-05a4aa688d31 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 404 len: 111 microversion: 2.1 time: 0.061523 Aug 27 03:30:16.487141 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2380/4604] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:16 2022] DELETE /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:16.493761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.494947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.502560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:16.505249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.506308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.507006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.507980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.508675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.509599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.067037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.083337 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e93ee512-6f24-4610-a6df-71d9af24b092 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.685117 Aug 27 03:30:17.088340 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2225/4605] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:16 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:17.104364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.105541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 7972c949-6a4f-44e5-908b-e7ef35f7b275] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.124736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.125678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.126459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.127450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.128159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.129355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.132568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.151496 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:17.164275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 HTTP/1.1 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '7972c949-6a4f-44e5-908b-e7ef35f7b275'} Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.169543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.175303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.175303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.175303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.175303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:17.175303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:17.175303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. Aug 27 03:30:17.175303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.178151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.181298 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0aead202-c04b-49a0-920c-aa1151edad28 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2821 microversion: 2.32 time: 0.692548 Aug 27 03:30:17.184625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 7972c949-6a4f-44e5-908b-e7ef35f7b275 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:17.186035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-877e2878-e1a6-41c1-b63c-9d366e2a0fd0 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275" status: 404 len: 111 microversion: 2.1 time: 0.095977 Aug 27 03:30:17.191875 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2226/4606] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:17 2022] GET /compute/v2.1/servers/7972c949-6a4f-44e5-908b-e7ef35f7b275 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:17.197471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.198373 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2381/4607] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:16 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2821 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:17.204418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.223716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.228488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.229306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.230390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.233096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.235427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.243734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-665cdb9b-3374-4856-b6f5-a00294bca40f req-0df81237-0a84-4911-9c6c-6f764423554b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-deleted", "tag": "74829acf-8c1f-4b9d-9058-e4429ee36c60"}, {"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-deleted", "tag": "7c4f392d-0ced-41e9-b62c-450fb4af76a2"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:17.262386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-665cdb9b-3374-4856-b6f5-a00294bca40f req-0df81237-0a84-4911-9c6c-6f764423554b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.263140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-665cdb9b-3374-4856-b6f5-a00294bca40f req-0df81237-0a84-4911-9c6c-6f764423554b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.264633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-665cdb9b-3374-4856-b6f5-a00294bca40f req-0df81237-0a84-4911-9c6c-6f764423554b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.285765 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-665cdb9b-3374-4856-b6f5-a00294bca40f req-0df81237-0a84-4911-9c6c-6f764423554b service nova] Creating event network-vif-deleted:74829acf-8c1f-4b9d-9058-e4429ee36c60 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:17.287495 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-665cdb9b-3374-4856-b6f5-a00294bca40f req-0df81237-0a84-4911-9c6c-6f764423554b service nova] Creating event network-vif-deleted:7c4f392d-0ced-41e9-b62c-450fb4af76a2 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:17.303490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-665cdb9b-3374-4856-b6f5-a00294bca40f req-0df81237-0a84-4911-9c6c-6f764423554b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100721 Aug 27 03:30:17.307775 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2382/4608] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:17.319601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.320511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.328383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.329287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.329939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.330874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.331487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.333959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.358447 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 HTTP/1.1 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '010a38a0-1870-4e4b-8b44-cf583e8e52b6'} Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:17.361246 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.365258 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.369931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:17.371177 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2def120e-1271-4db3-9dbb-01c415447d01 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 404 len: 111 microversion: 2.1 time: 0.061777 Aug 27 03:30:17.375219 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2383/4609] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:17 2022] DELETE /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:17.382692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.383677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 010a38a0-1870-4e4b-8b44-cf583e8e52b6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.392674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.393518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.394219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.395781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.396506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.397174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.414082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.429687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.431193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.436322 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eaccfb9c-3a91-4826-99f0-d93eea7d6c75 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.242418 Aug 27 03:30:17.437740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 HTTP/1.1 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '010a38a0-1870-4e4b-8b44-cf583e8e52b6'} Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.449033 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.455989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.455989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.455989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.455989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:17.455989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:17.455989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. Aug 27 03:30:17.455989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.456834 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2227/4610] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:17 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:17.468624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 010a38a0-1870-4e4b-8b44-cf583e8e52b6 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:17.470701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b806de5-4d3a-4e9b-93ef-562434696a78 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6" status: 404 len: 111 microversion: 2.1 time: 0.093823 Aug 27 03:30:17.478628 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2384/4611] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:17 2022] GET /compute/v2.1/servers/010a38a0-1870-4e4b-8b44-cf583e8e52b6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:17.483129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.486064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.504267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.515142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.516906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.520877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.522345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.523286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.550491 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 HTTP/1.1 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '9202ba1e-6f84-4e06-9d55-e538dcd9f9d5'} Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:17.552987 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.557162 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.559174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:17.560288 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bc02ba1-e074-4eac-a7aa-0d38831a4b9a tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 404 len: 111 microversion: 2.1 time: 0.081488 Aug 27 03:30:17.567343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2228/4612] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:17 2022] DELETE /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:30:17.575052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.575850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.584590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.585262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.585965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.587456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.588209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.589013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.610748 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 HTTP/1.1 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '9202ba1e-6f84-4e06-9d55-e538dcd9f9d5'} Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.615009 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.629989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.629989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.629989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.629989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:17.629989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:17.629989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. Aug 27 03:30:17.629989 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.634461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:17.636560 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fecf9448-d852-441f-93da-1b42056644ec tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5" status: 404 len: 111 microversion: 2.1 time: 0.070200 Aug 27 03:30:17.638308 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2385/4613] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:17 2022] GET /compute/v2.1/servers/9202ba1e-6f84-4e06-9d55-e538dcd9f9d5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:17.654568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f729bb73-abd9-4a6f-995e-61ae53f6e712 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.659929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f729bb73-abd9-4a6f-995e-61ae53f6e712 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 4c31b7aa-13c4-466a-9f35-c40b2d977934] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.694304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f729bb73-abd9-4a6f-995e-61ae53f6e712 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f729bb73-abd9-4a6f-995e-61ae53f6e712 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934 HTTP/1.1 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '4c31b7aa-13c4-466a-9f35-c40b2d977934'} Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.706852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.714309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f729bb73-abd9-4a6f-995e-61ae53f6e712 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:17.715377 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f729bb73-abd9-4a6f-995e-61ae53f6e712 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934" status: 404 len: 111 microversion: 2.1 time: 0.070045 Aug 27 03:30:17.721286 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2229/4614] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:17 2022] DELETE /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:17.729477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae1e6a72-5932-4f9f-9e4f-b1d35c045e96 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.730321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae1e6a72-5932-4f9f-9e4f-b1d35c045e96 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 4c31b7aa-13c4-466a-9f35-c40b2d977934] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.740766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ae1e6a72-5932-4f9f-9e4f-b1d35c045e96 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae1e6a72-5932-4f9f-9e4f-b1d35c045e96 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934 HTTP/1.1 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4c31b7aa-13c4-466a-9f35-c40b2d977934'} Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:17.744222 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:17.758822 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:17.758822 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:17.758822 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:17.758822 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. Aug 27 03:30:17.758822 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:17.758822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae1e6a72-5932-4f9f-9e4f-b1d35c045e96 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 4c31b7aa-13c4-466a-9f35-c40b2d977934 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:17.763196 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae1e6a72-5932-4f9f-9e4f-b1d35c045e96 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934" status: 404 len: 111 microversion: 2.1 time: 0.037882 Aug 27 03:30:17.765282 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2386/4615] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:17 2022] GET /compute/v2.1/servers/4c31b7aa-13c4-466a-9f35-c40b2d977934 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:17.788575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.789100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.798969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.800514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.801480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.803356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.804636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.805324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.855290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:30:18.065066 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d4c0cd6-4fe0-428a-ac7d-7b498ddba822 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 204 len: 0 microversion: 2.1 time: 0.290186 Aug 27 03:30:18.072827 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2230/4616] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:17 2022] DELETE /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:30:18.077033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:18.077555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:18.093877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.094840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.095669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.097011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.102939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.107329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.135362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:18.136710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:18.148351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.148912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.149358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.151163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.151686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.152211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.541917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:18.557744 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e717ec22-27cb-4bbc-9709-3470415d284a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.429012 Aug 27 03:30:18.580665 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2231/4617] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:18 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:18.590023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:18.603077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:18.624161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.624985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.627065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:18.628150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.630844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.631595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.633598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.650951 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a7c43e8-f596-419a-a3e0-738fb78b11b1 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1479 microversion: 2.1 time: 0.577914 Aug 27 03:30:18.654400 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2387/4618] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:18 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1479 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:18.661421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:18.666996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:18.690227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.692968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.694340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.695554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.698004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.741259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:19.182230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:19.204339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:19.216576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:19.218823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4ff291f-fc58-4945-a1d7-78ff5dd36961 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.562720 Aug 27 03:30:19.219884 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2388/4619] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:18 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:19.357361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-72f5abe7-413c-4017-bdd9-c828e609a371 req-bf83697e-92b0-4bad-9e03-885cef68e259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-deleted", "tag": "ae27ab8a-5ee1-4b13-ba45-faab9b193597"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:19.395682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-72f5abe7-413c-4017-bdd9-c828e609a371 req-bf83697e-92b0-4bad-9e03-885cef68e259 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:19.396747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-72f5abe7-413c-4017-bdd9-c828e609a371 req-bf83697e-92b0-4bad-9e03-885cef68e259 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:19.397777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-72f5abe7-413c-4017-bdd9-c828e609a371 req-bf83697e-92b0-4bad-9e03-885cef68e259 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:19.426318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-72f5abe7-413c-4017-bdd9-c828e609a371 req-bf83697e-92b0-4bad-9e03-885cef68e259 service nova] Creating event network-vif-deleted:ae27ab8a-5ee1-4b13-ba45-faab9b193597 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:19.440994 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-72f5abe7-413c-4017-bdd9-c828e609a371 req-bf83697e-92b0-4bad-9e03-885cef68e259 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087995 Aug 27 03:30:19.446359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2389/4620] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:30:19.608654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:19.609803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:19.619605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:19.633955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:19.639217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:19.642145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:19.643287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:19.645415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:19.748344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:19.773738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:19.777839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:19.779142 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a87cf99-978a-408e-a271-2ef3d2868ab0 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2502 microversion: 2.32 time: 1.197006 Aug 27 03:30:19.800353 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2232/4621] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:18 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2502 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:19.817082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:19.818481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:19.837578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:19.838518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:19.847194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:19.856956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:19.858388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:19.859510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:20.745831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:20.773342 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4fd50862-9326-4c82-b928-838db91219b1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 1.161715 Aug 27 03:30:20.774886 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2390/4622] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:19 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:20.798479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:20.802064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:20.822241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:20.822992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:20.823619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:20.826827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:20.827528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:20.828138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:21.232799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:21.236363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c309dc0978744766aedfe3fe40fb901c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea760eafe494a01bbde27f0465bcbaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:21.290998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:21.311062 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc3edcb2-5df5-4922-9fb3-e0b9e1ae333d tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 200 len: 1479 microversion: 2.1 time: 1.479511 Aug 27 03:30:21.340338 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2233/4623] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:19 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 1479 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:21.351686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:21.353266 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a661561-5cb9-4743-accb-c06ee1e12fdc tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.576072 Aug 27 03:30:21.358863 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2391/4624] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:20 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:21.365200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:21.368597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:21.382350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:21.383666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:21.386943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:21.395460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:21.395961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:21.399060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:21.653834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-af9684f3-bbdb-4f0e-bcb6-bfcfd2e3048d req-f7d65e48-3466-4c20-997c-af2c7f55ae02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6336c272-e9fc-47d8-b2c8-5a19def0c93a", "name": "network-vif-deleted", "tag": "691ff810-3d82-425f-abb7-2197323d0bbb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:21.716587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-af9684f3-bbdb-4f0e-bcb6-bfcfd2e3048d req-f7d65e48-3466-4c20-997c-af2c7f55ae02 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:21.724964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-af9684f3-bbdb-4f0e-bcb6-bfcfd2e3048d req-f7d65e48-3466-4c20-997c-af2c7f55ae02 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:21.725981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-af9684f3-bbdb-4f0e-bcb6-bfcfd2e3048d req-f7d65e48-3466-4c20-997c-af2c7f55ae02 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:21.782800 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-af9684f3-bbdb-4f0e-bcb6-bfcfd2e3048d req-f7d65e48-3466-4c20-997c-af2c7f55ae02 service nova] Creating event network-vif-deleted:691ff810-3d82-425f-abb7-2197323d0bbb for instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a on n-h1-852086-5 Aug 27 03:30:21.845425 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-af9684f3-bbdb-4f0e-bcb6-bfcfd2e3048d req-f7d65e48-3466-4c20-997c-af2c7f55ae02 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203424 Aug 27 03:30:21.846712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2392/4625] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:21.859373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:21.860604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:21.890369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:21.902635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:21.906641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:21.907778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:21.908349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:21.915328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:22.330963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.361666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.364238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.369726 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-438fc43c-706f-40f1-a923-67cbef223c51 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 2168 microversion: 2.32 time: 1.026234 Aug 27 03:30:22.370717 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2234/4626] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:21 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 2168 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:22.376072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:22.376981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] [instance: 6336c272-e9fc-47d8-b2c8-5a19def0c93a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:22.404244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:22.404821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:22.405277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:22.415694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:22.415955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:22.416721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:22.467382 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] HTTP exception thrown: Instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a could not be found. Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Request method failure captured: Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a HTTP/1.1 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY7NoFgJTMa_sQqCJtcBywsnlKJbvjwOBjNKrSK6JN8yd1VqhflPrK7kXf07e-PKh3ktQngV6gwtuqwVmJRQQu58bOCdN_3h76iwKQJ-CRiZQIStW6dfVA3qWsMHhQbUc9pWMwSZvF8_NvyKRV8XMDni_KWVbTKxyjNTGgjroZ8_Iq0 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ea760eafe494a01bbde27f0465bcbaf", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ea760eafe494a01bbde27f0465bcbaf"}]}] Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-1383201050 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ea760eafe494a01bbde27f0465bcbaf Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-1383201050 Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: c309dc0978744766aedfe3fe40fb901c Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-1383201050-project Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a could not be found. Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6336c272-e9fc-47d8-b2c8-5a19def0c93a'} Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a could not be found. Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a could not be found. Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:22.471168 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:22.476531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:22.476531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:22.476531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:22.476531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:22.476531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:22.476531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a could not be found. Aug 27 03:30:22.476531 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:30:22.481380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] Returning 404 to user: Instance 6336c272-e9fc-47d8-b2c8-5a19def0c93a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:22.487067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2058f30e-8214-4713-ba4b-39dc766a09d3 tempest-ServersTestJSON-1383201050 tempest-ServersTestJSON-1383201050-project] 10.222.0.69 "GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a" status: 404 len: 111 microversion: 2.1 time: 0.115154 Aug 27 03:30:22.498015 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2235/4627] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:22 2022] GET /compute/v2.1/servers/6336c272-e9fc-47d8-b2c8-5a19def0c93a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:22.500278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:22.500912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:22.508675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:22.509445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:22.509905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:22.510754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:22.511292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:22.512323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:22.692055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.711816 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59d4f970-f56d-4408-b1f3-8c57927cb984 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.863226 Aug 27 03:30:22.712417 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2393/4628] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:21 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:22.831138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.872217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.887749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.900720 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d48cd4a-dc45-41a7-9394-fcfdc106cf02 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.403374 Aug 27 03:30:22.921066 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2236/4629] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:22 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:23.408242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:23.409526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:23.421875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.423173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.424428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:23.426328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.427119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.427889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:23.563597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:23.581300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:23.585149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:23.586766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f94aac9d-8efa-431d-aa5c-b3c632cd2555 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.187841 Aug 27 03:30:23.587924 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2394/4630] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:23 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:23.736425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:23.737041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:23.756041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.756841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.757474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:23.759118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.760607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.761215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:23.928451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:23.935110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:23.948075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.952466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.954929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:23.958644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.959426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.961318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.214660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:24.229091 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-284e1f14-4ed5-4167-bb71-b6abf4385da9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1655 microversion: 2.1 time: 0.493527 Aug 27 03:30:24.230111 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2237/4631] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:23 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1655 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:24.253964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e251dc35-dde2-405c-be36-648abe826d7d req-c030d78c-a240-4d53-a381-32f723ba8db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-deleted", "tag": "d78d7323-5afa-431c-9cd9-c6983436a16d"}, {"server_uuid": "ca299f7e-6f85-46ea-97a1-66a49929589b", "name": "network-vif-deleted", "tag": "5a0b4c7a-a135-4d68-b8d3-a8cd69119f06"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:24.261965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:24.274043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:24.284067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:24.284858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e251dc35-dde2-405c-be36-648abe826d7d req-c030d78c-a240-4d53-a381-32f723ba8db0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.285853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9dcaab7b-5f42-421c-b3ce-fa9a4e384fcf tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.361524 Aug 27 03:30:24.286795 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2395/4632] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:23 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:24.287235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e251dc35-dde2-405c-be36-648abe826d7d req-c030d78c-a240-4d53-a381-32f723ba8db0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.288342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e251dc35-dde2-405c-be36-648abe826d7d req-c030d78c-a240-4d53-a381-32f723ba8db0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.291670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-25c49fd0-4b6c-4989-9fc2-ab599387fea5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:24.307202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25c49fd0-4b6c-4989-9fc2-ab599387fea5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.307707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25c49fd0-4b6c-4989-9fc2-ab599387fea5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.308146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25c49fd0-4b6c-4989-9fc2-ab599387fea5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.328629 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e251dc35-dde2-405c-be36-648abe826d7d req-c030d78c-a240-4d53-a381-32f723ba8db0 service nova] Creating event network-vif-deleted:d78d7323-5afa-431c-9cd9-c6983436a16d for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:24.329613 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e251dc35-dde2-405c-be36-648abe826d7d req-c030d78c-a240-4d53-a381-32f723ba8db0 service nova] Creating event network-vif-deleted:5a0b4c7a-a135-4d68-b8d3-a8cd69119f06 for instance ca299f7e-6f85-46ea-97a1-66a49929589b on n-h2-852086-5 Aug 27 03:30:24.340450 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e251dc35-dde2-405c-be36-648abe826d7d req-c030d78c-a240-4d53-a381-32f723ba8db0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106845 Aug 27 03:30:24.342359 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2238/4633] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:24.362329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25c49fd0-4b6c-4989-9fc2-ab599387fea5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Going to try to start instance {{(pid=122407) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:30:24.491217 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-25c49fd0-4b6c-4989-9fc2-ab599387fea5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.202917 Aug 27 03:30:24.494057 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2396/4634] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:24 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:24.505493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:24.507081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:24.519015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.520473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.521173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.523552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.525547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.529550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.621647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:24.622697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:24.663939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.665797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.670185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.671009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.671495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.672134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.801882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:24.815487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e47f3e0-4442-4030-9e3e-48a89de4675f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1664 microversion: 2.1 time: 0.316364 Aug 27 03:30:24.823266 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2239/4635] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:24 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1664 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:24.994979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.020802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.023079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.030747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7cba2fe2-1cff-426c-8ef5-e3651d77d999 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.413716 Aug 27 03:30:25.032284 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2397/4636] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:24 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:25.320868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:25.323934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:25.337024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.338829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.342953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:25.344341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.345230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.345980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:25.689615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.715514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.717767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.719318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec806a3b-b82d-4691-ab81-4c3079747d6c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.407287 Aug 27 03:30:25.729438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-397760201", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "9629d05d-a036-490a-a905-c45e2c70a519"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:25.730665 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2398/4637] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:25 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:25.864716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:25.865959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:25.880213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] validate_networks() for [('9629d05d-a036-490a-a905-c45e2c70a519', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:30:25.883239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.891266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.893605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:25.907020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.909735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.912299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:26.031898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:26.635302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:26.666304 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2277c65d-80b4-46b9-ab51-43c80a3ccc97 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1664 microversion: 2.1 time: 0.806057 Aug 27 03:30:26.693728 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2399/4638] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:25 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1664 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:26.728693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:26.729379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:26.746870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:26.754572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:26.755407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:26.757941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:26.758677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:26.759299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:26.990666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.025070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.027414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.028893 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1aaf9d5c-eedd-48fe-afb4-1e10d97e8ba3 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.331618 Aug 27 03:30:27.046024 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2400/4639] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:26 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:27.052120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:27.053182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:27.061511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:27.062128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:27.062679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.063486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:27.064007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:27.064512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.188474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.206760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.209446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.211726 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b1ed0c8-8a96-4c06-9229-5af72634a7ea tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.163815 Aug 27 03:30:27.213197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2401/4640] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:27 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:27.255735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:30:27.256643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:30:27.258143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:30:27.258143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:30:27.258143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:30:27.308631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:27.309503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:27.310286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.311367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:27.312052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:27.312758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.366258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Getting quotas for project 4ae9abba744b4b08ae3bf99d5f94d63e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:30:27.389417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Getting quotas for user ecc4fea72e9243f2989722084690be5a and project 4ae9abba744b4b08ae3bf99d5f94d63e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:30:27.448955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:30:27.453049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:30:27.545384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:27.577104 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b28fdbea-406e-413a-85d5-6ceb14203f4b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.287549 Aug 27 03:30:27.591984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2240/4641] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:30:27.595924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2dee9311-d107-49c3-ba4d-bdbb70ca763f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:27.596869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2dee9311-d107-49c3-ba4d-bdbb70ca763f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:27.718779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:27.719514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:27.737015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:27.737681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:27.738436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.739472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:27.739998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:27.740437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.909628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2dee9311-d107-49c3-ba4d-bdbb70ca763f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.947869 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2dee9311-d107-49c3-ba4d-bdbb70ca763f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1217 microversion: 2.1 time: 0.351251 Aug 27 03:30:27.954481 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2402/4642] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:27 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1217 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:28.063373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:28.067176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:28.084868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.088818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.095021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.098892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.103265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.106940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.362716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.385097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.388967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.392974 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9939877a-3306-4288-b41a-cbe73ce168bb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.335894 Aug 27 03:30:28.407926 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2403/4643] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:28 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:28.443588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:28.449450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:28.475922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.480711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.481664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.486480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.492599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.496172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.768200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.781101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.789492 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ad699a1a-dc73-4c06-9788-e1125fb9d87f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 1.078216 Aug 27 03:30:28.794485 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2241/4644] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:27 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:28.815776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.817860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.818410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:28.819239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:28.822782 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40ba8e46-c326-4f64-ac0d-8518200e0a9c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.418818 Aug 27 03:30:28.829140 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2404/4645] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:28 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:28.875435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.876181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.877141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.879176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.880172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.880809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.981670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11775b7b-c119-4718-80fd-2f3f5bfe6c95 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:28.983547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11775b7b-c119-4718-80fd-2f3f5bfe6c95 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.226271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-11775b7b-c119-4718-80fd-2f3f5bfe6c95 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:29.235684 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11775b7b-c119-4718-80fd-2f3f5bfe6c95 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1217 microversion: 2.1 time: 0.261204 Aug 27 03:30:29.236527 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2405/4646] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:28 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1217 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:29.440138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:29.441733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.491531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.492064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.492522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.493270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.493931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.499434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.666918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:29.687920 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc8b2b91-96af-43a8-a7da-124197992303 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.869210 Aug 27 03:30:29.693719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2242/4647] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:28 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:29.736392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:29.737668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.767673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.768973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.773783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.782057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:29.792278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.794676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.803229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.822688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:29.829330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:29.838932 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-582f7c4a-99b5-4856-ba2b-000b5ce6f367 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.407719 Aug 27 03:30:29.845226 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2406/4648] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:29 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:29.874066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:29.878017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.888634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.889867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.890613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.892212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:29.892533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.893466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.894841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.078071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:30.082717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Unlocking {{(pid=122408) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 03:30:30.092544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:30.100184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:30.101382 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c59c1102-997c-4af6-8148-144c027076fd tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.241390 Aug 27 03:30:30.116985 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2407/4649] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:29 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:30.269997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:30.269997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:30.351535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.360100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.361062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.363240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.371494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.379997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.515715 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed4934d8-4a2f-4f2b-9c0c-d90d56f5a479 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.783738 Aug 27 03:30:30.519028 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2243/4650] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:29 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:30:30.604504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:30.608619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:30.647577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.656588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.657342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.662583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.663426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.666739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.764438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:30.790356 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2748283f-f7a5-4e65-a041-c287957e6666 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1269 microversion: 2.1 time: 0.530215 Aug 27 03:30:30.793052 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2408/4651] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:30 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1269 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:30.876628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:30.878379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:30.908822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.911382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.915230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.916411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:30.923200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:30.923650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:31.116600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:31.133555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:31.136797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:31.149493 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1d577daf-026e-4ada-b8fe-76558e5bdbb2 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.276374 Aug 27 03:30:31.150943 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2409/4652] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:30 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:31.197706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:31.211522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:31.267616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:31.276178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:31.277676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:31.282236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:31.282724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:31.283168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:31.491307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:31.511385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:31.513653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:31.528491 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14e4c773-9fc7-461c-9d5f-a9005fd23b55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.348809 Aug 27 03:30:31.536824 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2410/4653] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:31 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:31.870834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:31.870834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:31.903416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:31.916745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:31.918850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:31.921085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:31.930850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:31.933222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.212087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:32.255468 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4444cc9-6cad-46c3-bd1c-4698f8abafa9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1275 microversion: 2.1 time: 0.405768 Aug 27 03:30:32.301941 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2411/4654] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:31 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1275 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:32.318519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:32.323839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:32.341995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.348962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.349622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.350546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.353172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.353734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.508393 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-506e5f3a-005f-4939-b6b3-cd21e0b34c92 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/ips" status: 200 len: 150 microversion: 2.1 time: 0.204364 Aug 27 03:30:32.516764 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2412/4655] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:30:32 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/ips => generated 150 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:32.523014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:32.525056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:32.546284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.549258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.552308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.556303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.575001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.578748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.195512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.243486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.246624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.264327 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9d847c7-8ad8-482c-881a-3f0424404f03 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.746173 Aug 27 03:30:33.290299 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2413/4656] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:32 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:33.345743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:33.350712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:33.388000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.389313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.393259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.399259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.403732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.407800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.593928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.626620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.627134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.635900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.639084 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3a89130-a2f4-4628-b389-37345853c0d6 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.347428 Aug 27 03:30:33.645536 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2414/4657] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:33 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:33.647665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5f19ec3-422f-41db-9eb3-436ed3e69014 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 3.093435 Aug 27 03:30:33.662192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2244/4658] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:30 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 3098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:33.671743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:33.671743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:33.683626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:33.685020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:33.699555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.700203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.702674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.702674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.702674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.702674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.707653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.708332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.709035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.716268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.725287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.727082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.060965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.095120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5e6ca635-5afe-44b5-bc24-19d264a5d585 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1275 microversion: 2.1 time: 0.442838 Aug 27 03:30:34.099437 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2415/4659] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:33 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1275 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:34.306258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:34.311501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:34.337458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.338740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.343147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.346632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.348712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.349805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.514547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.546534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.549998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.563065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-edd23f72-f7b9-4e5c-898e-ab9afc9be802 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.254086 Aug 27 03:30:34.608188 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2416/4660] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:34 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:34.730235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:34.730859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:34.770528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.770528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.770926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.771662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.772120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.772548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.968618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.985766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.987477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.991479 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf83abd8-1cbe-4c09-a8e2-b06bec3be03d tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.292799 Aug 27 03:30:34.992809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2417/4661] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:34 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:35.153947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:35.155250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:35.180388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.182888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.185687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.189200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.190873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.193190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.253270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:35.291370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:35.306003 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-054acbca-b1b3-401e-b780-352d7bd66420 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 1.628749 Aug 27 03:30:35.318747 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2245/4662] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:33 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:35.340381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:35.341562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:35.359458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.367224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.371185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.372146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.372983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.373606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.397036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:35.424829 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a80513d-83c1-4532-9005-3e4b99d9825c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1275 microversion: 2.1 time: 0.271608 Aug 27 03:30:35.437317 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2418/4663] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:35 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:35.616394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:35.617167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:35.645548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.646066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.646607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.647371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.653120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.653709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.982022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:36.009172 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a79607b-b4c2-4252-92fd-1524dac41e05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.673027 Aug 27 03:30:36.023289 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2246/4664] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:35 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:36.034141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:36.035829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:36.056697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.057476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.058305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.059214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.059842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.060429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.266559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:36.337350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:36.353489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:36.373068 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df46b477-5b2b-4480-aa4c-ccc690fdcf33 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1409 microversion: 2.54 time: 0.345317 Aug 27 03:30:36.377897 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2247/4665] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:36 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1409 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:36.384292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:36.390448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:36.416479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.419416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.420828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.431286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.434236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.435885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.694775 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24add1f5-08a9-4774-9201-b930eb2265a8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.313921 Aug 27 03:30:36.701045 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2248/4666] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:36 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:36.715297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:36.722782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:36.754718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.756005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.759033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.761709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.765606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.766646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.957065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:36.986658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.006267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.029175 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-570be972-ad98-4802-b24c-1662f5f96e3c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 1.407957 Aug 27 03:30:37.041525 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2419/4667] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:35 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:37.097213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:37.112038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:37.161692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:37.165541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:37.166227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:37.167018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:37.167496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:37.167920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:37.357425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:37.373151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.387639 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a967b59c-cb28-4585-958e-e1a8714ae440 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1275 microversion: 2.1 time: 0.684145 Aug 27 03:30:37.389035 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2249/4668] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:36 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1275 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:37.432957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:37.433604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:37.446263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:37.448355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:37.450205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:37.454347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:37.456549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:37.457216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:37.463509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:37.666982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.687749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9bbff68-f678-438d-9bd0-d9284b0925ed tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1673 microversion: 2.1 time: 0.644651 Aug 27 03:30:37.709356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.709942 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2420/4669] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:37 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1673 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:37.732510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.735605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:37.737250 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74cfd6a3-7e48-4161-af21-56d791f77cae tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1415 microversion: 2.54 time: 0.324586 Aug 27 03:30:37.742448 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2250/4670] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:37 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1415 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:38.072691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:38.080571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:38.104455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.105714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.106709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:38.130026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.141652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.145571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:38.389975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "911734f8-fbf6-4a69-bcc8-54e18c3c3d30"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:38.393751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:38.417062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:38.426753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.429690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.430733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:38.431747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.432768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.433484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:38.449067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:38.462608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:38.464488 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-31ce420e-650f-4029-8c83-89a7d6a7a323 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.410181 Aug 27 03:30:38.468856 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2421/4671] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:38 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:38.491715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:38.493548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:38.515813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.516880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.517503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:38.518449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.521609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.531579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:38.868986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:38.890120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a500014-ef78-4321-94bd-93867ebacf0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.418561 Aug 27 03:30:38.891560 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2422/4672] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:38 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:38.904818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:38.905830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:38.922262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.924769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.926550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:38.927816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:38.974103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:38.979625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:39.074767 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b08f8dc4-3517-4a3a-97b5-f524591cbe2b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680503 Aug 27 03:30:39.090700 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2251/4673] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:30:38 2022] POST /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:39.127504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:39.131238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:39.173004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:39.177361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:39.178239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:39.180710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:39.181719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:39.182599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:39.235155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:39.477727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:39.498199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-daec3833-f006-4ac1-847f-22b5772aaa2b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1653 microversion: 2.1 time: 0.596031 Aug 27 03:30:39.512639 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2423/4674] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:38 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1653 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:39.524266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:39.526559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:39.599330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:39.606821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:39.613501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:39.617080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:39.656585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:39.662171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:39.920073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:39.933327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:39.935267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:39.936547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-55a86491-de3b-4290-9dae-c625aa196c57 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.421314 Aug 27 03:30:39.937142 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2424/4675] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:39 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:39.950581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:39.951479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:39.978979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:39.980460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:39.981350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:39.986123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:39.987493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:39.990899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:40.181645 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-805bc0ef-da71-4438-a985-a9ec75d94779 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.239692 Aug 27 03:30:40.185409 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2425/4676] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:39 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:40.205189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:40.208655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:40.229254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:40.230519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:40.233244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:40.234413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:40.235009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:40.236894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:40.604868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:40.620011 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-01c64818-16ba-47d5-815f-3707e9f5e8d5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.431735 Aug 27 03:30:40.620941 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2426/4677] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:40 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:40.630246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:40.631828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:40.648125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:40.650753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:40.651979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:40.652957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:40.653955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:40.654711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:40.730439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:40.776883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:40.811685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:40.815507 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5b402b3-77fa-4282-8084-c14c00beb65a tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1415 microversion: 2.54 time: 1.718121 Aug 27 03:30:40.817719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2252/4678] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:39 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1415 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:40.984701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:40.987439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:41.031099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.031735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.032036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:41.032781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.033263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.033661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:41.196748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:41.228314 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-505cc940-7924-4363-8cef-c86435c1cb68 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.605348 Aug 27 03:30:41.229840 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2427/4679] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:40 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:41.263022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:41.265466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:41.276978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.278342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.279541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:41.282773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.283950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.284997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:41.460601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:41.492251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:41.522010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:41.525940 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0e26e73-058f-47eb-97f5-c94d93394820 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.566495 Aug 27 03:30:41.563528 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2253/4680] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:40 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:41.625959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:41.639823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c171703-d565-445d-9fa8-e56ab6990379 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.383508 Aug 27 03:30:41.642440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2428/4681] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:41 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:41.656661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:41.657704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:41.678623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.680502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.682091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:41.683627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.684545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.685409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:41.711444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:41.712603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:41.719850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:41.745596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.746103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.746645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:41.749230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:41.749552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:41.749988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:42.100785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.117549 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9d127bf7-c3d1-4fa8-bdde-2f062e7c54ff tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.451719 Aug 27 03:30:42.118540 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2429/4682] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:41 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:42.127307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:42.135892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:42.159228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:42.160902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:42.161593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:42.162502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:42.163070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:42.163614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:42.336676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.365721 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d52c8227-d8b1-4c22-8bc2-8c775e6b5a69 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.726752 Aug 27 03:30:42.380680 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2254/4683] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:41 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:42.397968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:42.399505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:42.444592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:42.446208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:42.447490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:42.449118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:42.450239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:42.451028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:42.469521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.497479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.505515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:42.505902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.507960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-057d467f-91ab-4bf0-b52a-de16e3923465 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1415 microversion: 2.54 time: 0.388139 Aug 27 03:30:42.514960 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2430/4684] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:42 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1415 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:42.568442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:42.569099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:42.589033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:42.598404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:42.599639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:42.604704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:42.609255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:42.614368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:42.826819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.872752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.878498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:42.891929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bdc413ae-767c-4fc1-8157-e7588df67fbf tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.323968 Aug 27 03:30:42.918202 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2431/4685] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:42 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:42.945277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e66e2472-a5e3-4cc2-a105-9631e68c4216 req-99a2343f-c458-44e0-b70b-edebed40c35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54115f30-fe92-4a2c-8fb2-e90281f3d35e", "tag": "1d21c5f4-68f1-4861-a5bc-8e9490fda880"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:42.977788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e66e2472-a5e3-4cc2-a105-9631e68c4216 req-99a2343f-c458-44e0-b70b-edebed40c35b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:42.982607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e66e2472-a5e3-4cc2-a105-9631e68c4216 req-99a2343f-c458-44e0-b70b-edebed40c35b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:42.989380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e66e2472-a5e3-4cc2-a105-9631e68c4216 req-99a2343f-c458-44e0-b70b-edebed40c35b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:43.083975 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e66e2472-a5e3-4cc2-a105-9631e68c4216 req-99a2343f-c458-44e0-b70b-edebed40c35b service nova] Creating event network-changed:1d21c5f4-68f1-4861-a5bc-8e9490fda880 for instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e on n-h1-852086-5 Aug 27 03:30:43.105118 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e66e2472-a5e3-4cc2-a105-9631e68c4216 req-99a2343f-c458-44e0-b70b-edebed40c35b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164082 Aug 27 03:30:43.108200 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2432/4686] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:43.246091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:43.260979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e79dcdd1-f2bd-481a-8429-9d331b3ffea0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.875400 Aug 27 03:30:43.261931 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2255/4687] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:42 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:43.296239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:43.298034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:43.309626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:43.310568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:43.312577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:43.332628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:43.333594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:43.336051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:43.396019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:43.397813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:43.417757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:43.419138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:43.421057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:43.424596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:43.428613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:43.429742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:43.828721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:43.846041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d41648b1-40af-47a4-9f95-2f58b01a7393 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.555339 Aug 27 03:30:43.850588 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2433/4688] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:43 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:43.869149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:43.870353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:43.874804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:43.896767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:43.897740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:43.900392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:43.903260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:43.903844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:43.904342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:43.911229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebb21670-5a58-4edb-90e9-0b199922dd73 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.521888 Aug 27 03:30:43.914989 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2256/4689] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:43 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:43.973204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:43.975000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:44.015981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.022132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.022841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.025939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.035100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.035586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.122764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.133424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:44.139438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.146310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.149026 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f24ba94-69c4-4ac5-85c6-d45e248ae7c4 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1400 microversion: 2.54 time: 0.296830 Aug 27 03:30:44.166618 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2434/4690] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:43 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1400 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:44.182782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:44.184138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:44.198602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.199767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.200942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.202595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.203556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.204746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.441679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.468576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.473734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.475505 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b2c36b2-8d25-4d54-b00b-b77b2f37a62e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.307207 Aug 27 03:30:44.476450 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2435/4691] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:44 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:44.482107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74124193-b005-42d5-9151-e0bb17d1b934 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '.version_select at 0x7fe457d32c10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:44.504683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:44.523735 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd692731-94f3-41b5-b4b5-c494a6fe1d18 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.575538 Aug 27 03:30:44.524840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2257/4692] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:43 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:44.533661 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-74124193-b005-42d5-9151-e0bb17d1b934 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1099709252" status: 204 len: 0 microversion: 2.54 time: 0.055421 Aug 27 03:30:44.539712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2436/4693] 10.222.0.69 () {60 vars in 1319 bytes} [Sat Aug 27 03:30:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1099709252 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:30:44.569498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:44.571066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:44.584628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.585465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.586585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.587778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.588928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.589937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.657555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:30:44.858177 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a0b18491-2fa0-4fee-8bb2-2ab7388a8d55 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "DELETE /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 204 len: 0 microversion: 2.54 time: 0.300706 Aug 27 03:30:44.867006 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2258/4694] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:30:44 2022] DELETE /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:30:44.889073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:44.890266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:44.910747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.912039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.912910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.917275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.918985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.920670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.947919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:44.950778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:44.978675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.985234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.989303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:44.991423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:44.996872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:44.998377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:45.196875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.213188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.216565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.218460 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f345356-cb1a-43d3-9569-4e6acc4cb69c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1406 microversion: 2.54 time: 0.343423 Aug 27 03:30:45.239907 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2437/4695] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:44 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:45.487309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.499761 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da774c4e-ad7c-42f1-b531-77224fd9f3f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.563536 Aug 27 03:30:45.515971 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2259/4696] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:44 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:45.520257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:45.521038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:45.531946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:45.532494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:45.538443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:45.539406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:45.540098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:45.540756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:45.720029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.745412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.758087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:45.759795 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a37e50a5-5f22-4503-8638-23116bfe284f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.247678 Aug 27 03:30:45.760920 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2438/4697] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:45 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:46.251047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:46.258958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:46.280843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.282099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.283209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:46.289914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.291308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.292512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:46.480949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:46.494945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:46.497126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:46.498689 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4e22748-dd54-4efe-a919-e4c4cfbab049 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1406 microversion: 2.54 time: 0.256107 Aug 27 03:30:46.500100 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2260/4698] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:46 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:46.525844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:46.540476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:46.569123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.571891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.572546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:46.574968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.575571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.576014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:46.785115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:46.786745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:46.798082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.800982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.801693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:46.803018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.807488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.808580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:46.956163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:46.979880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:46.981735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:46.990196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a601a202-d132-482d-95bf-7a161e0ff0ed tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.209166 Aug 27 03:30:46.991468 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2261/4699] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:46 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:46.994418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:47.031318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-db14c22b-be31-4c36-b9f5-6d57a310cb2a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.512113 Aug 27 03:30:47.032073 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2439/4700] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:46 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:47.539583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:47.540452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:47.573523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:47.580297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:47.585364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:47.589213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:47.594000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:47.598100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:47.732210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:47.771783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:47.773294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:47.774543 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8cf5f44b-6082-45d0-86a0-0afcb462301e tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1406 microversion: 2.54 time: 0.244113 Aug 27 03:30:47.778421 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2262/4701] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:47 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:48.042687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:48.044602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:48.065509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:48.069749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:48.074229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.075485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.076133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.077261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.077926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.078552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.090706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.091483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.091884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.093401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.095169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.099772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.299969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:48.320027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:48.322174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:48.323691 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-15335583-c117-4c96-a893-c709582664aa tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.292130 Aug 27 03:30:48.340335 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2440/4702] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:48 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:48.399063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:48.413662 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35fd99c9-e8e9-4bd2-8c2c-81df55963d34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.351940 Aug 27 03:30:48.415216 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2263/4703] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:48 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:48.812529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:48.812794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-206f8298-7380-4b40-9599-043626fb3c02 req-31e34b4e-7779-46b5-90fd-214b868e127f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54115f30-fe92-4a2c-8fb2-e90281f3d35e", "name": "network-vif-plugged", "status": "completed", "tag": "1d21c5f4-68f1-4861-a5bc-8e9490fda880"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:48.814208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:48.828323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.829087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.829764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.834556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.835026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-206f8298-7380-4b40-9599-043626fb3c02 req-31e34b4e-7779-46b5-90fd-214b868e127f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.835441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.835571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-206f8298-7380-4b40-9599-043626fb3c02 req-31e34b4e-7779-46b5-90fd-214b868e127f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.835950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-206f8298-7380-4b40-9599-043626fb3c02 req-31e34b4e-7779-46b5-90fd-214b868e127f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.836357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.868734 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-206f8298-7380-4b40-9599-043626fb3c02 req-31e34b4e-7779-46b5-90fd-214b868e127f service nova] Creating event network-vif-plugged:1d21c5f4-68f1-4861-a5bc-8e9490fda880 for instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e on n-h1-852086-5 Aug 27 03:30:48.884927 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-206f8298-7380-4b40-9599-043626fb3c02 req-31e34b4e-7779-46b5-90fd-214b868e127f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076485 Aug 27 03:30:48.885556 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2441/4704] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:48.930145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.930722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.931173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.931640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lazy-loading 'fault' on Instance uuid 36e06984-02ca-4883-9ad9-c5e543e7cf9d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:30:49.030928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.043068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.044692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '153c655e31c24f7883784a4ad9a820d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dacb0d82cf64aa8a1754545ca7515b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.056861 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f54f307-c9c1-42f8-8255-eccd3ecc7130 tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 200 len: 1411 microversion: 2.54 time: 0.248537 Aug 27 03:30:49.057758 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2264/4705] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:48 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 1411 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:49.367880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:49.369440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:49.381154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:49.382096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:49.383139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:49.384700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:49.385870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:49.386702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:49.448916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:49.450713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:49.459879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:49.460841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:49.461710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:49.463057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:49.463906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:49.464587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:49.563176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.574604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.576281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.580199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d6169530-fe16-49c5-924c-8bd930bab0fb tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.216527 Aug 27 03:30:49.598778 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2442/4706] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:49 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:49.772150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.782037 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-938b57ed-dce3-4f88-b694-331253595d09 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1317 microversion: 2.1 time: 0.341395 Aug 27 03:30:49.795119 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2265/4707] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:49 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:50.083482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:50.083885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] [instance: 36e06984-02ca-4883-9ad9-c5e543e7cf9d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:50.090989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.091824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.092425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.093316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.093945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.094559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.110579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] HTTP exception thrown: Instance 36e06984-02ca-4883-9ad9-c5e543e7cf9d could not be found. Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Request method failure captured: Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d HTTP/1.1 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-nwRlgmDLU7pg4Poi7nLkMHiI-DKqI37BJS7_DVa4r_14SnHDxMPW08xZSADtfeFUirEDqiYe_QJysKXgu8JG506Nu1tN0ymoBEhgAMrBi4kJUs3b8amGblSE5KHDc3JM0xfhX6VwAL3Hwcxx77SuWiwHmwqaqqKtq7bkPDuSrvpQ Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.54 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9dacb0d82cf64aa8a1754545ca7515b1 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerShowV254Test-948810921 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9dacb0d82cf64aa8a1754545ca7515b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dacb0d82cf64aa8a1754545ca7515b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9dacb0d82cf64aa8a1754545ca7515b1", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dacb0d82cf64aa8a1754545ca7515b1"}]}] Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerShowV254Test-948810921 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9dacb0d82cf64aa8a1754545ca7515b1 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerShowV254Test-948810921 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerShowV254Test-948810921-project Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 153c655e31c24f7883784a4ad9a820d0 Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerShowV254Test-948810921-project Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 36e06984-02ca-4883-9ad9-c5e543e7cf9d could not be found. Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '36e06984-02ca-4883-9ad9-c5e543e7cf9d'} Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e06984-02ca-4883-9ad9-c5e543e7cf9d could not be found. Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e06984-02ca-4883-9ad9-c5e543e7cf9d could not be found. Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:50.113103 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:50.118461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:50.118461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:50.118461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:50.118461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:50.118461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:50.118461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e06984-02ca-4883-9ad9-c5e543e7cf9d could not be found. Aug 27 03:30:50.118461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:30:50.119860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] Returning 404 to user: Instance 36e06984-02ca-4883-9ad9-c5e543e7cf9d could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:50.121265 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-18e44c8d-51d1-4b22-b973-5fcfae6f065c tempest-ServerShowV254Test-948810921 tempest-ServerShowV254Test-948810921-project] 10.222.0.69 "GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d" status: 404 len: 111 microversion: 2.54 time: 0.041992 Aug 27 03:30:50.122028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2443/4708] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:50 2022] GET /compute/v2.1/servers/36e06984-02ca-4883-9ad9-c5e543e7cf9d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:30:50.607373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:50.608033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:50.627056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.628091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.629699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.632070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.634595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.635897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.799382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:50.805769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:50.806432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:50.814485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.815087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.815414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.816458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.817196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.817757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.823240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:50.836845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:50.840324 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37615daa-2c30-446e-8e14-dff342a6f81f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.238558 Aug 27 03:30:50.841156 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2266/4709] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:50 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:51.075012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:51.086750 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ae4cc41-7264-454c-b802-235ca8792a52 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1506 microversion: 2.1 time: 0.284589 Aug 27 03:30:51.092436 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2444/4710] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:50 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:51.108355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:51.109144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:51.139195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.139663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.140101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.141949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.142448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.144925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.444838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:51.455657 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39e4898b-4a43-49bc-a968-8e464024e912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1506 microversion: 2.1 time: 0.351475 Aug 27 03:30:51.457117 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2267/4711] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:51 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:51.478495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:51.481873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:51.504437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.505921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.507548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.511710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.512390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.513034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.709384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:30:51.709827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:30:51.710329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:30:51.710783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:30:51.711149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:30:51.855489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:51.872252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:51.873532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:51.884969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.885575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.887042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.887802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.888337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.888854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.890726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.897625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.898103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.909128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.910058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.911011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.936521 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-36c14635-d8a4-48a8-8586-a43f62616cc9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "POST /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e/action" status: 202 len: 1108 microversion: 2.1 time: 0.463867 Aug 27 03:30:51.952919 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2445/4712] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:51 2022] POST /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e/action => generated 1108 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:30:51.970525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:51.970525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:52.009629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:52.010553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:52.011318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:52.019784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:52.023775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:52.025035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:52.083805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:52.118272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:52.131670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:52.137353 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc0b36c6-2d26-4c67-a2bb-e167dedd0798 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.269109 Aug 27 03:30:52.139231 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2268/4713] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:51 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:52.773164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:52.803738 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bcaf3f65-d708-4c3d-bb6e-e9ce19e75e84 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.846874 Aug 27 03:30:52.806733 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2446/4714] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:51 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:53.173066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:53.173595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:53.194102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:53.194424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:53.194687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:53.199531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:53.200176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:53.200871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:53.293039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:53.308048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:53.314784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:53.322624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:53.323959 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab46de8c-1d3b-4e91-adfe-72f9d022b716 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.155819 Aug 27 03:30:53.327078 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2269/4715] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:53 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:53.827563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:53.829791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:53.846375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:53.850631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:53.851709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:53.852673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:53.856627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:53.857356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:54.354652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:54.355308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:54.373322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:54.376186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:54.380513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:54.381751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:54.382583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:54.383073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:54.384262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:54.396056 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3c1b9db9-75f4-436d-942d-dc5a2af7ce2c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.570611 Aug 27 03:30:54.397718 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2447/4716] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:53 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:54.577402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:54.592783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:54.595889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:54.603170 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7e6815c-e113-4434-a1a2-aacbfb20084a tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.254432 Aug 27 03:30:54.607384 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2270/4717] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:54 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:55.436598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:55.439033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:55.452887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:55.459895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:55.460839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:55.461825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:55.462528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:55.466339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:55.633463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:55.634708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:55.640715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:55.641211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:55.641651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:55.642415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:55.642880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:55.643311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:55.902985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:55.918813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:55.924009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:55.926702 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b22ff48-985b-4395-90cb-b598a90873db tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.298719 Aug 27 03:30:55.930059 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2271/4718] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:55 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:30:55.993521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:56.009729 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4792f02-dc1f-42f5-b576-f93940d42b1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.577209 Aug 27 03:30:56.013474 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2448/4719] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:55 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:56.960133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:56.961515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:56.984386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:56.984889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:56.985332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:56.993606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:56.994423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:56.995152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:57.037232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:57.039152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:57.084555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:57.085080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:57.094856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:57.095637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:57.096124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:57.096559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:57.560601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:57.601266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:57.612074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:57.615838 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6deebe4-48c8-4ba4-af39-76794dbfec4f tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1603 microversion: 2.32 time: 0.662379 Aug 27 03:30:57.619738 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2272/4720] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:56 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1603 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:57.687667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:57.711524 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5186afda-235d-43fb-9d02-886c745e5cfd tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.682030 Aug 27 03:30:57.725648 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2449/4721] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:57 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:58.650635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:58.652026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:58.666566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:58.672349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:58.677066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:58.678780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:58.681675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:58.682759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:58.684760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:58.750482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:58.756051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:58.791865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:58.792496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:58.797277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:58.801045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:58.807348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:58.809384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:58.920025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:58.921483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:58.922191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:58.931140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lazy-loading 'fault' on Instance uuid ca299f7e-6f85-46ea-97a1-66a49929589b {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:30:59.169219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:59.200209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:59.201891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e04f79ef1a24f97a2475c8a8b6ae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a99adf57f6b4eb0a3d5db791cc29e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:59.209755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7f86cbd-6d3b-4928-844f-18e24a34084d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 200 len: 1608 microversion: 2.32 time: 0.564091 Aug 27 03:30:59.216130 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2273/4722] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:30:58 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 1608 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:30:59.386136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:59.399903 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-864f6680-0e38-40cb-a705-d621f450673f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.668242 Aug 27 03:30:59.404870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2450/4723] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:58 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:00.248758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:00.250760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:00.309187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:00.310148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:00.311229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:00.312157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:00.312860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:00.313599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:00.363779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] HTTP exception thrown: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Request method failure captured: Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b HTTP/1.1 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY4mn6Su0_CTcpGm2uOykQy5lQFz9Q-Ib4-xr0Y7g0kmlEwcIcPhCUPpdx2mgf4RYezOZnz9LEJyqP55Yq_xn_9J_kpl6DcFRqMW-zIZ69t6cHT6kLD50PAB_WMj-U1-IARvJlyqMTpGxqKvq838B_gw_n3eo9wxFY5dmyq0dHd54ng Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8a99adf57f6b4eb0a3d5db791cc29e46 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8a99adf57f6b4eb0a3d5db791cc29e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8a99adf57f6b4eb0a3d5db791cc29e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8a99adf57f6b4eb0a3d5db791cc29e46", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8a99adf57f6b4eb0a3d5db791cc29e46"}]}] Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8a99adf57f6b4eb0a3d5db791cc29e46 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TaggedBootDevicesTest-1301022703-project Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 4e04f79ef1a24f97a2475c8a8b6ae14c Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TaggedBootDevicesTest-1301022703-project Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ca299f7e-6f85-46ea-97a1-66a49929589b'} Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:00.365900 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:00.370711 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:00.377577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Returning 404 to user: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:00.386808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d579da34-bf57-4b27-9a9f-106ff058fb6e tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 404 len: 111 microversion: 2.32 time: 0.138256 Aug 27 03:31:00.388116 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2274/4724] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:31:00 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:31:00.399249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4fcea828-2187-4368-a88e-4a1f67b3bc5d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '.version_select at 0x7fe457baa1f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:00.435686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:00.436612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:00.453862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:00.457261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:00.462910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:00.465276 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4fcea828-2187-4368-a88e-4a1f67b3bc5d tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488282231" status: 204 len: 0 microversion: 2.32 time: 0.072383 Aug 27 03:31:00.466924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:00.469110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:00.470152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:00.474744 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2451/4725] 10.222.0.69 () {60 vars in 1259 bytes} [Sat Aug 27 03:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488282231 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:31:01.090960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:01.101783 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff922342-dcb2-45cf-bbf3-9f7afdd00404 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.669994 Aug 27 03:31:01.115951 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2275/4726] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:00 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:01.971359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-503719631", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "40826f3a-dfd3-4261-a575-fcf9e7851f65"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:02.094180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] validate_networks() for [('40826f3a-dfd3-4261-a575-fcf9e7851f65', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:31:02.142048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:02.143337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:02.158448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:02.162958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:02.166279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:02.167285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:02.168017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:02.175974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:02.980057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:02.993693 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-715e03f4-da2d-4750-b470-f1ea71c8245f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.853241 Aug 27 03:31:03.010498 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2276/4727] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:02 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:03.056972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:03.057519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:03.060412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:03.060979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:03.061524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:03.080394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:03.081626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:03.083696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:03.084567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:03.089922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:03.090737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:03.169182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Getting quotas for project 6f4ff72b17904946adb501a0c4160597. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:03.180818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Getting quotas for user 480a7803522d46c784f31c8e6d1ee39f and project 6f4ff72b17904946adb501a0c4160597. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:03.197757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:31:03.201604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:31:03.313392 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3283a0a6-a105-4c7f-9b94-0aff43ebe69d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813744 Aug 27 03:31:03.314332 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2452/4728] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:31:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:31:03.340569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5789f8f5-6321-4b92-b4e7-1f0dd06b6160 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:03.342955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5789f8f5-6321-4b92-b4e7-1f0dd06b6160 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:03.559577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5789f8f5-6321-4b92-b4e7-1f0dd06b6160 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:03.572980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5789f8f5-6321-4b92-b4e7-1f0dd06b6160 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1227 microversion: 2.1 time: 0.241528 Aug 27 03:31:03.574006 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2277/4729] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:03 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1227 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:04.015891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:04.017055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:04.049956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:04.051304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:04.056157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:04.058623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:04.060688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:04.062741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:04.112846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:04.465408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c19a71f-8704-43b3-a62c-224f599dffe4"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:04.468360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:04.494137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:04.499447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:04.500300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:04.501726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:04.506776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:04.508970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:04.595301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:04.639427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5b8edf1-8446-4d26-a09d-9b17fc48b54b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.626171 Aug 27 03:31:04.652032 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2453/4730] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:04 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:04.709233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:04.730675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:04.782900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:04.784191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:04.787083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:04.788653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:04.790047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:04.791046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:04.968629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:04.986122 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea0b4116-5b6e-41f1-b9fa-c764b414cf5f tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1231 microversion: 2.1 time: 0.331152 Aug 27 03:31:04.988932 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2454/4731] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:04 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1231 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:05.292672 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2d3877b-dfb5-4ce1-8ff6-3811f25a9950 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831634 Aug 27 03:31:05.298457 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2278/4732] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:31:04 2022] POST /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:05.677956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:05.678602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:05.691420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:05.695579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:05.696052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:05.696811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:05.697278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:05.704453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:06.034779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:06.040230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:06.057005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:06.059566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:06.065765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:06.070091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:06.070843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:06.071491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:06.241624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:06.257540 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3bf7384-f2d4-441c-90d1-f00c66d5d1aa tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1279 microversion: 2.1 time: 0.233816 Aug 27 03:31:06.261602 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2279/4733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:06 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:06.470893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf9a4ea4-1ffa-4fa8-bca9-8b4a0713d587 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'create', calling method: .version_select at 0x7fe4574bd5e0>, body: {"keypair": {"name": "tempest-keypair-1774491639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW/e5u5/51zekmuIp+mWSdbHslMoA72R4taom2ggZl2lLvPlViULIQ2oCFMH/mbuogEMSurHw38zt1qiGWgXTM1cELPaB/b1gcVrVlheCMPMGWV52kLwCKN1AuLiq2sCw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:06.531683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bf9a4ea4-1ffa-4fa8-bca9-8b4a0713d587 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:06.566625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bf9a4ea4-1ffa-4fa8-bca9-8b4a0713d587 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for user 1470dd7c067e4c3c86b6f610d3e59262 and project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:06.664473 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf9a4ea4-1ffa-4fa8-bca9-8b4a0713d587 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401398 Aug 27 03:31:06.668478 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2280/4734] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:31:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:07.136839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:07.154179 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-69e259f3-9ab2-4b64-9dd5-b09cf1569b66 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 1.479659 Aug 27 03:31:07.159479 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2455/4735] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:05 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:07.285343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:07.287130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:07.313737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:07.315850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:07.324373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:07.326076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:07.327982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:07.329727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:07.529678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:07.541069 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46089552-8b90-48ce-941d-7c7c2c65f24b tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1285 microversion: 2.1 time: 0.261696 Aug 27 03:31:07.544940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2281/4736] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:07 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:08.185926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:08.186759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:08.208149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:08.212891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:08.213369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:08.214227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:08.214869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:08.218789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:08.567173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:08.567705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:08.586771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:08.587287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:08.587730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:08.588459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:08.594502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:08.595035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:08.954693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:09.007264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-be6f2402-4e31-4e9e-8011-6c7cfaf0cdaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.825904 Aug 27 03:31:09.016477 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2456/4737] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:08 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:09.094656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:09.131018 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6cc693a5-9ec0-44c4-a4d1-ed7b7496cb94 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.564181 Aug 27 03:31:09.132321 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2282/4738] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:08 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:09.383545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c1decc66-77e9-4765-937b-853435d2613c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: .version_select at 0x7fe457e5b9d0>, body: {"keypair": {"name": "tempest-keypair-1630755077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCL1jldvSp5SPxj+5zUhKLUtTI0W1sm2M5SblcIusZaQ4UZFDvGOcs5bn8XCtgpXIdERsdwViB/gl4PkUpBdf8ETBgb3ZXsjDqlSOyNTgO4XH3fZlcCMtQryxzzeiJMTg=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:09.447380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c1decc66-77e9-4765-937b-853435d2613c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:09.472619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c1decc66-77e9-4765-937b-853435d2613c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:09.578899 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c1decc66-77e9-4765-937b-853435d2613c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201274 Aug 27 03:31:09.596921 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2457/4739] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:31:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:10.032670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:10.033553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:10.061142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:10.061923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:10.067847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:10.069075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:10.069835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:10.070595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:10.152565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:10.153447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:10.172105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:10.176810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:10.177684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:10.181897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:10.186452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:10.191123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:11.078035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:11.098862 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95ff9bd5-3c5c-40fb-85f3-26b0683733a6 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.946374 Aug 27 03:31:11.116114 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2458/4740] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:10 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:11.219202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:11.228666 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55dd9f45-1ffa-49b5-917a-4f37da1d22ee tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 1.200577 Aug 27 03:31:11.233969 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2283/4741] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:10 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:11.572538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-830ae2cb-2bf2-4696-85f4-aef6d90010e0 req-f7c23f18-fd63-4a28-af66-2c8ec27f127d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731dcd04-a6a4-424b-950d-14c64e27fa7a", "tag": "dc4cbdf0-93a2-435e-9ba5-fe483eecf8a3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:11.623033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-830ae2cb-2bf2-4696-85f4-aef6d90010e0 req-f7c23f18-fd63-4a28-af66-2c8ec27f127d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:11.627597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-830ae2cb-2bf2-4696-85f4-aef6d90010e0 req-f7c23f18-fd63-4a28-af66-2c8ec27f127d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:11.628281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-830ae2cb-2bf2-4696-85f4-aef6d90010e0 req-f7c23f18-fd63-4a28-af66-2c8ec27f127d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:11.655630 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-830ae2cb-2bf2-4696-85f4-aef6d90010e0 req-f7c23f18-fd63-4a28-af66-2c8ec27f127d service nova] Creating event network-changed:dc4cbdf0-93a2-435e-9ba5-fe483eecf8a3 for instance 731dcd04-a6a4-424b-950d-14c64e27fa7a on n-h2-852086-5 Aug 27 03:31:11.686079 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-830ae2cb-2bf2-4696-85f4-aef6d90010e0 req-f7c23f18-fd63-4a28-af66-2c8ec27f127d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113489 Aug 27 03:31:11.689817 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2459/4742] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:12.121190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:12.122123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:12.138571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:12.139089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:12.139543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:12.140299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:12.140775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:12.141204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:12.253943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:12.255433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:12.257765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:12.276239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:12.286257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:12.287120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:12.288115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:12.290316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:12.291809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:12.750365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:12.787961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6a44e153-a01f-4fc8-a02b-a050189f98d1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.538713 Aug 27 03:31:12.794864 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2460/4743] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:12 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:12.885617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1025269708", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bfc3c8c-fa3d-497c-bef6-083c416b049d"}], "security_groups": [{"name": "tempest-securitygroup--1001276803"}], "key_name": "tempest-keypair-1774491639", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:13.108739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:13.342935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] validate_networks() for [('3bfc3c8c-fa3d-497c-bef6-083c416b049d', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:31:13.347658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:13.371730 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afbd16b2-8b32-404d-a964-7cd61d100be7 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 1.256107 Aug 27 03:31:13.389690 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2284/4744] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:12 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:13.816401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:13.817036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:13.833258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:13.836021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:13.838520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:13.840411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:13.846969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:13.850813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:14.844421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:14.869921 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af93b65c-4c7f-4b53-913f-a63844ad0c40 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 1.057319 Aug 27 03:31:14.884571 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2285/4745] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:13 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:14.922953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:14.924072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:14.942185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:14.942997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:14.943622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:14.945813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:14.949517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:14.950295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:15.771053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:15.784857 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-919bdb2e-2ddc-4658-b88d-904ffa348b35 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.896749 Aug 27 03:31:15.787815 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2286/4746] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:14 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:15.808261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:15.809075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:15.835077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:15.835593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:15.836032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:15.837094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:15.837574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:15.838056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:15.897087 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] HTTP exception thrown: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Request method failure captured: Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b HTTP/1.1 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY4mn6Su0_CTcpGm2uOykQy5lQFz9Q-Ib4-xr0Y7g0kmlEwcIcPhCUPpdx2mgf4RYezOZnz9LEJyqP55Yq_xn_9J_kpl6DcFRqMW-zIZ69t6cHT6kLD50PAB_WMj-U1-IARvJlyqMTpGxqKvq838B_gw_n3eo9wxFY5dmyq0dHd54ng Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8a99adf57f6b4eb0a3d5db791cc29e46 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8a99adf57f6b4eb0a3d5db791cc29e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8a99adf57f6b4eb0a3d5db791cc29e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8a99adf57f6b4eb0a3d5db791cc29e46", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8a99adf57f6b4eb0a3d5db791cc29e46"}]}] Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8a99adf57f6b4eb0a3d5db791cc29e46 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TaggedBootDevicesTest-1301022703-project Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 4e04f79ef1a24f97a2475c8a8b6ae14c Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TaggedBootDevicesTest-1301022703-project Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ca299f7e-6f85-46ea-97a1-66a49929589b'} Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:15.909799 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:15.919945 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:31:15.925399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Returning 404 to user: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:15.942445 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49978df2-fd60-44e1-a43e-660c9573322c tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 404 len: 111 microversion: 2.32 time: 0.139780 Aug 27 03:31:15.947776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2287/4747] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:31:15 2022] DELETE /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:31:15.956526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:15.975031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:16.009093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.009958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.021507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.022645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.023487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.024303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.029802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:16.091749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:16.092296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:16.092900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:16.093525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:16.094881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:16.130905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.132145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.132952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.135947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.142626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.144046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.216848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:16.249363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for user 1470dd7c067e4c3c86b6f610d3e59262 and project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:16.293109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:31:16.312225 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6bc42e86-4491-46ff-9756-ca5d4479b8e5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.360819 Aug 27 03:31:16.312916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:31:16.316927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2288/4748] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:31:15 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:16.336175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.337534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:16.365352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.380486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.384415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.386911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.392526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.394293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.605216 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce3faa90-1852-416a-b30c-3673c9c9045f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.723956 Aug 27 03:31:16.608528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:16.611765 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2461/4749] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:31:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:31:16.617823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.618484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] [instance: ca299f7e-6f85-46ea-97a1-66a49929589b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:16.685143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.685648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.686092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.686850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.687308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.687732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.756035 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] HTTP exception thrown: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Request method failure captured: Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b HTTP/1.1 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY4mn6Su0_CTcpGm2uOykQy5lQFz9Q-Ib4-xr0Y7g0kmlEwcIcPhCUPpdx2mgf4RYezOZnz9LEJyqP55Yq_xn_9J_kpl6DcFRqMW-zIZ69t6cHT6kLD50PAB_WMj-U1-IARvJlyqMTpGxqKvq838B_gw_n3eo9wxFY5dmyq0dHd54ng Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8a99adf57f6b4eb0a3d5db791cc29e46 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8a99adf57f6b4eb0a3d5db791cc29e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8a99adf57f6b4eb0a3d5db791cc29e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8a99adf57f6b4eb0a3d5db791cc29e46", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8a99adf57f6b4eb0a3d5db791cc29e46"}]}] Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8a99adf57f6b4eb0a3d5db791cc29e46 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1301022703 Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TaggedBootDevicesTest-1301022703-project Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 4e04f79ef1a24f97a2475c8a8b6ae14c Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TaggedBootDevicesTest-1301022703-project Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ca299f7e-6f85-46ea-97a1-66a49929589b'} Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:16.758370 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. Aug 27 03:31:16.762783 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:16.764689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] Returning 404 to user: Instance ca299f7e-6f85-46ea-97a1-66a49929589b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:16.766242 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5988089-5dcc-459a-bbb9-91af23315f58 tempest-TaggedBootDevicesTest-1301022703 tempest-TaggedBootDevicesTest-1301022703-project] 10.222.0.69 "GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b" status: 404 len: 111 microversion: 2.32 time: 0.152328 Aug 27 03:31:16.772221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2462/4750] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:31:16 2022] GET /compute/v2.1/servers/ca299f7e-6f85-46ea-97a1-66a49929589b => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:31:16.782696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:16.783249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:16.822198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.822731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.823181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:16.827207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:16.827702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:16.828149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:17.084379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.097533 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea196768-bad5-4af4-b80d-e06b8ac7cd2f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.777121 Aug 27 03:31:17.110855 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2289/4751] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:16 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.140212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1953166692", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37d2c35e-4ba5-4e30-b147-136ed6948e64"}], "security_groups": [{"name": "tempest-securitygroup--128838456"}], "key_name": "tempest-keypair-1630755077", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:17.374805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] validate_networks() for [('37d2c35e-4ba5-4e30-b147-136ed6948e64', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:31:17.390497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.421925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0dfd553-5eef-48b5-a8c5-4848a93c90bd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1670 microversion: 2.1 time: 0.647140 Aug 27 03:31:17.422578 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2463/4752] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:16 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1670 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.439489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-554e239f-2eb9-47f1-8ef3-e5d9d14a0729 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.440167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-554e239f-2eb9-47f1-8ef3-e5d9d14a0729 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:17.654415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-554e239f-2eb9-47f1-8ef3-e5d9d14a0729 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:17.670430 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-554e239f-2eb9-47f1-8ef3-e5d9d14a0729 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1238 microversion: 2.1 time: 0.246428 Aug 27 03:31:17.671041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2464/4753] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:17 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1238 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:17.716147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:17.716792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:17.750389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:17.758102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:17.760236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:17.761062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:17.761554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:17.761999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.166272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.183386 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d88e325-8746-4f9c-a724-7a4ddc8a3cd0 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.490810 Aug 27 03:31:18.184198 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2465/4754] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:17 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.189120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.193956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:18.233629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.234135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.234787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.235547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.238693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.239206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.583875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:18.585056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:18.585706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:18.587040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:18.587641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:18.599354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.600078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.600674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.601729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.602393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.603018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.630545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:18.637123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:18.647505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.654799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:31:18.657483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:31:18.658490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce9d36d6-686a-4632-876e-5bf41aba7e19 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.473036 Aug 27 03:31:18.659854 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2466/4755] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:18 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.670198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.671109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:18.694522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.696066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.697185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.698273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.700024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.700944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.736523 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88cfc89c-a2fc-4271-8254-b51ae4933acd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.623306 Aug 27 03:31:18.744853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2290/4756] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:31:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:18.751633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.752658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:18.761012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.761889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.762639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.763602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:18.764659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:18.765400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:18.891643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.903727 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20b7339d-7626-4060-b6e6-7cd323a60618 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1290 microversion: 2.1 time: 0.157484 Aug 27 03:31:18.905059 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2291/4757] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:18 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1290 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:18.911731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6ec20a8-4660-4c1b-8368-e3376afec616 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:18.912408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6ec20a8-4660-4c1b-8368-e3376afec616 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:18.945601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:18.967310 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-981cbbf6-e377-4544-ae85-ac1b1936b816 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1670 microversion: 2.1 time: 0.306103 Aug 27 03:31:18.983051 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2467/4758] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:18 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.039947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6ec20a8-4660-4c1b-8368-e3376afec616 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.051719 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6ec20a8-4660-4c1b-8368-e3376afec616 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1242 microversion: 2.1 time: 0.144927 Aug 27 03:31:19.066398 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2292/4759] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:18 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1242 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.214095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.217924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:19.250706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.251983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.254018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.256580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.260811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.263487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.683491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.684109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:19.691637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.702050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.702935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.706700 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eea6ee61-09e1-4463-a80b-3bfe0cee52bb tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.504410 Aug 27 03:31:19.706927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.707569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.708057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.708502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.709382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2468/4760] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:19 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:19.931756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.932869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:19.949230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.949870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.950894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.951829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:19.952291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:19.952718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:19.958398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:19.966989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abb81f17-f7fb-4c9f-a0ae-4a6bb1d559c3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.287680 Aug 27 03:31:19.982524 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2293/4761] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:19 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:19.994965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:19.994965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:20.015755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.016476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.017112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.018600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.019705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.030737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.098955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.109960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-027a88b1-0712-4fef-bc0a-1cae76e446fe tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1296 microversion: 2.1 time: 0.183225 Aug 27 03:31:20.126565 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2469/4762] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:19 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:20.133962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.134927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:20.145574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.147244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.148027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.149011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.149668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.150374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.248668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.281430 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4db4ccc-ac23-484a-ad51-c41034eabacf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1246 microversion: 2.1 time: 0.133760 Aug 27 03:31:20.282548 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2470/4763] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:20 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1246 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:20.308652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cc0921d9-34cc-43c9-ac99-39ab1c41a576 req-7cdf98e2-8f9c-4038-92b0-4306ac046e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731dcd04-a6a4-424b-950d-14c64e27fa7a", "name": "network-vif-plugged", "status": "completed", "tag": "dc4cbdf0-93a2-435e-9ba5-fe483eecf8a3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:20.323580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc0921d9-34cc-43c9-ac99-39ab1c41a576 req-7cdf98e2-8f9c-4038-92b0-4306ac046e67 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.336554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc0921d9-34cc-43c9-ac99-39ab1c41a576 req-7cdf98e2-8f9c-4038-92b0-4306ac046e67 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.337568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc0921d9-34cc-43c9-ac99-39ab1c41a576 req-7cdf98e2-8f9c-4038-92b0-4306ac046e67 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.368482 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cc0921d9-34cc-43c9-ac99-39ab1c41a576 req-7cdf98e2-8f9c-4038-92b0-4306ac046e67 service nova] Creating event network-vif-plugged:dc4cbdf0-93a2-435e-9ba5-fe483eecf8a3 for instance 731dcd04-a6a4-424b-950d-14c64e27fa7a on n-h2-852086-5 Aug 27 03:31:20.376881 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cc0921d9-34cc-43c9-ac99-39ab1c41a576 req-7cdf98e2-8f9c-4038-92b0-4306ac046e67 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072364 Aug 27 03:31:20.378743 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2471/4764] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:20.408785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:20.422592 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e00d919-1ae6-49e7-a16d-1ff48249531e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1675 microversion: 2.1 time: 0.433123 Aug 27 03:31:20.428472 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2294/4765] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:19 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1675 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:20.737549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:20.740018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:20.754143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.755518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.756681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:20.758361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:20.759518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:20.760604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.013126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.018943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:21.040537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.041027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.041479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.042223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.042895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.043487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.046112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.061019 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1ce1dfcf-10bb-4ade-8ad4-d2700fa696e9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.332214 Aug 27 03:31:21.065467 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2472/4766] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:20 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.138645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.142865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:21.155077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.155946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.156725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.159230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.159709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.160127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.433414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.450011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a338da2c-e259-4e73-9b20-17941f31ed1e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.449734 Aug 27 03:31:21.450639 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2295/4767] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:20 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.467500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.472825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:21.487858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.488809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.489358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.490098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.500925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.501421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.530383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.583432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7905d3c2-3ac4-4e81-8810-ef701b5f7b1a tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.452991 Aug 27 03:31:21.603587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2473/4768] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:21 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:21.621445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:21.628516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:21.650020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.654625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.655187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.656228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:21.659205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:21.661636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:21.720463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.741193 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83df7b24-6f3b-46b7-9101-534e3a61ea50 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1246 microversion: 2.1 time: 0.277549 Aug 27 03:31:21.747600 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2296/4769] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:21 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1246 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:21.972370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:21.983322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:22.017055 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2aa5270b-14ad-45b3-8834-a1ee628d5562 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1675 microversion: 2.1 time: 0.408399 Aug 27 03:31:22.024922 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2474/4770] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:21 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1675 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:22.099412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.100856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:22.115371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.116995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.119915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.121042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.121679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.123411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.492615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.493383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:22.505361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:22.514310 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c584ee1-428b-4027-b7bd-5e527b142249 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.419096 Aug 27 03:31:22.515367 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2297/4771] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:22 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:22.533491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.535653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.536504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.538244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.540151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.540984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.642472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.645316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:22.655146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.656017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.656796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.668770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.669762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.681267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.780970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:22.794963 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c3febd3-1aee-4b6d-a7f2-3f23dcc96b5e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.306968 Aug 27 03:31:22.796160 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2475/4772] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:22 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:22.806654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:22.807804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:22.827652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.828592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.829242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.830182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:22.831776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:22.832191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:22.911335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:22.920544 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a968eb1c-05af-4ccb-80a0-5371ee66e078 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1246 microversion: 2.1 time: 0.123076 Aug 27 03:31:22.921335 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2476/4773] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:22 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.031694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.051043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.053426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:23.054132 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bb569d3-ebc3-46bd-a40d-d93bbb03bbc5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.420856 Aug 27 03:31:23.062807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.063745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.064399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.066964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.068011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.071304 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2298/4774] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:22 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.075303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.084417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f13714c4-60f2-48ab-92f7-ba8a6e6323bc req-b36b5b4c-387a-4875-bede-06191b6e506b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7db87c-e21a-4282-90f4-a393fe1104b8", "tag": "f20f1ec1-d2ba-4dee-8de9-1a3971b9103f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:23.102623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f13714c4-60f2-48ab-92f7-ba8a6e6323bc req-b36b5b4c-387a-4875-bede-06191b6e506b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.103345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f13714c4-60f2-48ab-92f7-ba8a6e6323bc req-b36b5b4c-387a-4875-bede-06191b6e506b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.103519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f13714c4-60f2-48ab-92f7-ba8a6e6323bc req-b36b5b4c-387a-4875-bede-06191b6e506b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.120303 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f13714c4-60f2-48ab-92f7-ba8a6e6323bc req-b36b5b4c-387a-4875-bede-06191b6e506b service nova] Creating event network-changed:f20f1ec1-d2ba-4dee-8de9-1a3971b9103f for instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 on n-h1-852086-5 Aug 27 03:31:23.137461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f13714c4-60f2-48ab-92f7-ba8a6e6323bc req-b36b5b4c-387a-4875-bede-06191b6e506b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057916 Aug 27 03:31:23.138383 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2299/4775] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:23.537689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.538257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:23.552942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.553451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.553893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.554645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.555103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.555530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.638317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.653541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-63600fb8-c0ab-4a7f-aa49-8d695cbe6b2e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1675 microversion: 2.1 time: 0.608407 Aug 27 03:31:23.654909 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2477/4776] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:23 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1675 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.725680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:23.735118 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0af5c051-2073-4af8-8b7f-b32ff7656e99 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.203092 Aug 27 03:31:23.735704 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2300/4777] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:23 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:23.840404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.841446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:23.848917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.849543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.850089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.851114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.851883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.852477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.954145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:23.959743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:23.971490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.977819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.978519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:23.979440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:23.981578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:23.982244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.082751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.103247 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2057396f-c36e-4a61-bd26-551be39a5839 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1513 microversion: 2.1 time: 0.266834 Aug 27 03:31:24.118356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2478/4778] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:23 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.128783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.130647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:24.146175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.147303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.148142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.152608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.156804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.157468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.226292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.234277 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a00919f3-bcf5-4cf5-bae4-cdbd9d15f42b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1246 microversion: 2.1 time: 0.284396 Aug 27 03:31:24.234882 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2301/4779] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:23 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1246 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.391106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.401331 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1fada469-e9de-4119-a66b-ce952d723521 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.281245 Aug 27 03:31:24.402575 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2479/4780] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:24 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:24.688570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.689237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:24.695857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.697020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.697673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.698657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.699337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.700004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.755921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:24.756547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:24.774713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.775217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.775669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.776388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:24.776852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:24.777282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:24.946077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:24.957315 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c22b2856-8c81-4369-bfa3-23d854224554 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1675 microversion: 2.1 time: 0.273032 Aug 27 03:31:24.958669 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2302/4781] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:24 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.038131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.053832 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ffe007e1-d522-4172-b06d-0b8c5bb63633 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.301673 Aug 27 03:31:25.061394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2480/4782] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:24 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.124946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.125559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:25.133940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.134905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.135695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.136669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.137290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.137881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.256471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.258191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:25.274551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.274551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.274551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.277733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.278267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.278719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.351981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.353127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.361517 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a3692e33-ac2a-4c6c-856a-353d2b00c9ef tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1246 microversion: 2.1 time: 0.109679 Aug 27 03:31:25.366215 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2481/4783] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:25 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:25.366843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49e6c98d-9c2b-488f-949d-d4900e559aaa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1519 microversion: 2.1 time: 0.242416 Aug 27 03:31:25.367809 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2303/4784] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:25 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.422548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.423426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:25.430544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.431034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.431464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.432217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.432702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.433100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.638451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:25.648371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e954f51b-724a-40da-95bb-e84e263bf00d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.229863 Aug 27 03:31:25.661839 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2482/4785] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:25 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:25.982968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:25.983759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:25.993077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.994040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.994852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:25.996145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:25.997048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:25.997919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.082302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.083415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:26.091675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.092352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.092891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.093717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.094460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.094992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.177777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:26.264193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.308185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.317860 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b38e3c5-9980-42ee-a99a-baf7d9216ff3 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.240520 Aug 27 03:31:26.318520 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2483/4786] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:26 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.336863 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dfbb5d0d-08b6-4d63-919c-65f1a47e74c2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.360017 Aug 27 03:31:26.345691 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2304/4787] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:25 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.389420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.390416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:26.391057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.392113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:26.404004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.404512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.407542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.408006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.409462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.409753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.410187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.411061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.413818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.414410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.417579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.418063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.562815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.577185 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d71de7d3-0de5-4c4e-af5c-110c6a1a95c6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1246 microversion: 2.1 time: 0.190130 Aug 27 03:31:26.578056 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2305/4788] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:26 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1246 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.673670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:26.674544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:26.694875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.698379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.700042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.702421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:26.706887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:26.707678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:26.716478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:26.867395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.880439 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc23f109-0f0b-4eba-8ed7-68af0a54c1b0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1519 microversion: 2.1 time: 0.495116 Aug 27 03:31:26.882275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2484/4789] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:26 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1519 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:26.959361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:26.968371 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a8b70fa-85f0-444e-8684-452cd0273a40 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.300476 Aug 27 03:31:26.978984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2306/4790] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:26 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:27.350251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.350738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:27.375683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:27.380206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:27.380366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.380963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.381479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.382345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.383374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.383896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.414343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:27.418845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.419573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.421302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.430195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.430705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.431155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.506380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'flavor' on Instance uuid d8427f5b-2531-4195-b370-6e0a7564ad16 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:31:27.650804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:27.670710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a4f7879-2e81-48d1-a675-66e16a498752 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1327 microversion: 2.1 time: 0.329412 Aug 27 03:31:27.672051 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2485/4791] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:27 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1327 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:27.682794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.684068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:27.693601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:27.696742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.698116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.699907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.701473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.702741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.704096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.803286 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-540ea46f-f1bd-4785-b433-b1d685cfe862 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/action" status: 200 len: 32 microversion: 2.1 time: 0.432835 Aug 27 03:31:27.809661 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2307/4792] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:31:27 2022] POST /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:31:27.816711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.817853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:27.828922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.829457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.832082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.833869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.834442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.834891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.847070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:27.865115 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7291056e-2171-4df3-98fb-1bd113486980 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1294 microversion: 2.1 time: 0.191166 Aug 27 03:31:27.866304 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2486/4793] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:27 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1294 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:27.906035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:27.917753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:27.929927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.931830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.932642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:27.934038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:27.935448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:27.936233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:28.056038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.066543 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-feecdb45-cdeb-42aa-af2d-42d15ce8d01a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.254577 Aug 27 03:31:28.067158 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2308/4794] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:27 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:28.072136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:28.073222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:28.084855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:28.085746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:28.087178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:28.088262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:28.089163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:28.090022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:28.188094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.196870 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4efe134-9ba7-4dfa-bea1-2db45eb12816 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1519 microversion: 2.1 time: 0.297745 Aug 27 03:31:28.198013 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2487/4795] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:27 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1519 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:28.300375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:28.315482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48ff016c-603d-4bd7-a482-79ef0ea11a16 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.245572 Aug 27 03:31:28.316772 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2309/4796] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:28 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:28.693290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:28.694719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:28.709258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:28.709753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:28.710198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:28.710699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ce53932a-b957-4a30-a2fa-0ae94d4d4fa0 req-83df55a6-2e38-46c1-9e28-893fa76b78a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54115f30-fe92-4a2c-8fb2-e90281f3d35e", "name": "network-vif-plugged", "status": "completed", "tag": "1d21c5f4-68f1-4861-a5bc-8e9490fda880"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:28.726451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:28.730406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:28.731070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:28.731469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:28.737299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce53932a-b957-4a30-a2fa-0ae94d4d4fa0 req-83df55a6-2e38-46c1-9e28-893fa76b78a0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:28.737808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce53932a-b957-4a30-a2fa-0ae94d4d4fa0 req-83df55a6-2e38-46c1-9e28-893fa76b78a0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:28.738274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce53932a-b957-4a30-a2fa-0ae94d4d4fa0 req-83df55a6-2e38-46c1-9e28-893fa76b78a0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:28.761000 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ce53932a-b957-4a30-a2fa-0ae94d4d4fa0 req-83df55a6-2e38-46c1-9e28-893fa76b78a0 service nova] Creating event network-vif-plugged:1d21c5f4-68f1-4861-a5bc-8e9490fda880 for instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e on n-h1-852086-5 Aug 27 03:31:28.777523 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ce53932a-b957-4a30-a2fa-0ae94d4d4fa0 req-83df55a6-2e38-46c1-9e28-893fa76b78a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070518 Aug 27 03:31:28.778147 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2310/4797] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:28.889373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:28.890140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:28.906762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:28.907341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:28.907724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:28.908450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:28.921571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:28.922739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:29.045854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:29.241669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.252963 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0623b875-5003-42c4-9217-f5ffe780cb05 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1312 microversion: 2.1 time: 0.367645 Aug 27 03:31:29.268209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2311/4798] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:28 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1312 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:29.275415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.276456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:29.284181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:29.285031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:29.286516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:29.287562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:29.288447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:29.289146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:29.474468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.487735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4370824b-2401-4cb0-90a6-a6d4a6d1f036 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1527 microversion: 2.1 time: 0.798628 Aug 27 03:31:29.494767 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2488/4799] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:28 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1527 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:29.504462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.504462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:29.523480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:29.524634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:29.527207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:29.528151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:29.530182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:29.531492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:29.888327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:29.899117 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a95077e0-169f-445b-8b87-b2e982a7d586 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.629386 Aug 27 03:31:29.921335 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2312/4800] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:29 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:29.936225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:29.938442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:29.958985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:29.959508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:29.959960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:29.963272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:29.963804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:29.967456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.004739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.014444 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-203ea0b6-5607-4c5f-938c-46adb113da16 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1519 microversion: 2.1 time: 0.518401 Aug 27 03:31:30.020032 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2489/4801] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:29 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1519 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.037535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.043599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:30.057424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.058528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.059404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.060477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.061115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.061909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.338650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.361208 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9bf84310-06f1-41b9-8145-48613292c260 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.433502 Aug 27 03:31:30.362904 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2313/4802] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:29 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.367860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.368481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:30.400268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.400771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.401212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.405026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.406283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.406918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.507715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.515557 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a5bc55f-c64e-4c49-99ab-156f3ce2ee2a tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1527 microversion: 2.1 time: 0.493772 Aug 27 03:31:30.523144 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2490/4803] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:30 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.538318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:30.557326 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1f63a5c-ea41-41e8-ba65-f65b8419916f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1300 microversion: 2.1 time: 0.193631 Aug 27 03:31:30.592032 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2314/4804] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:30 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1300 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:30.857986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-14228fa9-97cd-47a5-97d5-c4585e37772a req-8109d8e2-975f-494d-a328-4937845ba55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7db87c-e21a-4282-90f4-a393fe1104b8", "name": "network-vif-plugged", "status": "completed", "tag": "f20f1ec1-d2ba-4dee-8de9-1a3971b9103f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:30.889631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-14228fa9-97cd-47a5-97d5-c4585e37772a req-8109d8e2-975f-494d-a328-4937845ba55e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.891126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-14228fa9-97cd-47a5-97d5-c4585e37772a req-8109d8e2-975f-494d-a328-4937845ba55e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.891809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-14228fa9-97cd-47a5-97d5-c4585e37772a req-8109d8e2-975f-494d-a328-4937845ba55e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.916996 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-14228fa9-97cd-47a5-97d5-c4585e37772a req-8109d8e2-975f-494d-a328-4937845ba55e service nova] Creating event network-vif-plugged:f20f1ec1-d2ba-4dee-8de9-1a3971b9103f for instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 on n-h1-852086-5 Aug 27 03:31:30.934668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.936166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:30.940865 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-14228fa9-97cd-47a5-97d5-c4585e37772a req-8109d8e2-975f-494d-a328-4937845ba55e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089073 Aug 27 03:31:30.941682 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2315/4805] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:30.952817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:30.953047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.953661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.956821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.957557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:30.958610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.961032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.962283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.974050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.978247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.978850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:30.983038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:30.983937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:30.984533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.002937 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] HTTP exception thrown: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Request method failure captured: Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a HTTP/1.1 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_1rRLqvgeeE14B-owlZOetvIU64O0w76Xggzvm-OqTFEO9oCb2qK35LN-o-mEHHpYNCwD8px7feVz3IswfD4UGbpErFUxdYl7GJlC-C2vlYle4MKJ8gTbhlN9E9sMigjm2lAm4XaNbv8BSqVfObF5x2G4-iLSztE6RbqaZo4rXEiM Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1c054fbf75234837a9764ae275590db7 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-737230847 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1c054fbf75234837a9764ae275590db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1c054fbf75234837a9764ae275590db7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1c054fbf75234837a9764ae275590db7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1c054fbf75234837a9764ae275590db7"}]}] Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-737230847 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1c054fbf75234837a9764ae275590db7 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-737230847 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestMultiTenantJSON-737230847-project Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2d0f3ad1422a4748b5220082b8087206 Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-737230847-project Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '731dcd04-a6a4-424b-950d-14c64e27fa7a'} Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:31.006302 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.011232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Returning 404 to user: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:31.012713 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-deceb92f-3bf9-409a-9302-3230c84a17a4 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] 10.222.0.69 "DELETE /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 404 len: 111 microversion: 2.1 time: 0.472051 Aug 27 03:31:31.013731 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2491/4806] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:31:30 2022] DELETE /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 111 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:31:31.028688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.029334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:31.045168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.045674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.046188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.052028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.053038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.054019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.061706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:31.314228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.323504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d5badf5-62ad-4023-b033-2e7b426199f5 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1527 microversion: 2.1 time: 0.300436 Aug 27 03:31:31.339737 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2492/4807] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:31 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1527 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:31.345728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.347244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:31.354423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.355228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.355770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.356637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.357331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.358425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.546673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.556025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-99277023-1d2d-4f41-bb37-4023addc524d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1504 microversion: 2.1 time: 0.214941 Aug 27 03:31:31.557253 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2493/4808] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:31 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:31.568405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Action: 'update', calling method: >, body: {"server": {"name": "731dcd04-a6a4-424b-950d-14c64e27fa7a_new"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:31.573147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:31.582081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.597447 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7affa710-2f6b-4471-ba31-371d86c6f879 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.651960 Aug 27 03:31:31.598440 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2316/4809] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:30 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:31.601031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.601549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.602000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.602832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.605372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.606020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.606965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:31.607247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.615197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.616641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.617593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.618767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.620597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.621607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.643860 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] HTTP exception thrown: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Request method failure captured: Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: request: PUT /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a HTTP/1.1 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 64 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_1rRLqvgeeE14B-owlZOetvIU64O0w76Xggzvm-OqTFEO9oCb2qK35LN-o-mEHHpYNCwD8px7feVz3IswfD4UGbpErFUxdYl7GJlC-C2vlYle4MKJ8gTbhlN9E9sMigjm2lAm4XaNbv8BSqVfObF5x2G4-iLSztE6RbqaZo4rXEiM Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1c054fbf75234837a9764ae275590db7 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-737230847 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1c054fbf75234837a9764ae275590db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1c054fbf75234837a9764ae275590db7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1c054fbf75234837a9764ae275590db7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1c054fbf75234837a9764ae275590db7"}]}] Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-737230847 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1c054fbf75234837a9764ae275590db7 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-737230847 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestMultiTenantJSON-737230847-project Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2d0f3ad1422a4748b5220082b8087206 Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-737230847-project Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: {"server": {"name": "731dcd04-a6a4-424b-950d-14c64e27fa7a_new"}} Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '731dcd04-a6a4-424b-950d-14c64e27fa7a', 'body': {'server': {'name': '731dcd04-a6a4-424b-950d-14c64e27fa7a_new'}}} Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:31:31.650305 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:31.660829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] Returning 404 to user: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:31.668859 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d818ad3a-9e8a-4d48-b30f-7b162eb4cca5 tempest-ServersNegativeTestMultiTenantJSON-737230847 tempest-ServersNegativeTestMultiTenantJSON-737230847-project] 10.222.0.69 "PUT /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 404 len: 111 microversion: 2.1 time: 0.104457 Aug 27 03:31:31.668859 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2494/4810] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:31:31 2022] PUT /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:31.686291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.687403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:31.695305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.696182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.696858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.697810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.698935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.699811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.929218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.945193 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-628de132-4a68-43ae-a896-82e0f051d97e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 200 len: 1504 microversion: 2.1 time: 0.273666 Aug 27 03:31:31.956822 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2495/4811] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:31 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:31.969271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:31.970625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:31.981579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.982473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.984017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.985743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:31.986305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:31.986833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:31.987669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:31.999645 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93fbd8d2-912b-4229-9873-ef75a85bafa7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.399283 Aug 27 03:31:32.012907 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2317/4812] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:31 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:32.036034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.037631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:32.049490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.051442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.053736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.055721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.056670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.058540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.125774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:31:32.248422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b6b1b27-cf50-4f84-b008-1c15d1da606d tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "DELETE /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 204 len: 0 microversion: 2.1 time: 0.231197 Aug 27 03:31:32.249426 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2318/4813] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:31:32 2022] DELETE /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:31:32.263250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.265175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:32.273470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:32.326844 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac9ba3ef-0f0e-4ba5-b963-18ff64527bb5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1367 microversion: 2.1 time: 0.367988 Aug 27 03:31:32.328122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.328692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.329466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.338478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.338749 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2496/4814] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:31 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:32.346798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.347681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:32.351882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.352392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.361505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.363400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.364705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.366104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.367198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.368250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.397112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:31:32.436667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:32.543196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9feb22c0-9574-4be3-b801-64702004a676 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "DELETE /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 204 len: 0 microversion: 2.1 time: 0.291050 Aug 27 03:31:32.544193 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2319/4815] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:31:32 2022] DELETE /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:31:32.630016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:32.631175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:32.649000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.652839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.653325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.654081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:32.655662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:32.656111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:32.704325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:32.723417 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee997385-e2a2-4b90-8bae-d2a02e4f55db tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1533 microversion: 2.1 time: 0.382833 Aug 27 03:31:32.725466 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2497/4816] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:32 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1533 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:32.816899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1170230690", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "9629d05d-a036-490a-a905-c45e2c70a519"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:32.911277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] validate_networks() for [('9629d05d-a036-490a-a905-c45e2c70a519', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:31:33.641231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:33.643362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:33.644092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:33.644593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:33.645283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:33.657565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:33.658890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:33.659723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:33.661161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:33.662298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:33.663040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:33.700315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:33.703906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Getting quotas for project 4ae9abba744b4b08ae3bf99d5f94d63e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:31:33.721600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:33.728541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Getting quotas for user ecc4fea72e9243f2989722084690be5a and project 4ae9abba744b4b08ae3bf99d5f94d63e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:31:33.732328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c218bc6-23e1-4045-a65b-b1712e2b7a70 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 1.110537 Aug 27 03:31:33.734640 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2320/4817] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:32 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:33.751669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:33.753651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:33.767315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:33.770998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:33.771534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:31:33.771756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:33.772487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:33.777319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:33.777319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:33.783714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:31:33.928260 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8de902b-560c-4df7-b410-91ac9b49da10 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116210 Aug 27 03:31:33.942382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2498/4818] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:31:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:31:33.942382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:33.942382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:33.953225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:33.953827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:33.954105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:33.954864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:33.956026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:33.956759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:34.304245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.313812 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-be41e849-65da-403d-b698-089290259de5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1367 microversion: 2.1 time: 0.378642 Aug 27 03:31:34.323388 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2499/4819] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:33 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:34.336559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.338379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:34.356711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:34.358664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:34.359655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:34.362874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:34.363541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:34.366986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:34.513903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.525128 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7daa045-5f3f-425c-b3af-331e867d37f8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1364 microversion: 2.1 time: 0.783865 Aug 27 03:31:34.525386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2321/4820] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:33 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1364 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:34.575905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fd9e3b4d-93e3-4502-ae45-d82edada1732 req-65d91b2c-6442-4506-93bf-aab96291a392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5", "tag": "1a0aafcd-717f-48a7-babe-deb38d89952c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:34.589238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fd9e3b4d-93e3-4502-ae45-d82edada1732 req-65d91b2c-6442-4506-93bf-aab96291a392 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:34.590740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fd9e3b4d-93e3-4502-ae45-d82edada1732 req-65d91b2c-6442-4506-93bf-aab96291a392 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:34.591663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fd9e3b4d-93e3-4502-ae45-d82edada1732 req-65d91b2c-6442-4506-93bf-aab96291a392 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:34.621003 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fd9e3b4d-93e3-4502-ae45-d82edada1732 req-65d91b2c-6442-4506-93bf-aab96291a392 service nova] Creating event network-changed:1a0aafcd-717f-48a7-babe-deb38d89952c for instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 on n-h2-852086-5 Aug 27 03:31:34.644557 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fd9e3b4d-93e3-4502-ae45-d82edada1732 req-65d91b2c-6442-4506-93bf-aab96291a392 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072571 Aug 27 03:31:34.646912 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2322/4821] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:34.660688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb21deb8-1e88-4702-90d9-70113ba321f1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.661863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb21deb8-1e88-4702-90d9-70113ba321f1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:34.856140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb21deb8-1e88-4702-90d9-70113ba321f1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:34.871109 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb21deb8-1e88-4702-90d9-70113ba321f1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1218 microversion: 2.1 time: 0.222395 Aug 27 03:31:34.887905 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2323/4822] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:34 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:34.905787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:34.906860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:34.921296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:34.930095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:34.931726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:34.933122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:34.933979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:34.951864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.446946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.457650 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c452f9e-76b3-4d97-b8a1-9787b93c3957 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.568192 Aug 27 03:31:35.463772 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2324/4823] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:34 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.469249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.479704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:35.499106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.500321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.503628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.505176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.509423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.510090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.648185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.665450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d3c6b693-11ce-402c-9b9f-0bad04c0aca9 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1533 microversion: 2.1 time: 1.340658 Aug 27 03:31:35.685795 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2500/4824] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:34 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1533 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.710132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.710767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:35.727133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.727631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.728263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.729176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.734333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.734991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.127807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.156317 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19127002-ccdd-4de6-9021-691d4771d774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1550 microversion: 2.1 time: 0.465944 Aug 27 03:31:36.157464 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2501/4825] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:35 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1550 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.171569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-53fe7361-61b2-46f0-9fcf-82ebf16dfbd4 req-3a958905-c671-482d-9c31-9ccbf11cc77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731dcd04-a6a4-424b-950d-14c64e27fa7a", "name": "network-vif-deleted", "tag": "dc4cbdf0-93a2-435e-9ba5-fe483eecf8a3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:36.202001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-53fe7361-61b2-46f0-9fcf-82ebf16dfbd4 req-3a958905-c671-482d-9c31-9ccbf11cc77f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.203303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-53fe7361-61b2-46f0-9fcf-82ebf16dfbd4 req-3a958905-c671-482d-9c31-9ccbf11cc77f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.203960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-53fe7361-61b2-46f0-9fcf-82ebf16dfbd4 req-3a958905-c671-482d-9c31-9ccbf11cc77f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.236948 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-53fe7361-61b2-46f0-9fcf-82ebf16dfbd4 req-3a958905-c671-482d-9c31-9ccbf11cc77f service nova] Creating event network-vif-deleted:dc4cbdf0-93a2-435e-9ba5-fe483eecf8a3 for instance 731dcd04-a6a4-424b-950d-14c64e27fa7a on n-h2-852086-5 Aug 27 03:31:36.258438 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-53fe7361-61b2-46f0-9fcf-82ebf16dfbd4 req-3a958905-c671-482d-9c31-9ccbf11cc77f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094151 Aug 27 03:31:36.261573 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2502/4826] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:36.272254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.279849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.280341 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1cabef5-13eb-4fc0-a6ad-a41a5beec672 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1367 microversion: 2.1 time: 0.815228 Aug 27 03:31:36.284851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:36.285743 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2325/4827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:35 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1367 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.293056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.293562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:36.309191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.310517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.311962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.312304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.312472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.313135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.314150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.315099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.315749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.318071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.318911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.319060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.490406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.499000 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f82b08ea-32a6-4171-b637-ba5a44c11a92 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1278 microversion: 2.1 time: 0.234875 Aug 27 03:31:36.509005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2503/4828] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:36 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:36.523361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.526923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:36.544765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.552083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.553931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.555566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.561378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.561378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.613520 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4efd3b2-4edf-4200-bf5d-f5bbf3963f6c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.321823 Aug 27 03:31:36.613520 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2326/4829] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:31:36 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-interface => generated 284 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:36.670836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-97179bbe-e5b8-4a16-8eb1-a4da43be421e req-b93e72a2-3f6f-45de-945f-03ce98d87066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54115f30-fe92-4a2c-8fb2-e90281f3d35e", "name": "network-vif-unplugged", "status": "completed", "tag": "1d21c5f4-68f1-4861-a5bc-8e9490fda880"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:36.684531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-97179bbe-e5b8-4a16-8eb1-a4da43be421e req-b93e72a2-3f6f-45de-945f-03ce98d87066 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.685434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-97179bbe-e5b8-4a16-8eb1-a4da43be421e req-b93e72a2-3f6f-45de-945f-03ce98d87066 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.686066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-97179bbe-e5b8-4a16-8eb1-a4da43be421e req-b93e72a2-3f6f-45de-945f-03ce98d87066 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.702418 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-97179bbe-e5b8-4a16-8eb1-a4da43be421e req-b93e72a2-3f6f-45de-945f-03ce98d87066 service nova] Creating event network-vif-unplugged:1d21c5f4-68f1-4861-a5bc-8e9490fda880 for instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e on n-h1-852086-5 Aug 27 03:31:36.709406 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-97179bbe-e5b8-4a16-8eb1-a4da43be421e req-b93e72a2-3f6f-45de-945f-03ce98d87066 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044426 Aug 27 03:31:36.711176 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2327/4830] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:36.718070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:36.719050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:36.726975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.727868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.728603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.729437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.730008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.730702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.779878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.780686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.781117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.782201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lazy-loading 'fault' on Instance uuid 731dcd04-a6a4-424b-950d-14c64e27fa7a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:31:36.897046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.915547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34bd972f-5e4f-446f-adbe-362401b38f43 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.402692 Aug 27 03:31:36.916302 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2504/4831] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:36 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:37.260271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.272814 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15a416b1-e585-4ad6-be9c-293fd91c5737 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1317 microversion: 2.1 time: 0.559783 Aug 27 03:31:37.287302 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2328/4832] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:36 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:37.311800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.312829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:37.321204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.322070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.322735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.324165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.324885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.326510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.529687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.530789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:37.543585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.544308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.544907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.545809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.546630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.547224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.797767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.814433 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-956ee5c4-4001-4c28-ba3b-e14bafa6715b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1276 microversion: 2.1 time: 0.294965 Aug 27 03:31:37.818027 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2329/4833] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:37 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1276 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:37.825757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f5c6af0b-c072-4e66-a541-35e5fc551173 req-ccf6a34d-3849-404c-a20a-4d553612318c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54115f30-fe92-4a2c-8fb2-e90281f3d35e", "name": "network-vif-deleted", "tag": "1d21c5f4-68f1-4861-a5bc-8e9490fda880"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:37.854232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f5c6af0b-c072-4e66-a541-35e5fc551173 req-ccf6a34d-3849-404c-a20a-4d553612318c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.855197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f5c6af0b-c072-4e66-a541-35e5fc551173 req-ccf6a34d-3849-404c-a20a-4d553612318c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.855900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f5c6af0b-c072-4e66-a541-35e5fc551173 req-ccf6a34d-3849-404c-a20a-4d553612318c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.873529 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f5c6af0b-c072-4e66-a541-35e5fc551173 req-ccf6a34d-3849-404c-a20a-4d553612318c service nova] Creating event network-vif-deleted:1d21c5f4-68f1-4861-a5bc-8e9490fda880 for instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e on n-h1-852086-5 Aug 27 03:31:37.880642 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f5c6af0b-c072-4e66-a541-35e5fc551173 req-ccf6a34d-3849-404c-a20a-4d553612318c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060833 Aug 27 03:31:37.881615 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2330/4834] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:37.946564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.947607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:37.961694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.965571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.966351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.968216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.970686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.971194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.074979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.088450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5086219-967d-4b94-b9a5-12b39ed9748b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1367 microversion: 2.1 time: 0.781678 Aug 27 03:31:38.105580 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2505/4835] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:37 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1367 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:38.343559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.349408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:38.372046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:38.373003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:38.376282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.378597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:38.379336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:38.380191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.420519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:38.421010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:38.421630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.422385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lazy-loading 'fault' on Instance uuid 731dcd04-a6a4-424b-950d-14c64e27fa7a {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:31:38.490667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480a7803522d46c784f31c8e6d1ee39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4ff72b17904946adb501a0c4160597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.528115 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-27a443ab-4ca8-45ae-8978-a36c74899a32 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 200 len: 1317 microversion: 2.1 time: 0.235423 Aug 27 03:31:38.529081 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2506/4836] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:38 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:38.844896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.845520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:38.849310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.859519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:38.860423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:38.862138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.862644 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90981784-6868-4e39-8d41-b532692a4e9b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.918902 Aug 27 03:31:38.865147 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2331/4837] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:37 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:38.867032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:38.868053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:38.868926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.977359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.991762 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a46a4281-c403-4c98-9b95-ca6b0398877e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1276 microversion: 2.1 time: 0.150165 Aug 27 03:31:39.002264 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2507/4838] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:38 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:39.115725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.116904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:39.126947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.128552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.129242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:39.130258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.131514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.132566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:39.557674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.558356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] [instance: 731dcd04-a6a4-424b-950d-14c64e27fa7a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:39.569565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.569565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.570789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:39.570789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.571375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.571809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:39.594138 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] HTTP exception thrown: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Request method failure captured: Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a HTTP/1.1 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_qPAoTmY-YZvXJVnrxserVqHNY5xCtPnsqBgJx6hM0Yl5phrDCmwwOnS47iOnO9BwY01GtiQQF4tIi-cJ0btIVw0dT7YSoOZVJFIqhx3hc_3OH2hcJ-EXqbeOVf_2MAXH3Z63oPyZ0kOAHYIyzwf8Hsx99lIB_28xQ9Q64U-SIVKw Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 6f4ff72b17904946adb501a0c4160597 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1570551339 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6f4ff72b17904946adb501a0c4160597"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6f4ff72b17904946adb501a0c4160597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6f4ff72b17904946adb501a0c4160597", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6f4ff72b17904946adb501a0c4160597"}]}] Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1570551339 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 6f4ff72b17904946adb501a0c4160597 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1570551339 Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1570551339-project Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 480a7803522d46c784f31c8e6d1ee39f Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1570551339-project Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '731dcd04-a6a4-424b-950d-14c64e27fa7a'} Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:39.596006 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] Returning 404 to user: Instance 731dcd04-a6a4-424b-950d-14c64e27fa7a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea7d3444-6e8c-489b-8f40-4384e7a4e239 tempest-ServersNegativeTestMultiTenantJSON-1570551339 tempest-ServersNegativeTestMultiTenantJSON-1570551339-project] 10.222.0.69 "GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a" status: 404 len: 111 microversion: 2.1 time: 0.045797 Aug 27 03:31:39.603645 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2508/4839] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:39 2022] GET /compute/v2.1/servers/731dcd04-a6a4-424b-950d-14c64e27fa7a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:31:39.884843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.885349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:39.893312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.894030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.894505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:39.895362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.896240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.896672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:40.112975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.124111 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0cea4ed5-fe86-471a-be64-64c208ab9428 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1367 microversion: 2.1 time: 1.016151 Aug 27 03:31:40.138993 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2332/4840] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:39 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1367 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.145568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.146605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:40.154531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:40.155407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:40.156077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:40.157037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:40.157715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:40.159534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:40.259041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.272724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-415e5f1f-0868-4b2f-8bdb-f1cb2d87a356 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.392361 Aug 27 03:31:40.273662 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2509/4841] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:39 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:40.288240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.297487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22b85f46-cf40-4e79-b6d2-1ce322d98f0e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1276 microversion: 2.1 time: 0.156950 Aug 27 03:31:40.311035 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2333/4842] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:40 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.348337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fdf37f30-84fa-4e5a-b524-0c426726d4f2 req-4e4d89e4-e8ba-46c0-8b28-0944bee513c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5", "name": "network-vif-plugged", "status": "completed", "tag": "1a0aafcd-717f-48a7-babe-deb38d89952c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:40.372245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fdf37f30-84fa-4e5a-b524-0c426726d4f2 req-4e4d89e4-e8ba-46c0-8b28-0944bee513c8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:40.376152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fdf37f30-84fa-4e5a-b524-0c426726d4f2 req-4e4d89e4-e8ba-46c0-8b28-0944bee513c8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:40.378915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fdf37f30-84fa-4e5a-b524-0c426726d4f2 req-4e4d89e4-e8ba-46c0-8b28-0944bee513c8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:40.417809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fdf37f30-84fa-4e5a-b524-0c426726d4f2 req-4e4d89e4-e8ba-46c0-8b28-0944bee513c8 service nova] Creating event network-vif-plugged:1a0aafcd-717f-48a7-babe-deb38d89952c for instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 on n-h2-852086-5 Aug 27 03:31:40.430470 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fdf37f30-84fa-4e5a-b524-0c426726d4f2 req-4e4d89e4-e8ba-46c0-8b28-0944bee513c8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088879 Aug 27 03:31:40.432634 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2510/4843] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:41.146638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.148515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:41.173808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:41.174513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:41.175022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:41.175829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:41.176334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:41.176779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:41.298608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.299813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:41.316717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:41.317677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:41.320923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:41.322112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:41.322845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:41.324873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:41.619349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:41.644193 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73dba53a-1233-4a8b-91e4-22f6440f40ba tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1367 microversion: 2.1 time: 0.499109 Aug 27 03:31:41.660068 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2334/4844] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:41 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:41.671978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.673405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:41.687308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:41.688212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:41.692786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:41.694217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:41.695162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:41.696591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:42.072043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.081254 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfa5eb59-ad76-434a-a4c9-65082fa98045 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.419617 Aug 27 03:31:42.081862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2335/4845] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:41 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:42.093938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1f5cf0c3-ebe8-4807-8651-f24f6cd94cd4 req-b21e9331-5e27-4330-8e88-42e436614bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7db87c-e21a-4282-90f4-a393fe1104b8", "tag": "f20f1ec1-d2ba-4dee-8de9-1a3971b9103f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:42.120138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1f5cf0c3-ebe8-4807-8651-f24f6cd94cd4 req-b21e9331-5e27-4330-8e88-42e436614bc8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:42.120627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1f5cf0c3-ebe8-4807-8651-f24f6cd94cd4 req-b21e9331-5e27-4330-8e88-42e436614bc8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:42.121066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1f5cf0c3-ebe8-4807-8651-f24f6cd94cd4 req-b21e9331-5e27-4330-8e88-42e436614bc8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:42.134987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1f5cf0c3-ebe8-4807-8651-f24f6cd94cd4 req-b21e9331-5e27-4330-8e88-42e436614bc8 service nova] Creating event network-changed:f20f1ec1-d2ba-4dee-8de9-1a3971b9103f for instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 on n-h1-852086-5 Aug 27 03:31:42.141589 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1f5cf0c3-ebe8-4807-8651-f24f6cd94cd4 req-b21e9331-5e27-4330-8e88-42e436614bc8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057973 Aug 27 03:31:42.142921 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2336/4846] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:42.252234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.256311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:42.275932 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b91c6f5-6174-44c1-8055-3456339ea396 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.983446 Aug 27 03:31:42.277084 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2511/4847] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:41 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:42.676437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:42.678348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:42.724569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:42.726451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:42.727871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:42.757105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:42.757997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:42.758839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.125648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.128778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:43.143515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.147550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.148917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.150533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.151501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.152732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.682619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:43.728246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.750420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:43.759482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7525be4-6b47-4432-859b-4749e18eed26 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1556 microversion: 2.1 time: 1.087482 Aug 27 03:31:43.771782 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2337/4848] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:42 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1556 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:43.797884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.803774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:43.838562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.838776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.839177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.839623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.841094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.843930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.844701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.850620 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6165a0fd-402f-4985-9451-4133e4c5c930 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.735072 Aug 27 03:31:43.852717 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2512/4849] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:43 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.862116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.863492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:43.895810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.896321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.897013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.898051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.898686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.901209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:44.157723 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a054bcd9-800b-44c9-99d4-ca7ce431f322 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.303596 Aug 27 03:31:44.160879 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2513/4850] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:31:43 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5/os-interface => generated 284 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:44.184973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-73df7b53-afdf-4771-bb50-8c9afb41f889 req-b494cf25-54be-481f-8a93-a6772ebcb073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e906f0-fbf5-499d-89d7-4d783215b3aa", "tag": "9a810162-9ce6-4cb0-82cb-9266aeb323f5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:44.198079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-73df7b53-afdf-4771-bb50-8c9afb41f889 req-b494cf25-54be-481f-8a93-a6772ebcb073 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:44.198902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-73df7b53-afdf-4771-bb50-8c9afb41f889 req-b494cf25-54be-481f-8a93-a6772ebcb073 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:44.199358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-73df7b53-afdf-4771-bb50-8c9afb41f889 req-b494cf25-54be-481f-8a93-a6772ebcb073 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:44.239728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-73df7b53-afdf-4771-bb50-8c9afb41f889 req-b494cf25-54be-481f-8a93-a6772ebcb073 service nova] Creating event network-changed:9a810162-9ce6-4cb0-82cb-9266aeb323f5 for instance c5e906f0-fbf5-499d-89d7-4d783215b3aa on n-h1-852086-5 Aug 27 03:31:44.254317 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-73df7b53-afdf-4771-bb50-8c9afb41f889 req-b494cf25-54be-481f-8a93-a6772ebcb073 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073936 Aug 27 03:31:44.254945 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2514/4851] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:44.454742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.469556 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c580b13-3c68-4a5f-9c0a-16466965ddf7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.686106 Aug 27 03:31:44.488162 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2338/4852] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:43 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.884932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.885654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:44.894573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:44.895334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:44.895934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:44.896802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:44.897418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:44.898017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:45.497405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.498031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:45.505972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:45.511782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:45.512674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:45.513347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:45.514792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:45.515447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:45.516322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:45.520756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:45.637884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.650478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b863b444-3898-48d3-8c95-2983b44fe419 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.769880 Aug 27 03:31:45.651859 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2515/4853] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:44 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.796676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.816857 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-556a5319-19e1-4de8-9cfa-0ea2e6bee962 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.325045 Aug 27 03:31:45.818485 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2339/4854] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:45 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:46.319628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f8a78d6d-eb66-4f73-bfab-63290d0aff41 req-f1ccfa69-26ed-4a74-9ee5-ba5e70cad648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5", "tag": "1a0aafcd-717f-48a7-babe-deb38d89952c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:46.375554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8a78d6d-eb66-4f73-bfab-63290d0aff41 req-f1ccfa69-26ed-4a74-9ee5-ba5e70cad648 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:46.387079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8a78d6d-eb66-4f73-bfab-63290d0aff41 req-f1ccfa69-26ed-4a74-9ee5-ba5e70cad648 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:46.391277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8a78d6d-eb66-4f73-bfab-63290d0aff41 req-f1ccfa69-26ed-4a74-9ee5-ba5e70cad648 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:46.442540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f8a78d6d-eb66-4f73-bfab-63290d0aff41 req-f1ccfa69-26ed-4a74-9ee5-ba5e70cad648 service nova] Creating event network-changed:1a0aafcd-717f-48a7-babe-deb38d89952c for instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 on n-h2-852086-5 Aug 27 03:31:46.459135 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f8a78d6d-eb66-4f73-bfab-63290d0aff41 req-f1ccfa69-26ed-4a74-9ee5-ba5e70cad648 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144622 Aug 27 03:31:46.464670 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2516/4855] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:46.687799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.688418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:46.702114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:46.702957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:46.704503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:46.707138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:46.709671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:46.712259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:46.852428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.855912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:46.891614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:46.899617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:46.900623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:46.901455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:46.902093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:46.902823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:47.445387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.474955 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aeb71af1-52c7-40da-89e1-1e91960e617a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.626445 Aug 27 03:31:47.475765 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2517/4856] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:46 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.484342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:47.505442 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7050a8d-0460-47fa-84cc-9212517ffe4c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.817249 Aug 27 03:31:47.508493 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2340/4857] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:46 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:48.498435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.500820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:48.520822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:48.521730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:48.522461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:48.523595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:48.524449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:48.531194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:48.539070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:48.544365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:48.550019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:48.552782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:48.555317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:48.556384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:48.566742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:48.567599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:48.807134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.830982 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89fe6257-4d7c-473c-9a01-abd249c48912 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.300409 Aug 27 03:31:48.835955 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2341/4858] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:48 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.550591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:49.578960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d1059f28-67d6-4a34-9c6c-c1e5480be5a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 1.082989 Aug 27 03:31:49.598587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2518/4859] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:48 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.859439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.860649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:49.883604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:49.884111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:49.884590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:49.885944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:49.886767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:49.887491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:50.437695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.450307 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-747648c1-20aa-4268-a5d8-20d2f9ae125f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.595080 Aug 27 03:31:50.452196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2342/4860] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:49 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:50.603132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:50.607013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:50.628391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:50.632912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:50.633694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:50.637898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:50.638816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:50.640354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:51.342328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-12fd07c4-fe3f-4e3d-825e-e958b788e01f req-fef7b5a5-a905-4fa4-9fbe-0bd9f54771a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e906f0-fbf5-499d-89d7-4d783215b3aa", "name": "network-vif-plugged", "status": "completed", "tag": "9a810162-9ce6-4cb0-82cb-9266aeb323f5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:51.381080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12fd07c4-fe3f-4e3d-825e-e958b788e01f req-fef7b5a5-a905-4fa4-9fbe-0bd9f54771a3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:51.381991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12fd07c4-fe3f-4e3d-825e-e958b788e01f req-fef7b5a5-a905-4fa4-9fbe-0bd9f54771a3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:51.382883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12fd07c4-fe3f-4e3d-825e-e958b788e01f req-fef7b5a5-a905-4fa4-9fbe-0bd9f54771a3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:51.421558 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-12fd07c4-fe3f-4e3d-825e-e958b788e01f req-fef7b5a5-a905-4fa4-9fbe-0bd9f54771a3 service nova] Creating event network-vif-plugged:9a810162-9ce6-4cb0-82cb-9266aeb323f5 for instance c5e906f0-fbf5-499d-89d7-4d783215b3aa on n-h1-852086-5 Aug 27 03:31:51.434827 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-12fd07c4-fe3f-4e3d-825e-e958b788e01f req-fef7b5a5-a905-4fa4-9fbe-0bd9f54771a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098395 Aug 27 03:31:51.455559 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2343/4861] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:51.468076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.488280 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ceea3063-9b35-4fda-92a0-ceaf24985ad8 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.892019 Aug 27 03:31:51.489841 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2519/4862] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:50 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:51.493089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:51.494583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:51.508443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:51.509931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:51.512152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:51.515410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:51.519493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:51.520110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.105626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.117876 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f56e8cd9-a30a-44df-85b2-d0dfa40ce492 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.640569 Aug 27 03:31:52.119147 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2344/4863] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:51 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:52.521084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.521710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:52.534146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.535366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.536157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.537046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.537744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.538440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.880957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.891231 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6893a7b1-fd17-4b98-a306-03378157072c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.374570 Aug 27 03:31:52.897452 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2520/4864] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:52 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:53.141102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.141933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:53.151869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.152406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.153086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.160797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.161993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.162838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.572263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.600795 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa27c03d-2877-4765-92e2-b94b64353faa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1318 microversion: 2.1 time: 0.464674 Aug 27 03:31:53.620044 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2345/4865] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:53 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:53.919621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.920254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:53.932728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.933545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.934751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.940655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.941870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.943744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:54.373205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.383198 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38b7c6d6-3309-4ff8-8f9d-483c4a3252a7 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.468070 Aug 27 03:31:54.389870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2521/4866] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:53 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:54.625317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.626118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:54.659312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:54.660333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:54.661357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:54.662482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:54.663598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:54.664303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.419631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.420521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:55.468448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.474476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.476581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.485585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.486491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.487893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.520525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.549514 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5adbec93-e4f9-425f-9931-d223b56463cb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1508 microversion: 2.1 time: 0.927626 Aug 27 03:31:55.563684 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2346/4867] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:54 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1508 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:55.585478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.586918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:55.596900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.597664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.599018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.613281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.615083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.618022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.021518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.050993 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56265c23-a4d8-41f1-b857-465e1feb2ae8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1508 microversion: 2.1 time: 0.462579 Aug 27 03:31:56.070288 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2347/4868] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:55 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:56.083893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:56.090322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:56.115896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.116434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.116891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.117637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.118098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.118560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.276431 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22984244-d010-4486-8ea3-bc34bc4d04f5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "PUT /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1080 microversion: 2.1 time: 0.199572 Aug 27 03:31:56.288803 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2348/4869] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:31:56 2022] PUT /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1080 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:56.296751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.299843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:56.309493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:56.312490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.313791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.314844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.316103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.316538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.317191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.661065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.677559 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed599d99-186f-4aaf-a933-eff030211f42 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1506 microversion: 2.1 time: 0.385641 Aug 27 03:31:56.678766 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2349/4870] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:56 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:56.703827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.705393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:56.722541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.724657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.725105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.728644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.731932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.732570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.737007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.750771 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-383d9daa-6189-4b79-a4d2-8fad134d2edb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 1.334603 Aug 27 03:31:56.755316 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2522/4871] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:55 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:57.212171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.242432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb3cc16b-7b05-4046-8b84-ba29d0ff0976 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1506 microversion: 2.1 time: 0.544746 Aug 27 03:31:57.245478 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2350/4872] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:56 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:57.274733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:57.281171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:57.327801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:57.329545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:57.338889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:57.356909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:57.358005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:57.360198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:57.662872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:57.663891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:57.665133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:57.668632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:57.669260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:57.779166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.779899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:57.797013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:57.800590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:57.803555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:57.804594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:57.806730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:57.811812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:57.977616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:57.999208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.000863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.013705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.015841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.019409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.020313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.098717 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e56888c9-8bb4-4289-afd0-2615bc1c4a30 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "POST /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa/action" status: 202 len: 1112 microversion: 2.1 time: 0.834036 Aug 27 03:31:58.100446 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2523/4873] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:31:57 2022] POST /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa/action => generated 1112 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:31:58.124705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.125477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:58.141018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.141769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.142482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.143398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.146819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.147432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.405898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.430731 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b446a8b6-5ae6-45b5-9cb1-5e6737918bca tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.655592 Aug 27 03:31:58.439424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2351/4874] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:57 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:58.777961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.799916 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04a8ba27-8d7c-4eff-ad39-bd43e71560a3 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.677263 Aug 27 03:31:58.804605 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2524/4875] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:58 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:59.481682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.484621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:59.517832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.553053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.557845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.558951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.563493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.566139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.828627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:59.833574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.835761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:59.847636 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9da7394-d836-4787-abf5-41d123abe433 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1735 microversion: 2.1 time: 0.374230 Aug 27 03:31:59.849397 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2352/4876] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:59 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1735 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:59.856062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.859262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.860374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.861868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.863091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.864124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.447339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:00.460208 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c6c5d0b-228a-4e64-82e7-b99afed4fbad tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.633667 Aug 27 03:32:00.461236 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2525/4877] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:59 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:00.870012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:00.870759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:00.881975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.882915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.883674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.884693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.884693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.884693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.267545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.292034 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b4c5a52-9856-456f-b7fb-62807c38409f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1715 microversion: 2.1 time: 0.426223 Aug 27 03:32:01.300204 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2353/4878] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:00 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1715 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:01.481831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.487259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:01.495191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.495963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.496723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.497876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.499523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.500140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.556391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.557337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:01.577982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.579361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.581599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.583558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.584836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.585480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.770466 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Cannot 'detach_volume' instance d8427f5b-2531-4195-b370-6e0a7564ad16 while it is in vm_state rescued Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments/1c19a71f-8704-43b3-a62c-224f599dffe4 HTTP/1.1 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'detach_volume' instance d8427f5b-2531-4195-b370-6e0a7564ad16 while it is in vm_state rescued Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': 'd8427f5b-2531-4195-b370-6e0a7564ad16', 'id': '1c19a71f-8704-43b3-a62c-224f599dffe4'} Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8427f5b-2531-4195-b370-6e0a7564ad16 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d8427f5b-2531-4195-b370-6e0a7564ad16 while it is in vm_state rescued Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:01.774413 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d8427f5b-2531-4195-b370-6e0a7564ad16 while it is in vm_state rescued Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 409 to user: Cannot 'detach_volume' instance d8427f5b-2531-4195-b370-6e0a7564ad16 while it is in vm_state rescued {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d8edf97-710d-4741-83e7-320cd786e8ab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments/1c19a71f-8704-43b3-a62c-224f599dffe4" status: 409 len: 152 microversion: 2.1 time: 0.250311 Aug 27 03:32:01.779459 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2354/4879] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:32:01 2022] DELETE /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments/1c19a71f-8704-43b3-a62c-224f599dffe4 => generated 152 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:32:01.795621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:01.796216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:01.819457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.820114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.820564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.821295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.821752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.823096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.875277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.894206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:01.904194 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-486c6d7f-b9e5-4a5b-bd1d-b09030b5778d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.414755 Aug 27 03:32:01.909679 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2526/4880] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:01 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:02.067147 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98085692-eba6-441a-9744-4f63d4a3fe0a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/action" status: 202 len: 0 microversion: 2.1 time: 0.278141 Aug 27 03:32:02.070754 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2355/4881] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:01 2022] POST /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:02.098976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.101754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:02.121202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.147286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.148085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.149079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.150893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.158598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.359440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1952490456", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "03d24d03-2c9d-4c38-91f1-f9c92dbf3867"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:02.483484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] validate_networks() for [('03d24d03-2c9d-4c38-91f1-f9c92dbf3867', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:02.631365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.648682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e9e17c9-8c52-4131-8d0a-1c1d7e454071 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1723 microversion: 2.1 time: 0.567260 Aug 27 03:32:02.653595 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2356/4882] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:02 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1723 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:02.931311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.932357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:02.969005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.970075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.973241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.975224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.975972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.980435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:03.162299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:03.163102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:03.163673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:03.164481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:03.165388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:03.184052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:03.185675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:03.187954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:03.191039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:03.192276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:03.193488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:03.246843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Getting quotas for project 4412ab4903d34828951cbb339177ce00. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:03.252283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Getting quotas for user facd4165dbd645d6b3f010f757838dd2 and project 4412ab4903d34828951cbb339177ce00. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:03.278678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:03.284214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:03.472721 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6e765fd1-103d-4ee9-b4ad-54ecced5b3c3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440511 Aug 27 03:32:03.487058 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2527/4883] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:03.586685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.596518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5af448ae-5500-4df6-ba54-042406e6a1a0 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.672233 Aug 27 03:32:03.604035 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2357/4884] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:02 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:03.677078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:03.678051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:03.694459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:03.699627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:03.700592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:03.702685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:03.705899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:03.706638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:03.772441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1606805647", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "03d24d03-2c9d-4c38-91f1-f9c92dbf3867"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:03.884755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] validate_networks() for [('03d24d03-2c9d-4c38-91f1-f9c92dbf3867', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:04.092736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.096163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:04.112882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32c15e55-8db6-4e9e-9df8-e290ccb5cc4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1723 microversion: 2.1 time: 0.441885 Aug 27 03:32:04.117563 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2528/4885] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:03 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1723 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:04.634043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.635795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:04.656444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:04.659955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:04.664227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:04.664968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:04.665920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:04.667580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:04.668206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:05.041227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:05.041852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:05.042898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:05.045037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:05.048737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:05.049316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:05.058031 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2884f08d-8703-4bce-9e14-cc299e084862 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.430601 Aug 27 03:32:05.074664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2529/4886] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:04 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:05.088788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:05.089575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:05.090778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:05.092094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:05.094417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:05.099410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:05.147713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:05.148336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:05.167019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:05.168519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:05.170087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:05.172676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:05.174947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:05.176611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:05.229784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Getting quotas for project 4412ab4903d34828951cbb339177ce00. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:05.275802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Getting quotas for user facd4165dbd645d6b3f010f757838dd2 and project 4412ab4903d34828951cbb339177ce00. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:05.340313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:05.347062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:05.504736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1dd21473-263d-4c49-9bc2-69041c66c994 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.740469 Aug 27 03:32:05.507330 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2358/4887] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:05.512833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:05.513797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:05.550570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:05.552702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:05.557317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:05.559188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:05.560400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:05.562102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:05.733707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:05.748647 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-76b26c83-b0a5-4960-9b82-58b266dc9a4c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1723 microversion: 2.1 time: 0.606739 Aug 27 03:32:05.767564 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2530/4888] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:05 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1723 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:05.868535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-39676496", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "451", "networks": [{"uuid": "03d24d03-2c9d-4c38-91f1-f9c92dbf3867"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:05.984821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:06.005954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] validate_networks() for [('03d24d03-2c9d-4c38-91f1-f9c92dbf3867', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:06.011682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f69b9ce-68ee-41d1-b564-3c0ebce0e523 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.502839 Aug 27 03:32:06.036303 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2359/4889] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:05 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:06.042931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:06.044314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:06.076298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:06.085922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:06.088335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:06.089601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:06.090327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:06.090968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:06.947675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:06.948482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:06.949171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:06.950146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:06.950725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:06.975058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:06.975861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:06.977163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:06.979906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:06.980978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:06.981744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.029471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.031298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Getting quotas for project 4412ab4903d34828951cbb339177ce00. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:07.038625 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b53423b-c659-4911-9092-c7a222ece919 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 1.001045 Aug 27 03:32:07.052709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Getting quotas for user facd4165dbd645d6b3f010f757838dd2 and project 4412ab4903d34828951cbb339177ce00. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:07.080425 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2360/4890] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:06 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:07.080963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:07.083652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:07.085386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.086012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:07.110456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.112760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.113224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.115840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.116886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.118853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.158578 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b248c68c-a1e3-4ca3-9750-9c483c6c9ade tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297200 Aug 27 03:32:07.159867 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2531/4891] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:07.172175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.176175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:07.194975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.195499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.198072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.199250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.199936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.201715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.458549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.464297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.472869 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b383fd84-5a01-4ad3-884a-21db87417316 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1729 microversion: 2.1 time: 0.311409 Aug 27 03:32:07.474282 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2532/4892] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:07 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1729 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:07.483754 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20aa8714-9baa-4b2e-9784-36cb07c19783 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.402113 Aug 27 03:32:07.491609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1968806882", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "80ecba10-3337-46af-8d48-57b733208b77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:07.497536 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2361/4893] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:07 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:07.504708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.505343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:07.520661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.525771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.529169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.531073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.536495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.536946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.657317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:08.281558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:08.282295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:08.283384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:08.284078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:08.284693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:08.296908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.297893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.299683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.300781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.301496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.302196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.329072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:08.335890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:08.422971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.431348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:08.441221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80ecba10-3337-46af-8d48-57b733208b77',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:08.443135 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1769a5c3-01d3-42c4-9e88-5f308db85999 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.944318 Aug 27 03:32:08.443718 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2362/4894] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:07 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:08.448762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.449880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:08.467709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.468968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.469761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.471181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.471946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.472660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.674568 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-611c3e49-4165-41c7-bae2-b0e194320341 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197544 Aug 27 03:32:08.676271 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2533/4895] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:08.681705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.682844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:08.693345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.694268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.695010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.695965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.696707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.697366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.769145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.787322 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-381e728a-44a6-4c78-ad0b-f092befdcbc7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1271 microversion: 2.1 time: 0.342213 Aug 27 03:32:08.789369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2363/4896] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:08 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1271 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:08.800501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.804438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:08.833080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.838487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.839164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.841237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.844723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.847032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.888827 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6794d87a-9b2a-49fd-be3a-a250d9d7628a tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210888 Aug 27 03:32:08.889949 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2534/4897] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:32:08 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:08.900315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.901944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:08.930329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.931506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.935184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.936869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.938575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.940771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:09.322348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.369935 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b440cdd-d227-4108-895f-c5d6d991aa05 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.577960 Aug 27 03:32:09.375321 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2364/4898] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:08 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:09.381012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.381887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:09.404959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:09.406266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:09.406905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:09.410056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:09.410800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:09.411447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:09.702903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.715422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d7c3589-c29f-4846-9a86-43d875b1c72c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1107 microversion: 2.1 time: 0.338494 Aug 27 03:32:09.716407 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2365/4899] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:09 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1107 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:09.849158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.866663 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02c3e0dc-6611-45ab-b506-afb50fb91a03 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.974182 Aug 27 03:32:09.867288 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2535/4900] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:08 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:09.891475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-899894963", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "05166925-98fa-4fca-b74f-85bb13110797"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:09.929380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b28fbe58-d54f-478f-a2b8-95315b4f31e3 tempest-ComputeTenantNetworksTest-755183467 tempest-ComputeTenantNetworksTest-755183467-project] Calling method '.version_select at 0x7fe45732bd30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.990131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] validate_networks() for [('05166925-98fa-4fca-b74f-85bb13110797', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:10.370657 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b28fbe58-d54f-478f-a2b8-95315b4f31e3 tempest-ComputeTenantNetworksTest-755183467 tempest-ComputeTenantNetworksTest-755183467-project] 10.222.0.69 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.651405 Aug 27 03:32:10.372134 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2366/4901] 10.222.0.69 () {58 vars in 1158 bytes} [Sat Aug 27 03:32:09 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:10.387321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.388129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:10.395889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:10.396660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:10.397392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:10.398581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:10.399287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:10.399914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:10.576341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:10.618143 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-861ee78c-51e2-486d-adc9-c24881d60efb tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1277 microversion: 2.1 time: 0.235603 Aug 27 03:32:10.621557 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2367/4902] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:10 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:10.629565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca9549a8-8796-4372-955e-186caab988fa tempest-ComputeTenantNetworksTest-755183467 tempest-ComputeTenantNetworksTest-755183467-project] Calling method '.version_select at 0x7fe4573a93a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.783481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:10.784470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:10.785360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:10.785787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:10.786248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:10.796348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:10.796932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:10.797330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:10.799216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:10.799698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:10.800128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:10.825380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:10.833734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for user 89f850adf9a7432798f86fe9d2d17b79 and project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:10.851477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:10.853877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:10.922446 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0409ce7f-1395-4147-8704-224254861680 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052887 Aug 27 03:32:10.925055 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2536/4903] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:10.934602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.936291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:10.952107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:10.953142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:10.953934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:10.955521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:10.956394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:10.957206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:10.973666 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca9549a8-8796-4372-955e-186caab988fa tempest-ComputeTenantNetworksTest-755183467 tempest-ComputeTenantNetworksTest-755183467-project] 10.222.0.69 "GET /compute/v2.1/os-tenant-networks/4b109448-5930-4e83-80ed-36605588792a" status: 200 len: 139 microversion: 2.1 time: 0.349673 Aug 27 03:32:10.974717 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2368/4904] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:32:10 2022] GET /compute/v2.1/os-tenant-networks/4b109448-5930-4e83-80ed-36605588792a => generated 139 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:10.982878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:10.986554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:11.007579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:11.009306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:11.009966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:11.010956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:11.011964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:11.012625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:11.160515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.177319 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7e05ab67-cb77-434b-91a1-3c54dba78c56 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1173 microversion: 2.1 time: 0.247455 Aug 27 03:32:11.193764 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2537/4905] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:10 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1173 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:11.199512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d6b1ea18-86f9-4ea2-a592-53044c80944f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:11.200773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d6b1ea18-86f9-4ea2-a592-53044c80944f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:11.327118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d6b1ea18-86f9-4ea2-a592-53044c80944f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.339554 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d6b1ea18-86f9-4ea2-a592-53044c80944f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1214 microversion: 2.1 time: 0.141259 Aug 27 03:32:11.341797 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2538/4906] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:11 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:11.641498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:11.642838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:11.657445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:11.661146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:11.662433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:11.665575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:11.666395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:11.666937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:11.836128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:11.861700 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6149ff7c-24a4-4391-8b8a-b07470411e3e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1277 microversion: 2.1 time: 0.222518 Aug 27 03:32:11.871676 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2539/4907] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:11 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:11.887908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b2b9c4ca-f523-42f0-859a-971cdd27f23f req-ee77372e-afdf-4f77-8c9d-27cc48b316d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8427f5b-2531-4195-b370-6e0a7564ad16", "tag": "310d8927-f16a-452d-a9f4-b6563414334b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:11.916675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2b9c4ca-f523-42f0-859a-971cdd27f23f req-ee77372e-afdf-4f77-8c9d-27cc48b316d6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:11.917443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2b9c4ca-f523-42f0-859a-971cdd27f23f req-ee77372e-afdf-4f77-8c9d-27cc48b316d6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:11.917957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2b9c4ca-f523-42f0-859a-971cdd27f23f req-ee77372e-afdf-4f77-8c9d-27cc48b316d6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:11.953716 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b2b9c4ca-f523-42f0-859a-971cdd27f23f req-ee77372e-afdf-4f77-8c9d-27cc48b316d6 service nova] Creating event network-changed:310d8927-f16a-452d-a9f4-b6563414334b for instance d8427f5b-2531-4195-b370-6e0a7564ad16 on n-h2-852086-5 Aug 27 03:32:11.971426 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b2b9c4ca-f523-42f0-859a-971cdd27f23f req-ee77372e-afdf-4f77-8c9d-27cc48b316d6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094332 Aug 27 03:32:11.975661 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2540/4908] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:12.203128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.208364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.215284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:12.223734 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4f95919-9b53-45c1-a693-5ebd8c0ddbd5 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 1.247727 Aug 27 03:32:12.242226 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2369/4909] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:10 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:12.255105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.260129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.264338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:12.269679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.270313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.270783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:12.373075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.374677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:12.390687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.403298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.407290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:12.409184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.412443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.413192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:12.553583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.566981 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2094052-a767-422f-9786-f9371293e6ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1173 microversion: 2.1 time: 0.369834 Aug 27 03:32:12.582111 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2541/4910] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:12 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1173 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:12.680145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:12.691787 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-010e6514-25b5-45aa-89d4-bf57a55383e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1266 microversion: 2.1 time: 0.331206 Aug 27 03:32:12.696207 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2370/4911] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:12 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:12.906389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:12.908443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:12.917739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.918835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.919464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:12.920775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:12.921819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:12.922458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.246035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.246647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:13.267086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.269411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.270099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.271095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.271723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.272306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.377078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.409926 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-52197da5-abb3-4a15-97c8-0c906323d4d7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.510355 Aug 27 03:32:13.410602 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2542/4912] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:12 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:13.591193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.592738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:13.614776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.618752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.622742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.623880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.629879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.630627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.842797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:13.860123 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2df40ed1-d5a2-440a-8395-8390744022f5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1173 microversion: 2.1 time: 0.274109 Aug 27 03:32:13.870842 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2543/4913] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:13 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1173 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:13.885004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:13.887538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:13.903413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.908740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.909496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:13.910325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:13.911137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:13.911767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.127056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.147224 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed3388ea-9b1a-40e6-bfd1-1c628d036234 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1272 microversion: 2.1 time: 0.282317 Aug 27 03:32:14.148831 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2544/4914] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:13 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:14.156389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.156902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:14.166554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.167640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.168606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.170603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.171993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.173921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.214327 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-99346b9e-658e-4933-b42d-947cd71e6e4e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/ips" status: 200 len: 146 microversion: 2.1 time: 0.063714 Aug 27 03:32:14.215595 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2545/4915] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:32:14 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/ips => generated 146 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:14.226113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f8e14c77-e739-4487-9748-8d40ea83ce54 req-020c3763-50f0-4f46-881b-5633f9957f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8427f5b-2531-4195-b370-6e0a7564ad16", "tag": "310d8927-f16a-452d-a9f4-b6563414334b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:14.239535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8e14c77-e739-4487-9748-8d40ea83ce54 req-020c3763-50f0-4f46-881b-5633f9957f31 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.240023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8e14c77-e739-4487-9748-8d40ea83ce54 req-020c3763-50f0-4f46-881b-5633f9957f31 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.240579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f8e14c77-e739-4487-9748-8d40ea83ce54 req-020c3763-50f0-4f46-881b-5633f9957f31 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.257089 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f8e14c77-e739-4487-9748-8d40ea83ce54 req-020c3763-50f0-4f46-881b-5633f9957f31 service nova] Creating event network-changed:310d8927-f16a-452d-a9f4-b6563414334b for instance d8427f5b-2531-4195-b370-6e0a7564ad16 on n-h2-852086-5 Aug 27 03:32:14.264890 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f8e14c77-e739-4487-9748-8d40ea83ce54 req-020c3763-50f0-4f46-881b-5633f9957f31 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047967 Aug 27 03:32:14.267317 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2546/4916] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:14.436294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.437153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:14.446630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.447479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.448396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.449399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.450538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.453135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.716181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:14.740915 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33b6b7e4-9525-4b31-816b-7ba990356073 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.311286 Aug 27 03:32:14.741655 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2547/4917] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:14 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:14.905200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:14.905943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:14.915253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.916949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.917758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:14.918758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:14.920612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:14.921670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.046774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.063203 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9224c60-e8ec-4b22-b4dd-89a755627b0c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 1.816529 Aug 27 03:32:15.065143 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2371/4918] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:13 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:15.179985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.181427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:15.194759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:15.196546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:15.197207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:15.197421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.203770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:15.205010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:15.205688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.308218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.317670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:15.322876 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38ab9865-a590-44f5-9ae7-d79f3b00de22 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1215 microversion: 2.1 time: 0.424416 Aug 27 03:32:15.326122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2548/4919] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:14 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1215 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:15.779553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:15.781597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:15.797884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:15.798744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:15.799196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.799919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:15.800378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:15.800816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:15.875323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:15.893427 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8854f7d-75ba-421b-a697-83f6e63e17ad tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1272 microversion: 2.1 time: 0.717892 Aug 27 03:32:15.906380 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2372/4920] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:15 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1272 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:16.019334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0b3e27aa-a566-4e07-86de-6d2cc36cce2c req-9ac675b8-113f-4c5a-813c-386bc9193e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d37106-31bb-44bc-9884-8e72d7b3faaa", "tag": "d1fcf354-77f1-4493-acbe-0a9096bb9829"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:16.035726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0b3e27aa-a566-4e07-86de-6d2cc36cce2c req-9ac675b8-113f-4c5a-813c-386bc9193e93 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:16.036283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0b3e27aa-a566-4e07-86de-6d2cc36cce2c req-9ac675b8-113f-4c5a-813c-386bc9193e93 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:16.036714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0b3e27aa-a566-4e07-86de-6d2cc36cce2c req-9ac675b8-113f-4c5a-813c-386bc9193e93 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:16.082190 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0b3e27aa-a566-4e07-86de-6d2cc36cce2c req-9ac675b8-113f-4c5a-813c-386bc9193e93 service nova] Creating event network-changed:d1fcf354-77f1-4493-acbe-0a9096bb9829 for instance 23d37106-31bb-44bc-9884-8e72d7b3faaa on n-h1-852086-5 Aug 27 03:32:16.092312 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0b3e27aa-a566-4e07-86de-6d2cc36cce2c req-9ac675b8-113f-4c5a-813c-386bc9193e93 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077535 Aug 27 03:32:16.101417 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2373/4921] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:16.108468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.109177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:16.117258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:16.117770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:16.118293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:16.119049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:16.119536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:16.119986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:16.203088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.218976 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9dae3086-9974-4bd3-8a41-1d56ac60b5ed tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.450207 Aug 27 03:32:16.235197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2549/4922] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:15 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:16.354765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.355378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:16.370411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:16.371207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:16.371915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:16.372846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:16.373307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:16.373900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:16.417098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:16.691169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.698968 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-06cfce74-1b07-4c0e-936f-7c4abb99e60e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1215 microversion: 2.1 time: 0.348136 Aug 27 03:32:16.701185 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2550/4923] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:16 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:16.720647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:16.740623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:16.753266 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a358748-7bb4-44a7-b965-58e022ab7891 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.649875 Aug 27 03:32:16.755180 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2374/4924] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:16 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:16.922786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:16.924576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:16.942970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:16.943802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:16.944537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:16.945760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:16.951114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:16.951700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:17.076031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:17.091976 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-da590057-8535-4103-812c-b5453abcd699 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1272 microversion: 2.1 time: 0.174955 Aug 27 03:32:17.093654 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2551/4925] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:16 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:17.264134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.269803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:17.296035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:17.296876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:17.302496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:17.306896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:17.310557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:17.311265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:17.731206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:17.733679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:17.758656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:17.759751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:17.760934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:17.762551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:17.772185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:17.776961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.106301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.121886 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-191c55b9-4c68-4923-9ac2-d109930d8850 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1215 microversion: 2.1 time: 0.403137 Aug 27 03:32:18.134273 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2552/4926] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:17 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1215 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:18.134273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.134273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:18.145295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.146232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.147090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.148074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.148753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.149393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.395090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.404682 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c947a75-cfef-48fa-8984-77087c0f2992 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.278839 Aug 27 03:32:18.405504 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2553/4927] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:18 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:18.412093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5254615-0a3f-430b-b30a-dab0e0bfae1f"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:18.415050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:18.428426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.429487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.430203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.432826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.433644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.434814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.701525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:18.717033 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64b006ee-c189-4be5-9208-717364cd55c7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 1.475720 Aug 27 03:32:18.734994 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2375/4928] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:17 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:18.747642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:18.748285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:18.756102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.756957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.757608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:18.758608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:18.759273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:18.759875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:19.017704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:19.031300 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a273455-cec3-4a8f-9c90-2fe61f8a219a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1272 microversion: 2.1 time: 0.293718 Aug 27 03:32:19.034244 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2376/4929] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:18 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:19.051036 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-97c6c5d0-d1b4-4e1e-950a-86f557aa37ad tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643354 Aug 27 03:32:19.059218 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2554/4930] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:32:18 2022] POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:19.167853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:19.177224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:19.195932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:19.197195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:19.199106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:19.201373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:19.202613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:19.203758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:19.445194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:19.447502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:19.477383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:19.484582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:19.486812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:19.493412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:19.493412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:19.496407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:20.041307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:20.061474 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec01050c-5f49-43f9-8068-50a36c76ce03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1215 microversion: 2.1 time: 0.898728 Aug 27 03:32:20.068579 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2377/4931] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:19 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1215 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:20.087527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:20.091318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:20.113202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:20.117946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:20.118440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:20.119392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:20.122797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:20.123378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:20.807547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:21.100990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.119922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-76bd0ed3-559b-428e-a3dc-f09cc294928c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 1.688968 Aug 27 03:32:21.121087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2555/4932] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:19 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.128572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.129955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:21.175774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:21.176655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:21.180300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:21.181451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:21.184563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:21.187327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:21.336366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=26 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:21.379522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.396622 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39f4c00a-c5e3-49a0-accf-d92a07277261 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 1.323388 Aug 27 03:32:21.398195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2378/4933] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:20 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.409992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:21.411603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:21.449056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:21.449297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:21.449652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:21.462613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:21.462856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:21.463294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:21.604539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:21.617631 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bcd42219-ff7e-490e-ac5b-079291042f5e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.494434 Aug 27 03:32:21.634651 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2556/4934] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:21 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:21.640284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cbf794a5-38f6-4a5b-a013-64cdeccf5846 req-4c810bc8-182f-49bf-9f5c-ed89aada3448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5849700a-bf66-43f6-9d99-696dba4a8ab0", "tag": "c5b82efe-d154-4dcd-b443-017a8204ffef"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:21.667547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:21.671544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cbf794a5-38f6-4a5b-a013-64cdeccf5846 req-4c810bc8-182f-49bf-9f5c-ed89aada3448 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:21.672895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cbf794a5-38f6-4a5b-a013-64cdeccf5846 req-4c810bc8-182f-49bf-9f5c-ed89aada3448 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:21.675993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cbf794a5-38f6-4a5b-a013-64cdeccf5846 req-4c810bc8-182f-49bf-9f5c-ed89aada3448 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:21.700298 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cbf794a5-38f6-4a5b-a013-64cdeccf5846 req-4c810bc8-182f-49bf-9f5c-ed89aada3448 service nova] Creating event network-changed:c5b82efe-d154-4dcd-b443-017a8204ffef for instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 on n-h2-852086-5 Aug 27 03:32:21.709903 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cbf794a5-38f6-4a5b-a013-64cdeccf5846 req-4c810bc8-182f-49bf-9f5c-ed89aada3448 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073193 Aug 27 03:32:21.710565 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2557/4935] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:22.159642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.163533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:22.181902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:22.182878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:22.183613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:22.185121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:22.186039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:22.187030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:22.464612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.490170 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ff87852-14dd-470c-8720-83e3643219b8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.337341 Aug 27 03:32:22.492263 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2558/4936] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:22 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:22.501218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.502110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:22.509900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:22.510716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:22.511476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:22.512716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:22.513536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:22.514133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:22.786128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:22.836374 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0472d33e-be62-42c4-8d8e-e827f27603af tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.335397 Aug 27 03:32:22.838698 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2559/4937] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:22 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:22.859716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:22.859716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:22.881551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:22.882279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:22.887511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:22.889077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:22.889931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:22.890722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.269671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.279632 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2fe3f68-be54-43b4-8dd7-377d88bfbc3c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.439175 Aug 27 03:32:23.281635 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2560/4938] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:22 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:23.493587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.503902 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea04e571-a91c-4106-ba4b-b39cec865ba7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 2.100977 Aug 27 03:32:23.504488 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2379/4939] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:21 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:23.513776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.514854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:23.522479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.523171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.524023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.525169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.525792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.526425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.708952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:23.724128 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-42374455-aab8-4bd9-bd00-e3cd4635667e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.214024 Aug 27 03:32:23.725353 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2561/4940] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:23 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:23.846572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1952b43d-3c0b-49c4-977c-d4839405cac0 req-5e5e244a-a0b4-401c-b815-aca84340a2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207e7dd0-23d3-47b1-b82b-fad154ab86e7", "tag": "3d09b34a-44b7-4263-a0ce-8cb6b26029fe"}, {"name": "network-changed", "server_uuid": "83a538b7-cc32-4afb-be97-8d0d2f7a37f4", "tag": "9b9483a9-ad52-4cc9-96fc-05799bb43f6f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:23.858287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1952b43d-3c0b-49c4-977c-d4839405cac0 req-5e5e244a-a0b4-401c-b815-aca84340a2b9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.858747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1952b43d-3c0b-49c4-977c-d4839405cac0 req-5e5e244a-a0b4-401c-b815-aca84340a2b9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.859186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1952b43d-3c0b-49c4-977c-d4839405cac0 req-5e5e244a-a0b4-401c-b815-aca84340a2b9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.871456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:23.872383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:23.885449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.885970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.886492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.887212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:23.887671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:23.888670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:23.893933 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1952b43d-3c0b-49c4-977c-d4839405cac0 req-5e5e244a-a0b4-401c-b815-aca84340a2b9 service nova] Creating event network-changed:3d09b34a-44b7-4263-a0ce-8cb6b26029fe for instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 on n-h1-852086-5 Aug 27 03:32:23.897558 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1952b43d-3c0b-49c4-977c-d4839405cac0 req-5e5e244a-a0b4-401c-b815-aca84340a2b9 service nova] Creating event network-changed:9b9483a9-ad52-4cc9-96fc-05799bb43f6f for instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 on n-h1-852086-5 Aug 27 03:32:23.916610 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1952b43d-3c0b-49c4-977c-d4839405cac0 req-5e5e244a-a0b4-401c-b815-aca84340a2b9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074040 Aug 27 03:32:23.917540 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2380/4941] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:24.118448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.129798 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4f044d8-56ab-49fa-a141-23c688e73f62 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.262370 Aug 27 03:32:24.132716 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2562/4942] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:23 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:24.307910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.310952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:24.324477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:24.325814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:24.327132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:24.328191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:24.328894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:24.330391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:24.534020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.535624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:24.556481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:24.557307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:24.557969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:24.559064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:24.559749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:24.560463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:24.885432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:24.899957 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fd69510d-b3c8-4e1a-add8-b7b1c443acec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.376929 Aug 27 03:32:24.901647 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2563/4943] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:24 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:24.926211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:24.926998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:24.936617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:24.937717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:24.939110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:24.939936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:24.940638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:24.941270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.052473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.072824 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c091e6fc-0282-4fec-a74e-2ad8da572e07 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.772151 Aug 27 03:32:25.096166 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2381/4944] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:24 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:25.103169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ecd06b77-7f44-4a29-8558-d95a1b4bb723 req-f6837115-d973-41d5-a191-0a5a23f1f3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d37106-31bb-44bc-9884-8e72d7b3faaa", "name": "network-vif-plugged", "status": "completed", "tag": "d1fcf354-77f1-4493-acbe-0a9096bb9829"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:25.115798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ecd06b77-7f44-4a29-8558-d95a1b4bb723 req-f6837115-d973-41d5-a191-0a5a23f1f3ee service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:25.116675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ecd06b77-7f44-4a29-8558-d95a1b4bb723 req-f6837115-d973-41d5-a191-0a5a23f1f3ee service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:25.117392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ecd06b77-7f44-4a29-8558-d95a1b4bb723 req-f6837115-d973-41d5-a191-0a5a23f1f3ee service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.146643 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ecd06b77-7f44-4a29-8558-d95a1b4bb723 req-f6837115-d973-41d5-a191-0a5a23f1f3ee service nova] Creating event network-vif-plugged:d1fcf354-77f1-4493-acbe-0a9096bb9829 for instance 23d37106-31bb-44bc-9884-8e72d7b3faaa on n-h1-852086-5 Aug 27 03:32:25.158081 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ecd06b77-7f44-4a29-8558-d95a1b4bb723 req-f6837115-d973-41d5-a191-0a5a23f1f3ee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058136 Aug 27 03:32:25.160448 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2382/4945] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:25.175350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:25.178380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:25.190951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:25.191872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:25.192700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.193673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:25.194457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:25.195399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.288722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.300371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d21b328-23fa-4626-9d48-8bb5ce81a86d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.396796 Aug 27 03:32:25.303245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2564/4946] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:24 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:25.412734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:25.428364 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a628f2c2-676d-4c4b-909e-58ad1edd17f4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.265078 Aug 27 03:32:25.429806 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2383/4947] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:25 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:25.925650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:25.926431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:25.933327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:25.934210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:25.934836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.935716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:25.936591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:25.937208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.940318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0c101610-75cb-434d-b6d2-324d24df3152 req-f1d876da-3891-4fb3-9660-9e86d99106be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf23289-3f9f-4689-9908-a3b1d38601e5", "tag": "90d61710-6b11-4f4c-8590-cfb3862c3a6a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:25.959849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c101610-75cb-434d-b6d2-324d24df3152 req-f1d876da-3891-4fb3-9660-9e86d99106be service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:25.963111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c101610-75cb-434d-b6d2-324d24df3152 req-f1d876da-3891-4fb3-9660-9e86d99106be service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:25.963674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c101610-75cb-434d-b6d2-324d24df3152 req-f1d876da-3891-4fb3-9660-9e86d99106be service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:25.981966 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0c101610-75cb-434d-b6d2-324d24df3152 req-f1d876da-3891-4fb3-9660-9e86d99106be service nova] Creating event network-changed:90d61710-6b11-4f4c-8590-cfb3862c3a6a for instance baf23289-3f9f-4689-9908-a3b1d38601e5 on n-h2-852086-5 Aug 27 03:32:25.999855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0c101610-75cb-434d-b6d2-324d24df3152 req-f1d876da-3891-4fb3-9660-9e86d99106be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064455 Aug 27 03:32:26.004213 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2384/4948] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:26.111749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.112564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:26.126624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:26.127214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:26.127768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:26.128630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:26.129206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:26.133779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:26.177779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.214731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0d89f56-5397-43d3-9c3d-44da2003def3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.293495 Aug 27 03:32:26.215974 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2565/4949] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:25 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:26.325961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.327053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:26.340229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:26.342764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:26.342929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:26.343643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:26.347131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:26.347694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:26.395925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:26.570841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.585404 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-876ee538-de31-480b-9c5a-8196a22be062 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.262129 Aug 27 03:32:26.602381 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2566/4950] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:26 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:26.606839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:26.607484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:26.624277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:26.625004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:26.626911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:26.632021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:26.635843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:26.636620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:26.849915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:26.859911 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e604f2e5-0405-47dc-97d4-96b4d748eefa tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.262918 Aug 27 03:32:26.863531 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2567/4951] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:26 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:27.187265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.201100 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49c2c279-b85a-4d2c-9679-973aec0a7bec tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 1.093624 Aug 27 03:32:27.202113 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2385/4952] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:26 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:27.246040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.247889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:27.257178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:27.258091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:27.258820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:27.260062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:27.260768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:27.261884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:27.458207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.472981 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2bd54a2-d3ca-4cf8-ae3c-87fe35e50224 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.234364 Aug 27 03:32:27.493653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2568/4953] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:27 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:27.611337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.612682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:27.615538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:27.624159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:27.624943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:27.625538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:27.627457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:27.628701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:27.629148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:27.804935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:27.813040 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb49855a-72bc-4e57-89c4-c9fa9effd7aa tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.206657 Aug 27 03:32:27.813734 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2386/4954] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:27 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:27.887259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:27.887885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:27.895328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:27.895830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:27.896273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:27.896989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:27.897450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:27.897878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:28.077377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.086817 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c9db62b-53be-49e6-9aad-2e33e3f34c82 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.204132 Aug 27 03:32:28.087691 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2569/4955] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:27 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:28.224294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.225633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:28.236620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:28.237121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:28.237726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:28.238494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:28.238976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:28.239461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:28.443476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.454664 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22e3ddc1-e50a-4a34-9071-a21e98393b95 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.234742 Aug 27 03:32:28.456278 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2387/4956] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:28 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:28.497752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.499630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:28.509232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:28.510094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:28.510780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:28.511713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:28.512423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:28.513144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:28.762705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:28.773513 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6e76b88-d51d-4c1f-9b79-7ced8329280e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.282620 Aug 27 03:32:28.774813 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2570/4957] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:28 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:28.839867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:28.840866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:28.849627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:28.849627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:28.850064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:28.851241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:28.851937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:28.852409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:28.973239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-68c824f3-9728-4d8d-b270-5144a78a4707 req-063a7730-9f03-4925-beea-9882db71db10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a538b7-cc32-4afb-be97-8d0d2f7a37f4", "name": "network-vif-plugged", "status": "completed", "tag": "9b9483a9-ad52-4cc9-96fc-05799bb43f6f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:28.987784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-68c824f3-9728-4d8d-b270-5144a78a4707 req-063a7730-9f03-4925-beea-9882db71db10 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:28.988639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-68c824f3-9728-4d8d-b270-5144a78a4707 req-063a7730-9f03-4925-beea-9882db71db10 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:28.989442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-68c824f3-9728-4d8d-b270-5144a78a4707 req-063a7730-9f03-4925-beea-9882db71db10 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:29.015767 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-68c824f3-9728-4d8d-b270-5144a78a4707 req-063a7730-9f03-4925-beea-9882db71db10 service nova] Creating event network-vif-plugged:9b9483a9-ad52-4cc9-96fc-05799bb43f6f for instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 on n-h1-852086-5 Aug 27 03:32:29.023902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-68c824f3-9728-4d8d-b270-5144a78a4707 req-063a7730-9f03-4925-beea-9882db71db10 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055266 Aug 27 03:32:29.025576 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2571/4958] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:29.060320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.075765 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95bab9d2-407c-4178-a7e0-b4a7baa9c935 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.240784 Aug 27 03:32:29.077644 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2388/4959] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:28 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:29.115303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.117651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:29.128192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:29.129654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:29.130735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:29.132078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:29.132989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:29.134277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:29.412872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.427961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34da0cb2-3dc6-481b-ad6a-57049dea901f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.321527 Aug 27 03:32:29.428572 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2572/4960] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:29 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:29.494751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.495558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:29.503384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:29.504104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:29.504649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:29.505695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:29.506319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:29.507229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:29.813417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:29.814371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:29.817181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:29.821833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:29.822395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:29.822828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:29.824228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:29.824705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:29.825254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:29.834667 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab3e1fb0-eddd-4976-b355-4f700296bee9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.344056 Aug 27 03:32:29.836505 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2389/4961] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:29 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.004287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.016929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9fe9e12c-f87d-43cc-b07e-d5e8bb46dd94 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.216442 Aug 27 03:32:30.018517 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2573/4962] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:29 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.103458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.104614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:30.124526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:30.125506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:30.126634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:30.127775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:30.128465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:30.129469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:30.449793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.450075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.450708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:30.460988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:30.461555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:30.462006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:30.463401 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dabf6c56-7405-4efc-959a-15a1350f4add tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1517 microversion: 2.1 time: 0.365309 Aug 27 03:32:30.464357 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2390/4963] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:30 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:30.467439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:30.468302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:30.469062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:30.638379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:30.647021 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd4e1b22-1705-41e9-ae56-92f5505621e6 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.200762 Aug 27 03:32:30.647621 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2574/4964] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:30 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:30.856673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:30.857287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:30.864658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:30.865154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:30.865592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:30.866327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:30.866790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:30.867217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.034059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.041529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.042307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:31.042757 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c08399e2-f4ef-4c26-a878-64f5ca37d5eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.189973 Aug 27 03:32:31.043349 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2391/4965] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:30 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:31.054423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.054423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.054423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.054423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.054423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.054423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.062793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7f0ac538-986c-4237-b1a4-76155df19e52 req-112eb9b9-31c1-4c1d-aab9-245cf9e74d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5849700a-bf66-43f6-9d99-696dba4a8ab0", "name": "network-vif-plugged", "status": "completed", "tag": "c5b82efe-d154-4dcd-b443-017a8204ffef"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:31.073698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7f0ac538-986c-4237-b1a4-76155df19e52 req-112eb9b9-31c1-4c1d-aab9-245cf9e74d87 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.074217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7f0ac538-986c-4237-b1a4-76155df19e52 req-112eb9b9-31c1-4c1d-aab9-245cf9e74d87 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.074661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7f0ac538-986c-4237-b1a4-76155df19e52 req-112eb9b9-31c1-4c1d-aab9-245cf9e74d87 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.088969 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7f0ac538-986c-4237-b1a4-76155df19e52 req-112eb9b9-31c1-4c1d-aab9-245cf9e74d87 service nova] Creating event network-vif-plugged:c5b82efe-d154-4dcd-b443-017a8204ffef for instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 on n-h2-852086-5 Aug 27 03:32:31.095936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7f0ac538-986c-4237-b1a4-76155df19e52 req-112eb9b9-31c1-4c1d-aab9-245cf9e74d87 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038082 Aug 27 03:32:31.097035 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2392/4966] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:31.240106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.256114 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7d548fe8-d7e2-4fb5-899d-ff54dc8940f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.218743 Aug 27 03:32:31.256890 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2575/4967] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:31 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:31.290195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.290925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:31.297336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.298818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.298818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.299595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.300067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.300504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.343404 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-150ffc71-388d-472b-86c3-287b4d625966 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5/ips" status: 200 len: 149 microversion: 2.1 time: 0.057874 Aug 27 03:32:31.344165 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2393/4968] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:32:31 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:31.356528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "911734f8-fbf6-4a69-bcc8-54e18c3c3d30"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:31.359491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:31.370303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.371425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.372106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.373467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.374554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.375111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.482680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Invalid volume: volume 911734f8-fbf6-4a69-bcc8-54e18c3c3d30 is already attached to instances: 1a62a379-69d5-41ac-ad6a-7d481ff57538 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5/os-volume_attachments HTTP/1.1 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 74 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: {"volumeAttachment": {"volumeId": "911734f8-fbf6-4a69-bcc8-54e18c3c3d30"}} Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid volume: volume 911734f8-fbf6-4a69-bcc8-54e18c3c3d30 is already attached to instances: 1a62a379-69d5-41ac-ad6a-7d481ff57538 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5', 'body': {'volumeAttachment': {'volumeId': '911734f8-fbf6-4a69-bcc8-54e18c3c3d30'}}} Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 911734f8-fbf6-4a69-bcc8-54e18c3c3d30 is already attached to instances: 1a62a379-69d5-41ac-ad6a-7d481ff57538 Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:32:31.484726 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 911734f8-fbf6-4a69-bcc8-54e18c3c3d30 is already attached to instances: 1a62a379-69d5-41ac-ad6a-7d481ff57538 Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 911734f8-fbf6-4a69-bcc8-54e18c3c3d30 is already attached to instances: 1a62a379-69d5-41ac-ad6a-7d481ff57538 Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:32:31.497637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 400 to user: Invalid volume: volume 911734f8-fbf6-4a69-bcc8-54e18c3c3d30 is already attached to instances: 1a62a379-69d5-41ac-ad6a-7d481ff57538 {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:32:31.500654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.500861 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-525ccfc4-f1c0-4fb4-aecd-271e6d7eb785 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135355 Aug 27 03:32:31.501026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:31.501530 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2576/4969] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:32:31 2022] POST /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:32:31.502102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.502102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.502102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.502675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.502675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:31.502965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.502965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.502965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.504584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.504934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.505263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.505994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.506506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.506942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.532766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:31.536017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:32:31.665983 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c169185f-cd37-46eb-8c9f-5993692bea2d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 204 len: 0 microversion: 2.1 time: 0.168704 Aug 27 03:32:31.667183 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2577/4970] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:32:31 2022] DELETE /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:31.676848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.677560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:31.686321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.686821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.687990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.688155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.689486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.692628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.778594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.794787 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53d01760-3ac1-47f0-8b01-d9f6fa875836 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1523 microversion: 2.1 time: 0.313155 Aug 27 03:32:31.795985 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2394/4971] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:31 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:31.801206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:31.802280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:31.809967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.810755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.811351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.812269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:31.812897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:31.813608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:31.921738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:31.935437 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fef47f18-c979-4749-8934-cf684643db17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.266904 Aug 27 03:32:31.936138 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2578/4972] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:31 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.002141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.011736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b1e7d22-5c70-45e2-805d-992617f13b0c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1681 microversion: 2.1 time: 0.214296 Aug 27 03:32:32.012434 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2395/4973] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:31 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.068753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.069818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:32.078358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.079638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.080374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:32.081163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.081749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.082521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:32.262891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.273691 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f34bfe77-0fba-4bb8-97db-bfa1a030e6c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.209640 Aug 27 03:32:32.286680 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2579/4974] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:32 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.290924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.291542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:32.300894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.301035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.301463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:32.302255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.303032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.303510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:32.499543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:32.512322 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c5dbc97-6440-448e-b3f9-3fedd938c9f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.237516 Aug 27 03:32:32.514707 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2396/4975] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:32 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:32.833032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.834555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:32.845924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.846954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.847569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:32.848498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.849372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.850050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:32.963775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:32.964466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:32.975009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.975521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.975967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:32.976720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:32.977169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:32.977604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.107411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.119759 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1ed13b56-5275-43aa-a7a1-508884608ef9 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1523 microversion: 2.1 time: 0.293957 Aug 27 03:32:33.130210 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2580/4976] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:32 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.130210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.130210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:33.143197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:33.144391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:33.144853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.145777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:33.146270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:33.146711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.223688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.252053 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a93fcf55-e204-4cc9-bb0b-7108a421fb32 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.288616 Aug 27 03:32:33.258684 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2397/4977] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:32 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:33.264793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c9de3d12-cb21-47ec-82bb-a7ea3d4e15ee req-1a9f9f22-e0b2-416e-be12-b2d046028c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e906f0-fbf5-499d-89d7-4d783215b3aa", "name": "network-vif-unplugged", "status": "completed", "tag": "9a810162-9ce6-4cb0-82cb-9266aeb323f5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:33.281653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c9de3d12-cb21-47ec-82bb-a7ea3d4e15ee req-1a9f9f22-e0b2-416e-be12-b2d046028c7c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:33.282449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c9de3d12-cb21-47ec-82bb-a7ea3d4e15ee req-1a9f9f22-e0b2-416e-be12-b2d046028c7c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:33.283064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c9de3d12-cb21-47ec-82bb-a7ea3d4e15ee req-1a9f9f22-e0b2-416e-be12-b2d046028c7c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.308940 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c9de3d12-cb21-47ec-82bb-a7ea3d4e15ee req-1a9f9f22-e0b2-416e-be12-b2d046028c7c service nova] Creating event network-vif-unplugged:9a810162-9ce6-4cb0-82cb-9266aeb323f5 for instance c5e906f0-fbf5-499d-89d7-4d783215b3aa on n-h1-852086-5 Aug 27 03:32:33.317011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c9de3d12-cb21-47ec-82bb-a7ea3d4e15ee req-1a9f9f22-e0b2-416e-be12-b2d046028c7c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056920 Aug 27 03:32:33.320625 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2398/4978] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:33.333134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.334123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:33.351081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:33.351740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:33.352220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.353033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:33.353597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:33.354040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.459191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.479201 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1173c960-7d00-4856-9090-c402a151a1d7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1681 microversion: 2.1 time: 0.355848 Aug 27 03:32:33.481478 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2581/4979] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:33 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1681 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.537332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:33.538825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:33.565251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:33.567284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:33.568123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.569948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:33.570808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:33.572457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:33.587029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:33.651700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.672408 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a7f6e10-daa9-47e6-b60c-dc85c1da696c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.349947 Aug 27 03:32:33.686045 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2399/4980] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:33 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:33.847156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:33.856808 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-09f14983-cc8c-4413-aa42-dc06f1081f5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.324207 Aug 27 03:32:33.862378 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2582/4981] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:33 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:34.147526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.148392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:34.156725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.157500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.157962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.158936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.159429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.159857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.292523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.303511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:34.324976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.325986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.326908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.328257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.338601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.338601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.440525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.460948 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d7f6811-3e3c-4c15-893e-78e737bd55da tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1523 microversion: 2.1 time: 0.317978 Aug 27 03:32:34.476217 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2400/4982] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:34 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:34.503389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59fb9609-af25-4dfe-ad20-e99f9b072348 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:34.511887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fb9609-af25-4dfe-ad20-e99f9b072348 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.513301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fb9609-af25-4dfe-ad20-e99f9b072348 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.513954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fb9609-af25-4dfe-ad20-e99f9b072348 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.567424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59fb9609-af25-4dfe-ad20-e99f9b072348 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:32:34.652878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:34.664111 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2e80552-b95c-4f5b-9807-3a2b5bf8335b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1319 microversion: 2.1 time: 0.378648 Aug 27 03:32:34.665436 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2583/4983] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:34 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:34.671006 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59fb9609-af25-4dfe-ad20-e99f9b072348 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action" status: 202 len: 0 microversion: 2.1 time: 0.192633 Aug 27 03:32:34.671775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.671977 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2401/4984] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:34 2022] POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:34.673583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:34.680538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.681573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.682245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.683385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.684209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.684859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.693337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:34.694058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:34.710399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.710895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.711910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.713959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:34.717527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:34.718305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:34.992680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.019258 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e005d6fe-3591-467a-96f2-e52ee15084ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1681 microversion: 2.1 time: 0.351769 Aug 27 03:32:35.021936 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2584/4985] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:34 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1681 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.031397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.033399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:35.047098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.048671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.058833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.060705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.061804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.062857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.348866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.358701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0724747-9d61-45c5-8971-03deaec1ffdf tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.334675 Aug 27 03:32:35.359299 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2585/4986] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:35 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.374191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.375151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:35.383981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.385462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.385948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.386816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.387284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.388031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.468353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.488539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45555036-3ece-4fcf-b52c-1e51267deae5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.801221 Aug 27 03:32:35.489540 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2402/4987] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:34 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:35.494414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6f67fbe0-3bb5-4723-ab03-8fe094f7c5ca req-7d57f79c-1855-41bc-a852-df287652e6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf23289-3f9f-4689-9908-a3b1d38601e5", "name": "network-vif-plugged", "status": "completed", "tag": "90d61710-6b11-4f4c-8590-cfb3862c3a6a"}, {"server_uuid": "c5e906f0-fbf5-499d-89d7-4d783215b3aa", "name": "network-vif-plugged", "status": "completed", "tag": "9a810162-9ce6-4cb0-82cb-9266aeb323f5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:35.513380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f67fbe0-3bb5-4723-ab03-8fe094f7c5ca req-7d57f79c-1855-41bc-a852-df287652e6b0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.514507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f67fbe0-3bb5-4723-ab03-8fe094f7c5ca req-7d57f79c-1855-41bc-a852-df287652e6b0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.515216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f67fbe0-3bb5-4723-ab03-8fe094f7c5ca req-7d57f79c-1855-41bc-a852-df287652e6b0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.547129 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6f67fbe0-3bb5-4723-ab03-8fe094f7c5ca req-7d57f79c-1855-41bc-a852-df287652e6b0 service nova] Creating event network-vif-plugged:90d61710-6b11-4f4c-8590-cfb3862c3a6a for instance baf23289-3f9f-4689-9908-a3b1d38601e5 on n-h2-852086-5 Aug 27 03:32:35.548137 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6f67fbe0-3bb5-4723-ab03-8fe094f7c5ca req-7d57f79c-1855-41bc-a852-df287652e6b0 service nova] Creating event network-vif-plugged:9a810162-9ce6-4cb0-82cb-9266aeb323f5 for instance c5e906f0-fbf5-499d-89d7-4d783215b3aa on n-h1-852086-5 Aug 27 03:32:35.561958 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6f67fbe0-3bb5-4723-ab03-8fe094f7c5ca req-7d57f79c-1855-41bc-a852-df287652e6b0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070879 Aug 27 03:32:35.563555 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2403/4988] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:35.573459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.574614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:35.605377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.606333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.606995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.608101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.608772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.610558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.666209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:35.682487 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb55c300-44af-4685-9135-8c4b7c47b85d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.320423 Aug 27 03:32:35.684062 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2586/4989] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:35 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:35.701495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:35.702110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:35.708480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.708960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.709395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:35.710105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:35.710576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:35.711206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.005642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.016172 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c37c82d7-2161-4f82-b698-05846824b8f2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1510 microversion: 2.1 time: 0.324807 Aug 27 03:32:36.027111 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2587/4990] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:35 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.039135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.040881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:36.050827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.050947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.051556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.051556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.051556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.051912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.052098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.069581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0a2a488-555f-4380-9c99-f3e115d49542 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1523 microversion: 2.1 time: 0.504000 Aug 27 03:32:36.070613 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2404/4991] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:35 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.088568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.091241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:36.112642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.113758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.114544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.115516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.116194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.116868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.275069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.290422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f48ba9e-962a-4fd4-9950-549ef5a429bd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1512 microversion: 2.1 time: 0.256189 Aug 27 03:32:36.291104 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2588/4992] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:36 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:36.313935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.315177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:36.322822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.327279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.327279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.327279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.327279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.327279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.523353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.539290 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae20402a-e16c-4ab7-82ec-af4f788109bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 200 len: 1513 microversion: 2.1 time: 0.230823 Aug 27 03:32:36.541516 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2589/4993] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:36 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.547372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.548260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:36.556804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.558226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.559116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.559765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.560581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.561418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.562074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.572851 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0be879de-13bd-460d-8893-14918259f3c4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1681 microversion: 2.1 time: 0.500390 Aug 27 03:32:36.575987 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2405/4994] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:36 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1681 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.591750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.592821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:36.612491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.613129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.613640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.614524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.615315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.617198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.810196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.827712 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc741eb8-94a3-44d3-a783-28d8dfc7b205 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.283419 Aug 27 03:32:36.830723 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2590/4995] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:36 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.838110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.845845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.847068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:36.851006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:36.862691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.863223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.864031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.864370 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b2e0e27-1224-4fa0-9998-3a5abcc71474 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.285990 Aug 27 03:32:36.865402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.866282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.866424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2406/4996] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:36 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:36.866724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.881138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:36.882094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:36.898374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.899044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.902327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:36.903525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:36.905865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:36.906695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.043579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:37.196201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.211085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.211816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.213004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.334493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.345451 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a056401f-071b-4663-97e7-5fcb70ac0a53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.472133 Aug 27 03:32:37.346779 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2407/4997] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:36 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.351886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:37.352952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:37.360364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.361863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.362672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.363666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.364454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.365117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.529456 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3045a01e-20d3-4fe4-a59d-80971d7f1e27 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.695079 Aug 27 03:32:37.566477 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2591/4998] 10.222.0.69 () {58 vars in 1167 bytes} [Sat Aug 27 03:32:36 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.590572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-9894bd92-1944-403f-accc-d7b0de8425e8 req-a7c2d329-39b6-46ef-9c10-ed57528d594b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5", "name": "network-vif-deleted", "tag": "1a0aafcd-717f-48a7-babe-deb38d89952c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:37.625542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9894bd92-1944-403f-accc-d7b0de8425e8 req-a7c2d329-39b6-46ef-9c10-ed57528d594b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.627654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9894bd92-1944-403f-accc-d7b0de8425e8 req-a7c2d329-39b6-46ef-9c10-ed57528d594b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.630038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9894bd92-1944-403f-accc-d7b0de8425e8 req-a7c2d329-39b6-46ef-9c10-ed57528d594b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.680377 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-9894bd92-1944-403f-accc-d7b0de8425e8 req-a7c2d329-39b6-46ef-9c10-ed57528d594b service nova] Creating event network-vif-deleted:1a0aafcd-717f-48a7-babe-deb38d89952c for instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 on n-h2-852086-5 Aug 27 03:32:37.696576 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-9894bd92-1944-403f-accc-d7b0de8425e8 req-a7c2d329-39b6-46ef-9c10-ed57528d594b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127289 Aug 27 03:32:37.698986 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2592/4999] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:37.724881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:37.743075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.745181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1952490456', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:37.763350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.765115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.767342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.771423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.772655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.773677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.785980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:37.806738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15e1f055-96bd-445c-858c-812b343d3e3d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1523 microversion: 2.1 time: 0.458233 Aug 27 03:32:37.808589 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2408/5000] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:37 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1523 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:37.827771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:37.831527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:37.847320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.850341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.850944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.852080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:37.853907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:37.854910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:37.990299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.008597 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8def4d5-1294-41b5-abf6-db56debc2f84 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1327 microversion: 2.1 time: 0.197420 Aug 27 03:32:38.027882 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2409/5001] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:37 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1327 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.041044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.042014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:38.056202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.056706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.058118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.058893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.061487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.062949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.092733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:38.179362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.186716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.187205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.187784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.436179 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3d21e3e7-1150-47fe-bb1e-974de9441639 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1952490456" status: 200 len: 1515 microversion: 2.1 time: 0.725725 Aug 27 03:32:38.436785 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2593/5002] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:32:37 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1952490456 => generated 1515 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.442456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.443203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:38.455087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.455600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.456047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.456774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.457236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.457665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.554598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.573136 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c3a23d3-7c69-48de-a778-98e49814fddc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1314 microversion: 2.1 time: 0.543891 Aug 27 03:32:38.575388 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2410/5003] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:38 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.598053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.598771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:38.619225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.621069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.622194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.626400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.628373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.629884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.687884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:38.765992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.778710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab894f9a-4ef7-4efc-b099-ef28cd4fdef7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.340345 Aug 27 03:32:38.779650 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2594/5004] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:38 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:38.785354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:38.791047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:38.792151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:38.799315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.800094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.800879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.801953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:38.802823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:38.803446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:38.996959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:39.141233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.161323 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0702c7af-9baf-42f3-8d1e-d1ba7147d48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.575878 Aug 27 03:32:39.166448 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2411/5005] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:38 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.184962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.185598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:39.200932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.209268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.210206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.210659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.218591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.220906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.222701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.223477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.223955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.224389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.481288 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b03829ba-3888-49fc-b19f-f1dedc605ede tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.699334 Aug 27 03:32:39.482858 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2595/5006] 10.222.0.69 () {58 vars in 1173 bytes} [Sat Aug 27 03:32:38 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.513631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.515426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:39.532406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.534712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.537217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.539251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.540664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.544160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.602072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.602833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.603439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.604068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lazy-loading 'fault' on Instance uuid 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:32:39.634657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.651239 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6658232-60ca-48a3-8cd7-b31ae1fc8e25 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1508 microversion: 2.1 time: 0.482302 Aug 27 03:32:39.653168 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2412/5007] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:39 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.682705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a8fa2cc9-0073-40a2-bcc2-ff8a5531a06b req-46f1d3a7-a61b-4446-883c-9f8a8fb24701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207e7dd0-23d3-47b1-b82b-fad154ab86e7", "name": "network-vif-plugged", "status": "completed", "tag": "3d09b34a-44b7-4263-a0ce-8cb6b26029fe"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:39.700378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a8fa2cc9-0073-40a2-bcc2-ff8a5531a06b req-46f1d3a7-a61b-4446-883c-9f8a8fb24701 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.700867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a8fa2cc9-0073-40a2-bcc2-ff8a5531a06b req-46f1d3a7-a61b-4446-883c-9f8a8fb24701 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.701311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a8fa2cc9-0073-40a2-bcc2-ff8a5531a06b req-46f1d3a7-a61b-4446-883c-9f8a8fb24701 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.715501 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a8fa2cc9-0073-40a2-bcc2-ff8a5531a06b req-46f1d3a7-a61b-4446-883c-9f8a8fb24701 service nova] Creating event network-vif-plugged:3d09b34a-44b7-4263-a0ce-8cb6b26029fe for instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 on n-h1-852086-5 Aug 27 03:32:39.721649 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a8fa2cc9-0073-40a2-bcc2-ff8a5531a06b req-46f1d3a7-a61b-4446-883c-9f8a8fb24701 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066064 Aug 27 03:32:39.722842 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2413/5008] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:39.724359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.732764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.738856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.739856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.servers [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Removing options 'limit' from query {{(pid=122408) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 03:32:39.741042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:39.741760 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d45f694-fb8e-4d62-bb50-7c53dfe11977 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 200 len: 1332 microversion: 2.1 time: 0.257365 Aug 27 03:32:39.744522 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2596/5009] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:39 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:39.749414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.749907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.750387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.756089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.756917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.757536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.768944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:39.769628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:39.787791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.792982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.793771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.795025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.795666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.796279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:39.803286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:39.833184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:39.840975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:39.841845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:39.842503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.080100 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3602d77-0d00-4347-a8b6-1b5d6ee21edd tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.354216 Aug 27 03:32:40.081235 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2414/5010] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 03:32:39 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.091480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.096636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:40.113403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.113683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.115077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.116035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.117299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.118104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.118966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.123625 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b8587eeb-2805-41bb-85c8-fedebcbf25a3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1500 microversion: 2.1 time: 0.376329 Aug 27 03:32:40.124222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2597/5011] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:39 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1500 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.130397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.131335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:40.137961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.138874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.139557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.140649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.141633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.142853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.329971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.330836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.339443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b78bb6cd-8508-4eb3-9ce4-704d0347e1f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 200 len: 1508 microversion: 2.1 time: 0.256084 Aug 27 03:32:40.340041 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2415/5012] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:40 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.341581 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b1acbd2-8669-46ab-9f6e-5551abc150b1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.215888 Aug 27 03:32:40.342378 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2598/5013] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:40 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.347783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:40.348561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:40.354115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:40.356101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.356930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.357547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.358885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.359506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.360874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.377612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.385076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.386215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:40.391394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.392732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.393076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.394218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.394395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.394720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.427628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:40.476475 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f58fd940-1b3f-450c-a206-ff5b6be2d0a4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.132594 Aug 27 03:32:40.476475 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2416/5014] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:32:40 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.479358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.479970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:40.490648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.492056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.492056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.492401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.492702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.493120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.576346 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.network.security_group_api [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Removing security group 71804287-c9a0-46ba-bd29-82bcd9febc93 from port 90d61710-6b11-4f4c-8590-cfb3862c3a6a Aug 27 03:32:40.675935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.686610 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6dc8e077-b149-4266-9568-ab6ce12f9016 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1203 microversion: 2.1 time: 0.211026 Aug 27 03:32:40.687260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2417/5015] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:40 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.692668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.693297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:40.699965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.700792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.701690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.702688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.703443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.704323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.737284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:32:40.859440 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d8c6542-aa36-4da9-a8d5-adb793c31dfb tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 204 len: 0 microversion: 2.1 time: 0.170368 Aug 27 03:32:40.860095 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2418/5016] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:32:40 2022] DELETE /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:40.866398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.871949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:40.872627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.servers [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Removing options 'limit' from query {{(pid=122408) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 03:32:40.873593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:40.880150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.880425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.881096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.881841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.882329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.882761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.918942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:40.957257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8f83d09-ec2f-4900-b217-bf59bb6ad488 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.095225 Aug 27 03:32:40.958261 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2419/5017] 10.222.0.69 () {58 vars in 1150 bytes} [Sat Aug 27 03:32:40 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:40.963281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:40.964376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:40.973004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.973820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.974467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.975368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:40.976038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:40.976813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:40.995658 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 HTTP/1.1 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5'} Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:32:40.998541 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:41.004502 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:32:41.004502 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:32:41.004502 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:32:41.004502 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:32:41.004502 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:32:41.004502 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:32:41.004502 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:32:41.006514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:32:41.008577 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81cb56c7-14c2-4ded-b867-cce1f482e507 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 404 len: 111 microversion: 2.1 time: 0.048309 Aug 27 03:32:41.009631 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2420/5018] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:40 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:41.023967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.029904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.030926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:41.038683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.039719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.040386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.041368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.042062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.043061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.079620 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7e648261-b6de-48f1-8499-f26332e23b53 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5/action" status: 202 len: 0 microversion: 2.1 time: 0.735040 Aug 27 03:32:41.082023 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2599/5019] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:40 2022] POST /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:41.096179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34481c46-cb5e-405d-af98-9cf7794d26da tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '.version_select at 0x7fe456f71f70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.122200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:41.163338 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34481c46-cb5e-405d-af98-9cf7794d26da tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630755077" status: 202 len: 0 microversion: 2.1 time: 0.079319 Aug 27 03:32:41.163972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2600/5020] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:32:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1630755077 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:41.179110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-451315903", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "9629d05d-a036-490a-a905-c45e2c70a519"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:41.226791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4d417f2-e44e-435a-8ece-efd4eb6ef119 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.211290 Aug 27 03:32:41.238274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2421/5021] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 03:32:41 2022] GET /compute/v2.1/servers => generated 1010 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:41.238274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.238274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:41.255130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.255634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.256249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.256983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.258226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.258796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.296098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] validate_networks() for [('9629d05d-a036-490a-a905-c45e2c70a519', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:41.418500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.434671 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32ab3697-557d-451d-b29e-fa8e4d8fc0fd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1458 microversion: 2.1 time: 0.204489 Aug 27 03:32:41.435278 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2422/5022] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:41 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1458 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:41.441536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-50924524-b66f-4117-9071-9a407177964e req-e7fc8290-eeec-4909-8d70-19d7ea30c0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf23289-3f9f-4689-9908-a3b1d38601e5", "tag": "90d61710-6b11-4f4c-8590-cfb3862c3a6a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:41.466276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50924524-b66f-4117-9071-9a407177964e req-e7fc8290-eeec-4909-8d70-19d7ea30c0ff service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.466806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50924524-b66f-4117-9071-9a407177964e req-e7fc8290-eeec-4909-8d70-19d7ea30c0ff service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.467302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50924524-b66f-4117-9071-9a407177964e req-e7fc8290-eeec-4909-8d70-19d7ea30c0ff service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.511126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-50924524-b66f-4117-9071-9a407177964e req-e7fc8290-eeec-4909-8d70-19d7ea30c0ff service nova] Creating event network-changed:90d61710-6b11-4f4c-8590-cfb3862c3a6a for instance baf23289-3f9f-4689-9908-a3b1d38601e5 on n-h2-852086-5 Aug 27 03:32:41.532311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-50924524-b66f-4117-9071-9a407177964e req-e7fc8290-eeec-4909-8d70-19d7ea30c0ff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094293 Aug 27 03:32:41.533124 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2423/5023] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:41.555225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.569389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:41.570083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:41.617021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.619459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.619779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.620929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.621112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.623269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.791623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:41.869808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb4acac9-6b09-4086-8911-b2c5d93dce17 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.335154 Aug 27 03:32:41.871260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2424/5024] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:32:41 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:41.879643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:41.881347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:41.895449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.897065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.897986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.899439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:41.900402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:41.901229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:41.989562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:41.989979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:41.990508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:41.990914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:41.991321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:42.003712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.004195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.004627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.005375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.006051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.006598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.055648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Getting quotas for project 4ae9abba744b4b08ae3bf99d5f94d63e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:42.077176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Getting quotas for user ecc4fea72e9243f2989722084690be5a and project 4ae9abba744b4b08ae3bf99d5f94d63e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:42.102874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:42.107230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:42.237528 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-25f3fffe-ff9d-417e-8e67-11149ac98fb4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071234 Aug 27 03:32:42.239270 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2601/5025] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:42.261724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.262899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:42.275890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.276682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.277389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.278566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.279326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.280061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.670760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:42.681692 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9a0c25bb-0835-4b62-ae49-ff07416c179b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.425946 Aug 27 03:32:42.682685 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2602/5026] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:42 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:42.697453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.698670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:42.712250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.713234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.714022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.715546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.716466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.717073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.769787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:42.811189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ce5275f-6bb3-4419-ace6-19a95afe3e6d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.937888 Aug 27 03:32:42.814786 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2425/5027] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:41 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:42.836098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:42.856382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:42.863237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.servers [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Removing options 'limit' from query {{(pid=122408) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 03:32:42.865161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:42.887286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.888167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.888950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.890361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:42.891133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:42.892438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:42.996221 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e464a54d-dff0-4478-b910-48fffe4279e1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.178515 Aug 27 03:32:42.998295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2426/5028] 10.222.0.69 () {58 vars in 1140 bytes} [Sat Aug 27 03:32:42 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:43.015439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88315c54-b68e-492e-b71d-18d8586a900a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.017276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88315c54-b68e-492e-b71d-18d8586a900a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:43.060028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.073582 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fd714c0d-4e95-4341-b8b7-482a5d6273df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1390 microversion: 2.1 time: 0.389215 Aug 27 03:32:43.075075 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2603/5029] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:42 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.088844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.089646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:43.107562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.109415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.111199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.112562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.113313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.113970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.152991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-88315c54-b68e-492e-b71d-18d8586a900a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.166021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88315c54-b68e-492e-b71d-18d8586a900a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1217 microversion: 2.1 time: 0.165718 Aug 27 03:32:43.167897 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2427/5030] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:42 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.175507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.182103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.183065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1952490456', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:32:43.200469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.201286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.201958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.202946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.203625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.204428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.409745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:32:43.417556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.422024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:43.442265 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3afb0fd4-73ec-462b-8697-5daaf39ea692 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.365259 Aug 27 03:32:43.443362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2604/5031] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:43 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.453615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.455197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:43.468278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.470684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.471708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.473139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.474696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.475244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.660728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.671309 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fd59cb43-0330-4670-85b9-f479ab08c8fb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1390 microversion: 2.1 time: 0.226373 Aug 27 03:32:43.675440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2605/5032] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:43 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1390 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:43.688431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.689519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:43.700536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.701406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.701863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.702660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.703301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.704242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.903791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-253b28d8-9ff2-4988-9241-fb9e1958fe73 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1952490456" status: 200 len: 346 microversion: 2.1 time: 0.732629 Aug 27 03:32:43.904840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2428/5033] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:32:43 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1952490456 => generated 346 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:43.952083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.955247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:43.985549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.990501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.991284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.992398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.993053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.993699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.057689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.069945 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33f8c906-5a81-43e0-a68e-1489aea0cbb8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.392931 Aug 27 03:32:44.081576 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2606/5034] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:43 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.096306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.097464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:44.138089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.145473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.146793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.148500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.154069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.155051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.377695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.393591 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79428b6c-63db-440f-a4ae-133b24fae705 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1390 microversion: 2.1 time: 0.468742 Aug 27 03:32:44.394965 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2429/5035] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:43 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1390 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.405448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-646578ac-df1a-417c-8a29-75708b1f57ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:44.409445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:44.427189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-646578ac-df1a-417c-8a29-75708b1f57ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.428441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-646578ac-df1a-417c-8a29-75708b1f57ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.429245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-646578ac-df1a-417c-8a29-75708b1f57ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.481163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-646578ac-df1a-417c-8a29-75708b1f57ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:32:44.505010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.514453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a87dfb8e-995f-447e-b754-876d3b6dc39b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.430496 Aug 27 03:32:44.515160 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2607/5036] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:44 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.523154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.523859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:44.537246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.537856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.539376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.539767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.540834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.541670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.570532 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-646578ac-df1a-417c-8a29-75708b1f57ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "POST /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa/action" status: 202 len: 0 microversion: 2.1 time: 0.173216 Aug 27 03:32:44.571421 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2430/5037] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:44 2022] POST /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:44.588587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.590220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:44.603712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.605054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.606432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.608037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.609456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.610813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.777706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.790742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:44.805263 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1cf47c4b-0f9b-4f23-b8df-f5fcd04d4f46 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1269 microversion: 2.1 time: 0.225126 Aug 27 03:32:44.805941 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2431/5038] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:44 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.824973 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54671b11-0aea-4642-b845-799f96bc8918 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.308461 Aug 27 03:32:44.830914 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2608/5039] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:44 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:44.834794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-afb12050-b501-4d5f-aad5-30e8803382b7 req-b84bcd7b-120d-4ec6-8c03-4d5178f8ac4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e906f0-fbf5-499d-89d7-4d783215b3aa", "name": "network-vif-deleted", "tag": "9a810162-9ce6-4cb0-82cb-9266aeb323f5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:44.852968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.853680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:44.862154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-afb12050-b501-4d5f-aad5-30e8803382b7 req-b84bcd7b-120d-4ec6-8c03-4d5178f8ac4d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.869149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-afb12050-b501-4d5f-aad5-30e8803382b7 req-b84bcd7b-120d-4ec6-8c03-4d5178f8ac4d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.869925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-afb12050-b501-4d5f-aad5-30e8803382b7 req-b84bcd7b-120d-4ec6-8c03-4d5178f8ac4d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.871236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.871747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.872195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.872952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.873412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.873842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.885988 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-afb12050-b501-4d5f-aad5-30e8803382b7 req-b84bcd7b-120d-4ec6-8c03-4d5178f8ac4d service nova] Creating event network-vif-deleted:9a810162-9ce6-4cb0-82cb-9266aeb323f5 for instance c5e906f0-fbf5-499d-89d7-4d783215b3aa on n-h1-852086-5 Aug 27 03:32:44.893539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-afb12050-b501-4d5f-aad5-30e8803382b7 req-b84bcd7b-120d-4ec6-8c03-4d5178f8ac4d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083638 Aug 27 03:32:44.894649 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2432/5040] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:44.904170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:44.905898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:44.919286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.920147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.920766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:44.921998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:44.924016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:44.924911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.015339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:32:45.124251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lazy-loading 'services' on Instance uuid 1a62a379-69d5-41ac-ad6a-7d481ff57538 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:32:45.175047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-115c53ce-2308-4cce-b586-7f32f9283d75 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 204 len: 0 microversion: 2.1 time: 0.278458 Aug 27 03:32:45.176332 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2433/5041] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:32:44 2022] DELETE /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:45.186560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.189355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:45.200961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.202217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.202974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.205221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.206241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.207089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.282311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-74637d88-3d49-4da1-a9f8-b0f5a76f7bc3 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments/911734f8-fbf6-4a69-bcc8-54e18c3c3d30" status: 202 len: 0 microversion: 2.1 time: 0.448578 Aug 27 03:32:45.283225 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2609/5042] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:32:44 2022] DELETE /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments/911734f8-fbf6-4a69-bcc8-54e18c3c3d30 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:45.294713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2131482144", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "05166925-98fa-4fca-b74f-85bb13110797"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:45.404887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] validate_networks() for [('05166925-98fa-4fca-b74f-85bb13110797', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:45.478797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.496422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20c498ed-e555-4ef5-a933-1379a8a2cb45 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.318173 Aug 27 03:32:45.497725 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2434/5043] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:45 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.504170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.505349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:45.514017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.518039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.518039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.519500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.520445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.521576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.832433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.873526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3fa0f73c-ff20-4ddc-bd76-62c9f345f369 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1396 microversion: 2.1 time: 0.373518 Aug 27 03:32:45.887472 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2435/5044] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:45 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1396 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.908095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.911330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:45.924208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.924208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.924208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.925354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.925990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.926728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.993277 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bd4ac34-aa95-4a16-9dd6-275b8261dc23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103977 Aug 27 03:32:45.998437 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2436/5045] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:45 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:46.009827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.012035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:46.025575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.025575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.025575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.030765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.031408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.031951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.138459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:46.138955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:46.139594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:46.140074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:46.140625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:46.163439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.164178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.164867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.165792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.166459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.167080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.191116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:46.201492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Getting quotas for user 89f850adf9a7432798f86fe9d2d17b79 and project a0cf74946f704a99a6878baa30bbac4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:46.227389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:46.230779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:46.309500 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-643c9c85-2c93-4fec-9652-fc951ebe3706 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019375 Aug 27 03:32:46.312277 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2610/5046] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:32:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:46.323084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.325269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:46.335635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.338341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.338778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.339357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.340086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.340922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.341560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.349114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa6e02aa-8fc2-47c1-a599-88a33a5e80c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.348541 Aug 27 03:32:46.358822 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2437/5047] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:45 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:46.358822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05c7bb1a-3b2a-498b-8287-d1585f7d7412 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.358822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05c7bb1a-3b2a-498b-8287-d1585f7d7412 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:46.499819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05c7bb1a-3b2a-498b-8287-d1585f7d7412 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.507509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05c7bb1a-3b2a-498b-8287-d1585f7d7412 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1215 microversion: 2.1 time: 0.155456 Aug 27 03:32:46.508541 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2438/5048] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:46 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:46.530238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.530927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:46.555895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.557434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.560269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.560959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.561446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.561881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.695404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.710238 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a86fe92-b9dc-41d8-ba73-2666e46cd299 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.394484 Aug 27 03:32:46.728527 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2611/5049] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:46 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:46.914355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.915430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:46.926943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.927692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.928125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.929059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.930572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.931000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.931404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.943785 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b2fd463d-b8f1-46e2-9de9-06b90c9515d9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.419682 Aug 27 03:32:46.944935 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2439/5050] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:46 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.018933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.021477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:47.029848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.030383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.030883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.033566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.034683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.037043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.082841 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-443e93b1-fa05-445b-bea8-00891940ad9b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073013 Aug 27 03:32:47.085795 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2440/5051] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:47 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:47.140008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:47.152496 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff9ea756-6696-49d7-a5aa-f0da91edebc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1396 microversion: 2.1 time: 0.242254 Aug 27 03:32:47.156197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2612/5052] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:46 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1396 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.394127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.395204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:47.406691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.407983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.408594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.418071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.420042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.421969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.536281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.537834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:47.577423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.579027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.580699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.594825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.595887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.596515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.756532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:47.771329 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d0c06c9-7404-4e09-8b1b-8be16298e34f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1267 microversion: 2.1 time: 0.240551 Aug 27 03:32:47.772149 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2613/5053] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:47 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.789011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-41561cec-20ad-4339-9f60-35783a407dca req-66257f2c-43c6-4585-a30e-cec2a1ee9f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8848dfe8-81b0-41a7-97b5-8a42d003ec6c", "tag": "38aef60b-7f6c-4c6f-9164-6e83ab38ff79"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:47.805438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-41561cec-20ad-4339-9f60-35783a407dca req-66257f2c-43c6-4585-a30e-cec2a1ee9f0d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.806457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-41561cec-20ad-4339-9f60-35783a407dca req-66257f2c-43c6-4585-a30e-cec2a1ee9f0d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.807339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-41561cec-20ad-4339-9f60-35783a407dca req-66257f2c-43c6-4585-a30e-cec2a1ee9f0d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.197828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.207071 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee7ca01a-dbad-42e8-bb19-e1902ea21954 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.818903 Aug 27 03:32:48.207668 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2441/5054] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:47 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.221575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.222104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:48.230134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.230664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.231119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.231816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.232480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.233070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.274949 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-41561cec-20ad-4339-9f60-35783a407dca req-66257f2c-43c6-4585-a30e-cec2a1ee9f0d service nova] Creating event network-changed:38aef60b-7f6c-4c6f-9164-6e83ab38ff79 for instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c on n-h2-852086-5 Aug 27 03:32:48.280918 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-41561cec-20ad-4339-9f60-35783a407dca req-66257f2c-43c6-4585-a30e-cec2a1ee9f0d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.507245 Aug 27 03:32:48.284195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2614/5055] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:48.290061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.291029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:48.299278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.300027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.314385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.315647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.317626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.319249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.560629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.569421 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8af179c9-c136-45d1-b383-c078c0e0b78b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.283726 Aug 27 03:32:48.570337 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2615/5056] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:48 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.575137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.577277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:48.593093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.593524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.593966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.595531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.596158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.596616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.621736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:48.642072 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a161fd5-d92a-42a8-a975-df01f9bb99dd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069871 Aug 27 03:32:48.643260 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2616/5057] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:48 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:48.647823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.648430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:48.665690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.666602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.666739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.667335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.667786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.668212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.869815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.878390 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ee40226-3b15-4aeb-9035-c9ab0b023d87 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.669626 Aug 27 03:32:48.884277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.896156 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2442/5058] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:48 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.901162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.901792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:48.908407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b7cdca3-cc3d-4463-8f25-bf36c1bfd693 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1396 microversion: 2.1 time: 0.263364 Aug 27 03:32:48.909392 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2617/5059] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:48 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1396 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.922428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.922428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.922428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.922934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.923089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.923871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.234693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.235787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:49.246762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.247753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.248718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.255601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.256693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.257545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.479436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.490405 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9287b57-ffc1-491e-874f-f935e2de012c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.260822 Aug 27 03:32:49.491469 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2618/5060] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:49 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:49.592363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.611701 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a01f52b8-4654-41d6-88ef-8aa89627c4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1273 microversion: 2.1 time: 0.713921 Aug 27 03:32:49.616836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.619044 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2443/5061] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:48 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1273 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:49.620105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:49.639971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.641321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.642456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.643980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.645113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.646208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.661966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.666437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:49.682857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.683572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.684202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.687268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.688109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.688832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.693305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:49.800297 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f31fe6dd-7a3a-4b1c-9c8d-a2723f3619e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145913 Aug 27 03:32:49.801263 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2444/5062] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:49 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:49.904690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.905334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:49.919729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.920239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.920687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.921422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.921881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.929447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.948132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.972719 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e8173f9-2d74-4606-ac4d-6095c70d1282 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.369649 Aug 27 03:32:49.974109 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2619/5063] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:49 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:49.979746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.980628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:49.989578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.990410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.991079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.991980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.992737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.993328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.099410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.108145 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb82caac-5ccb-4dd8-acf0-69a176ac3062 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.132285 Aug 27 03:32:50.109149 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2620/5064] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:49 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:50.334943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-62ca790a-8124-4e86-afbe-f983b757fd1e req-d98d5988-3f90-41a9-bcfe-b583c3f9cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207e7dd0-23d3-47b1-b82b-fad154ab86e7", "name": "network-vif-deleted", "tag": "3d09b34a-44b7-4263-a0ce-8cb6b26029fe"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:50.351686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-62ca790a-8124-4e86-afbe-f983b757fd1e req-d98d5988-3f90-41a9-bcfe-b583c3f9cc3e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.352463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-62ca790a-8124-4e86-afbe-f983b757fd1e req-d98d5988-3f90-41a9-bcfe-b583c3f9cc3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.353665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-62ca790a-8124-4e86-afbe-f983b757fd1e req-d98d5988-3f90-41a9-bcfe-b583c3f9cc3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.372825 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-62ca790a-8124-4e86-afbe-f983b757fd1e req-d98d5988-3f90-41a9-bcfe-b583c3f9cc3e service nova] Creating event network-vif-deleted:3d09b34a-44b7-4263-a0ce-8cb6b26029fe for instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 on n-h1-852086-5 Aug 27 03:32:50.381584 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-62ca790a-8124-4e86-afbe-f983b757fd1e req-d98d5988-3f90-41a9-bcfe-b583c3f9cc3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050783 Aug 27 03:32:50.383081 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2621/5065] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:50.399183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.411172 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41fa44e0-9cf4-4e0c-a437-df41a7e1d38e tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.511415 Aug 27 03:32:50.412154 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2445/5066] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:49 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:50.513393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:50.514475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:50.522215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.522944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.523572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.524454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.525151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.525742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.644649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:50.645586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:50.662018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.664687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.664687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.664687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.664687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.665356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.789603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:50.815153 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d2bf130a-3a15-4743-9665-87ad23dc6e01 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.305645 Aug 27 03:32:50.817242 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2622/5067] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:50 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:50.830570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:50.837632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:50.866618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.869580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.870038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.870818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.871288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.874402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.977793 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e82965ee-2bd9-43d0-8946-43e848b2a939 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157362 Aug 27 03:32:50.982939 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2623/5068] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:50 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:51.007537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:51.009427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:51.023667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.024850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.025912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.027748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.029255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.030265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.356222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.386335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-09505e1d-7139-4b88-816a-907d1001ff1d tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.390553 Aug 27 03:32:51.389427 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2624/5069] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:50 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:51.404468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:51.405691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:51.435521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.439067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.440161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.441569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.442698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.443637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.525601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.562200 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8353dae1-e306-4de7-a440-2dea337e6de3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.924074 Aug 27 03:32:51.563244 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2446/5070] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:50 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:51.571735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:51.572865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:51.583719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.584526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.585263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.586480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.589590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.590131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.590952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.604177 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5254ca40-9578-47da-8beb-11055234ef03 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.206182 Aug 27 03:32:51.605538 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2625/5071] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:51 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:51.843093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:51.845650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:51.857261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.858453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.859410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.860677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:51.861512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:51.862312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.025592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:52.046527 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38239c37-076e-4c68-b7fa-ec896286b2c8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.476761 Aug 27 03:32:52.049169 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2447/5072] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:51 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:52.054415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.067764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:52.083320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.084401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.085014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.086057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.087196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.090776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.166540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:52.189312 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-764b2e73-0477-4eab-be38-51ce24d50c49 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.351485 Aug 27 03:32:52.191095 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2626/5073] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:51 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:52.197284 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9517fc1-fa41-4576-9ab2-e8fd759c5f14 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145773 Aug 27 03:32:52.200038 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2448/5074] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:52 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:52.419918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.421272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:52.433168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.434707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.435418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.436836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.437917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.439700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.590891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.591893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:52.604965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.618749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.619571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.620378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.620861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.621290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.707651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:52.725192 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d87ad6fa-bfec-4a55-b99b-2356850f80ff tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.314126 Aug 27 03:32:52.738247 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2627/5075] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:52 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:52.745442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.752192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:52.773497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.780129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.783206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.784632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.785611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.786528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.931703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:52.947210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4b9446b-9a60-4df5-93f8-bd35a39fb48a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.212772 Aug 27 03:32:52.949452 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2628/5076] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:52 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:53.023004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.048267 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5ce28cc-b3f5-48f0-aaa1-6e83f97a904b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.461487 Aug 27 03:32:53.066196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2449/5077] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:52 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:53.084886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.085652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:53.096844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.097553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.098944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.099968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.101364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.102458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.212816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.216663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:53.227088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.228081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.228751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.229715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.230444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.231509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.238941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:53.337326 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a524b27-7a43-43cc-b946-4afc8384dd9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129264 Aug 27 03:32:53.339927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2450/5078] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:53 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:53.353901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.358130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:53.370139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.371821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.374088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.377999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.379664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.380761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.579133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.615437 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ded2d6d-2a4a-4101-9023-4c93b359533c tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.536785 Aug 27 03:32:53.626970 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2629/5079] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:53 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:53.642746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0b2d11f5-3152-48cc-bb54-1239eb467a4c req-56730f10-860f-402d-859a-e75434dfdcdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac772560-1c31-4977-85dd-a63202adb8e5", "tag": "014c473a-6d17-46aa-a021-c49719e13251"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:53.666208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0b2d11f5-3152-48cc-bb54-1239eb467a4c req-56730f10-860f-402d-859a-e75434dfdcdf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.667275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0b2d11f5-3152-48cc-bb54-1239eb467a4c req-56730f10-860f-402d-859a-e75434dfdcdf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.670468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0b2d11f5-3152-48cc-bb54-1239eb467a4c req-56730f10-860f-402d-859a-e75434dfdcdf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.707237 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0b2d11f5-3152-48cc-bb54-1239eb467a4c req-56730f10-860f-402d-859a-e75434dfdcdf service nova] Creating event network-changed:014c473a-6d17-46aa-a021-c49719e13251 for instance ac772560-1c31-4977-85dd-a63202adb8e5 on n-h1-852086-5 Aug 27 03:32:53.722074 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0b2d11f5-3152-48cc-bb54-1239eb467a4c req-56730f10-860f-402d-859a-e75434dfdcdf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098288 Aug 27 03:32:53.723653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2630/5080] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:53.765301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.766910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:53.776415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.777400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.778026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.779051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.779697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.780349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.953433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.970107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bbf4869e-5323-47c9-858f-801aea0b3839 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.625774 Aug 27 03:32:53.971921 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2451/5081] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:53 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:53.986658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.989071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.006268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.010862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.017492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.017492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.031989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.032871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.096118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.131854 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-178ad88e-864a-44c0-b7fa-157a784d9ccf tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.375372 Aug 27 03:32:54.143443 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2631/5082] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:53 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.154991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.168324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.181054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.184942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.188900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.190712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.195206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.196019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.273594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.287204 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-577e6202-ca05-4947-9b93-a398341db490 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.306482 Aug 27 03:32:54.288992 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2452/5083] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:53 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.335135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.336334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.344372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.345557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.346194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.347097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.347879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.348803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.440819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.448600 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf678b21-2599-44b4-9fc0-8d7ce990e715 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.303527 Aug 27 03:32:54.449826 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2632/5084] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:54 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.455353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.457583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.463925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.464441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.464888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.465688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.466095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.466555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.476629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'services' on Instance uuid d8427f5b-2531-4195-b370-6e0a7564ad16 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:32:54.514770 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84f9c8c1-fdfb-4c7f-a5dc-959bd0ab9db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063385 Aug 27 03:32:54.516156 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2633/5085] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:54 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:32:54.589110 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b70d0209-6433-421f-a34f-cda6babd6aff tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments/1c19a71f-8704-43b3-a62c-224f599dffe4" status: 202 len: 0 microversion: 2.1 time: 0.258483 Aug 27 03:32:54.590505 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2453/5086] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:32:54 2022] DELETE /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments/1c19a71f-8704-43b3-a62c-224f599dffe4 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:54.610034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.614912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.622333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:54.624279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.625034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.626452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.627424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.627923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.628807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.654982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.657453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.666904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:54.672618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.673835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.674532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.676454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.677732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.678653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.711105 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11b0a0ae-50ee-47cd-a76e-9bb49c7509a2 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112228 Aug 27 03:32:54.712759 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2634/5087] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:54 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:54.749312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.755644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.779216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.780212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.780212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.780792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.794360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.795007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.868836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:32:54.981555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.005024 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6512c89-5ecf-4746-aef0-2454b1442c34 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.360159 Aug 27 03:32:55.008424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2454/5088] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:54 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:55.022498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.025538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.042139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.043505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.044541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.046058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.047577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.048960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.131357 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00819870-8e03-4c19-b189-c0078cb5ac51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 204 len: 0 microversion: 2.1 time: 0.409967 Aug 27 03:32:55.134461 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2635/5089] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:32:54 2022] DELETE /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:32:55.155146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.156158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.176168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.177366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.178861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.180583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.181727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.182786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.333574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.369739 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57c776c3-4d3a-496e-9f21-939596953533 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.358963 Aug 27 03:32:55.382192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2455/5090] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:55 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:55.386496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.386661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.396697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.397196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.397655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.398400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.399438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.399995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.443848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.455206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f76b3fa2-7ff3-40de-9834-d69a79e63d4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1682 microversion: 2.1 time: 0.314905 Aug 27 03:32:55.469545 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2636/5091] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:55 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1682 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:55.478511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.479331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.487030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.487800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.488416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.489546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.490216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.490819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.580888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.593687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4a7572d-c0ec-4d66-850a-7357b3bcc47d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.122127 Aug 27 03:32:55.595036 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2637/5092] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:55 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:55.600527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.601434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.615359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.616003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.616464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.620446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.621546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.621998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.686926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.726970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c38e3d4b-55c2-4629-971c-380e50204f21 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.354146 Aug 27 03:32:55.728791 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2456/5093] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:55 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:55.740602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:55.744803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:55.770500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.771779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.775718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.776734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:55.779184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:55.782374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.862933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.881261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc994306-b116-480a-924d-04068182a315 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150994 Aug 27 03:32:55.881914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f4156b0-152e-4a69-b51b-a23a2280d9a6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.285251 Aug 27 03:32:55.882196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2457/5094] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:55 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:55.884750 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2638/5095] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:55 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.036167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.036797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.056340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.057032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.057559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.058418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.059038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.059485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.258714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.270731 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8077bd1f-95a7-4448-99ed-652c3c6f814b tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.237902 Aug 27 03:32:56.271571 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2458/5096] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.398458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.399314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.401525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:56.403532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:56.417668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.418268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.423852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.423852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.423852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.423852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.476722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.477353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.499328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.499839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.501697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.514071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.515178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.516054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.517152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:56.651152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.663932 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f6dda0e-3acb-4faa-835a-097747620229 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.270981 Aug 27 03:32:56.665715 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2639/5097] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.676488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.677718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.692286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.693517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.694947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.696572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.697821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.699317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.793148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.806976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab998ede-d360-40a0-9076-d63712dc6715 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1682 microversion: 2.1 time: 0.333707 Aug 27 03:32:56.809751 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2459/5098] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1682 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:56.819052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.820977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.835151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.836218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.836881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.838517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.840805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.841868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.845772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.850924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:56.862713 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e48c0d22-117f-4d94-8107-229b9c9d2c46 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.195004 Aug 27 03:32:56.863757 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2640/5099] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.902004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.906320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.914948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.915852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.916924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.917962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.918753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.919259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.050335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17ed0f1f-27de-4158-b269-5ab271b4b81b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155542 Aug 27 03:32:57.052458 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2641/5100] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:57.055095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.066588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.067335 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a18b7e27-3c4f-4f0b-add7-afe8831ab943 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.255323 Aug 27 03:32:57.067551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:57.082529 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2460/5101] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:57.082697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.082697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.082697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.082697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.082697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.082697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.250960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.264338 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1193d1f6-8573-4c96-83a2-7a2921bf51d6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.207530 Aug 27 03:32:57.265444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2642/5102] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:57 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:57.302066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.303128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:57.311873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.312441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.313902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.315639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.316142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.316768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.536468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b18e8bf0-3eb9-4625-b654-00dfa8f203ba req-1f425575-ab19-4937-9921-0b342006d566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8848dfe8-81b0-41a7-97b5-8a42d003ec6c", "name": "network-vif-plugged", "status": "completed", "tag": "38aef60b-7f6c-4c6f-9164-6e83ab38ff79"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:57.560922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.569832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b18e8bf0-3eb9-4625-b654-00dfa8f203ba req-1f425575-ab19-4937-9921-0b342006d566 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.574290 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb055c69-5170-44ee-bba7-3e526ff095b1 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.279833 Aug 27 03:32:57.576982 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2461/5103] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:57 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:57.595172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b18e8bf0-3eb9-4625-b654-00dfa8f203ba req-1f425575-ab19-4937-9921-0b342006d566 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.595172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b18e8bf0-3eb9-4625-b654-00dfa8f203ba req-1f425575-ab19-4937-9921-0b342006d566 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.600897 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b18e8bf0-3eb9-4625-b654-00dfa8f203ba req-1f425575-ab19-4937-9921-0b342006d566 service nova] Creating event network-vif-plugged:38aef60b-7f6c-4c6f-9164-6e83ab38ff79 for instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c on n-h2-852086-5 Aug 27 03:32:57.611152 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b18e8bf0-3eb9-4625-b654-00dfa8f203ba req-1f425575-ab19-4937-9921-0b342006d566 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079293 Aug 27 03:32:57.613207 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2643/5104] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:57.698495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.699143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:57.728227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.728781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.729593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.730615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.731231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.731919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.849094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.849859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:57.861661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.862184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.862614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.863327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.863781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.867276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.113178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:58.125011 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0fce3791-abc9-4f83-b4e7-f1edbb07a462 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1682 microversion: 2.1 time: 0.289697 Aug 27 03:32:58.126469 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2644/5105] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:57 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:58.132656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.133611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:58.141183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.142039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.142807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.143700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.144378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.145104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.241543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:58.252044 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51d3505d-80c9-4865-91bf-66d7a6354bcb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.124004 Aug 27 03:32:58.267692 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2645/5106] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:58 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:58.273750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.276876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:58.288271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.289055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.289667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.290631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.291309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.291934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.298808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:58.321445 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-101bfb02-7277-4f16-98fe-cedcbec25944 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.627906 Aug 27 03:32:58.322679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2462/5107] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:57 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:58.329871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.341849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:58.350019 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d3969656-f584-4ad6-be61-82562a11c852 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080732 Aug 27 03:32:58.351349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.351640 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2646/5108] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:58 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:58.352354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.353168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.354560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.356976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.357914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.365254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.367988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:58.379198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.379679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.380129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.380860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.381328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.381763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.647415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:58.656756 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-28af54c4-9da3-430d-add4-d895ff641f78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.298635 Aug 27 03:32:58.657837 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2647/5109] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:58 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:58.662749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.663643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:58.675899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.676560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.677105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.677947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.678564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.679105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.918030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:58.927730 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d79768ff-3895-4cfc-ab30-b3ceaa034abe tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.268069 Aug 27 03:32:58.938764 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2648/5110] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:58 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:59.148680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.149592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:59.158254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.162823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.163480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.167122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.167782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.168354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.336696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.354107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7f949ac-ed11-40ed-8e01-0ea2b8e8d84c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 1.027977 Aug 27 03:32:59.366554 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2463/5111] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:58 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:59.388972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.393709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:59.411615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.412128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.412588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.424636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.425188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.425826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.549335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.574883 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f991b124-39ba-4ec5-9114-1cfe2025d97f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1682 microversion: 2.1 time: 0.430015 Aug 27 03:32:59.591863 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2649/5112] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:59 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1682 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:59.607110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.607763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:59.618838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.619322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.619778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.620519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.620989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.621426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.626231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:59.675948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.713042 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d51001d8-d985-4889-ab2c-0cad4123920b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1188 microversion: 2.1 time: 0.348033 Aug 27 03:32:59.734752 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2464/5113] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:59 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1188 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:59.745405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.747984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:59.763583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.764495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.765175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.766881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.767599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.768531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.818430 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c2652a2-281c-4301-9939-76e8b9c0e988 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082850 Aug 27 03:32:59.819357 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2465/5114] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:32:59 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:59.824478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ac018eda-113a-4099-8bf4-a3a88b6768f6 req-d567d065-442d-4906-b950-50d8707679f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac772560-1c31-4977-85dd-a63202adb8e5", "name": "network-vif-plugged", "status": "completed", "tag": "014c473a-6d17-46aa-a021-c49719e13251"}, {"server_uuid": "1a62a379-69d5-41ac-ad6a-7d481ff57538", "name": "network-vif-unplugged", "status": "completed", "tag": "c89f6834-6ff4-42a0-91fb-7bd99e89753b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:59.839142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ac018eda-113a-4099-8bf4-a3a88b6768f6 req-d567d065-442d-4906-b950-50d8707679f8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.840074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ac018eda-113a-4099-8bf4-a3a88b6768f6 req-d567d065-442d-4906-b950-50d8707679f8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.841007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ac018eda-113a-4099-8bf4-a3a88b6768f6 req-d567d065-442d-4906-b950-50d8707679f8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.866134 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ac018eda-113a-4099-8bf4-a3a88b6768f6 req-d567d065-442d-4906-b950-50d8707679f8 service nova] Creating event network-vif-plugged:014c473a-6d17-46aa-a021-c49719e13251 for instance ac772560-1c31-4977-85dd-a63202adb8e5 on n-h1-852086-5 Aug 27 03:32:59.867145 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ac018eda-113a-4099-8bf4-a3a88b6768f6 req-d567d065-442d-4906-b950-50d8707679f8 service nova] Creating event network-vif-unplugged:c89f6834-6ff4-42a0-91fb-7bd99e89753b for instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 on n-h1-852086-5 Aug 27 03:32:59.877111 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ac018eda-113a-4099-8bf4-a3a88b6768f6 req-d567d065-442d-4906-b950-50d8707679f8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.055753 Aug 27 03:32:59.878054 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2466/5115] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:59.884488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.885597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:59.887659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.894401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.895143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.896007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.896928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.897563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.898256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.908247 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c68fdc7e-2fbf-40f9-bad4-3d5e54382bd0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.314457 Aug 27 03:32:59.910725 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2650/5116] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:59 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:59.954721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.955039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:59.962986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.963852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.964462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.965412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.966136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.966596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.154126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.178467 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2ec2f80-a2d2-422d-8e0e-18cde1eef684 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1317 microversion: 2.1 time: 0.222627 Aug 27 03:33:00.187472 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2651/5117] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:59 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:00.386138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.400267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:00.428099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.432137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.433748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.435593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.436772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.437281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.438767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.445505 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a048540d-77f3-470b-9805-983d76b57ea6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.566008 Aug 27 03:33:00.446413 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2467/5118] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:59 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:00.607762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.608391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:00.616121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.616888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.617526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.618475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.627202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.628362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.799704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.810946 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-295f54b2-f831-4605-812d-c18a967ec43f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.433935 Aug 27 03:33:00.812097 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2652/5119] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:00 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:00.818815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.820903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:00.832409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.833420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.835418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.836424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.838445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.842877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.908722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.910989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.911611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.912393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid 207e7dd0-23d3-47b1-b82b-fad154ab86e7 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:00.928025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.954903 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09f4fc0a-466f-4198-90ab-36ab161f6d11 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1615 microversion: 2.1 time: 0.349683 Aug 27 03:33:00.955971 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2468/5120] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:00 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1615 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:00.979659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:00.983414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.995658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:01.002599 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-798c6299-8d72-4f1e-8ea1-664f6baaa3be tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1193 microversion: 2.1 time: 0.186980 Aug 27 03:33:01.006809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2653/5121] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:00 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1193 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:01.019960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.024866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.025738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:01.026913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.030826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.039733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.041356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.042598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.048382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.052381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.053127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.056371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.056931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.058224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.191908 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c7272ab-75be-4431-8a89-7564b103ec4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227543 Aug 27 03:33:01.199275 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2469/5122] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:33:00 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:01.219212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.220654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:01.246139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.250498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.251456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.252765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.253580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.257621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.322423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.341053 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f3a1842-ebc3-4936-9483-1da2e5101774 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1725 microversion: 2.1 time: 0.331621 Aug 27 03:33:01.342017 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2654/5123] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:01 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1725 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:01.469091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.469857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:01.498383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.499074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.499541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.502139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.502650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.503097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.870736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.889718 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2e9e800-7aff-494a-b988-60d8542ececb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1315 microversion: 2.1 time: 0.423958 Aug 27 03:33:01.891627 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2655/5124] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:01 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:01.909019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.917497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-52980bcb-168d-482b-bf54-58b3b65676bb req-c59adc0f-bc93-405b-a0f0-299c5e9ccebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a62a379-69d5-41ac-ad6a-7d481ff57538", "name": "network-vif-deleted", "tag": "c89f6834-6ff4-42a0-91fb-7bd99e89753b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:01.926223 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ceb821c-8d53-4029-b150-e8888cb7319a tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1507 microversion: 2.1 time: 0.721111 Aug 27 03:33:01.930653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2470/5125] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:01 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1507 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:01.948548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:01.949180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:01.960472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52980bcb-168d-482b-bf54-58b3b65676bb req-c59adc0f-bc93-405b-a0f0-299c5e9ccebb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.961200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52980bcb-168d-482b-bf54-58b3b65676bb req-c59adc0f-bc93-405b-a0f0-299c5e9ccebb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.961953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52980bcb-168d-482b-bf54-58b3b65676bb req-c59adc0f-bc93-405b-a0f0-299c5e9ccebb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.968485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.969138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.969890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.976606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.977314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.977916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.996612 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-52980bcb-168d-482b-bf54-58b3b65676bb req-c59adc0f-bc93-405b-a0f0-299c5e9ccebb service nova] Creating event network-vif-deleted:c89f6834-6ff4-42a0-91fb-7bd99e89753b for instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 on n-h1-852086-5 Aug 27 03:33:02.008432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-52980bcb-168d-482b-bf54-58b3b65676bb req-c59adc0f-bc93-405b-a0f0-299c5e9ccebb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112305 Aug 27 03:33:02.010835 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2656/5126] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:02.023330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.024794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.038077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.039231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.040232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.041360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.042099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.043003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.286471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.299647 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9cdeb31a-a703-4ada-9ba0-0e0d0558fab2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1507 microversion: 2.1 time: 0.286177 Aug 27 03:33:02.301121 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2657/5127] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.323341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.333939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.334614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.346105 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca66372b-d7f7-4981-9c9e-a35100de43bc tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.414746 Aug 27 03:33:02.346732 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2471/5128] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:01 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.361363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.361899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.364868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.365719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.366865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.368630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.379623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.380261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.408564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.409082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.409533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.410303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.412997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.423258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.474253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.475039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.475495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.475986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lazy-loading 'fault' on Instance uuid 1a62a379-69d5-41ac-ad6a-7d481ff57538 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:02.530009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.530884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.532129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.532841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid 207e7dd0-23d3-47b1-b82b-fad154ab86e7 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:02.543286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.561374 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-278a277a-2ab0-46d4-8b59-9ef53bdcec4d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 200 len: 1332 microversion: 2.1 time: 0.258084 Aug 27 03:33:02.588462 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2658/5129] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 1332 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.596639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.602395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.622876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.628464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.629418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.631743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.635250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.636215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.639058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.648178 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-717cbfe8-ca57-4207-bf17-fda6d855e551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 200 len: 1147 microversion: 2.1 time: 0.272515 Aug 27 03:33:02.664268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2472/5130] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 1147 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.686012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:02.688701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.708605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.710326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.711224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.712523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.713283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.714625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.719972 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fef7e8f9-12d0-4eba-9ba9-5b66e096b560 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133119 Aug 27 03:33:02.727712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2659/5131] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:02.736212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.737307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.771158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.771158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.774418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.775623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.776344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.777011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.821479 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5181dc87-5ae5-4bb8-9f8b-0a7d61f10052 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "PUT /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1079 microversion: 2.1 time: 0.155629 Aug 27 03:33:02.828813 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2473/5132] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:33:02 2022] PUT /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1079 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.852709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.854405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.872145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.872642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.873616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.874848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.877187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.878972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.115865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.142457 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a57abb2-7774-4b34-8488-0d4bab0c0275 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1702 microversion: 2.1 time: 0.412879 Aug 27 03:33:03.143665 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2660/5133] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1702 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.182761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.185679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:03.197324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.198081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.198876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.200183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.201259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.201735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.283696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.298981 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6f9aa71-6764-4160-a54b-e2d104970f08 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1505 microversion: 2.1 time: 0.456959 Aug 27 03:33:03.303082 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2474/5134] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.321656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea105528-e829-4bf2-ac48-17849e24f984 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:03.324861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:03.341406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea105528-e829-4bf2-ac48-17849e24f984 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.342277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea105528-e829-4bf2-ac48-17849e24f984 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.343346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea105528-e829-4bf2-ac48-17849e24f984 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.383701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea105528-e829-4bf2-ac48-17849e24f984 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Going to try to start instance {{(pid=122408) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:33:03.418002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:03.452122 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea105528-e829-4bf2-ac48-17849e24f984 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action" status: 202 len: 0 microversion: 2.1 time: 0.144739 Aug 27 03:33:03.465990 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2475/5135] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:03 2022] POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:03.478318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.485079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.485856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:03.494589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.494792 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfbf07c0-5606-4a4d-bc08-49b6c96e1164 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1501 microversion: 2.1 time: 0.334281 Aug 27 03:33:03.495228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.495717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.496462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.497222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.497714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.506717 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2661/5136] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:03 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.543900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.544855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:03.559777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.562009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.571972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.573244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.574013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.574806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.715666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.729967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2724e9e8-00bc-4700-9997-97d4e788607d tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1505 microversion: 2.1 time: 0.259110 Aug 27 03:33:03.730205 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2476/5137] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:03 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.746899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.747723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:03.763980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.764561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.765023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.765974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.766335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.766948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.953205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.963672 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58320d5f-c6f1-4a16-ac90-056b4f0257ca tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.454483 Aug 27 03:33:03.964686 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2662/5138] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:03 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.987950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:03.989014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.013053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.014185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.015446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.030658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.032209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.033112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.087013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.104369 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f026570a-88c7-47eb-8629-de1d9fa74632 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1711 microversion: 2.1 time: 0.373229 Aug 27 03:33:04.105485 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2477/5139] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:03 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1711 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:04.111553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.112603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.130013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.132884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.133518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.137364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.138110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.138814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.174005 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 HTTP/1.1 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1a62a379-69d5-41ac-ad6a-7d481ff57538'} Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:04.178776 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:04.185473 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f45e4850-fbfb-4535-8b5e-68c85319c2cd tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 404 len: 111 microversion: 2.1 time: 0.072364 Aug 27 03:33:04.196348 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e79b5dd-73ac-4ebc-9563-ad0d36ff169a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5/action" status: 202 len: 0 microversion: 2.1 time: 0.229124 Aug 27 03:33:04.197579 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2478/5140] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:04 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:04.198710 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2663/5141] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:03 2022] POST /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:04.203131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.204401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 207e7dd0-23d3-47b1-b82b-fad154ab86e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.207886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.211202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.220467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.223585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.224506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.226856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.227791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.229169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.239304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.244053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.245179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.247569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.251827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.255358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.283570 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 could not be found. Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 HTTP/1.1 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 could not be found. Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '207e7dd0-23d3-47b1-b82b-fad154ab86e7'} Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 could not be found. Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 could not be found. Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:04.285383 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.289951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:04.289951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:04.289951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:04.289951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:04.289951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:04.289951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 could not be found. Aug 27 03:33:04.289951 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:04.292483 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d3225aeb-aeef-46b5-9615-58930559645c tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091713 Aug 27 03:33:04.293610 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2664/5142] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:33:04 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:04.293734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 207e7dd0-23d3-47b1-b82b-fad154ab86e7 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:04.299703 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a86935a9-015c-4d56-8cc1-e40d0045ed87 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7" status: 404 len: 111 microversion: 2.1 time: 0.100854 Aug 27 03:33:04.300279 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2479/5143] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:04 2022] GET /compute/v2.1/servers/207e7dd0-23d3-47b1-b82b-fad154ab86e7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:04.317756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c98cca7-52b1-448c-9df0-d6a013caac58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '.version_select at 0x7fe4574bd3a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.318399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:04.326413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.347042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.349111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.349758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.352662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.354605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.355009 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c98cca7-52b1-448c-9df0-d6a013caac58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032193520" status: 202 len: 0 microversion: 2.1 time: 0.053201 Aug 27 03:33:04.356541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.362631 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2480/5144] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:33:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032193520 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:04.377267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.380220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.400616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.402136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.403061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.405496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.409794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.410847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.557064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:04.659020 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20271a22-227f-41f6-b8dd-d247ca5a7e12 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "PUT /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1081 microversion: 2.1 time: 0.363066 Aug 27 03:33:04.660397 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2665/5145] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 03:33:04 2022] PUT /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1081 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:04.685916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.688231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.697214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.698581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.699669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.700667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.701528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.702340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.887814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.903263 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dec04a2f-6d43-4477-9fca-765f464f9812 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1506 microversion: 2.1 time: 0.539125 Aug 27 03:33:04.903933 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2481/5146] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:04 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.003817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.005241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.027518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.028464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.029156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.030206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.033333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.034292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.036942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.054379 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c729890-0372-4cb1-ab4b-f695c5f23023 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1507 microversion: 2.1 time: 0.375590 Aug 27 03:33:05.055888 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2666/5147] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:04 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.077638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.078832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.086702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.087632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.088335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.089297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.090096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.090810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.414076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.439576 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35b615c2-ad24-4ac8-a626-82a3d82093be tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1507 microversion: 2.1 time: 0.365392 Aug 27 03:33:05.451590 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2667/5148] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:05 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:05.465768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.469955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.486753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.487630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.488582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.489995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.490845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.491955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.553928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.568933 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5e9d21c-b4b4-438d-b956-a3a3fb7d421e tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1522 microversion: 2.1 time: 0.571238 Aug 27 03:33:05.572260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2482/5149] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:04 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.580664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.585061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.601119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.603315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.603525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.604240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.604716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.605149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.670846 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f47639b-2ad0-4568-b894-5f5ec535d4d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096514 Aug 27 03:33:05.672495 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2483/5150] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:33:05 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:05.679542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.680347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.693204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.693926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.694626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.696150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.696932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.698057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.747039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:05.801853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.811162 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-242798a3-f3b0-451f-8166-1a5b4988134e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1711 microversion: 2.1 time: 0.356679 Aug 27 03:33:05.812042 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2668/5151] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:05 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1711 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.933688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.934504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.957370 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41739f9c-b4a1-44b0-aad4-79030db4fe5f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 204 len: 0 microversion: 2.1 time: 0.283226 Aug 27 03:33:05.958057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.959190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.959935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.961522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.962117 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2484/5152] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:05 2022] DELETE /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:05.962563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.963243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.975847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.976550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.997451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.997959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.998432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.999168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.999622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.000595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.070790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:06.159051 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Instance is already in deleting state, ignoring this request Aug 27 03:33:06.160480 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5dc61c97-16ed-488c-910e-0138c0b2572f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 204 len: 0 microversion: 2.1 time: 0.190149 Aug 27 03:33:06.161929 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2485/5153] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:05 2022] DELETE /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:06.177816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.184335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:06.215724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.216561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.217314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.218102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.219314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.219832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.504550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.519682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc01ae24-74a7-4d6a-9d1a-175d89ebc995 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1513 microversion: 2.1 time: 0.349146 Aug 27 03:33:06.527672 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2486/5154] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:06 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:06.546323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3ce2082-c5da-45aa-981d-cc021f4b6e69 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: .version_select at 0x7fe457644d30>, body: {"keypair": {"name": "tempest-keypair-2110190476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEemdARrFwQuZUsY4hlz/uXp7B+ZBIt+FG0OoJxEyyFknyLn+UVF3V/fpC90lKtBk7Hvi5dmqUOJ2pQDx3AJB3uUT3G/0pE0b89v5yCxUFS7dhxhUDa6HSeBmtC5DDM3CA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:06.572024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f3ce2082-c5da-45aa-981d-cc021f4b6e69 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:33:06.582656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f3ce2082-c5da-45aa-981d-cc021f4b6e69 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:33:06.637885 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3ce2082-c5da-45aa-981d-cc021f4b6e69 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107903 Aug 27 03:33:06.639644 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2487/5155] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:33:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:06.664829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.666590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:06.688729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.689209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.689604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.690435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.691312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.691949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.744322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.760038 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-320f3019-73d8-48a4-9bea-8e1a520650db tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1486 microversion: 2.1 time: 0.830143 Aug 27 03:33:06.761817 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2669/5156] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:05 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1486 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:06.778937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.784275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:06.792643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.797212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.797983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.799066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.799552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.800284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.862055 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-324103b1-151f-4246-9622-6cf111fd0a0d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098478 Aug 27 03:33:06.863263 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2670/5157] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:33:06 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:06.887864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:06.888455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:06.917523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.918633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.919764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.921129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.921624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.922486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.984862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lazy-loading 'flavor' on Instance uuid ac772560-1c31-4977-85dd-a63202adb8e5 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:07.038214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.072261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-792a25c3-300c-4584-9eba-2a194a2fa7ad tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1499 microversion: 2.1 time: 0.423858 Aug 27 03:33:07.073257 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2488/5158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:06 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1499 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:07.084937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.086015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:07.112544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.113041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.113567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.115343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.115919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.116399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.370650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.375756 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0ff8fbc-6b89-4671-b18a-685d5b37d34d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5/action" status: 202 len: 0 microversion: 2.1 time: 0.509621 Aug 27 03:33:07.388785 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25cad6e0-a7a9-45ae-83e1-83ca9cd7cb41 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1715 microversion: 2.1 time: 0.312525 Aug 27 03:33:07.390090 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2489/5159] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:07 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1715 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:07.399056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.406742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.407913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:07.416021 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2671/5160] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:06 2022] POST /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:07.423983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.426718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.429599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.431466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.431956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.432165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.433089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:07.447926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.450086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.450888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.451703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.453589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.454202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.454878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.523596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:07.593075 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c17da5f5-ea3d-424b-99e4-5410fe16b9e7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.199925 Aug 27 03:33:07.597106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2490/5161] 10.222.0.69 () {58 vars in 1154 bytes} [Sat Aug 27 03:33:07 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:07.605507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.607221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:07.618387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.619059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.619610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.620635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.621497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.622510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.752677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.764588 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-271afe9d-3536-4d16-ba0e-4ba48f389382 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1492 microversion: 2.1 time: 0.346912 Aug 27 03:33:07.766305 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2672/5162] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:07 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1492 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:07.774231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f540822-f1c0-4e41-b5cd-532ead28cbc4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:07.783811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f540822-f1c0-4e41-b5cd-532ead28cbc4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.784325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f540822-f1c0-4e41-b5cd-532ead28cbc4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.784780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2f540822-f1c0-4e41-b5cd-532ead28cbc4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.828099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f540822-f1c0-4e41-b5cd-532ead28cbc4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Going to try to start instance {{(pid=122407) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:33:07.928896 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f540822-f1c0-4e41-b5cd-532ead28cbc4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "POST /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa/action" status: 202 len: 0 microversion: 2.1 time: 0.153635 Aug 27 03:33:07.930570 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2673/5163] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:07 2022] POST /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:07.946772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.949884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:07.978852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.979056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.979499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.980392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.980931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.981502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.033864 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e6b7d036-08e2-45e0-9466-4ff8b81b3bd1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101504 Aug 27 03:33:08.035194 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2674/5164] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:33:07 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:08.040885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:08.041853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:08.051311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:08.053233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:08.055576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.056876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:08.057581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:08.058371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.155837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.182875 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7dcfa2f4-a1cc-4534-986f-d58c6b57b880 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1513 microversion: 2.1 time: 0.583617 Aug 27 03:33:08.189142 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2491/5165] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:07 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1513 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.371088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.382921 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e19c0802-d6bd-4798-af1b-78d171c2a846 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1508 microversion: 2.1 time: 0.346273 Aug 27 03:33:08.383662 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2675/5166] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:08 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.792955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:08.793639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:08.810285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:08.815441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:08.816278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.817325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:08.821299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:08.821809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.829332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:09.053819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.057233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.076865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.077737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.087275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.090267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.090870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.091482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.178470 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7c967f6-ba3a-41d1-9ab2-7a1c77ac9fab tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133068 Aug 27 03:33:09.190772 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2676/5167] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:33:09 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:33:09.206983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.208003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.224304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.225347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.225347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.229134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.229134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.229134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.453872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:09.471450 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3aa96eac-56d6-4349-9684-a5e9bc4a1552 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1513 microversion: 2.1 time: 0.683854 Aug 27 03:33:09.472354 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2492/5168] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:08 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1513 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:09.477488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:09.480071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.497262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.497827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.498512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.499479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.500609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.501589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.581340 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Cannot 'reboot' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action HTTP/1.1 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 28 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: {"reboot": {"type": "HARD"}} Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: exception: Cannot 'reboot' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '4e47f54e-4421-4a9f-978e-ebd3e92aff77', 'body': {'reboot': {'type': 'HARD'}}} Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:33:09.584055 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.589035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.590575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 409 to user: Cannot 'reboot' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:09.591606 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f167ca88-7e47-44c9-9601-d3a0a7751d5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action" status: 409 len: 145 microversion: 2.1 time: 0.117975 Aug 27 03:33:09.592375 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2493/5169] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:09 2022] POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action => generated 145 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:33:09.606324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.607222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.616445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.617073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.617587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.618577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.619178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.619729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.733700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:09.767616 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-547db82f-d8bc-4853-afcc-7c6e1ea8c8ce tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1513 microversion: 2.1 time: 0.559815 Aug 27 03:33:09.769769 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2677/5170] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:09 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1513 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:09.786606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:09.795103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.808535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.809040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.809684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.811349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.812210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.813384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.872833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Cannot 'rebuild' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action HTTP/1.1 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 65 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: exception: Cannot 'rebuild' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4e47f54e-4421-4a9f-978e-ebd3e92aff77', 'body': {'rebuild': {'imageRef': 'acef3da5-f17c-4877-a77f-8b5440d3d46e'}}} Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:33:09.876328 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued Aug 27 03:33:09.881503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.884982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 409 to user: Cannot 'rebuild' instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 while it is in vm_state rescued {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:09.886398 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2dcd959-f061-4fce-81e7-7e6aad65339f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action" status: 409 len: 146 microversion: 2.1 time: 0.113399 Aug 27 03:33:09.894351 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2678/5171] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:09 2022] POST /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77/action => generated 146 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:33:09.900697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.901489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.904471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:09.914786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.915885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.917492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.918708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.919573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.920354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.928492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:09.960267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:10.096902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec71ab2c-47ea-4a3a-b7f0-a4e9987645d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 204 len: 0 microversion: 2.1 time: 0.199676 Aug 27 03:33:10.103449 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2679/5172] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:09 2022] DELETE /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:10.110499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.112643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.114292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:10.120947 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-154094a7-004a-4733-9f94-44f4280c24d0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1508 microversion: 2.1 time: 0.527311 Aug 27 03:33:10.134502 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2494/5173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:09 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:10.135017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:10.135765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:10.136455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:10.137466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:10.137994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:10.138430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:10.493951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.494684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:10.511780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:10.512297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:10.512769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:10.513701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:10.514195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:10.514646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.150453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.152668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.177813 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c0abdb5-b831-4d1f-9ac7-ced041e49375 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.687912 Aug 27 03:33:11.178451 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2495/5174] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:10 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:11.197053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.200248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:11.204387 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-398fe11c-0917-46ec-9a78-77390e727d9f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1689 microversion: 2.1 time: 1.095086 Aug 27 03:33:11.207917 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2680/5175] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:10 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1689 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:11.218103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.219199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.219668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.220417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.220888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.221330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.256609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2be24ec1-c338-4e6d-9913-3fb393bbe840 req-a1d053ef-909a-4b5c-87c8-3d5d98a53821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8848dfe8-81b0-41a7-97b5-8a42d003ec6c", "name": "network-vif-deleted", "tag": "38aef60b-7f6c-4c6f-9164-6e83ab38ff79"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:11.339810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2be24ec1-c338-4e6d-9913-3fb393bbe840 req-a1d053ef-909a-4b5c-87c8-3d5d98a53821 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.345342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2be24ec1-c338-4e6d-9913-3fb393bbe840 req-a1d053ef-909a-4b5c-87c8-3d5d98a53821 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.350024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2be24ec1-c338-4e6d-9913-3fb393bbe840 req-a1d053ef-909a-4b5c-87c8-3d5d98a53821 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.393303 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-2be24ec1-c338-4e6d-9913-3fb393bbe840 req-a1d053ef-909a-4b5c-87c8-3d5d98a53821 service nova] Creating event network-vif-deleted:38aef60b-7f6c-4c6f-9164-6e83ab38ff79 for instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c on n-h2-852086-5 Aug 27 03:33:11.408885 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2be24ec1-c338-4e6d-9913-3fb393bbe840 req-a1d053ef-909a-4b5c-87c8-3d5d98a53821 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168665 Aug 27 03:33:11.411443 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2681/5176] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:11.428803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.431899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:11.443614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.458329 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-064dfb2b-7238-49ed-841a-d61f7e2fefb2 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1471 microversion: 2.1 time: 0.278432 Aug 27 03:33:11.463730 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2496/5177] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:11 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:11.474374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b52cc2e8-081c-44b0-9512-ef28dd20d6c8 req-8761099e-9ed1-4d90-9e71-ef37bd6dbfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac772560-1c31-4977-85dd-a63202adb8e5", "name": "network-vif-plugged", "status": "completed", "tag": "014c473a-6d17-46aa-a021-c49719e13251"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:11.480350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.482475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.483410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.484486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.485211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.486005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.500295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b52cc2e8-081c-44b0-9512-ef28dd20d6c8 req-8761099e-9ed1-4d90-9e71-ef37bd6dbfd5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.500295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b52cc2e8-081c-44b0-9512-ef28dd20d6c8 req-8761099e-9ed1-4d90-9e71-ef37bd6dbfd5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.501192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b52cc2e8-081c-44b0-9512-ef28dd20d6c8 req-8761099e-9ed1-4d90-9e71-ef37bd6dbfd5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.534614 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b52cc2e8-081c-44b0-9512-ef28dd20d6c8 req-8761099e-9ed1-4d90-9e71-ef37bd6dbfd5 service nova] Creating event network-vif-plugged:014c473a-6d17-46aa-a021-c49719e13251 for instance ac772560-1c31-4977-85dd-a63202adb8e5 on n-h1-852086-5 Aug 27 03:33:11.541968 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b52cc2e8-081c-44b0-9512-ef28dd20d6c8 req-8761099e-9ed1-4d90-9e71-ef37bd6dbfd5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076293 Aug 27 03:33:11.545232 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2497/5178] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:12.044072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.053490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92adc434-dd48-455e-87f6-f2423d069114 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1508 microversion: 2.1 time: 0.640654 Aug 27 03:33:12.055820 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2682/5179] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:11 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1508 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.223507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.225020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:12.228814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-235123320", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37d2c35e-4ba5-4e30-b147-136ed6948e64"}], "security_groups": [{"name": "tempest-securitygroup--481347608"}], "key_name": "tempest-keypair-2110190476", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:12.248300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.251749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.259771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:12.261639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.262409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.263099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:12.417535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] validate_networks() for [('37d2c35e-4ba5-4e30-b147-136ed6948e64', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:33:12.847674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:12.874086 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89ba2e82-4842-4b60-ab63-9a22db244750 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.656016 Aug 27 03:33:12.876482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2498/5180] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:12 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.900200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.902674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:12.925614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.926557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.929612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:12.933248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.934448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.935213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.333989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.353893 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95ac49ea-1787-47ed-a5eb-49f75d3c5d4d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1689 microversion: 2.1 time: 0.472644 Aug 27 03:33:13.374027 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2499/5181] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:12 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1689 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:13.382099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:13.385487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:13.400812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.403632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.407111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.411834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.413683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.414365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.491154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:13.491831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:13.492332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:13.492769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:13.493223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:13.524425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.525101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.525647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.534648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.552646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.556075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.565176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.584427 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec46e528-afd8-4918-9dd6-8752beb89046 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1471 microversion: 2.1 time: 0.202380 Aug 27 03:33:13.589640 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2500/5182] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:13 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:13.602618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:13.603975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:13.616536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.617498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.618207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.619196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:13.620259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:13.622495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.642539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:33:13.661084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:33:13.705079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:33:13.720886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:33:13.848969 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f3db14d-3a23-4be4-b1a7-fd1dc76ef3ae tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.624780 Aug 27 03:33:13.849840 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2683/5183] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:33:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:33:13.863411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5919766-42b5-438d-b07c-21e28b177ad0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:13.863764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a5919766-42b5-438d-b07c-21e28b177ad0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:14.014410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.026386 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d97f539-031f-49a6-9aab-976ad1e44631 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1512 microversion: 2.1 time: 0.434275 Aug 27 03:33:14.038332 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2501/5184] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:13 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:14.042329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a5919766-42b5-438d-b07c-21e28b177ad0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.048459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.049902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:14.055296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5919766-42b5-438d-b07c-21e28b177ad0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1241 microversion: 2.1 time: 0.196389 Aug 27 03:33:14.056057 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2684/5185] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:13 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1241 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:14.062012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.066085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.067810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.068951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.069849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.070613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.071065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.085590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.086043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.servers [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Removing options 'limit' from query {{(pid=122407) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 03:33:14.096085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:14.101779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.102862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.104675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.105701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.106445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.112860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.114968 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc8fe4cb-03e6-41c9-8eed-1d399f89dc25 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.055914 Aug 27 03:33:14.115793 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2685/5186] 10.222.0.69 () {58 vars in 1140 bytes} [Sat Aug 27 03:33:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:33:14.136451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.158854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:14.173969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.176647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.179413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.180922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.185875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.186640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.543668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.569583 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0edaecb-24e9-4bf4-a2fb-fe89c007454f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.521829 Aug 27 03:33:14.570781 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2502/5187] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:14 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:14.596513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.602064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:14.613104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.626886 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b889b7d-2ff7-42c1-92b2-fe088baba9b3 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1512 microversion: 2.1 time: 0.491852 Aug 27 03:33:14.641960 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2686/5188] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:14 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1512 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:14.653192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.661869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.666754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.669166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.671757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.673408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.676512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.677588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:14.694071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.698466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.713957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.716300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.718268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.721022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.793638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.794545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.795325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.796027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lazy-loading 'fault' on Instance uuid 8848dfe8-81b0-41a7-97b5-8a42d003ec6c {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:14.876118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc4fea72e9243f2989722084690be5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae9abba744b4b08ae3bf99d5f94d63e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.905408 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fd7543ad-f6f2-4272-abf4-455613e19164 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 200 len: 1307 microversion: 2.1 time: 0.261420 Aug 27 03:33:14.920382 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2687/5189] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:14 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:14.936511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.944462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:14.967553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.970431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.971252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.973489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.981064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.982246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.357612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.374458 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-977aadeb-c815-4389-9c1b-fe87c0290052 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 200 len: 1513 microversion: 2.1 time: 0.445821 Aug 27 03:33:15.389673 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2688/5190] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:14 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 1513 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:15.397597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.398357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:15.405513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.406335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.407043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.408086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.408633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.409142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.603661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.619507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-654f741f-ddc2-41cd-bba5-032da17fc5ff tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1245 microversion: 2.1 time: 0.223524 Aug 27 03:33:15.622528 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2689/5191] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:15 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1245 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:15.655362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.659922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:15.686775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.688800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.690016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.691643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.692724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.693548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.898100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.912592 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce417007-a861-4690-a7bd-7ff75902a57b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1689 microversion: 2.1 time: 1.340452 Aug 27 03:33:15.913196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2503/5192] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:14 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1689 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:15.931203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.940552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:15.970765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.977757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.982317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.985245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.991330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.995091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.339532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.355763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-108eea71-9b4d-4f1c-a974-6dcbc4790a03 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1510 microversion: 2.1 time: 0.731037 Aug 27 03:33:16.356605 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2690/5193] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:15 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1510 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.378175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.379902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 8848dfe8-81b0-41a7-97b5-8a42d003ec6c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:16.414624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.415196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.416024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.417107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.417807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.418656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.466520 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] HTTP exception thrown: Instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c could not be found. Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Request method failure captured: Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c HTTP/1.1 Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_RNgp3G9NHWWN8_syFNTrHxPJMz77AFG3CojsBEObEI5djMzERVh-uHS4AGprT9s4l2yldAX8Ij5Ru6ommmq3AKJVx6Ft5R4Gc7CB8STVuUwVl814Aveop_00MPfYBdkAv4bas1WTcvxviZdSg_zoBszou35MLHspVndzwY07BwAY Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ae9abba744b4b08ae3bf99d5f94d63e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}] Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ecc4fea72e9243f2989722084690be5a Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c could not be found. Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '8848dfe8-81b0-41a7-97b5-8a42d003ec6c'} Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c could not be found. Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c could not be found. Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:16.469476 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.476025 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:16.476025 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:16.476025 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:16.476025 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:16.476025 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:16.476025 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c could not be found. Aug 27 03:33:16.476025 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.477830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Returning 404 to user: Instance 8848dfe8-81b0-41a7-97b5-8a42d003ec6c could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:16.479745 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54883fc4-2eaf-4ae1-bd9c-e59c21cc768f tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c" status: 404 len: 111 microversion: 2.1 time: 0.121159 Aug 27 03:33:16.480418 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2691/5194] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:16 2022] GET /compute/v2.1/servers/8848dfe8-81b0-41a7-97b5-8a42d003ec6c => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:16.488051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.493429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.495765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:16.600461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:16.613014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.625780 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e077238-dae6-4022-969e-44a53cd622e8 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.711504 Aug 27 03:33:16.631083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2504/5195] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:15 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.636506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.639204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:16.661208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.665229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.666133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.667138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.667595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.668037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.711505 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] HTTP exception thrown: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Request method failure captured: Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa HTTP/1.1 Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY_RNgp3G9NHWWN8_syFNTrHxPJMz77AFG3CojsBEObEI5djMzERVh-uHS4AGprT9s4l2yldAX8Ij5Ru6ommmq3AKJVx6Ft5R4Gc7CB8STVuUwVl814Aveop_00MPfYBdkAv4bas1WTcvxviZdSg_zoBszou35MLHspVndzwY07BwAY Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ae9abba744b4b08ae3bf99d5f94d63e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}] Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ecc4fea72e9243f2989722084690be5a Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'c5e906f0-fbf5-499d-89d7-4d783215b3aa'} Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:16.713283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Returning 404 to user: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc9221ca-4686-481f-b66e-915c249682ae tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 404 len: 111 microversion: 2.1 time: 0.082179 Aug 27 03:33:16.718341 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2505/5196] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:16 2022] DELETE /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:16.723817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.724450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:16.745830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.749411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.750289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.751155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.751640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.752078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.757464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.758761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.759372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.760401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.761034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.762026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.931410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.942938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62768b77-bbf1-4a46-a7cf-7dcfdf5f46a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1301 microversion: 2.1 time: 0.224652 Aug 27 03:33:16.943528 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2506/5197] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:16 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1301 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.956522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.957844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: c5e906f0-fbf5-499d-89d7-4d783215b3aa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:16.961049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:16.976221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.976943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.979867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.980942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.982000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.983513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.018823 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] HTTP exception thrown: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Request method failure captured: Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa HTTP/1.1 Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY_RNgp3G9NHWWN8_syFNTrHxPJMz77AFG3CojsBEObEI5djMzERVh-uHS4AGprT9s4l2yldAX8Ij5Ru6ommmq3AKJVx6Ft5R4Gc7CB8STVuUwVl814Aveop_00MPfYBdkAv4bas1WTcvxviZdSg_zoBszou35MLHspVndzwY07BwAY Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ae9abba744b4b08ae3bf99d5f94d63e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}] Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: ecc4fea72e9243f2989722084690be5a Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'c5e906f0-fbf5-499d-89d7-4d783215b3aa'} Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:17.021319 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.026184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.026184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:17.026184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:17.026184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:17.026184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:17.026184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. Aug 27 03:33:17.026184 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.028381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Returning 404 to user: Instance c5e906f0-fbf5-499d-89d7-4d783215b3aa could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:17.029522 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdacb9ed-1c82-4717-b5bb-bc7b664df6f8 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa" status: 404 len: 111 microversion: 2.1 time: 0.082788 Aug 27 03:33:17.033505 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2507/5198] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:16 2022] GET /compute/v2.1/servers/c5e906f0-fbf5-499d-89d7-4d783215b3aa => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:17.041637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.046842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:17.060645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.063870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.064542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.065467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.068393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.069057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.161809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3473731e-1e1b-43d7-877b-bffe62d0f100 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.673106 Aug 27 03:33:17.162950 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2692/5199] 10.222.0.69 () {58 vars in 1154 bytes} [Sat Aug 27 03:33:16 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:17.184313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.184764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:17.204115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.205165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.205897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.208220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.209906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.210760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.234521 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] HTTP exception thrown: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Request method failure captured: Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e HTTP/1.1 Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_RNgp3G9NHWWN8_syFNTrHxPJMz77AFG3CojsBEObEI5djMzERVh-uHS4AGprT9s4l2yldAX8Ij5Ru6ommmq3AKJVx6Ft5R4Gc7CB8STVuUwVl814Aveop_00MPfYBdkAv4bas1WTcvxviZdSg_zoBszou35MLHspVndzwY07BwAY Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ae9abba744b4b08ae3bf99d5f94d63e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}] Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ecc4fea72e9243f2989722084690be5a Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '54115f30-fe92-4a2c-8fb2-e90281f3d35e'} Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:17.237515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.243765 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.247020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Returning 404 to user: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:17.248367 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-117092ca-1d8d-4fb1-bc4d-89d34a2c9d31 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "DELETE /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 404 len: 111 microversion: 2.1 time: 0.084424 Aug 27 03:33:17.253358 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2693/5200] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:17 2022] DELETE /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:17.254688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.255593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:17.275213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.275720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.276170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.279426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.279936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.280385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.475311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:17.698692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.708748 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dd199557-4e5f-42c2-8d96-b258185b7d31 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1512 microversion: 2.1 time: 0.457152 Aug 27 03:33:17.709953 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2694/5201] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:17 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1512 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:17.715791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.716647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] [instance: 54115f30-fe92-4a2c-8fb2-e90281f3d35e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:17.723974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.724809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.725463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.726558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.727314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.727987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.755277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] HTTP exception thrown: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Request method failure captured: Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e HTTP/1.1 Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_RNgp3G9NHWWN8_syFNTrHxPJMz77AFG3CojsBEObEI5djMzERVh-uHS4AGprT9s4l2yldAX8Ij5Ru6ommmq3AKJVx6Ft5R4Gc7CB8STVuUwVl814Aveop_00MPfYBdkAv4bas1WTcvxviZdSg_zoBszou35MLHspVndzwY07BwAY Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4ae9abba744b4b08ae3bf99d5f94d63e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4ae9abba744b4b08ae3bf99d5f94d63e"}]}] Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4ae9abba744b4b08ae3bf99d5f94d63e Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1195350483 Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ecc4fea72e9243f2989722084690be5a Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1195350483-project Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '54115f30-fe92-4a2c-8fb2-e90281f3d35e'} Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:17.756977 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] Returning 404 to user: Instance 54115f30-fe92-4a2c-8fb2-e90281f3d35e could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:17.764496 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58ac28d3-6e1f-413a-b413-9f5738b2a4b4 tempest-ServerDiskConfigTestJSON-1195350483 tempest-ServerDiskConfigTestJSON-1195350483-project] 10.222.0.69 "GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e" status: 404 len: 111 microversion: 2.1 time: 0.049068 Aug 27 03:33:17.765740 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2695/5202] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:17 2022] GET /compute/v2.1/servers/54115f30-fe92-4a2c-8fb2-e90281f3d35e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:17.784244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-706039546", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5400c10c-56d5-455c-9bc9-a57432487738", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:17.808037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.818061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac1f03ed-d5f1-4d0a-af5d-d0c0be483100 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1621 microversion: 2.1 time: 0.783183 Aug 27 03:33:17.826974 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2508/5203] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:17 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1621 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:17.835056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.836020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:17.849283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.849811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.850274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.855698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.856450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.857059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.913235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:33:18.301435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.315906 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccaeb212-9080-426a-abb9-41167880693b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.487339 Aug 27 03:33:18.316522 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2509/5204] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:17 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:18.327026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:18.329913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:18.346073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.348314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.348937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.350742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.355993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.356698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.787139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:18.805799 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b46afe9-265e-43e6-b107-74307d860818 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 200 len: 1513 microversion: 2.1 time: 0.483916 Aug 27 03:33:18.830656 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2510/5205] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:18 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:18.845976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:18.847002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:18.874193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.874193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.874193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.875093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.875830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.876636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.896616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:19.213707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.231913 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71291e56-7e1f-49d4-96db-3b5b94f7fced tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1299 microversion: 2.1 time: 0.395415 Aug 27 03:33:19.238571 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2511/5206] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:18 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1299 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:19.255743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-85b3924d-9431-4312-b2aa-98bd09e7b169 req-73af9ca6-4966-42e2-8d66-0f6a6a0ca13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8427f5b-2531-4195-b370-6e0a7564ad16", "name": "network-vif-deleted", "tag": "310d8927-f16a-452d-a9f4-b6563414334b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:19.322697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-85b3924d-9431-4312-b2aa-98bd09e7b169 req-73af9ca6-4966-42e2-8d66-0f6a6a0ca13b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.326759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-85b3924d-9431-4312-b2aa-98bd09e7b169 req-73af9ca6-4966-42e2-8d66-0f6a6a0ca13b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.327526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-85b3924d-9431-4312-b2aa-98bd09e7b169 req-73af9ca6-4966-42e2-8d66-0f6a6a0ca13b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.380946 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-85b3924d-9431-4312-b2aa-98bd09e7b169 req-73af9ca6-4966-42e2-8d66-0f6a6a0ca13b service nova] Creating event network-vif-deleted:310d8927-f16a-452d-a9f4-b6563414334b for instance d8427f5b-2531-4195-b370-6e0a7564ad16 on n-h2-852086-5 Aug 27 03:33:19.407053 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-85b3924d-9431-4312-b2aa-98bd09e7b169 req-73af9ca6-4966-42e2-8d66-0f6a6a0ca13b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164264 Aug 27 03:33:19.415962 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2512/5207] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:19.436989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:19.441501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:19.450411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:19.451057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:19.451885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:19.452608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:19.453393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:19.463676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.464188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.464633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.465369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.470767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.471242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.477740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.483330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.490733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.492712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.495112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.497216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.605814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:33:19.648409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:33:19.876750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:33:19.879914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5400c10c-56d5-455c-9bc9-a57432487738',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:33:19.904667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.945594 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56554115-f40c-4cae-a659-cb3aa38fc665 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1510 microversion: 2.1 time: 0.525388 Aug 27 03:33:19.969650 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2513/5208] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:19 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1510 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:19.978722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:19.979873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:19.986788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.987828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.988682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.989756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:19.990286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:19.990877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.054836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.060217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.061026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.061967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'fault' on Instance uuid d8427f5b-2531-4195-b370-6e0a7564ad16 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:20.238323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.262063 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f17a79a-da31-4715-b660-be045eff2009 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 200 len: 1335 microversion: 2.1 time: 0.288399 Aug 27 03:33:20.264697 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2514/5209] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:19 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 1335 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:20.292044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.302022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:20.304861 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-accdedcb-ddd1-480d-8114-65d69f040a7c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.537995 Aug 27 03:33:20.307106 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2696/5210] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:33:20.327808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.334133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:20.354604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.359673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:20.367612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.372916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.373681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.375129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.375810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.376770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.377856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.378649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.379327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.380268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.386486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.387032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.452523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:20.547752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.571043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.574437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.575159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.984883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.003936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5565c93-6ab1-45ce-908d-031cb6501ec5 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.736008 Aug 27 03:33:21.006427 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2515/5211] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:20 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.031921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.033683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:21.050316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.052609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.056725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.057965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.058687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.059497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.179786 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6cea26ef-6fe7-4e1e-b0eb-ce99a46278e0 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.869145 Aug 27 03:33:21.181351 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2697/5212] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:33:20 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.199978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1bfad99-a0f2-4c68-bbc7-e5dcdbc93cc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.200684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a1bfad99-a0f2-4c68-bbc7-e5dcdbc93cc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:21.336906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a1bfad99-a0f2-4c68-bbc7-e5dcdbc93cc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.354471 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a1bfad99-a0f2-4c68-bbc7-e5dcdbc93cc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1056 microversion: 2.1 time: 0.171460 Aug 27 03:33:21.357064 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2698/5213] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1056 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.372890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.385374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.388397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:21.660264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.660948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.661482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.662457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.663187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.664250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.724521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:21.738144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:21.812969 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95a6e7f1-75fe-4a86-9b2d-7306a7112d00 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.451643 Aug 27 03:33:21.824535 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2699/5214] 10.222.0.69 () {58 vars in 1150 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.831710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.832902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: d8427f5b-2531-4195-b370-6e0a7564ad16] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:21.850395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.853326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.853987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.854893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.857017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.857816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.894148 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Instance d8427f5b-2531-4195-b370-6e0a7564ad16 could not be found. Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 HTTP/1.1 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d8427f5b-2531-4195-b370-6e0a7564ad16 could not be found. Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd8427f5b-2531-4195-b370-6e0a7564ad16'} Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8427f5b-2531-4195-b370-6e0a7564ad16 could not be found. Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8427f5b-2531-4195-b370-6e0a7564ad16 could not be found. Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:21.909065 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8427f5b-2531-4195-b370-6e0a7564ad16 could not be found. Aug 27 03:33:21.915687 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:21.916807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 404 to user: Instance d8427f5b-2531-4195-b370-6e0a7564ad16 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:21.919468 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b9a4d03-d6f3-4b1b-a6cb-2619830750d6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16" status: 404 len: 111 microversion: 2.1 time: 0.101429 Aug 27 03:33:21.921636 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2700/5215] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers/d8427f5b-2531-4195-b370-6e0a7564ad16 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:21.932286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.948249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.951572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:21.955412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:21.965963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.969140 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-085a3a4c-7a76-4e5d-b70e-995b40f73cdb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 0.955797 Aug 27 03:33:21.969823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.970401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.971891 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2516/5216] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:21.983623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1bf8a89-5aed-40d4-aa4f-5b8bc7211f5d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '.version_select at 0x7fe457612ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:21.984976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.987924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.989973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:22.034767 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1bf8a89-5aed-40d4-aa4f-5b8bc7211f5d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390326366" status: 202 len: 0 microversion: 2.1 time: 0.060761 Aug 27 03:33:22.040906 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2517/5217] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390326366 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:22.055476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:22.057781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:22.077459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:22.083230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:22.083743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:22.088211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:22.090623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:22.094503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:22.223494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:22.370509 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2af12d96-1c1e-45e9-b745-c4eda4f50932 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.445500 Aug 27 03:33:22.371292 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2701/5218] 10.222.0.69 () {58 vars in 1212 bytes} [Sat Aug 27 03:33:21 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:22.384446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:22.385092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:22.403630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:22.408131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:22.408599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:22.409364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:22.409837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:22.412302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:22.668062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:22.683750 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d24947a8-e8d6-4394-86aa-dec19fbaad7e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1154 microversion: 2.1 time: 0.307265 Aug 27 03:33:22.698221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2702/5219] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:22 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1154 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:22.698221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:22.716463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:22.719797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:22.740435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:22.740435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:22.740822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:22.741568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:22.742118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:22.742483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.001683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:23.025099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:23.040373 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b436eef-dc60-440f-b1f5-0958af33cd26 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.996491 Aug 27 03:33:23.040898 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2518/5220] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:22 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:23.057852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:23.059214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:23.086881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.087741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.091323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.092910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.101128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.102021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.203903 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-514663cb-4cb9-444c-b12b-cd0350e754a9 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.517516 Aug 27 03:33:23.215244 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2703/5221] 10.222.0.69 () {58 vars in 1196 bytes} [Sat Aug 27 03:33:22 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:23.512575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Calling method '.version_select at 0x7fe4602594c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:23.517131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.517743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.518320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.537394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.538018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.538576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.553147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.553684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.554241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.561208 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1539f1a2-1153-47cb-a827-92592a986613 tempest-PortsAdminExtendedAttrsTestJSON-117584160 tempest-PortsAdminExtendedAttrsTestJSON-117584160-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.343470 Aug 27 03:33:23.568737 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2704/5222] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:33:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:23.580345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:23.587156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:23.587649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'name': '1952490456', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:23.595448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.596032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.596551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.597403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.598071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.598517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.767245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:23.851667 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-76727ad1-caf6-41e7-92c8-ebd0d4a782b7 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?name=1952490456" status: 200 len: 346 microversion: 2.1 time: 0.281453 Aug 27 03:33:23.852527 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2705/5223] 10.222.0.69 () {58 vars in 1156 bytes} [Sat Aug 27 03:33:23 2022] GET /compute/v2.1/servers?name=1952490456 => generated 346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:23.859579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:23.860428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:23.868445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.868999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.870551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:23.871316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:23.871849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:23.872334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.033999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.046062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-235652ed-1039-4bff-909f-da57a38614ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1172 microversion: 2.1 time: 0.192436 Aug 27 03:33:24.064039 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2706/5224] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:23 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1172 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:24.071935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.077049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.078327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:24.084717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:24.085205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:24.085630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.086390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:24.086843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:24.087263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.198828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:24.290543 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95b3a19c-0e93-41df-b1e3-ca37ee3a558b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.225254 Aug 27 03:33:24.291356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2707/5225] 10.222.0.69 () {58 vars in 1154 bytes} [Sat Aug 27 03:33:24 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:24.297770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.298671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:24.306063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:24.306592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:24.307239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.307962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:24.308551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:24.308988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.470842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.480271 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4e683b2-4fab-4d5a-90fc-443586d51623 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 1.435591 Aug 27 03:33:24.489855 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2519/5226] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:23 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:24.504378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3d5cf8e0-f8fc-477d-9800-8f911dea03c0 req-46b63d7b-18f6-43c6-b389-abef6185ede4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69718556-4ec9-430e-b09b-5481ceea5320", "tag": "bbd206aa-6c48-4e45-b9ed-feff2f0d2aed"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:24.558754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d5cf8e0-f8fc-477d-9800-8f911dea03c0 req-46b63d7b-18f6-43c6-b389-abef6185ede4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:24.559448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d5cf8e0-f8fc-477d-9800-8f911dea03c0 req-46b63d7b-18f6-43c6-b389-abef6185ede4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:24.561659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d5cf8e0-f8fc-477d-9800-8f911dea03c0 req-46b63d7b-18f6-43c6-b389-abef6185ede4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.608653 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3d5cf8e0-f8fc-477d-9800-8f911dea03c0 req-46b63d7b-18f6-43c6-b389-abef6185ede4 service nova] Creating event network-changed:bbd206aa-6c48-4e45-b9ed-feff2f0d2aed for instance 69718556-4ec9-430e-b09b-5481ceea5320 on n-h1-852086-5 Aug 27 03:33:24.629662 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3d5cf8e0-f8fc-477d-9800-8f911dea03c0 req-46b63d7b-18f6-43c6-b389-abef6185ede4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137017 Aug 27 03:33:24.636117 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2520/5227] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:24.649980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:24.662265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.666830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-195249045', 'deleted': False, 'project_id': '4412ab4903d34828951cbb339177ce00'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:33:24.686528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:24.689125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:24.691201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.692557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:24.696231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:24.696992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:24.818863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:24.833734 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83a2bd10-d3b5-48c8-b0fc-2b46fc80ca6b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.541070 Aug 27 03:33:24.835026 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2708/5228] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:24 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:24.881509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:33:25.059732 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d3b8aed-aff9-43e6-b0f1-cbbc478617ec tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195249045" status: 200 len: 346 microversion: 2.1 time: 0.421671 Aug 27 03:33:25.060730 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2521/5229] 10.222.0.69 () {58 vars in 1228 bytes} [Sat Aug 27 03:33:24 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195249045 => generated 346 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:25.075307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:25.075689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:25.076624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:25.076988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:25.084670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:25.085541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:25.086317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:25.087227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:25.087843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:25.088356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:25.099052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:25.108042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:25.110289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:25.112111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:25.134464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:25.135009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:25.135466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:25.291026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:25.504106 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-61da5435-b814-43ad-94c8-2b0fcf491750 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 204 len: 0 microversion: 2.1 time: 0.432573 Aug 27 03:33:25.505078 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2709/5230] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:25 2022] DELETE /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:25.521825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:25.526001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:25.550783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:25.552135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:25.555874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:25.558344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:25.558951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:25.560038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:26.305144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.324177 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aab591b2-5cd7-41c3-8dca-0a9ac8c271a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 0.814507 Aug 27 03:33:26.325145 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2710/5231] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:25 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:26.347702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:26.349494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:26.367939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:26.368910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:26.369730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:26.370845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:26.371529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:26.372128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:26.763471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:26.787729 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16a1d837-b1bd-493b-803c-7d6f4b513020 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1516 microversion: 2.1 time: 0.460493 Aug 27 03:33:26.789894 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2711/5232] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:26 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1516 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:26.800347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:26.807568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:26.836577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:26.837555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:26.838668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:26.840022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:26.841148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:26.842018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:27.212353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:27.258987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e458e56-b8fa-40a5-bc07-a7fcdd9e70ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1214 microversion: 2.1 time: 2.182210 Aug 27 03:33:27.268972 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2522/5233] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:25 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1214 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:27.291255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:27.306574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ceb58e3f-7caf-4e2e-bc7e-de5f951ea871 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.513170 Aug 27 03:33:27.309027 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2712/5234] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:26 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:27.353910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:27.355541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:27.373617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:27.376036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:27.376683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:27.378579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:27.379710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:27.380642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:27.810972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:27.811585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:27.829418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:27.829942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:27.830588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:27.832998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:27.835307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:27.839118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:28.138875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.150319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:28.157604 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82c4dc57-a7a4-4430-81cf-8e9aa44dfe57 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1516 microversion: 2.1 time: 0.350627 Aug 27 03:33:28.165633 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2713/5235] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:27 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:28.300873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:28.303528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:28.329447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:28.342423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:28.346611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:28.351957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:28.354793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:28.356551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:28.447883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.457140 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb8c5606-7567-41c4-9794-48f95514f644 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 1.110752 Aug 27 03:33:28.458195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2523/5236] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:27 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:28.463217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:28.473578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:28.480449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:28.491426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:28.498847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:28.500171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:28.501032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:28.501653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:28.804641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:28.845907 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7d37ac3-7c3b-4323-8a0c-0afb08104b30 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1214 microversion: 2.1 time: 0.547662 Aug 27 03:33:28.848923 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2714/5237] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:28 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1214 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:29.130238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.143103 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a1f3b78-75df-449a-9671-cac84a0bc9ef tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.683484 Aug 27 03:33:29.158227 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2524/5238] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:28 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:29.194955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:29.194955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:29.198500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:29.208620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:29.211344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:29.212319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:29.215097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:29.215620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:29.482531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:29.488080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:29.491599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:29.503641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:29.505469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:29.506270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:29.511732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:29.512223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:29.512666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:29.523849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d8cb4962-ac1a-41ea-b50a-90f92a8bb330 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1516 microversion: 2.1 time: 0.341914 Aug 27 03:33:29.561092 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2715/5239] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:29 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:29.873903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:29.876296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:29.901584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:29.902596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:29.907816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:29.908908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:29.910757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:29.917137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:30.254080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.268703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a1cadc65-6cc2-4d71-9aef-b1d437518635 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1214 microversion: 2.1 time: 0.401203 Aug 27 03:33:30.272159 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2716/5240] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:29 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:30.295233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4a7f05ec-0088-4ee7-864e-7a9b091db9ae req-a8602a46-9375-45f1-9fa5-1faf8d842b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5849700a-bf66-43f6-9d99-696dba4a8ab0", "name": "network-vif-deleted", "tag": "c5b82efe-d154-4dcd-b443-017a8204ffef"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:30.312547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:30.320970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4a7f05ec-0088-4ee7-864e-7a9b091db9ae req-a8602a46-9375-45f1-9fa5-1faf8d842b3d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:30.321476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4a7f05ec-0088-4ee7-864e-7a9b091db9ae req-a8602a46-9375-45f1-9fa5-1faf8d842b3d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:30.321911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4a7f05ec-0088-4ee7-864e-7a9b091db9ae req-a8602a46-9375-45f1-9fa5-1faf8d842b3d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:30.322094 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8649bcf1-5ab0-4630-91f9-25f58ca0cce1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 0.846866 Aug 27 03:33:30.329393 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2525/5241] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:29 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:30.336326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:30.349529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:30.356194 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4a7f05ec-0088-4ee7-864e-7a9b091db9ae req-a8602a46-9375-45f1-9fa5-1faf8d842b3d service nova] Creating event network-vif-deleted:c5b82efe-d154-4dcd-b443-017a8204ffef for instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 on n-h2-852086-5 Aug 27 03:33:30.371613 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4a7f05ec-0088-4ee7-864e-7a9b091db9ae req-a8602a46-9375-45f1-9fa5-1faf8d842b3d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079993 Aug 27 03:33:30.372787 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2717/5242] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:30.386711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:30.387216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:30.387870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:30.388612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:30.389072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:30.389502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:30.573795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:30.574540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:30.588622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:30.589348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:30.591327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:30.594029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:30.600679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:30.601308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:30.717161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:30.717866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:30.718686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:30.719352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lazy-loading 'fault' on Instance uuid 5849700a-bf66-43f6-9d99-696dba4a8ab0 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:31.205600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:31.215961 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36dce207-7a4d-4f97-b8a0-ad8996e7279a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.883888 Aug 27 03:33:31.251446 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2526/5243] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:30 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:31.294677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.295840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:31.308854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:31.312863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:31.313907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:31.316405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:31.318657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:31.319362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:31.347443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:31.403687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:31.420407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1422ee82-5f3d-4f37-ac20-9af37524ed47 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 200 len: 1309 microversion: 2.1 time: 0.845238 Aug 27 03:33:31.438718 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2718/5244] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:30 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 1309 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:31.462758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:31.463752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:31.486285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:31.487052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:31.487688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:31.489190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:31.489827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:31.495715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:31.752518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:31.767717 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85c377de-7baa-48d6-9fcf-0eb6001bcfdf tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 0.327393 Aug 27 03:33:31.784803 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2719/5245] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:31 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:32.099663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:32.111461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccb62e68-e1cc-4b11-9db3-51cf151afe00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1214 microversion: 2.1 time: 0.822308 Aug 27 03:33:32.114141 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2527/5246] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:31 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1214 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:32.251086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.251699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:32.263347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.264364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.265232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.267497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.268271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.268942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.282263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ea3c11e6-af77-4369-83f4-86ad3cb28879 req-aaecccb0-8972-4835-a391-86f7ccd0ffb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69718556-4ec9-430e-b09b-5481ceea5320", "name": "network-vif-plugged", "status": "completed", "tag": "bbd206aa-6c48-4e45-b9ed-feff2f0d2aed"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:32.318632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ea3c11e6-af77-4369-83f4-86ad3cb28879 req-aaecccb0-8972-4835-a391-86f7ccd0ffb3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.319619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ea3c11e6-af77-4369-83f4-86ad3cb28879 req-aaecccb0-8972-4835-a391-86f7ccd0ffb3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.327149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ea3c11e6-af77-4369-83f4-86ad3cb28879 req-aaecccb0-8972-4835-a391-86f7ccd0ffb3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.347959 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ea3c11e6-af77-4369-83f4-86ad3cb28879 req-aaecccb0-8972-4835-a391-86f7ccd0ffb3 service nova] Creating event network-vif-plugged:bbd206aa-6c48-4e45-b9ed-feff2f0d2aed for instance 69718556-4ec9-430e-b09b-5481ceea5320 on n-h1-852086-5 Aug 27 03:33:32.356731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ea3c11e6-af77-4369-83f4-86ad3cb28879 req-aaecccb0-8972-4835-a391-86f7ccd0ffb3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231080 Aug 27 03:33:32.358014 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2720/5247] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:32.454067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.455243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 5849700a-bf66-43f6-9d99-696dba4a8ab0] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:32.471158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.473484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.475637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.476315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.476796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.477236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.518041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] HTTP exception thrown: Instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 could not be found. Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Request method failure captured: Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 HTTP/1.1 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAxNAWQPTYrwV2x7NjiQGgjN7Pi4fpbDXiMcKoky9povVbTEuFVZpKhAg3xv2LfDlKfS9n-QFHXY3bGu5lzobYEsaxqS1Qt93I7k5lJEzwSq4iRI9RDjLE0dM6UtFGeT_mEtBEnGVLbji0ha1ykfwweOLfBLYKtNSblHggdldHFmsU Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 4412ab4903d34828951cbb339177ce00 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4412ab4903d34828951cbb339177ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4412ab4903d34828951cbb339177ce00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4412ab4903d34828951cbb339177ce00", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4412ab4903d34828951cbb339177ce00"}]}] Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 4412ab4903d34828951cbb339177ce00 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ListServerFiltersTestJSON-1584319701-project Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: facd4165dbd645d6b3f010f757838dd2 Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ListServerFiltersTestJSON-1584319701-project Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 could not be found. Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5849700a-bf66-43f6-9d99-696dba4a8ab0'} Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 could not be found. Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 could not be found. Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:32.524087 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 could not be found. Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Returning 404 to user: Instance 5849700a-bf66-43f6-9d99-696dba4a8ab0 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:32.528410 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3c2e07be-9ba9-48e3-969b-146ba281630b tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0" status: 404 len: 111 microversion: 2.1 time: 0.076308 Aug 27 03:33:32.532275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2721/5248] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:32 2022] GET /compute/v2.1/servers/5849700a-bf66-43f6-9d99-696dba4a8ab0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:33:32.540788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.541575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:32.555872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.557861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.564338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.565287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.565977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.566722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.623802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:32.822756 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-712828be-8b04-4600-87d0-0d60b25affd4 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "DELETE /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 204 len: 0 microversion: 2.1 time: 0.284700 Aug 27 03:33:32.828958 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2722/5249] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:32 2022] DELETE /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:33:32.849786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:32.852007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:32.868766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.869337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.871268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:32.871268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:32.871268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:32.871663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:33.403643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.417044 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9c20158-cf0c-467d-994e-47c519f7f61f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 0.586276 Aug 27 03:33:33.418072 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2723/5250] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:32 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:33.425697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.426342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:33.447004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:33.447948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:33.448403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:33.449149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:33.453121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:33.459901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:33.460454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:33.469878 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33d6bc92-33d7-422d-a648-a5798e196d7b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 1.223191 Aug 27 03:33:33.470514 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2528/5251] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:32 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:33.492062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6732ce83-d297-45c7-ac9f-fe2595aa416f req-11c44bac-258d-469a-95c1-7f0fe38e87e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e72664-c42e-47cc-96d8-d3b214e64fde", "tag": "e0541285-4665-433c-b6f5-53def0f86c29"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:33.506694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6732ce83-d297-45c7-ac9f-fe2595aa416f req-11c44bac-258d-469a-95c1-7f0fe38e87e1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:33.507451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6732ce83-d297-45c7-ac9f-fe2595aa416f req-11c44bac-258d-469a-95c1-7f0fe38e87e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:33.508076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6732ce83-d297-45c7-ac9f-fe2595aa416f req-11c44bac-258d-469a-95c1-7f0fe38e87e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:33.524609 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6732ce83-d297-45c7-ac9f-fe2595aa416f req-11c44bac-258d-469a-95c1-7f0fe38e87e1 service nova] Creating event network-changed:e0541285-4665-433c-b6f5-53def0f86c29 for instance c8e72664-c42e-47cc-96d8-d3b214e64fde on n-h2-852086-5 Aug 27 03:33:33.530278 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6732ce83-d297-45c7-ac9f-fe2595aa416f req-11c44bac-258d-469a-95c1-7f0fe38e87e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058509 Aug 27 03:33:33.532482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2529/5252] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:33.539219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:33.540251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:33.551810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:33.552714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:33.553403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:33.554412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:33.555242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:33.555898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:33.581249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:34.022538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.023962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.032641 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa5549f8-1eaf-4736-8c0d-a2caa1ef8e53 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1214 microversion: 2.1 time: 0.498649 Aug 27 03:33:34.032986 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4539b5e-be19-4467-a3ac-200f85011216 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 200 len: 1519 microversion: 2.1 time: 0.613666 Aug 27 03:33:34.033594 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2724/5253] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:33 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 1519 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:34.056834 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2530/5254] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:33 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1214 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:34.439130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:34.439919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:34.443066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:34.461482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:34.466771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:34.467652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:34.469246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:34.471337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:34.475032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:34.492141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:34.493382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:34.506742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:34.508311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:34.510991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:34.514820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:34.516057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:34.516696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:34.769142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:34.875334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:34.894383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbe37df8-563b-4c18-b4d9-11b719736851 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.402579 Aug 27 03:33:34.895071 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2531/5255] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:34 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:34.991459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.004147 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-943a8d22-6f2a-4e60-bf19-6337369d6537 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1366 microversion: 2.1 time: 0.569486 Aug 27 03:33:35.033639 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2725/5256] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:34 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1366 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:35.058374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.059347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:35.068886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.076100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:35.080578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:35.081340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:35.083280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:35.084507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:35.085899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:35.088302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:35.111651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:35.112791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:35.113881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:35.120787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:35.130587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:35.131044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:35.567914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.606423 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d40ff581-3cbf-4c3a-b6d4-485123f1b215 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1214 microversion: 2.1 time: 0.542292 Aug 27 03:33:35.625062 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2726/5257] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:35 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1214 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:35.882311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:35.894469 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd4f4a76-1e58-4642-a397-b6d27babc4c2 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 200 len: 1519 microversion: 2.1 time: 0.840814 Aug 27 03:33:35.914945 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2532/5258] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:35 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 1519 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:35.917770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:35.918621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:35.928207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:35.943125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:35.943853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:35.947192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:35.947902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:35.948555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:36.031737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:36.032437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:36.055742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:36.057135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:36.059274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:36.067141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:36.069606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:36.073363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:36.242471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:36.252375 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50893d71-b47e-4c04-a36f-d4cb73e5ffab tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.337532 Aug 27 03:33:36.258505 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2727/5259] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:35 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:36.657352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:36.657996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:36.677435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:36.677942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:36.678419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:36.679397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:36.679861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:36.680324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:37.066449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.086082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87aa57c6-913e-4e79-873e-de1b52f488a6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.432964 Aug 27 03:33:37.100322 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2728/5260] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:36 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:37.119388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.135519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:37.167472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:37.168310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:37.172214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:37.173216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:37.174137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:37.176659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:37.393309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.403478 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae3fa432-3897-4354-a8b6-31eccebb561f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1556 microversion: 2.1 time: 1.378414 Aug 27 03:33:37.411636 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2533/5261] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:36 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1556 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:37.416724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.430109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:37.462461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:37.462724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:37.463157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:37.463920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:37.464390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:37.464825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:37.691987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:37.706858 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f434280c-dcb2-405c-b4e9-1fe16277380c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 200 len: 1519 microversion: 2.1 time: 0.586838 Aug 27 03:33:37.716870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2729/5262] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:37 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 1519 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:37.729157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:37.731956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:37.749626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:37.752719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:37.754848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:37.755929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:37.757820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:37.758458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:37.805091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:37.993171 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1bb40de9-2d21-4fd2-b6c6-22ce795ed1a6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274763 Aug 27 03:33:37.994275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2730/5263] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:33:37 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:38.125255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.125255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:38.133409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:38.133954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:38.135385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:38.135385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:38.135637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:38.135990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:38.500289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.514590 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d76f9e6f-1e56-4906-893c-39b41628188d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.394719 Aug 27 03:33:38.516697 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2731/5264] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:38 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:38.544527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8f620167-9675-451c-8d4d-901a1f3ce338 req-bb3da601-ae86-484b-96b2-ac3ec40d33b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a538b7-cc32-4afb-be97-8d0d2f7a37f4", "name": "network-vif-deleted", "tag": "9b9483a9-ad52-4cc9-96fc-05799bb43f6f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:38.573945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8f620167-9675-451c-8d4d-901a1f3ce338 req-bb3da601-ae86-484b-96b2-ac3ec40d33b1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:38.574533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8f620167-9675-451c-8d4d-901a1f3ce338 req-bb3da601-ae86-484b-96b2-ac3ec40d33b1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:38.574983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8f620167-9675-451c-8d4d-901a1f3ce338 req-bb3da601-ae86-484b-96b2-ac3ec40d33b1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:38.604469 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8f620167-9675-451c-8d4d-901a1f3ce338 req-bb3da601-ae86-484b-96b2-ac3ec40d33b1 service nova] Creating event network-vif-deleted:9b9483a9-ad52-4cc9-96fc-05799bb43f6f for instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 on n-h1-852086-5 Aug 27 03:33:38.613303 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8f620167-9675-451c-8d4d-901a1f3ce338 req-bb3da601-ae86-484b-96b2-ac3ec40d33b1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085468 Aug 27 03:33:38.618214 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2732/5265] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:38.682523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.707353 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f19515c5-3dc0-4865-bbbe-ce109f44d4d0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 1.288217 Aug 27 03:33:38.725146 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2534/5266] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:37 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:38.743561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:38.744388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:38.772985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:38.774391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:38.775450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:38.783438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:38.784304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:38.785075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:38.837136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:38.849317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:38.849317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:38.849317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lazy-loading 'fault' on Instance uuid 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:38.968498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:38.968498 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fdc0be29-193e-4d5e-bdc8-f1adf9b36d8c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 200 len: 1311 microversion: 2.1 time: 0.221631 Aug 27 03:33:38.968498 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2733/5267] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:38 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:39.565838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:39.568641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:39.612557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:39.613097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:39.626484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:39.627298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:39.627791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:39.628237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:39.741966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:39.755425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:39.814683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:39.815202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:39.815648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:39.816354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:39.822851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:39.823559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.324111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:40.348669 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1022f6b-f994-4a21-9ef1-bff8e2e52511 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.804680 Aug 27 03:33:40.354378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:40.359659 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2535/5268] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:39 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:40.369866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-919d281f-0944-480c-87f7-588c028bc9ca tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.639976 Aug 27 03:33:40.376573 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2734/5269] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:39 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:40.382296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.383176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 83a538b7-cc32-4afb-be97-8d0d2f7a37f4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:40.393131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:40.394099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:40.395002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.395905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:40.398013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:40.399728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.462191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e0f838d4-5be9-48b5-b67e-7bd3a2636579 req-49e42fac-4752-4692-a83c-128d38eb0681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69718556-4ec9-430e-b09b-5481ceea5320", "tag": "bbd206aa-6c48-4e45-b9ed-feff2f0d2aed"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:40.498942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0f838d4-5be9-48b5-b67e-7bd3a2636579 req-49e42fac-4752-4692-a83c-128d38eb0681 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:40.499754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0f838d4-5be9-48b5-b67e-7bd3a2636579 req-49e42fac-4752-4692-a83c-128d38eb0681 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:40.503742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e0f838d4-5be9-48b5-b67e-7bd3a2636579 req-49e42fac-4752-4692-a83c-128d38eb0681 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.509721 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] HTTP exception thrown: Instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 could not be found. Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Request method failure captured: Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 HTTP/1.1 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAxNAWQPTYrwV2x7NjiQGgjN7Pi4fpbDXiMcKoky9povVbTEuFVZpKhAg3xv2LfDlKfS9n-QFHXY3bGu5lzobYEsaxqS1Qt93I7k5lJEzwSq4iRI9RDjLE0dM6UtFGeT_mEtBEnGVLbji0ha1ykfwweOLfBLYKtNSblHggdldHFmsU Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4412ab4903d34828951cbb339177ce00 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4412ab4903d34828951cbb339177ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4412ab4903d34828951cbb339177ce00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4412ab4903d34828951cbb339177ce00", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4412ab4903d34828951cbb339177ce00"}]}] Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4412ab4903d34828951cbb339177ce00 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ListServerFiltersTestJSON-1584319701-project Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: facd4165dbd645d6b3f010f757838dd2 Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ListServerFiltersTestJSON-1584319701-project Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 could not be found. Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '83a538b7-cc32-4afb-be97-8d0d2f7a37f4'} Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 could not be found. Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 could not be found. Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:40.516292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:40.525125 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:40.525125 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:40.525125 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:40.525125 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:40.525125 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:40.525125 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 could not be found. Aug 27 03:33:40.525125 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:40.532994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Returning 404 to user: Instance 83a538b7-cc32-4afb-be97-8d0d2f7a37f4 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:40.535582 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9be385c-7833-4e6c-8b53-a7305b561263 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4" status: 404 len: 111 microversion: 2.1 time: 0.169096 Aug 27 03:33:40.537916 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2536/5270] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:40 2022] GET /compute/v2.1/servers/83a538b7-cc32-4afb-be97-8d0d2f7a37f4 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:40.554703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e0f838d4-5be9-48b5-b67e-7bd3a2636579 req-49e42fac-4752-4692-a83c-128d38eb0681 service nova] Creating event network-changed:bbd206aa-6c48-4e45-b9ed-feff2f0d2aed for instance 69718556-4ec9-430e-b09b-5481ceea5320 on n-h1-852086-5 Aug 27 03:33:40.556060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.563824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:40.581507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e0f838d4-5be9-48b5-b67e-7bd3a2636579 req-49e42fac-4752-4692-a83c-128d38eb0681 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119475 Aug 27 03:33:40.597971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:40.599676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:40.600217 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2735/5271] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:40.605496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.611066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:40.612279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:40.613532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.715707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:40.914942 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57b61e7b-a84f-4412-a8c0-9b6adaa535df tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "DELETE /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 204 len: 0 microversion: 2.1 time: 0.371195 Aug 27 03:33:40.918903 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2537/5272] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:40 2022] DELETE /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:40.927332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.929202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:40.958632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:40.963947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:40.964870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.971630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:40.974424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:40.975008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:40.997873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:40.998318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:41.013968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.015418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.015972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.019566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.021362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.022033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.074892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:41.231343 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-716066df-8034-453d-9996-79f9fedddee1 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 204 len: 0 microversion: 2.1 time: 0.238080 Aug 27 03:33:41.232231 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2538/5273] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:40 2022] DELETE /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:33:41.247019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:41.249743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:41.264276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.266722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.267356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.268727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.274293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.277329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.625479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.636700 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a828b73c-ef4a-41eb-a2f8-48c14a555029 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1507 microversion: 2.1 time: 0.398974 Aug 27 03:33:41.638190 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2539/5274] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:41 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:41.646479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:41.647382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:41.659608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.660308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.660850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.661730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.662381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.662911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.854726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.864930 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dfef1ab6-b39e-4754-8573-c075ff95a873 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.225483 Aug 27 03:33:41.873746 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2540/5275] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:41 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:41.879915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:41.880764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:41.888587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.893331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.893965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.895629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:41.896035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:41.899336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:41.976923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:41.990018 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2cfe104c-e8d7-4500-9de3-db0be1497a4f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1518 microversion: 2.1 time: 1.069193 Aug 27 03:33:42.005068 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2736/5276] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:40 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1518 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:42.150554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:42.163739 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d363b505-e0df-4730-8129-3799bb333aa9 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.296411 Aug 27 03:33:42.164486 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2541/5277] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:41 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:42.682147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:42.682809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:42.703000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:42.704122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:42.706152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:42.708991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:42.710773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:42.712797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:42.884987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:42.885613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:42.907723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:42.909397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:42.911638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:42.916679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:42.918704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:42.919687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:43.111657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:43.124062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ccf6c103-3636-4847-9f19-b8a298ec792b tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1507 microversion: 2.1 time: 0.458775 Aug 27 03:33:43.124959 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2737/5278] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:42 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:43.141095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:43.144778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:43.157799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:43.158642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:43.159274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:43.161672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:43.167994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:43.173286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:43.173747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:43.182847 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ec635c5-4f5c-4afc-90c4-c4fae04fda1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.301712 Aug 27 03:33:43.190429 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2542/5279] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:42 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:43.206117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:43.206798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:43.216776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:43.217538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:43.218745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:43.219842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:43.220304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:43.220734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:43.445809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:43.455828 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d1ece4b-f006-4a85-ac17-70d0b1495d01 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.262404 Aug 27 03:33:43.458741 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2543/5280] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:43 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:43.513696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:43.523552 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-688e71f5-9195-4947-b08b-5876ab37540a tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1518 microversion: 2.1 time: 0.397120 Aug 27 03:33:43.552373 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2738/5281] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:43 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1518 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:44.147573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:44.148978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:44.168069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:44.168565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:44.169218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:44.170127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:44.170615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:44.171078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:44.176357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:44.207075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:44.208532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:44.233090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:44.234052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:44.244603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:44.250845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:44.253959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:44.256525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:44.747703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:44.762429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cddfd01f-a935-4314-8002-8f379e16d7c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.561159 Aug 27 03:33:44.763324 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2739/5282] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:44 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:44.792990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:44.793909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:44.809482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:44.810318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:44.810948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:44.812727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:44.813769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:44.814832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:45.088034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:45.099424 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c906e86-500a-4a92-a8ef-1b3a3b2c6f5f tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1507 microversion: 2.1 time: 0.955880 Aug 27 03:33:45.124793 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2544/5283] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:44 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1507 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:45.140202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:45.141689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:45.163206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:45.163926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:45.165362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:45.166623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:45.169431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:45.170031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:45.620885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:45.647172 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-560d2ce0-b3fc-455e-b1fb-bcf272fdbfd1 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1518 microversion: 2.1 time: 0.518505 Aug 27 03:33:45.649004 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2545/5284] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:45 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1518 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:45.683500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:45.703949 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f14b90b7-1e30-4a8d-be22-2f21d2313965 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1505 microversion: 2.1 time: 0.926773 Aug 27 03:33:45.705235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2740/5285] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:44 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1505 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:45.787627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:45.788243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:45.795059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:45.795950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:45.797387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:45.798590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:45.799837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:45.800622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.108718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:46.127577 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9407a6b1-2e13-4a96-a1ab-9a494325eb31 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.343668 Aug 27 03:33:46.128901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2546/5286] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:45 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:46.132858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e856efd4-5f64-48a6-888a-21f0d1c86a7a req-bf57aa0d-0f28-4b2c-90c9-290d94e7fd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d37106-31bb-44bc-9884-8e72d7b3faaa", "name": "network-vif-deleted", "tag": "d1fcf354-77f1-4493-acbe-0a9096bb9829"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:46.135431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.136528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:46.146917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.147935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.148550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.149535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.150552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.151294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.158786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e856efd4-5f64-48a6-888a-21f0d1c86a7a req-bf57aa0d-0f28-4b2c-90c9-290d94e7fd42 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.159349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e856efd4-5f64-48a6-888a-21f0d1c86a7a req-bf57aa0d-0f28-4b2c-90c9-290d94e7fd42 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.159797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e856efd4-5f64-48a6-888a-21f0d1c86a7a req-bf57aa0d-0f28-4b2c-90c9-290d94e7fd42 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.186423 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e856efd4-5f64-48a6-888a-21f0d1c86a7a req-bf57aa0d-0f28-4b2c-90c9-290d94e7fd42 service nova] Creating event network-vif-deleted:d1fcf354-77f1-4493-acbe-0a9096bb9829 for instance 23d37106-31bb-44bc-9884-8e72d7b3faaa on n-h1-852086-5 Aug 27 03:33:46.217448 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e856efd4-5f64-48a6-888a-21f0d1c86a7a req-bf57aa0d-0f28-4b2c-90c9-290d94e7fd42 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375282 Aug 27 03:33:46.220264 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2741/5287] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:46.299607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:46.309692 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6448f9f7-3b6a-4708-b815-4ff040fcdde4 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1465 microversion: 2.1 time: 0.178953 Aug 27 03:33:46.320731 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2547/5288] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:46 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:46.621593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.622354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:46.632699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.633750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.634681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.635578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.636378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.637337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.668877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.669566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:46.677039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.677813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.678475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.679611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.680249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.681006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.719131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.721575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.722043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.722732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lazy-loading 'fault' on Instance uuid 23d37106-31bb-44bc-9884-8e72d7b3faaa {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:46.774762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:46.784495 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff1d1d04-6a3f-4b08-ab4a-4107ebd45334 tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1311 microversion: 2.1 time: 0.119506 Aug 27 03:33:46.802386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2548/5289] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:46 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:46.809480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:46.810389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:46.819150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.819845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.820567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.821463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:46.822076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:46.822698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:46.850009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lazy-loading 'services' on Instance uuid 3a7db87c-e21a-4282-90f4-a393fe1104b8 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:46.997729 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dcb0904c-feca-4f95-a8fa-b9d2da31d58d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-volume_attachments/a5254615-0a3f-430b-b30a-dab0e0bfae1f" status: 202 len: 0 microversion: 2.1 time: 0.380953 Aug 27 03:33:46.999363 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2742/5290] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:33:46 2022] DELETE /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-volume_attachments/a5254615-0a3f-430b-b30a-dab0e0bfae1f => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:47.064577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:47.087949 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bbd776a3-bfee-455f-a460-0dd79e8233eb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1505 microversion: 2.1 time: 0.283229 Aug 27 03:33:47.088544 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2549/5291] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:46 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:47.150346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:47.151900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:47.158768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.159698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.160826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.162824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.163414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.163706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.308839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0496f0d4-0c3c-4044-af8e-cb59979a1664 req-cf914600-b25d-4dad-8878-2f02896b310c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac772560-1c31-4977-85dd-a63202adb8e5", "name": "network-vif-unplugged", "status": "completed", "tag": "014c473a-6d17-46aa-a021-c49719e13251"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:47.324178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0496f0d4-0c3c-4044-af8e-cb59979a1664 req-cf914600-b25d-4dad-8878-2f02896b310c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.324880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0496f0d4-0c3c-4044-af8e-cb59979a1664 req-cf914600-b25d-4dad-8878-2f02896b310c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.325669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0496f0d4-0c3c-4044-af8e-cb59979a1664 req-cf914600-b25d-4dad-8878-2f02896b310c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.347629 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0496f0d4-0c3c-4044-af8e-cb59979a1664 req-cf914600-b25d-4dad-8878-2f02896b310c service nova] Creating event network-vif-unplugged:014c473a-6d17-46aa-a021-c49719e13251 for instance ac772560-1c31-4977-85dd-a63202adb8e5 on n-h1-852086-5 Aug 27 03:33:47.353729 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0496f0d4-0c3c-4044-af8e-cb59979a1664 req-cf914600-b25d-4dad-8878-2f02896b310c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051980 Aug 27 03:33:47.355106 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2550/5292] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:47.376587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:47.377572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:47.386913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.387745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.388501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.402068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.403644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.404624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.499794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:47.509187 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28db6a08-c44e-460f-8c66-67fdfa860643 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1465 microversion: 2.1 time: 0.152653 Aug 27 03:33:47.510553 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2551/5293] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:47 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:47.806523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:47.807232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:47.819997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.820990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.821562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.823395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.824751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.833091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.931222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:47.932147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:47.934138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:47.935025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lazy-loading 'fault' on Instance uuid 23d37106-31bb-44bc-9884-8e72d7b3faaa {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:48.010917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd4165dbd645d6b3f010f757838dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412ab4903d34828951cbb339177ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:48.021091 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b4d9723-5a49-48d9-aa1d-9fff641bdc3c tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 200 len: 1311 microversion: 2.1 time: 0.219496 Aug 27 03:33:48.023313 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2552/5294] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:47 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 1311 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:48.089657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:48.104190 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b4abae2-f480-428b-831d-3e306e65a05c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.958506 Aug 27 03:33:48.105177 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2743/5295] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:47 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:48.121399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:48.122288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:48.131153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.137468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.139558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.143098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.143910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.145885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.257243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-aa8d29e2-99c6-465f-8104-6b795e0a4a77 req-03a7b221-3c9d-4e8c-924a-e2551ccb622e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e47f54e-4421-4a9f-978e-ebd3e92aff77", "name": "network-vif-deleted", "tag": "a6345e7d-90fc-4730-9aeb-af9bb2570beb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:48.270659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-aa8d29e2-99c6-465f-8104-6b795e0a4a77 req-03a7b221-3c9d-4e8c-924a-e2551ccb622e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.271365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-aa8d29e2-99c6-465f-8104-6b795e0a4a77 req-03a7b221-3c9d-4e8c-924a-e2551ccb622e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.271988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-aa8d29e2-99c6-465f-8104-6b795e0a4a77 req-03a7b221-3c9d-4e8c-924a-e2551ccb622e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.286122 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-aa8d29e2-99c6-465f-8104-6b795e0a4a77 req-03a7b221-3c9d-4e8c-924a-e2551ccb622e service nova] Creating event network-vif-deleted:a6345e7d-90fc-4730-9aeb-af9bb2570beb for instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 on n-h1-852086-5 Aug 27 03:33:48.291793 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-aa8d29e2-99c6-465f-8104-6b795e0a4a77 req-03a7b221-3c9d-4e8c-924a-e2551ccb622e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039880 Aug 27 03:33:48.301012 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2744/5296] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:48.431965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:48.444596 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9dabda72-4125-4a9f-bad7-6ce4e57b4560 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 200 len: 1508 microversion: 2.1 time: 0.326963 Aug 27 03:33:48.445186 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2553/5297] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:48 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:48.473196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:48.473819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:48.483542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.484634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.485334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.486253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.487176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.487767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.596716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1913539716", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "884cc9d3-fd5b-41fa-9c38-e6d9e28afb0e"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:48.676495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:48.686129 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00dbee4b-5b37-49a4-8421-c5362beff78b tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.222463 Aug 27 03:33:48.690542 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2554/5298] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:48 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:48.693006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] validate_networks() for [('884cc9d3-fd5b-41fa-9c38-e6d9e28afb0e', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:33:48.701702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:48.703252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:48.719826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.720548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.721872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.724200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.724856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.727126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.828295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:48.833464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.834201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.836616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.837382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'fault' on Instance uuid 4e47f54e-4421-4a9f-978e-ebd3e92aff77 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:48.959772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:48.970270 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb292b37-0c42-4bad-8c32-edc3feb0184d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 200 len: 1312 microversion: 2.1 time: 0.281410 Aug 27 03:33:48.990288 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2555/5299] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:48 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:48.990288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:48.990288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:48.990288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.990780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.991398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:48.992291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:48.992915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:48.995006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.234820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:49.245129 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cffa5822-0758-45eb-9251-a2e95b814765 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.266487 Aug 27 03:33:49.246043 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2556/5300] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:48 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:49.251603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:49.252467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] [instance: 23d37106-31bb-44bc-9884-8e72d7b3faaa] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:49.265893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.268936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.269901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.271321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.271957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.272570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.292617 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] HTTP exception thrown: Instance 23d37106-31bb-44bc-9884-8e72d7b3faaa could not be found. Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Request method failure captured: Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa HTTP/1.1 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAxNAWQPTYrwV2x7NjiQGgjN7Pi4fpbDXiMcKoky9povVbTEuFVZpKhAg3xv2LfDlKfS9n-QFHXY3bGu5lzobYEsaxqS1Qt93I7k5lJEzwSq4iRI9RDjLE0dM6UtFGeT_mEtBEnGVLbji0ha1ykfwweOLfBLYKtNSblHggdldHFmsU Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 4412ab4903d34828951cbb339177ce00 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/4412ab4903d34828951cbb339177ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4412ab4903d34828951cbb339177ce00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_4412ab4903d34828951cbb339177ce00", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/4412ab4903d34828951cbb339177ce00"}]}] Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 4412ab4903d34828951cbb339177ce00 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1584319701 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ListServerFiltersTestJSON-1584319701-project Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: facd4165dbd645d6b3f010f757838dd2 Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ListServerFiltersTestJSON-1584319701-project Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 23d37106-31bb-44bc-9884-8e72d7b3faaa could not be found. Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '23d37106-31bb-44bc-9884-8e72d7b3faaa'} Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d37106-31bb-44bc-9884-8e72d7b3faaa could not be found. Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d37106-31bb-44bc-9884-8e72d7b3faaa could not be found. Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:49.294584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:49.300018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:49.300018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:49.300018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:49.300018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:49.300018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:49.300018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d37106-31bb-44bc-9884-8e72d7b3faaa could not be found. Aug 27 03:33:49.300018 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:33:49.301553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] Returning 404 to user: Instance 23d37106-31bb-44bc-9884-8e72d7b3faaa could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:49.302954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e767d958-2be8-4a53-a699-c92f30fbe54f tempest-ListServerFiltersTestJSON-1584319701 tempest-ListServerFiltersTestJSON-1584319701-project] 10.222.0.69 "GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa" status: 404 len: 111 microversion: 2.1 time: 0.055652 Aug 27 03:33:49.303690 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2557/5301] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:49 2022] GET /compute/v2.1/servers/23d37106-31bb-44bc-9884-8e72d7b3faaa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:49.317605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:49.325110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:49.344975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.346288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.348585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.349502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.353845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.354344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.459819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:49.460306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:49.460690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:49.461096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:49.461719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:49.475404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.475893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.476430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.477299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.477983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.478702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.535907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Getting quotas for project bbf0e9a27cb04667ad8cd903f4fcb141. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:33:49.544993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Getting quotas for user 86eac073163840f098b169de9bc976be and project bbf0e9a27cb04667ad8cd903f4fcb141. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:33:49.592441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:33:49.594937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:33:49.625475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:49.701746 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9ca5c440-ed0e-4ac8-a25a-a82902eaae26 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.340385 Aug 27 03:33:49.710145 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2745/5302] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 03:33:49.723603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:49.724471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:49.732401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.733146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.735435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.737273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.738031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.738868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.880116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:49.894500 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6f9e06e-720f-4b92-8575-a45a6d76a6c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.589506 Aug 27 03:33:49.897687 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2558/5303] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:49 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:49.909832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-beb1e6fb-1db6-4ffe-9a04-2b728412ff47 req-a0f7ebd2-c8b6-42c0-80d6-aed2c5dfa648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e72664-c42e-47cc-96d8-d3b214e64fde", "name": "network-vif-plugged", "status": "completed", "tag": "e0541285-4665-433c-b6f5-53def0f86c29"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:49.938359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-beb1e6fb-1db6-4ffe-9a04-2b728412ff47 req-a0f7ebd2-c8b6-42c0-80d6-aed2c5dfa648 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:49.940065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-beb1e6fb-1db6-4ffe-9a04-2b728412ff47 req-a0f7ebd2-c8b6-42c0-80d6-aed2c5dfa648 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:49.946012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-beb1e6fb-1db6-4ffe-9a04-2b728412ff47 req-a0f7ebd2-c8b6-42c0-80d6-aed2c5dfa648 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:49.972957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-beb1e6fb-1db6-4ffe-9a04-2b728412ff47 req-a0f7ebd2-c8b6-42c0-80d6-aed2c5dfa648 service nova] Creating event network-vif-plugged:e0541285-4665-433c-b6f5-53def0f86c29 for instance c8e72664-c42e-47cc-96d8-d3b214e64fde on n-h2-852086-5 Aug 27 03:33:49.988275 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-beb1e6fb-1db6-4ffe-9a04-2b728412ff47 req-a0f7ebd2-c8b6-42c0-80d6-aed2c5dfa648 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089056 Aug 27 03:33:49.991245 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2559/5304] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:50.008946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc918616-eb8c-470f-a87a-a36b135e2868 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.009583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc918616-eb8c-470f-a87a-a36b135e2868 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:50.101872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.121593 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9c7d01e-508f-4ba6-a294-8e2ed5d16a56 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.401969 Aug 27 03:33:50.122377 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2746/5305] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:49 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:50.130512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.131049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 4e47f54e-4421-4a9f-978e-ebd3e92aff77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:50.152174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.152923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.153567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.154521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.157658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.160065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.195073 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 could not be found. Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 HTTP/1.1 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 could not be found. Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4e47f54e-4421-4a9f-978e-ebd3e92aff77'} Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 could not be found. Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 could not be found. Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:50.196813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 could not be found. Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 404 to user: Instance 4e47f54e-4421-4a9f-978e-ebd3e92aff77 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:50.202922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-396b7fba-5b0d-49a3-8d48-402d8cb45ff6 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77" status: 404 len: 111 microversion: 2.1 time: 0.075524 Aug 27 03:33:50.209889 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2747/5306] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:50 2022] GET /compute/v2.1/servers/4e47f54e-4421-4a9f-978e-ebd3e92aff77 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:50.226735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.229822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:50.248492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.249663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.250329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.251363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.252189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.266919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.285510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc918616-eb8c-470f-a87a-a36b135e2868 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.297010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc918616-eb8c-470f-a87a-a36b135e2868 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.312584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc918616-eb8c-470f-a87a-a36b135e2868 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.320004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc918616-eb8c-470f-a87a-a36b135e2868 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1259 microversion: 2.21 time: 0.326730 Aug 27 03:33:50.323988 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2560/5307] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:33:49 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1259 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:50.350259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.354322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:50.378413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.378929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.379475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.380333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.380886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.381385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.487168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:50.489355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:50.501370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5aede610-e0d0-44d4-a78e-523d1cbfa777 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.289950 Aug 27 03:33:50.503244 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2748/5308] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:50 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:50.525342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e7d0270-895f-43d0-bdd6-70e3c9df56f2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:50.538089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e7d0270-895f-43d0-bdd6-70e3c9df56f2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.539586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e7d0270-895f-43d0-bdd6-70e3c9df56f2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.540193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e7d0270-895f-43d0-bdd6-70e3c9df56f2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.585489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:50.646819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e7d0270-895f-43d0-bdd6-70e3c9df56f2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Going to try to stop instance {{(pid=122407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:33:50.711601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:50.728698 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc6c011a-6fd6-4237-9167-ebe8e880c8eb tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 204 len: 0 microversion: 2.1 time: 0.399583 Aug 27 03:33:50.732420 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2561/5309] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:50 2022] DELETE /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:50.763105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.769760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:50.795844 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e7d0270-895f-43d0-bdd6-70e3c9df56f2 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.275498 Aug 27 03:33:50.804354 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2749/5310] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:50 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:33:50.816927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.820872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.827963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.828957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.830851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.832441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.839638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:50.843785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:50.858429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.875256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.875708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:50.876476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:50.876973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:50.877371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:51.116180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.128892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-68fbfe16-7b09-4748-894d-b2b173e602de tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.310205 Aug 27 03:33:51.129746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2750/5311] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:50 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:51.145047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:51.146026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:51.154768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:51.156223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:51.156938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:51.157844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:51.159189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:51.160029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:51.426726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.436222 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d08d4c8-1412-4157-8dd6-11867a007942 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.305024 Aug 27 03:33:51.437947 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2751/5312] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:51 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:51.443232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:51.449796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:51.466585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:51.467333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:51.469782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:51.470826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:51.474915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:51.475375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:51.621870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.639974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.643150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.644496 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-80ca0244-4b13-4ddf-92ff-31987065294b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1255 microversion: 2.21 time: 0.205065 Aug 27 03:33:51.645387 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2752/5313] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:33:51 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1255 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:51.872058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:51.887376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e54b16c7-7bf0-44c8-9cf6-eedcff0ea6bf tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 1.150120 Aug 27 03:33:51.903547 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2562/5314] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:50 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:52.151140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:52.151516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:52.163568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:52.164070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:52.167119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:52.170458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:52.171811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:52.173605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:52.464513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:52.465161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:52.486492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:52.487193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:52.487997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:52.488888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:52.489510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:52.490669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:52.622523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:52.637055 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b130a2e-cf8a-42b1-91bb-9aeace667694 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.490494 Aug 27 03:33:52.639231 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2753/5315] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:52 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:52.696452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:52.703831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:52.736235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:52.737247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:52.737929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:52.748962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:52.751260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:52.753602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:52.951642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:52.988984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:52.992728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:52.994057 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0990f50-9a46-408c-883f-ed59b3597864 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1317 microversion: 2.21 time: 0.311123 Aug 27 03:33:52.995136 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2754/5316] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:33:52 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:53.028235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:53.055786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:53.085287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:53.085898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:53.086607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:53.087432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:53.087994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:53.088892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:53.170261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:53.190864 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81fd1df9-fe01-4f1a-adfc-cb8f328344de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1202 microversion: 2.1 time: 0.730286 Aug 27 03:33:53.194701 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2563/5317] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:52 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1202 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:53.385767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:53.401169 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1ad135a6-bc4e-4fc2-a097-3c5027abaa31 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.404807 Aug 27 03:33:53.404298 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2755/5318] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:52 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:53.660234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:53.660864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:53.678969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:53.682806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:53.682806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:53.683086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:53.683354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:53.683796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.020339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.021718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:54.029893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.030999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.031696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.033358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.034181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.035028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.174633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.189871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.210056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.211465 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30d6e230-ecbe-4c4f-9647-1a360bb6893e tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1317 microversion: 2.21 time: 0.195309 Aug 27 03:33:54.220923 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2756/5319] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:33:54 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:33:54.241107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.245750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:54.260930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.264787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.265374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.298522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.300714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.302092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.757811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.800813 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3c5a39cc-189c-4139-a637-22bbc22c66ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1388 microversion: 2.1 time: 0.577519 Aug 27 03:33:54.801744 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2757/5320] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:54 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1388 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:54.816498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.817129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:54.853416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.853921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.861129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.864345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.864947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.865648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:55.279045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.296523 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6bebca8c-4523-445f-a7ce-633eda750be6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 1.640848 Aug 27 03:33:55.299646 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2564/5321] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:53 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:55.315582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:55.317050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:55.336128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:55.336128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:55.336558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:55.337278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:55.337736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:55.338193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:55.425726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.445345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ef3c89c6-a124-4832-9cf0-41d087ae2074 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1520 microversion: 2.1 time: 0.641842 Aug 27 03:33:55.463247 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2758/5322] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:54 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1520 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:55.488028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:55.489213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:55.511759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:55.513103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:55.514087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:55.516248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:55.517323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:55.523311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:55.912642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.922669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.928090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.930565 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-07082080-0f39-4466-bbd2-9f3f0964bafe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1359 microversion: 2.21 time: 0.465759 Aug 27 03:33:55.937234 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2759/5323] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:33:55 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1359 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:56.089916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.106537 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6efde800-12b4-4192-ac02-e5b0f53bc5e6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1388 microversion: 2.1 time: 0.805252 Aug 27 03:33:56.133052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.133968 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2565/5324] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:55 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1388 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:56.134282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:56.145019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.146039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.146039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.148166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.148615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.150811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.327060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.328620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:56.336899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.337795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.338525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.339542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.340236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.341056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.497042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.512009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95788f0d-fdc7-412a-befb-098388ad0a3f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1388 microversion: 2.1 time: 0.384467 Aug 27 03:33:56.530650 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2760/5325] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:56 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1388 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:56.537556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.539198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:56.548671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.550490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.551724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.553356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.554110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.554881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.691748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.720532 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fecd42a5-a8a8-4717-972a-a8bc0e33f6d0 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1478 microversion: 2.1 time: 0.183957 Aug 27 03:33:56.722666 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2761/5326] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:56 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1478 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:56.730136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.735635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:56.774769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.781825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.782505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.783469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.784054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.784654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.852923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:56.904825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.914063 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72cf92e0-715b-488e-ba55-17abdacdcec1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.591970 Aug 27 03:33:56.917979 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2566/5327] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:56 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:56.970406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.971314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:56.988792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.989804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.990704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.993596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.003475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.005938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.036937 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac38a49b-434d-48eb-b9d4-761b8f052434 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 204 len: 0 microversion: 2.1 time: 0.312698 Aug 27 03:33:57.037613 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2762/5328] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:56 2022] DELETE /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:57.043882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-47fcb871-8ab1-4fe4-84b3-b98abd53774c req-1ff92d36-feae-4200-8b6b-cd2df9e1d9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6149aa8e-84bb-4a4c-933c-da6b1c15a90e", "name": "network-vif-deleted", "tag": "df29fb7e-38e5-4a90-b040-48fc33be1ef4"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:57.065813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47fcb871-8ab1-4fe4-84b3-b98abd53774c req-1ff92d36-feae-4200-8b6b-cd2df9e1d9af service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.071001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47fcb871-8ab1-4fe4-84b3-b98abd53774c req-1ff92d36-feae-4200-8b6b-cd2df9e1d9af service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.071943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47fcb871-8ab1-4fe4-84b3-b98abd53774c req-1ff92d36-feae-4200-8b6b-cd2df9e1d9af service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.096153 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-47fcb871-8ab1-4fe4-84b3-b98abd53774c req-1ff92d36-feae-4200-8b6b-cd2df9e1d9af service nova] Creating event network-vif-deleted:df29fb7e-38e5-4a90-b040-48fc33be1ef4 for instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e on n-h2-852086-5 Aug 27 03:33:57.104139 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-47fcb871-8ab1-4fe4-84b3-b98abd53774c req-1ff92d36-feae-4200-8b6b-cd2df9e1d9af service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064392 Aug 27 03:33:57.109793 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2763/5329] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:57.116799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.117787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:57.125882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.126792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.127488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.128729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.129813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.130848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.471285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.490449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.493981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.500635 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee6534f8-28da-41cd-b924-2274690f391d tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1359 microversion: 2.21 time: 0.533022 Aug 27 03:33:57.501473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2567/5330] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:33:56 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1359 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:57.511690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7f8b917-f397-4da3-aa5b-96aa3c2c4096 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:57.530915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f8b917-f397-4da3-aa5b-96aa3c2c4096 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.532866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f8b917-f397-4da3-aa5b-96aa3c2c4096 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.533750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f8b917-f397-4da3-aa5b-96aa3c2c4096 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.601739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7f8b917-f397-4da3-aa5b-96aa3c2c4096 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:33:57.614797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.628724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fe5d6b1f-c48f-4b46-b49e-702fc4ba554a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1394 microversion: 2.1 time: 0.517034 Aug 27 03:33:57.635184 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2764/5331] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:57 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1394 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:57.688302 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7f8b917-f397-4da3-aa5b-96aa3c2c4096 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action" status: 202 len: 0 microversion: 2.1 time: 0.183760 Aug 27 03:33:57.689549 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2568/5332] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:57 2022] POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:57.697673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.698622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:57.712951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.713655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.730897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.732394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.733987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.735030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.749343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.751131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:57.760080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:57.760658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.761365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.761981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.763060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.763726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.764489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.808035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.808808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.809428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.810065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'fault' on Instance uuid 6149aa8e-84bb-4a4c-933c-da6b1c15a90e {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:57.932321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.953063 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12fb59f0-f7a5-447c-93c4-d815a2244340 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1311 microversion: 2.1 time: 0.211241 Aug 27 03:33:57.957010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2569/5333] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:57 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:57.962381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.963317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:57.970729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.971584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.972259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.973223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.973949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.974824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:58.147267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:58.156365 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-23868c3f-9d92-4a30-ba86-016b57694f06 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1679 microversion: 2.1 time: 0.461727 Aug 27 03:33:58.172782 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2765/5334] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:57 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1679 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:58.471717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:58.498643 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67f2106e-c206-4b14-a1bf-b8e47fc8734c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.539883 Aug 27 03:33:58.502036 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2570/5335] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:57 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:58.536158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:58.541717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:58.557167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:58.558074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:58.559213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:58.573731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:58.575752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:58.577512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:58.660772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:58.661381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:58.676093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:58.676607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:58.677054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:58.678012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:58.678565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:58.683361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.053587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.063098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.070248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.079901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e6cb3e1f-157b-485a-b164-e6e82e18fabe tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1359 microversion: 2.21 time: 0.558187 Aug 27 03:33:59.084094 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2766/5336] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:33:58 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1359 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:33:59.089051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:59.093747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:59.106104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.124328 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f3b6a4e-e7b0-4cd3-9944-00a52c55fb50 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1394 microversion: 2.1 time: 0.470969 Aug 27 03:33:59.130206 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2571/5337] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:58 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1394 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:59.145553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.149004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.149004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.149004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.149004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.149004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.181057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:59.182035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:59.203975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.204962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.205628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.206656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.207335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.207993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.239939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.241669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.242405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.243157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lazy-loading 'fault' on Instance uuid 6149aa8e-84bb-4a4c-933c-da6b1c15a90e {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:33:59.354493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e78ab2dacae4a25803ea9f0cf512b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626a7fac21be48c7a265dc3441c0a66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.375604 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2867f22a-7795-4618-9245-fb85d995642d tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 200 len: 1311 microversion: 2.1 time: 0.288330 Aug 27 03:33:59.376889 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2767/5338] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:59 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 1311 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:59.391263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b9ce889d-8795-4661-be05-0c082e3f0507 req-975cdaa3-059a-4943-acb0-f77e0e7776b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91efb355-b663-4e6d-9b51-00a5993f7485", "tag": "8afd1ba8-dc15-467e-90ba-5a7b5f1083b0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:59.408311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b9ce889d-8795-4661-be05-0c082e3f0507 req-975cdaa3-059a-4943-acb0-f77e0e7776b6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.409096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b9ce889d-8795-4661-be05-0c082e3f0507 req-975cdaa3-059a-4943-acb0-f77e0e7776b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.409832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b9ce889d-8795-4661-be05-0c082e3f0507 req-975cdaa3-059a-4943-acb0-f77e0e7776b6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.427206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b9ce889d-8795-4661-be05-0c082e3f0507 req-975cdaa3-059a-4943-acb0-f77e0e7776b6 service nova] Creating event network-changed:8afd1ba8-dc15-467e-90ba-5a7b5f1083b0 for instance 91efb355-b663-4e6d-9b51-00a5993f7485 on n-h1-852086-5 Aug 27 03:33:59.437204 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b9ce889d-8795-4661-be05-0c082e3f0507 req-975cdaa3-059a-4943-acb0-f77e0e7776b6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058701 Aug 27 03:33:59.438440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2768/5339] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:59.557532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:59.558699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:59.566191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:59.569434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.570436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.571539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.573194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.574042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.574727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.577622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:59.832389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.844132 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df949a8a-5984-4609-a316-3b7d5b970cc1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.294461 Aug 27 03:33:59.845877 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2769/5340] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:59 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:59.989497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:00.003555 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95eb51d9-72b2-44b9-89bb-a918b837f62f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1679 microversion: 2.1 time: 0.826945 Aug 27 03:34:00.011388 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2572/5341] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:59 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1679 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:00.107294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:00.107905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:00.115182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.115762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.116205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.116991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.117705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.118222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.150578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:00.151459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:00.161348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.167840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.168421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.169247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.169854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.170527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.294395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:00.554973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:00.564634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1babc273-b8e4-4438-905e-62ca4ac70010 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1394 microversion: 2.1 time: 0.417962 Aug 27 03:34:00.575137 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2573/5342] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:00 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1394 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:00.575137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:00.575137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] [instance: 6149aa8e-84bb-4a4c-933c-da6b1c15a90e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:00.585127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.585807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.586525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.588368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.589069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.589742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.620517 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] HTTP exception thrown: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e could not be found. Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Request method failure captured: Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e HTTP/1.1 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY81bXjHr53LWfx6k18BIQdLlkwlolGe30_grQoxFZ_tDlTVo9pinGHRCER3qsm4PK60T0OEBvlqAjSLXqR0hA2YjwqZtD8IHYucx35sTrWUJGYbhAZ2LXXGKifIulRb-wZ-y21BNbZuQdlIQmZTJ93JM8_eSpA8Od-eZNMXqjNb1dU Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_626a7fac21be48c7a265dc3441c0a66a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/626a7fac21be48c7a265dc3441c0a66a"}]}] Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 626a7fac21be48c7a265dc3441c0a66a Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-282098794 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8e78ab2dacae4a25803ea9f0cf512b87 Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerRescueNegativeTestJSON-282098794-project Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e could not be found. Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6149aa8e-84bb-4a4c-933c-da6b1c15a90e'} Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e could not be found. Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e could not be found. Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:00.624304 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e could not be found. Aug 27 03:34:00.629153 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:00.631533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] Returning 404 to user: Instance 6149aa8e-84bb-4a4c-933c-da6b1c15a90e could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:00.633299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5841f4b1-9910-49de-bc7c-b51f5cbee895 tempest-ServerRescueNegativeTestJSON-282098794 tempest-ServerRescueNegativeTestJSON-282098794-project] 10.222.0.69 "GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e" status: 404 len: 111 microversion: 2.1 time: 0.066370 Aug 27 03:34:00.633988 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2574/5343] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:00 2022] GET /compute/v2.1/servers/6149aa8e-84bb-4a4c-933c-da6b1c15a90e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:00.692304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:00.708822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:00.711662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:00.713346 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44669ea7-6a22-4d28-a2c2-18a5f25228d0 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1359 microversion: 2.21 time: 0.609592 Aug 27 03:34:00.714102 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2770/5344] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:00 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1359 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:00.869620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:00.870604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:00.885760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.886605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.887239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.888138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.889248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.890599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.048233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:01.048233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:01.054236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.054969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.055495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.056296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.056847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.057345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.587200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:01.599936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba111606-c048-4cac-bab3-75089c1f0aeb tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.736569 Aug 27 03:34:01.604421 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2575/5345] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:00 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:01.619419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-568fdb10-cd23-470d-9799-35281f5521a5 req-8be66913-aded-4a1e-a305-ee156abfaeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e72664-c42e-47cc-96d8-d3b214e64fde", "name": "network-vif-deleted", "tag": "e0541285-4665-433c-b6f5-53def0f86c29"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:01.642911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-568fdb10-cd23-470d-9799-35281f5521a5 req-8be66913-aded-4a1e-a305-ee156abfaeb8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.643402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-568fdb10-cd23-470d-9799-35281f5521a5 req-8be66913-aded-4a1e-a305-ee156abfaeb8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.643844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-568fdb10-cd23-470d-9799-35281f5521a5 req-8be66913-aded-4a1e-a305-ee156abfaeb8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.647545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:01.659838 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6ab3a681-4dd4-417c-a9ab-3a0effb2a266 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1679 microversion: 2.1 time: 0.626653 Aug 27 03:34:01.665038 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2771/5346] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:01 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1679 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:01.677287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-568fdb10-cd23-470d-9799-35281f5521a5 req-8be66913-aded-4a1e-a305-ee156abfaeb8 service nova] Creating event network-vif-deleted:e0541285-4665-433c-b6f5-53def0f86c29 for instance c8e72664-c42e-47cc-96d8-d3b214e64fde on n-h2-852086-5 Aug 27 03:34:01.677969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:01.680133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:01.683984 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-568fdb10-cd23-470d-9799-35281f5521a5 req-8be66913-aded-4a1e-a305-ee156abfaeb8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078172 Aug 27 03:34:01.685535 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2576/5347] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:01.695807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.696682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.697359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.700011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.700709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.704680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.742498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:01.743572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:01.760398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.761186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.761885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.762899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.764761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.765583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.928112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:01.947051 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-779f22cb-c438-48b6-9509-feee17a06933 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1187 microversion: 2.1 time: 0.280555 Aug 27 03:34:01.949017 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2772/5348] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:01 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1187 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:02.072904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:02.077726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:02.091063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:02.094253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:02.096026 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa75641f-2fb1-49b2-b767-10eac3517949 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1359 microversion: 2.21 time: 0.360876 Aug 27 03:34:02.096992 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2577/5349] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:01 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1359 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:02.626017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:02.627507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:02.643321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:02.644378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:02.646612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:02.650453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:02.651727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:02.654552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:02.690891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:02.705306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:02.731564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:02.741248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:02.742212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:02.744341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:02.745193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:02.746339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.011421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:03.031111 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b39ddcd0-9b8a-4598-8ca4-64a6263d19c1 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 0.409695 Aug 27 03:34:03.034282 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2773/5350] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:02 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:03.051640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:03.052531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:03.074212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.075206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.075835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.077583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.078275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.080571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.120104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:03.134569 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c634fc91-a946-4b1b-a134-dce57ce79dce tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1679 microversion: 2.1 time: 0.449227 Aug 27 03:34:03.140371 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2578/5351] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:02 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1679 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:03.156045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:03.164474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:03.188077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.189278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.190379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.191584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.192226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.193405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.215330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:03.226955 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ecfd1d3-abb1-45ad-abcf-2ae1635bdb58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1187 microversion: 2.1 time: 0.191245 Aug 27 03:34:03.239952 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2774/5352] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:03 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1187 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:03.758324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-93724ca1-6be2-4280-8a67-c06d0c083cb3 req-4cf47260-8c45-49b1-88f2-7c5a716733b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efb355-b663-4e6d-9b51-00a5993f7485", "name": "network-vif-plugged", "status": "completed", "tag": "8afd1ba8-dc15-467e-90ba-5a7b5f1083b0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:03.785393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93724ca1-6be2-4280-8a67-c06d0c083cb3 req-4cf47260-8c45-49b1-88f2-7c5a716733b0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.788086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93724ca1-6be2-4280-8a67-c06d0c083cb3 req-4cf47260-8c45-49b1-88f2-7c5a716733b0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.788730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-93724ca1-6be2-4280-8a67-c06d0c083cb3 req-4cf47260-8c45-49b1-88f2-7c5a716733b0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.811909 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-93724ca1-6be2-4280-8a67-c06d0c083cb3 req-4cf47260-8c45-49b1-88f2-7c5a716733b0 service nova] Creating event network-vif-plugged:8afd1ba8-dc15-467e-90ba-5a7b5f1083b0 for instance 91efb355-b663-4e6d-9b51-00a5993f7485 on n-h1-852086-5 Aug 27 03:34:03.826193 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-93724ca1-6be2-4280-8a67-c06d0c083cb3 req-4cf47260-8c45-49b1-88f2-7c5a716733b0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071623 Aug 27 03:34:03.829475 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2775/5353] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:04.056141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:04.059291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:04.073279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.075292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.077316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.080654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.081441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.082384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.337379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.350575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.353601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.360658 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ecebafa-d845-427a-a311-7e13efa2fe72 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1359 microversion: 2.21 time: 1.209288 Aug 27 03:34:04.361575 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2579/5354] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:03 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1359 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:04.373137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:04.377604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:04.396587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.398376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.399851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.400247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.400942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.402761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.944734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.958878 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4e29d61-6c16-47e0-941e-9f65e68fc6a0 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1679 microversion: 2.1 time: 0.595159 Aug 27 03:34:04.959652 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2580/5355] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:04 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1679 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:04.970933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:04.972822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:04.986430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.989298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.994391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.995524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.996235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.996980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.151033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.164759 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-638ec277-1b43-4562-9d21-d490c6abb91c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1187 microversion: 2.1 time: 0.203351 Aug 27 03:34:05.168003 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2581/5356] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:04 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1187 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:05.387613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:05.389711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:05.399929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:05.404475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:05.405831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.408162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:05.408643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:05.409072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.571577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.587277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd5ec704-3236-4e11-b596-97ec07b5c6cd tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1678 microversion: 2.1 time: 1.531184 Aug 27 03:34:05.588322 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2776/5357] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:04 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1678 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:05.795849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.810319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.812388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.820998 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b517796-a9a5-470a-8004-36fa6c5758d3 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1359 microversion: 2.21 time: 0.430086 Aug 27 03:34:05.821662 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2582/5358] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:05 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1359 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:05.981175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:05.981822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:05.989404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:05.989897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:05.990733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.991660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:05.992262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:05.992691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.195272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.196412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:06.215197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.216081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.219350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.221480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.222211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.223522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.410124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:06.430004 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d5f1dd3-8149-411d-b6f3-01c2ac628961 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1679 microversion: 2.1 time: 0.453278 Aug 27 03:34:06.446238 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2777/5359] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:05 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1679 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:06.463222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:06.493026 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ff11d80-bd79-4973-a8a4-c30ddf566c80 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1187 microversion: 2.1 time: 0.307206 Aug 27 03:34:06.493697 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2583/5360] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:06 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1187 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:06.613365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.613998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:06.628491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.631460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.633665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.634665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.636243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.638094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.855209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-502522950", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "4a6ba2aa-a4d5-41f6-a7c1-e10a1f385a70"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:06.935827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:06.952715 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15062973-48ff-48eb-8861-cf6f6ef0a5d4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1655 microversion: 2.1 time: 0.343003 Aug 27 03:34:06.953802 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2584/5361] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:06 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1655 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:06.959408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.961354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:06.968953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.970582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.971207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.972125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.972784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.973362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.984872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] validate_networks() for [('4a6ba2aa-a4d5-41f6-a7c1-e10a1f385a70', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:34:07.209090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:07.231185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:07.239329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:07.245806 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9dd236e-689e-4564-bddf-c9336985aee7 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1551 microversion: 2.21 time: 0.290482 Aug 27 03:34:07.246706 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2585/5362] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:06 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1551 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:07.258464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2d2f046-0f6b-403e-ace5-fcffd77bfea4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:07.278926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d2f046-0f6b-403e-ace5-fcffd77bfea4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.279799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d2f046-0f6b-403e-ace5-fcffd77bfea4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.281955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d2f046-0f6b-403e-ace5-fcffd77bfea4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.340121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2d2f046-0f6b-403e-ace5-fcffd77bfea4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Going to try to start instance {{(pid=122408) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:34:07.432919 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2d2f046-0f6b-403e-ace5-fcffd77bfea4 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.181162 Aug 27 03:34:07.437057 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2586/5363] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:34:07 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:07.455235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:07.457498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:07.478137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.478959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.479528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.481574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.485437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.487134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.573629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:07.778728 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c0558df-c621-4930-871b-7012ce5f2c22 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "DELETE /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 204 len: 0 microversion: 2.21 time: 0.336898 Aug 27 03:34:07.784441 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2587/5364] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:34:07 2022] DELETE /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:34:07.795828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:07.798253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:07.814078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.815812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.819165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.820097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.820685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.821240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.267772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:08.284228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-970e71fd-60e4-44fb-ae85-c974e63cbc06 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1664 microversion: 2.1 time: 0.499304 Aug 27 03:34:08.285693 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2588/5365] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:07 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1664 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:08.296189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:08.297031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:08.309872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.310393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.310831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.312218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.312802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.313233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.472921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:08.473385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:08.473825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:08.474219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:08.474635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:08.501636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.502564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.511737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.527378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.528128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.528714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.568953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Getting quotas for project d31fce67599e4781bfe83d82c64982a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:08.578028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Getting quotas for user 79b7b41ba5314a8cbc6f54e0e61dbd3c and project d31fce67599e4781bfe83d82c64982a8. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:08.605390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:34:08.612730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:34:08.714144 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6d39a14-298f-49d5-a299-ded80d1a2d17 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.128184 Aug 27 03:34:08.715454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2778/5366] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:34:08.735365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:08.736183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:08.737293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:08.748036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.749577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.750277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.751639 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-539f3496-fb01-4b5c-a760-84357e78db21 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1679 microversion: 2.1 time: 0.463447 Aug 27 03:34:08.752555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.754018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.754520 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2589/5367] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:08 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1679 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:08.756089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.769757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:08.770645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:08.782999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.783675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.784259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.785107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.785692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.786265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:09.190788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.200197 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1de136fd-ef7e-4d6d-b240-4cffbb4ca155 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1187 microversion: 2.1 time: 0.475759 Aug 27 03:34:09.219286 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2779/5368] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:08 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1187 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:09.225174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8e437d46-f9f9-45fa-b2cb-f3514e74a157 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:09.235125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8e437d46-f9f9-45fa-b2cb-f3514e74a157 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:09.341219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e437d46-f9f9-45fa-b2cb-f3514e74a157 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.355230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8e437d46-f9f9-45fa-b2cb-f3514e74a157 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1216 microversion: 2.1 time: 0.131324 Aug 27 03:34:09.357593 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2780/5369] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:09 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1216 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:09.390570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:09.393931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:09.417481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:09.421668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:09.422464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:09.424434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:09.426487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:09.427926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:09.815946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.830670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.833576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.835058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.836304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d12ca16c-7acc-4082-ace3-e2e0ef7d0973 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1557 microversion: 2.21 time: 1.080692 Aug 27 03:34:09.836894 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2590/5370] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:08 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1557 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:09.841635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:09.848361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:09.854902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9aa66e3a-6e5d-4e65-bf60-f7bd07b4c075 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1664 microversion: 2.1 time: 0.493395 Aug 27 03:34:09.855847 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2781/5371] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:09 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1664 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:09.885788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:09.886334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:09.886782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:09.887795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:09.888312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:09.888787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.236528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:10.237156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:10.247991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:10.259689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.260116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.260868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.261999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.262804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.263422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.362866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.363362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.363797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.373074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid c8e72664-c42e-47cc-96d8-d3b214e64fde {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:10.488468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.494356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:10.510942 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f317e417-1a08-4c7f-85f4-efbc09763d07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1656 microversion: 2.1 time: 0.672987 Aug 27 03:34:10.526273 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2591/5372] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:09 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1656 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:10.533682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:10.551407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:10.579460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.588590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.589091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.589899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.590392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.590924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.676914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.692103 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-513523f9-be09-4a49-b14d-4815ff2decf2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 200 len: 1146 microversion: 2.1 time: 0.464141 Aug 27 03:34:10.694321 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2782/5373] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:10 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 1146 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:10.707309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-876d6c04-229d-4d13-a891-0ed048d4116f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:10.732503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876d6c04-229d-4d13-a891-0ed048d4116f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.734539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876d6c04-229d-4d13-a891-0ed048d4116f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.737113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-876d6c04-229d-4d13-a891-0ed048d4116f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.772300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.783688 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e201eec3-d124-419b-b874-18f89809e9f0 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1268 microversion: 2.1 time: 0.254600 Aug 27 03:34:10.786272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2592/5374] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:10 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1268 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:10.793512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-876d6c04-229d-4d13-a891-0ed048d4116f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Going to try to start instance {{(pid=122407) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:34:10.841955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:10.869404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:10.870838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:10.879384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.890206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.894584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.895873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.900824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.901574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.915067 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-876d6c04-229d-4d13-a891-0ed048d4116f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action" status: 202 len: 0 microversion: 2.1 time: 0.217767 Aug 27 03:34:10.917672 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2783/5375] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:34:10 2022] POST /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:10.933661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:10.942966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:10.961382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.963729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.965065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.967831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.968542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.969386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.184366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.203187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.211633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.212891 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a55330d9-e91d-4257-8b60-e45cf6616476 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1515 microversion: 2.21 time: 0.347494 Aug 27 03:34:11.218460 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2593/5376] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:10 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1515 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:11.227573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:11.241736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:11.271940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.277461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.278203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.279139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.280302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.280906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.789467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.804052 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4f078a8-4c9c-462b-a59f-66175da4fe48 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1665 microversion: 2.1 time: 0.584177 Aug 27 03:34:11.806384 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2594/5377] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:11 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1665 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:11.818372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c5fedc69-c39c-4bc4-9e25-8cb3424760ea req-cb1c7f99-6ebf-4c8a-9455-5ee7b54d705e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efb355-b663-4e6d-9b51-00a5993f7485", "name": "network-vif-deleted", "tag": "8afd1ba8-dc15-467e-90ba-5a7b5f1083b0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:11.856353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c5fedc69-c39c-4bc4-9e25-8cb3424760ea req-cb1c7f99-6ebf-4c8a-9455-5ee7b54d705e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.859129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c5fedc69-c39c-4bc4-9e25-8cb3424760ea req-cb1c7f99-6ebf-4c8a-9455-5ee7b54d705e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.860530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c5fedc69-c39c-4bc4-9e25-8cb3424760ea req-cb1c7f99-6ebf-4c8a-9455-5ee7b54d705e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.861611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.874575 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0c55e85-e73d-4333-83e6-dbc30ae17e54 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.951115 Aug 27 03:34:11.876961 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2784/5378] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:10 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:11.892290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:11.895880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: c8e72664-c42e-47cc-96d8-d3b214e64fde] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:11.900299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c5fedc69-c39c-4bc4-9e25-8cb3424760ea req-cb1c7f99-6ebf-4c8a-9455-5ee7b54d705e service nova] Creating event network-vif-deleted:8afd1ba8-dc15-467e-90ba-5a7b5f1083b0 for instance 91efb355-b663-4e6d-9b51-00a5993f7485 on n-h1-852086-5 Aug 27 03:34:11.909037 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c5fedc69-c39c-4bc4-9e25-8cb3424760ea req-cb1c7f99-6ebf-4c8a-9455-5ee7b54d705e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100600 Aug 27 03:34:11.922754 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2595/5379] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:11.936696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.937199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.937640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.938400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.938856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.939270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.940686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:11.941672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:11.972242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.972744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.973181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.973894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.974378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.974811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.986754 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance c8e72664-c42e-47cc-96d8-d3b214e64fde could not be found. Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde HTTP/1.1 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance c8e72664-c42e-47cc-96d8-d3b214e64fde could not be found. Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'c8e72664-c42e-47cc-96d8-d3b214e64fde'} Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e72664-c42e-47cc-96d8-d3b214e64fde could not be found. Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e72664-c42e-47cc-96d8-d3b214e64fde could not be found. Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:11.989865 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:11.996718 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:11.996718 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:11.996718 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:11.996718 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:11.996718 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:11.996718 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e72664-c42e-47cc-96d8-d3b214e64fde could not be found. Aug 27 03:34:11.996718 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:12.003167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance c8e72664-c42e-47cc-96d8-d3b214e64fde could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:12.005259 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e16bd5bc-7973-4e87-a30f-06d78c727690 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde" status: 404 len: 111 microversion: 2.1 time: 0.126900 Aug 27 03:34:12.007159 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2785/5380] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:11 2022] GET /compute/v2.1/servers/c8e72664-c42e-47cc-96d8-d3b214e64fde => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:12.018023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.019216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:12.032452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.033346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.034052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.035958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.036683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.037346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.167926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:12.181410 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ba3469b-3504-476d-9a48-6f586cb4a806 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1274 microversion: 2.1 time: 0.256963 Aug 27 03:34:12.182010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2596/5381] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:11 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1274 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:12.243745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.244830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:12.249516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:12.257044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.257990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.259003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.260644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.262145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.263093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.327733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:12.340295 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a958700a-3892-45db-971e-220a10b5d5f0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.328771 Aug 27 03:34:12.340912 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2786/5382] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:12 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:12.345385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.346263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.366009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.367057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lazy-loading 'fault' on Instance uuid 91efb355-b663-4e6d-9b51-00a5993f7485 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:12.377768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.378427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:12.403017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.403593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.404095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.404948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.405757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.405757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.828660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:12.840750 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce79648e-3661-4fe5-8b3c-b8be618266e0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.471468 Aug 27 03:34:12.843305 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2787/5383] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:12 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:12.876311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.879395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:12.893673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.893909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.900681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.902428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.905289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.905810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.189341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.208046 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1cdff7d9-6502-445d-bdb6-2a06bcecabfb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1665 microversion: 2.1 time: 0.363507 Aug 27 03:34:13.209406 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2788/5384] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:12 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1665 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.214724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.216682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.230125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.231724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.232489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.233962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.234820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.235504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.236998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.249965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.251443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eac073163840f098b169de9bc976be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0e9a27cb04667ad8cd903f4fcb141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.252639 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59624721-6a40-4511-a6b3-8c0c0483361a tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 200 len: 1349 microversion: 2.21 time: 1.013012 Aug 27 03:34:13.262081 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2597/5385] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:12 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 1349 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:13.267863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.272283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.286997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.287558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.287993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.288708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.289163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.289582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.451937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.452845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.463002 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85aa30e3-6df6-4513-9b01-6cdfdf30073a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.252368 Aug 27 03:34:13.463967 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2789/5386] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.482362 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f927224a-7a24-464a-84e9-03f33b831c57 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1274 microversion: 2.1 time: 0.202145 Aug 27 03:34:13.482362 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2598/5387] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.493359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.493359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.502231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.503048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.504240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.505121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.505844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.507074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.922778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.937943 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61dc159d-2edc-4def-a391-eeaae00f4d33 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.450190 Aug 27 03:34:13.939666 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2599/5388] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.964483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:13.966518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.977100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.977827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.986961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.995034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.997392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.001336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.039453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lazy-loading 'flavor' on Instance uuid d79642ca-ff1b-4d0b-b6d7-574372aa25ec {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:14.139205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-defd9622-6150-414a-ba37-fda2373372ea tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.180184 Aug 27 03:34:14.140626 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2790/5389] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:34:13 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:34:14.149259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.150225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:14.158390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.159306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.160562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.161640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.162302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.163173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.243337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.245632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:14.269723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.270764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.271582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.272815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.273637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.274418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.518108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.531031 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c91ca472-827a-48c7-849b-66f468fc683c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1669 microversion: 2.1 time: 0.296023 Aug 27 03:34:14.548783 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2791/5390] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:14 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1669 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:14.554377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.555222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:14.562602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.563339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.563979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.564705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.565332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.565919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.583382 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] HTTP exception thrown: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Request method failure captured: Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 HTTP/1.1 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZCcgvxXXg_YSQgy-gm3vrOl5pBM-huSwAi0F74Kye3rC8Lu_mPZf3297uoiSRROMZwXGisa8z0ZzxKff9mOiRrH1O_A3FwvoD3jIxMI34UmZmgF7KUFBEbWgxc7HjNeiT6FK5J-i0MN5b6TY545TVQPjIrLhJ0-h0NbPnnUDFohkRc Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: bbf0e9a27cb04667ad8cd903f4fcb141 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bbf0e9a27cb04667ad8cd903f4fcb141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bbf0e9a27cb04667ad8cd903f4fcb141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bbf0e9a27cb04667ad8cd903f4fcb141", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bbf0e9a27cb04667ad8cd903f4fcb141"}]}] Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: bbf0e9a27cb04667ad8cd903f4fcb141 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-InstanceActionsV221TestJSON-731558807-project Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 86eac073163840f098b169de9bc976be Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-InstanceActionsV221TestJSON-731558807-project Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '91efb355-b663-4e6d-9b51-00a5993f7485'} Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:14.585319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:14.590502 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:14.592766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Returning 404 to user: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:14.594642 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3722d84c-46cd-4311-a1a1-5365ec55fde2 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 404 len: 111 microversion: 2.21 time: 0.044211 Aug 27 03:34:14.595441 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2792/5391] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:14 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:34:14.605098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.606301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:14.613358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.613849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.614321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.615031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.615480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.615907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.829215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.852570 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6de05075-d98f-49db-8bc9-702136675eef tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1316 microversion: 2.1 time: 0.255643 Aug 27 03:34:14.854466 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2793/5392] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:14 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:14.862067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '.version_select at 0x7fe457ba6e50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.862933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:14.891288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.891911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.892483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.893309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.893868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.894431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.926204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:14.935432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75bad7da-9a2a-488d-a2f0-a4d438e279fc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1676 microversion: 2.1 time: 0.790021 Aug 27 03:34:14.949641 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2600/5393] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:14 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1676 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:15.023401 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a02a5367-8348-409b-9cda-e03dd872c12b tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.167352 Aug 27 03:34:15.024975 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2794/5394] 10.222.0.69 () {60 vars in 1337 bytes} [Sat Aug 27 03:34:14 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485/os-instance-actions => generated 611 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:15.037232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.038018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:15.051143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.051667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.063378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.065926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.069675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.071154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.097617 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] HTTP exception thrown: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Request method failure captured: Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 HTTP/1.1 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZCcgvxXXg_YSQgy-gm3vrOl5pBM-huSwAi0F74Kye3rC8Lu_mPZf3297uoiSRROMZwXGisa8z0ZzxKff9mOiRrH1O_A3FwvoD3jIxMI34UmZmgF7KUFBEbWgxc7HjNeiT6FK5J-i0MN5b6TY545TVQPjIrLhJ0-h0NbPnnUDFohkRc Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: bbf0e9a27cb04667ad8cd903f4fcb141 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bbf0e9a27cb04667ad8cd903f4fcb141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bbf0e9a27cb04667ad8cd903f4fcb141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bbf0e9a27cb04667ad8cd903f4fcb141", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bbf0e9a27cb04667ad8cd903f4fcb141"}]}] Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: bbf0e9a27cb04667ad8cd903f4fcb141 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-InstanceActionsV221TestJSON-731558807-project Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 86eac073163840f098b169de9bc976be Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-InstanceActionsV221TestJSON-731558807-project Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '91efb355-b663-4e6d-9b51-00a5993f7485'} Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:15.099862 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Returning 404 to user: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:15.104133 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d26344c8-161b-4742-9666-8bc6e930e287 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "DELETE /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 404 len: 111 microversion: 2.21 time: 0.068267 Aug 27 03:34:15.105114 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2601/5395] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:34:15 2022] DELETE /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:34:15.112027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.112838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] [instance: 91efb355-b663-4e6d-9b51-00a5993f7485] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:15.131751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.132106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.132541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.144598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.145094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.145533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.178706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] HTTP exception thrown: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Request method failure captured: Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 HTTP/1.1 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZCcgvxXXg_YSQgy-gm3vrOl5pBM-huSwAi0F74Kye3rC8Lu_mPZf3297uoiSRROMZwXGisa8z0ZzxKff9mOiRrH1O_A3FwvoD3jIxMI34UmZmgF7KUFBEbWgxc7HjNeiT6FK5J-i0MN5b6TY545TVQPjIrLhJ0-h0NbPnnUDFohkRc Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: bbf0e9a27cb04667ad8cd903f4fcb141 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bbf0e9a27cb04667ad8cd903f4fcb141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bbf0e9a27cb04667ad8cd903f4fcb141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bbf0e9a27cb04667ad8cd903f4fcb141", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bbf0e9a27cb04667ad8cd903f4fcb141"}]}] Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: bbf0e9a27cb04667ad8cd903f4fcb141 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-731558807 Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-InstanceActionsV221TestJSON-731558807-project Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 86eac073163840f098b169de9bc976be Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-InstanceActionsV221TestJSON-731558807-project Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '91efb355-b663-4e6d-9b51-00a5993f7485'} Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.180028 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] Returning 404 to user: Instance 91efb355-b663-4e6d-9b51-00a5993f7485 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:15.189945 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5ab47814-4d03-490a-9568-78d239aa90f4 tempest-InstanceActionsV221TestJSON-731558807 tempest-InstanceActionsV221TestJSON-731558807-project] 10.222.0.69 "GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485" status: 404 len: 111 microversion: 2.21 time: 0.075373 Aug 27 03:34:15.194248 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2795/5396] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:15 2022] GET /compute/v2.1/servers/91efb355-b663-4e6d-9b51-00a5993f7485 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:34:15.304546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1379530397", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": "none"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:15.367587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:15.368323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:15.368970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:15.369430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:15.370179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:15.381763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.382290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.382939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.383934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.384408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.384833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.406926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Getting quotas for project d2c9aeeba04f4d18b40d07b996a3d12a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:15.414535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Getting quotas for user 62a93a28048e4fb58f346e686cc09894 and project d2c9aeeba04f4d18b40d07b996a3d12a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:15.428751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:34:15.431137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:34:15.479686 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bdbc8dd-145b-4dc3-8458-f9327df83f74 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.352308 Aug 27 03:34:15.487040 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2602/5397] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:34:15.492477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a090dc1d-7ac1-466b-8cfd-00a98df07173 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.493083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a090dc1d-7ac1-466b-8cfd-00a98df07173 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:15.587525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a090dc1d-7ac1-466b-8cfd-00a98df07173 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.600732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a090dc1d-7ac1-466b-8cfd-00a98df07173 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.605260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a090dc1d-7ac1-466b-8cfd-00a98df07173 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.607502 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a090dc1d-7ac1-466b-8cfd-00a98df07173 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b" status: 200 len: 1278 microversion: 2.47 time: 0.118693 Aug 27 03:34:15.623084 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2796/5398] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:15 2022] GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:15.700978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-625215012", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": "none"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:15.779211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:15.779691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:15.780171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:15.780585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:15.781190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:15.790367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.791143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.791755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.792668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.793301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.793889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.814836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Getting quotas for project d2c9aeeba04f4d18b40d07b996a3d12a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:15.820954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Getting quotas for user 62a93a28048e4fb58f346e686cc09894 and project d2c9aeeba04f4d18b40d07b996a3d12a. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:15.837793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:34:15.840487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:34:15.876160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:15.877118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:15.883807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.884594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.885283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.886580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:15.887266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:15.888040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.913291 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66aa845f-382b-42a1-af45-2d79c843a550 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.218138 Aug 27 03:34:15.918592 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2603/5399] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:34:15.930342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc92e9d0-5db1-48ee-92f9-0a048d013688 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:15.934068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc92e9d0-5db1-48ee-92f9-0a048d013688 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:16.082519 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc92e9d0-5db1-48ee-92f9-0a048d013688 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "PUT /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 991 microversion: 2.47 time: 0.152970 Aug 27 03:34:16.084482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2604/5400] 10.222.0.69 () {62 vars in 1297 bytes} [Sat Aug 27 03:34:15 2022] PUT /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 991 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:34:16.109928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:16.118743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:16.138926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:16.139717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:16.140373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:16.143073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:16.144068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:16.150907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:16.197601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.218973 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b88fe35-e5e8-4b31-8cd5-3f85a9ab4469 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1316 microversion: 2.1 time: 0.346202 Aug 27 03:34:16.231855 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2797/5401] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:15 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:16.231855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9102fd6-72f0-4dea-b709-823d28ed68a8 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:16.231855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d9102fd6-72f0-4dea-b709-823d28ed68a8 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:16.346805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d9102fd6-72f0-4dea-b709-823d28ed68a8 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.355484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d9102fd6-72f0-4dea-b709-823d28ed68a8 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.357355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d9102fd6-72f0-4dea-b709-823d28ed68a8 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.359602 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9102fd6-72f0-4dea-b709-823d28ed68a8 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1277 microversion: 2.47 time: 0.136247 Aug 27 03:34:16.360410 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2798/5402] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:16 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:17.114668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.128292 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee6140eb-155b-4134-b727-9a9cdc0ff7f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1659 microversion: 2.1 time: 1.042399 Aug 27 03:34:17.129622 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2605/5403] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:16 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1659 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:17.151023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:17.151894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.161147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.162027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.163185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.164163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.164864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.167216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.241056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.242117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.253850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.256027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.258745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.259919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.262782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.263528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.371285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-31126021-a49f-4646-9adb-88eed6334116 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action" status: 202 len: 0 microversion: 2.1 time: 0.223979 Aug 27 03:34:17.372766 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2799/5404] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:34:17 2022] POST /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:17.383380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.384885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.393359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.394330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.395084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.396190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.396988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.397880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.688198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.701988 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d485f037-7e4b-4918-adf4-6e0326a18f0f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1665 microversion: 2.1 time: 0.323939 Aug 27 03:34:17.724700 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2800/5405] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:17 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1665 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:17.742570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.743354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.761493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.762231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.762788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.763612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.764768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.765325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.769070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:17.903631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.913350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.914949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.916283 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d6bbfc6-0522-4494-a8fa-04cfcc51059f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1329 microversion: 2.47 time: 0.178632 Aug 27 03:34:17.916971 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2801/5406] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:17 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1329 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:17.927734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.953681 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76566438-58b5-497e-9be3-f106463d5585 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1316 microversion: 2.1 time: 0.715971 Aug 27 03:34:17.959953 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2606/5407] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:17 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:18.154866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b9780b76-6228-4d3f-ac89-2987b9973ee1 req-6d36c859-6c4f-42f4-aef5-656fbd2820cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43675d79-e8d1-40a2-84ff-b719144bd36f", "tag": "6a57f449-95dd-4c89-9863-fdc6e1744a5c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:18.165608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b9780b76-6228-4d3f-ac89-2987b9973ee1 req-6d36c859-6c4f-42f4-aef5-656fbd2820cf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:18.166281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b9780b76-6228-4d3f-ac89-2987b9973ee1 req-6d36c859-6c4f-42f4-aef5-656fbd2820cf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:18.166714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b9780b76-6228-4d3f-ac89-2987b9973ee1 req-6d36c859-6c4f-42f4-aef5-656fbd2820cf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:18.178773 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b9780b76-6228-4d3f-ac89-2987b9973ee1 req-6d36c859-6c4f-42f4-aef5-656fbd2820cf service nova] Creating event network-changed:6a57f449-95dd-4c89-9863-fdc6e1744a5c for instance 43675d79-e8d1-40a2-84ff-b719144bd36f on n-h1-852086-5 Aug 27 03:34:18.183578 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b9780b76-6228-4d3f-ac89-2987b9973ee1 req-6d36c859-6c4f-42f4-aef5-656fbd2820cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032381 Aug 27 03:34:18.184298 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2802/5408] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:18.724651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:18.726125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:18.736038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:18.736617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:18.737036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:18.737801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:18.738292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:18.739824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:18.938226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:18.947625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:18.948374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:18.956319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:18.957058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:18.958029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:18.959421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:18.960061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:18.960657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:19.121775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:19.137476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:19.140770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:19.142037 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc9f8ae6-8c0e-49dd-8dea-4ce85ecd1405 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1337 microversion: 2.47 time: 0.204847 Aug 27 03:34:19.144221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2803/5409] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:18 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1337 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:19.150952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:19.157281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:19.165112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:19.166016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:19.166690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:19.167486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:19.168000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:19.168447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:19.369256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:19.380728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6de0836-06e9-4432-83e8-87de4baecc5b tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1316 microversion: 2.1 time: 0.234452 Aug 27 03:34:19.381646 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2804/5410] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:19 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:19.418181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:19.427392 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20e348d0-15dd-4aa0-9a5e-7f74d40b9649 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1665 microversion: 2.1 time: 0.706543 Aug 27 03:34:19.428095 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2607/5411] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:18 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1665 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:20.169387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:20.170387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:20.179667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.180170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.180609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.181377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.181834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.182614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.261099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:20.272064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:20.273967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:20.275301 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16ea05ac-b919-44c5-9919-1d173c7c4d18 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1335 microversion: 2.47 time: 0.110045 Aug 27 03:34:20.276320 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2805/5412] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:20 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:20.401753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:20.402480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:20.410521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.411305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.411991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.412794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.413574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.414063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.459888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:20.461320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:20.468781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.469565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.470154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.470900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.471712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.472145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.682848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:20.693815 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f53feb8-327a-4574-8001-067fd2205f27 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1665 microversion: 2.1 time: 0.248981 Aug 27 03:34:20.704958 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2806/5413] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:20 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1665 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:20.836940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:20.837855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:20.847585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.848764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.849305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.850716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.851264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.851776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.902784 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-da52d2ec-7541-4af8-9fc5-cef7afda5bc0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/ips" status: 200 len: 149 microversion: 2.1 time: 0.072251 Aug 27 03:34:20.903858 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2807/5414] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:34:20 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/ips => generated 149 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:21.043464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.064725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-605893f6-d49c-4522-ad9b-72de4a14a509 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1316 microversion: 2.1 time: 0.667054 Aug 27 03:34:21.065890 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2608/5415] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:20 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:21.305337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:21.307752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:21.333434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.338996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.342292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.345818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.346638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.348103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.512465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.566280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.590654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.596444 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d2418d20-d995-4574-8865-2e121856083a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1335 microversion: 2.47 time: 0.295461 Aug 27 03:34:21.597133 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2808/5416] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:21 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1335 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:21.732021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:21.734687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:21.752186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.755703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.757235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.760193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.761420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.762567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.103853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:22.104853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:22.137321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.141658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.147888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.151278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.152013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.155757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.808244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:22.829907 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6d7e70c-5e5c-4ef7-86fc-509c085d64f3 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1665 microversion: 2.1 time: 1.104388 Aug 27 03:34:22.830757 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2609/5417] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:21 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1665 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:22.835617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:22.836518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:22.853500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.854315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.854957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.855878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.856538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.857196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.866278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:22.882529 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e26bba94-84c6-4bae-9496-65137f238f3e tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1316 microversion: 2.1 time: 0.785226 Aug 27 03:34:22.890532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2809/5418] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:22 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:23.068989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.090324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.096846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:23.101077 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec391b37-eca4-4c39-a679-c395fb8a3457 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1335 microversion: 2.47 time: 0.269145 Aug 27 03:34:23.104331 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2610/5419] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:22 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1335 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:23.685353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-861d9471-b188-4ea4-b3e5-86344664cc6c req-72bf3cb7-acd8-4d86-974a-45acee576969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43675d79-e8d1-40a2-84ff-b719144bd36f", "name": "network-vif-plugged", "status": "completed", "tag": "6a57f449-95dd-4c89-9863-fdc6e1744a5c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:23.735968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-861d9471-b188-4ea4-b3e5-86344664cc6c req-72bf3cb7-acd8-4d86-974a-45acee576969 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.737644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-861d9471-b188-4ea4-b3e5-86344664cc6c req-72bf3cb7-acd8-4d86-974a-45acee576969 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.739522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-861d9471-b188-4ea4-b3e5-86344664cc6c req-72bf3cb7-acd8-4d86-974a-45acee576969 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.775199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-861d9471-b188-4ea4-b3e5-86344664cc6c req-72bf3cb7-acd8-4d86-974a-45acee576969 service nova] Creating event network-vif-plugged:6a57f449-95dd-4c89-9863-fdc6e1744a5c for instance 43675d79-e8d1-40a2-84ff-b719144bd36f on n-h1-852086-5 Aug 27 03:34:23.812198 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-861d9471-b188-4ea4-b3e5-86344664cc6c req-72bf3cb7-acd8-4d86-974a-45acee576969 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134500 Aug 27 03:34:23.822677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2810/5420] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:23.855800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:23.857337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:23.867211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.879215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.881451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.882585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.892384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.892384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.914441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a80e363-2486-4a57-8638-118ad0f28eaf"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:23.919291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:23.932958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.933456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.933896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.934729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.935191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.935706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.386825 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f8acc013-e1a6-43e1-86e1-a3a31856643d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484389 Aug 27 03:34:24.387940 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2811/5421] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:34:23 2022] POST /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:24.406005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:24.408736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:24.429262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.430148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.430926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.432120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.432788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.433515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.685185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.689750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:24.697740 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1cdd5f2a-bcaa-486d-b888-ba37d7e2de64 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1665 microversion: 2.1 time: 0.848303 Aug 27 03:34:24.699216 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2611/5422] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:23 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1665 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:24.705235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:24.706101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:24.712526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.713271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.714128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.719090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.719788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.720533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.757022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.772791 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a936a57a-5ded-4b29-8697-15f41dd264f6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1316 microversion: 2.1 time: 0.382490 Aug 27 03:34:24.773761 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2812/5423] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:24 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:24.888077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.899852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.901895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.905790 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ddfade6-64ec-4a93-81db-9b67a63a6585 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1356 microversion: 2.47 time: 0.205088 Aug 27 03:34:24.906803 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2612/5424] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:24 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1356 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:24.932100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:24.936836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:24.955300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.956109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.956718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.957889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.958766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.959369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.214319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:25.223464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:25.224965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:25.225993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:25.227394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:25.602774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:25.618993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.619378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.619823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.620552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.621013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.621444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.725557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:25.726955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:25.745722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.747932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.750358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.752698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.754665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.755255 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-25123596-385d-4752-b2e4-76ef99fdb113 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "POST /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c/action" status: 202 len: 1078 microversion: 2.47 time: 0.825136 Aug 27 03:34:25.755873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.765663 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2813/5425] 10.222.0.69 () {62 vars in 1319 bytes} [Sat Aug 27 03:34:24 2022] POST /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c/action => generated 1078 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 03:34:25.785000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:25.785634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:25.831610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:25.835754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.840125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.842513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.847909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.849186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:25.855160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.855863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.038854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.060559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.082773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.096995 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3677b7c9-0d5d-410d-a2f8-30701b43c439 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.322771 Aug 27 03:34:26.099981 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2814/5426] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:25 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:26.142924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:26.144026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:26.151294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.152129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.152780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.153715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.171726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.173189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.352437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:26.414151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.443621 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35631c0e-bf3a-492f-b045-0be11d552b47 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.722745 Aug 27 03:34:26.445986 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2613/5427] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:25 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:26.476007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:26.477514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:26.494579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.496410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.497599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.501156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.502331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.503749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.876015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.890764 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea8d3c74-95fa-4631-8325-8b324eefb421 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1505 microversion: 2.1 time: 0.763609 Aug 27 03:34:26.896712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2815/5428] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:26 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1505 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:26.934812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:26.936381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:26.960313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.963632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.964293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.965200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.965830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.967680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.984685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:27.067615 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b565a45b-a605-4bc1-a2d7-c6dbb438f507 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f/ips" status: 200 len: 109 microversion: 2.1 time: 0.136580 Aug 27 03:34:27.070917 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2816/5429] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:34:26 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f/ips => generated 109 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:27.101670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.103583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:27.133090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.134152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.136466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.141709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.143282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.145998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.275453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7582174b-c577-497b-9d1c-303de7415a6d tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f/ips" status: 200 len: 109 microversion: 2.1 time: 0.184990 Aug 27 03:34:27.292262 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2817/5430] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:34:27 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f/ips => generated 109 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:34:27.303027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.304653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:27.317062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.317762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:27.318757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.319786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.321898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.324712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.326583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.341126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a9995fc-2e8f-4017-bff4-4296fd2bfd32 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1668 microversion: 2.1 time: 0.866792 Aug 27 03:34:27.342868 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2614/5431] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:26 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1668 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:27.352630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.358841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:27.383302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.385696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.386640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.396156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.397644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.398322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.461485 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91103d3d-0d37-4e80-b1bb-0b344cf47521 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f/ips/tempest-ServerAddressesTestJSON-1888338098-network" status: 200 len: 94 microversion: 2.1 time: 0.117195 Aug 27 03:34:27.464621 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2615/5432] 10.222.0.69 () {58 vars in 1401 bytes} [Sat Aug 27 03:34:27 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f/ips/tempest-ServerAddressesTestJSON-1888338098-network => generated 94 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:34:27.474562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.475491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:27.481000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:27.485043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.487216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.487960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.489163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.489798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.490433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.509286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:27.522218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:27.523461 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f685cd03-d7ae-4e9d-bfe7-6f79bd361d41 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.229181 Aug 27 03:34:27.524790 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2818/5433] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:27 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:27.531387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.531858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:27.551885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.554428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.554954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.555656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.556118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.556580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.604364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:27.611888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:27.626645 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Working on deleting snapshot 0fa44c2d-a632-4205-b8f9-47a1fffd3129 from shelved instance... Aug 27 03:34:27.772698 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a506075f-a5ba-42bf-957f-c34bfdbb5d32 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 204 len: 0 microversion: 2.1 time: 0.232960 Aug 27 03:34:27.774266 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2819/5434] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:27 2022] DELETE /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:27.786690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.787652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:27.796814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.798313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.800794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.801760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.802270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.803611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:28.190297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:28.221563 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7ebd4b0a-8a0d-4231-a3a5-96aa6f0973a2 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1511 microversion: 2.1 time: 0.440884 Aug 27 03:34:28.225507 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2820/5435] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:27 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:28.550077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:28.550727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:28.564920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:28.570307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:28.573815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:28.574840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:28.577528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:28.578213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:29.338258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.352187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Doing local delete in cell c415b947-a476-436d-b81a-456a5f662c42(cell1) {{(pid=122408) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 03:34:29.354442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:29.355139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:29.355758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:29.356499 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 03:34:29.365271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] deallocate_for_instance() {{(pid=122408) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 03:34:29.379186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.389172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.392562 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b752a1b-daf6-4a4a-8093-ee4aeb9a8c96 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.847281 Aug 27 03:34:29.401590 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2821/5436] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:28 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:29.427283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:29.431179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:29.456808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:29.462599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:29.463424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:29.464468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:29.465105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:29.465694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:30.075318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.089780 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2ce786f5-7e69-4077-ab8a-56e812e990c6 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1511 microversion: 2.1 time: 0.685755 Aug 27 03:34:30.090403 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2822/5437] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:29 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1511 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:30.428748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:30.430155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:30.455605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:30.461300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:30.462543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:30.463381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:30.464677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:30.466679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:30.829437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.839681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.848007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.849230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-558c8663-76ba-4655-8bc5-38b71be8c4b7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.427145 Aug 27 03:34:30.854364 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2823/5438] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:30 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:30.873350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fc13338f-3240-47f7-a5bd-16e0a03df888 req-6aa536a3-0235-4313-ae8d-6e7e4ecbbf5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43675d79-e8d1-40a2-84ff-b719144bd36f", "name": "network-vif-deleted", "tag": "6a57f449-95dd-4c89-9863-fdc6e1744a5c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:30.936804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:30.942640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fc13338f-3240-47f7-a5bd-16e0a03df888 req-6aa536a3-0235-4313-ae8d-6e7e4ecbbf5e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:30.942860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fc13338f-3240-47f7-a5bd-16e0a03df888 req-6aa536a3-0235-4313-ae8d-6e7e4ecbbf5e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:30.949305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fc13338f-3240-47f7-a5bd-16e0a03df888 req-6aa536a3-0235-4313-ae8d-6e7e4ecbbf5e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:31.006669 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fc13338f-3240-47f7-a5bd-16e0a03df888 req-6aa536a3-0235-4313-ae8d-6e7e4ecbbf5e service nova] Creating event network-vif-deleted:6a57f449-95dd-4c89-9863-fdc6e1744a5c for instance 43675d79-e8d1-40a2-84ff-b719144bd36f on n-h1-852086-5 Aug 27 03:34:31.015885 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fc13338f-3240-47f7-a5bd-16e0a03df888 req-6aa536a3-0235-4313-ae8d-6e7e4ecbbf5e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159366 Aug 27 03:34:31.016843 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2824/5439] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:31.132527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.133388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:31.148046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:31.148696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:31.162656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:31.167148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:31.167671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:31.170982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:31.290335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:31.291001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:31.291601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:31.292674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lazy-loading 'fault' on Instance uuid 43675d79-e8d1-40a2-84ff-b719144bd36f {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:31.580277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b7b41ba5314a8cbc6f54e0e61dbd3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31fce67599e4781bfe83d82c64982a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:31.606274 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6edfb21d-19da-4462-a5a2-db0a8e367ce3 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 200 len: 1306 microversion: 2.1 time: 0.480816 Aug 27 03:34:31.607331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2825/5440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:31 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 1306 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:31.831629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Updating instance_info_cache with network_info: [] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:34:31.888833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.892311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:31.951178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:31.959878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:31.965778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:31.969910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:31.980102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:31.981426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:32.381022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:32.408744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:32.416666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:32.419087 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ccc9cfaa-a491-4301-bcb6-a35013575c20 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.540903 Aug 27 03:34:32.425577 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2826/5441] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:31 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:32.644609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:32.646507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] [instance: 43675d79-e8d1-40a2-84ff-b719144bd36f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:32.657098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:32.660209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:32.662482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:32.665744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:32.670457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:32.675848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:32.774642 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] HTTP exception thrown: Instance 43675d79-e8d1-40a2-84ff-b719144bd36f could not be found. Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Request method failure captured: Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f HTTP/1.1 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZCuwJYRwNn326phL4VBB762VBoR8WK2FqfU8naCs0cw1PFtEyiyWptu5G0DfUafYAysk222CYKEarJDzQ6ZqV-0rb6OkLkukMPgqjtg81U-z_27BX05XSwxAk_yva-OaWqppNvvI22mGpaiEFrAwMTy_qYlADymrWOpWxBl5vHDTxI Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d31fce67599e4781bfe83d82c64982a8 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerAddressesTestJSON-1030909889 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d31fce67599e4781bfe83d82c64982a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d31fce67599e4781bfe83d82c64982a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d31fce67599e4781bfe83d82c64982a8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d31fce67599e4781bfe83d82c64982a8"}]}] Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerAddressesTestJSON-1030909889 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d31fce67599e4781bfe83d82c64982a8 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1030909889 Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerAddressesTestJSON-1030909889-project Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 79b7b41ba5314a8cbc6f54e0e61dbd3c Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerAddressesTestJSON-1030909889-project Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 43675d79-e8d1-40a2-84ff-b719144bd36f could not be found. Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '43675d79-e8d1-40a2-84ff-b719144bd36f'} Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43675d79-e8d1-40a2-84ff-b719144bd36f could not be found. Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43675d79-e8d1-40a2-84ff-b719144bd36f could not be found. Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:32.791940 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43675d79-e8d1-40a2-84ff-b719144bd36f could not be found. Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:32.800768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] Returning 404 to user: Instance 43675d79-e8d1-40a2-84ff-b719144bd36f could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:32.804003 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9602fb0e-f906-4773-9872-7a024ffdc786 tempest-ServerAddressesTestJSON-1030909889 tempest-ServerAddressesTestJSON-1030909889-project] 10.222.0.69 "GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f" status: 404 len: 111 microversion: 2.1 time: 0.160077 Aug 27 03:34:32.806783 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2827/5442] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:32 2022] GET /compute/v2.1/servers/43675d79-e8d1-40a2-84ff-b719144bd36f => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:34:32.918500 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97101816-ef43-4427-90f1-f5dae90eb6a0 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 204 len: 0 microversion: 2.1 time: 5.452288 Aug 27 03:34:32.919377 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2616/5443] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:27 2022] DELETE /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 0 bytes in 5454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:32.941358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:32.941358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: ac772560-1c31-4977-85dd-a63202adb8e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:32.956217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:32.957069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:32.957828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:32.959873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:32.960698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:32.961454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.055617 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] HTTP exception thrown: Instance ac772560-1c31-4977-85dd-a63202adb8e5 could not be found. Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Request method failure captured: Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 HTTP/1.1 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6PyU9G282NEdwSwHsiROIz1Eu_XdsqX3gr0HhwBWpaVMzo466A22nQxIVm50JlaNZzes4ofckv_xopoFJrGs3_EIks4LyAEi7CyHYtIbyI8n8LwBG44Uyy1pgMqyhAoHyAskI44CnCaGYD1OQ3yW99l2rNGNLuz0cPhfen0pBuFP4 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a0cf74946f704a99a6878baa30bbac4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}] Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89f850adf9a7432798f86fe9d2d17b79 Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance ac772560-1c31-4977-85dd-a63202adb8e5 could not be found. Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ac772560-1c31-4977-85dd-a63202adb8e5'} Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac772560-1c31-4977-85dd-a63202adb8e5 could not be found. Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac772560-1c31-4977-85dd-a63202adb8e5 could not be found. Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:33.064661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:33.073660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:33.073660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:33.073660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:33.073660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:33.073660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:33.073660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac772560-1c31-4977-85dd-a63202adb8e5 could not be found. Aug 27 03:34:33.073660 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:33.078275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Returning 404 to user: Instance ac772560-1c31-4977-85dd-a63202adb8e5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:33.081120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-65cd43a2-6636-4590-a016-92f54ad5353d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5" status: 404 len: 111 microversion: 2.1 time: 0.154492 Aug 27 03:34:33.084566 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2828/5444] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:32 2022] GET /compute/v2.1/servers/ac772560-1c31-4977-85dd-a63202adb8e5 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:33.100210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.101070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:33.123607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.124390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.128509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.129267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.131978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.132633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.177687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-db3b3ece-88c0-408d-a62d-a84f2c279f9f req-b920fb60-1261-4cc0-b855-28278a369152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac772560-1c31-4977-85dd-a63202adb8e5", "name": "network-vif-deleted", "tag": "014c473a-6d17-46aa-a021-c49719e13251"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:33.196072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:33.202069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-db3b3ece-88c0-408d-a62d-a84f2c279f9f req-b920fb60-1261-4cc0-b855-28278a369152 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.202665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-db3b3ece-88c0-408d-a62d-a84f2c279f9f req-b920fb60-1261-4cc0-b855-28278a369152 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.205983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-db3b3ece-88c0-408d-a62d-a84f2c279f9f req-b920fb60-1261-4cc0-b855-28278a369152 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.237798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.server_external_events [req-db3b3ece-88c0-408d-a62d-a84f2c279f9f req-b920fb60-1261-4cc0-b855-28278a369152 service nova] Unable to find a host for instance ac772560-1c31-4977-85dd-a63202adb8e5. Dropping event network-vif-deleted {{(pid=122407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 03:34:33.241841 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-db3b3ece-88c0-408d-a62d-a84f2c279f9f req-b920fb60-1261-4cc0-b855-28278a369152 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.069047 Aug 27 03:34:33.243681 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2829/5445] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 03:34:33.397056 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8f95038-a2f3-4f19-90e3-01b3210eca48 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "DELETE /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 204 len: 0 microversion: 2.1 time: 0.304572 Aug 27 03:34:33.399325 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2617/5446] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:33 2022] DELETE /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:33.413485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.414737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:33.452214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.452884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.453015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:33.454090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.457514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.459829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.461613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.463858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.483615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.484137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.484846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.492233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.494146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.494982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.803484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:33.814911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:33.823011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:33.829193 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-10d58620-c79c-4324-8069-7fe61a355c4a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.383019 Aug 27 03:34:33.836755 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2618/5447] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:33 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:34.141054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:34.170694 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f7f32366-7b30-4355-8eef-4b58a1b1930d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1464 microversion: 2.1 time: 0.761235 Aug 27 03:34:34.172214 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2830/5448] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:33 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1464 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:34.878677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:34.880415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:34.889002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:34.904098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:34.906265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:34.910833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:34.912419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:34.915645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:35.145777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:35.213692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:35.224763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:35.228548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:35.230505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:35.251959 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1daa122a-2141-4c3b-8f7d-1cd761307edb tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.362271 Aug 27 03:34:35.258298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2619/5449] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:34 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:35.280483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:35.284152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:35.289730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:35.293428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:35.295190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:35.298903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:36.299591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:36.300392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:36.327059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:36.327824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:36.328443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:36.329661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:36.330345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:36.330967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:36.482288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:36.497185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a87ba0b0-0361-4dda-b815-aacbbb252a00 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1464 microversion: 2.1 time: 1.293821 Aug 27 03:34:36.500910 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2831/5450] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:35 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1464 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:36.941563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:36.968505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:36.973995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:36.981908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:36.985729 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3767c489-fa56-4b01-a2e9-015cff281869 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.691901 Aug 27 03:34:36.991048 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2620/5451] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:36 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:37.530900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:37.531527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:37.553635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:37.554982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:37.556825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:37.565404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:37.566298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:37.566928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:37.781051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:37.788314 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c7b4acd9-14b4-4997-9d90-44f19ecc511f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1464 microversion: 2.1 time: 0.261901 Aug 27 03:34:37.820408 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2832/5452] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:37 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1464 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:38.035357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:38.036297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:38.065027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.065630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.066122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.067015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.067946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.068549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.308549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:38.328429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:38.330025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:38.331835 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e752007-8131-4ce3-989c-e7a5775a1b40 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.302500 Aug 27 03:34:38.346215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2621/5453] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:38 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:38.612965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3022bbbe-7ad4-41fe-a5e5-48ac6000e9ab req-ab1a01de-5850-4fc9-8dc9-39e2667eefb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf23289-3f9f-4689-9908-a3b1d38601e5", "name": "network-vif-deleted", "tag": "90d61710-6b11-4f4c-8590-cfb3862c3a6a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:38.675916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3022bbbe-7ad4-41fe-a5e5-48ac6000e9ab req-ab1a01de-5850-4fc9-8dc9-39e2667eefb5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.677377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3022bbbe-7ad4-41fe-a5e5-48ac6000e9ab req-ab1a01de-5850-4fc9-8dc9-39e2667eefb5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.678310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3022bbbe-7ad4-41fe-a5e5-48ac6000e9ab req-ab1a01de-5850-4fc9-8dc9-39e2667eefb5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.701490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3022bbbe-7ad4-41fe-a5e5-48ac6000e9ab req-ab1a01de-5850-4fc9-8dc9-39e2667eefb5 service nova] Creating event network-vif-deleted:90d61710-6b11-4f4c-8590-cfb3862c3a6a for instance baf23289-3f9f-4689-9908-a3b1d38601e5 on n-h2-852086-5 Aug 27 03:34:38.709785 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3022bbbe-7ad4-41fe-a5e5-48ac6000e9ab req-ab1a01de-5850-4fc9-8dc9-39e2667eefb5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104738 Aug 27 03:34:38.711488 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2833/5454] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:38.832719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:38.833440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:38.836230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:38.849183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.849719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.850300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.851218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.851676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.852109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.954605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.956649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.958139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.959039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lazy-loading 'fault' on Instance uuid baf23289-3f9f-4689-9908-a3b1d38601e5 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:39.174206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:39.196679 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b2dda13-4d85-4c35-b428-181eabc7b8ee tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1304 microversion: 2.1 time: 0.368864 Aug 27 03:34:39.197373 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2622/5455] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:38 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1304 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:39.377114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:39.382596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:39.415569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:39.419331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:39.422684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:39.426559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:39.429858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:39.437175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:39.783640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:39.817575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:39.837478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:39.846327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:39.849889 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4f32742-2f01-495f-86fa-0ee29a8ac037 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.490936 Aug 27 03:34:39.850535 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2834/5456] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:39 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:40.223615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.224472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:40.238452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.238669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.239305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.240205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.242390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.243088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.317375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.318130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.318748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.319355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lazy-loading 'fault' on Instance uuid baf23289-3f9f-4689-9908-a3b1d38601e5 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:40.800590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:40.813229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5656ef44-620a-4f31-9e9a-d9ce391b6e78 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 200 len: 1304 microversion: 2.1 time: 0.594103 Aug 27 03:34:40.821557 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2623/5457] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:40 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 1304 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:40.879099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.885721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:40.950182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.954572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.955410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.956713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.957519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.958247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:41.181453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:41.208880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:41.225426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:41.227536 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c5f6b12-8e17-4e79-8111-888bc2ce93ba tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.356063 Aug 27 03:34:41.228500 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2835/5458] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:40 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:41.858229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.859172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: baf23289-3f9f-4689-9908-a3b1d38601e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:41.870231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:41.875219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:41.875800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:41.876682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:41.878753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:41.879382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:41.936581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] HTTP exception thrown: Instance baf23289-3f9f-4689-9908-a3b1d38601e5 could not be found. Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Request method failure captured: Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 HTTP/1.1 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY6PyU9G282NEdwSwHsiROIz1Eu_XdsqX3gr0HhwBWpaVMzo466A22nQxIVm50JlaNZzes4ofckv_xopoFJrGs3_EIks4LyAEi7CyHYtIbyI8n8LwBG44Uyy1pgMqyhAoHyAskI44CnCaGYD1OQ3yW99l2rNGNLuz0cPhfen0pBuFP4 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a0cf74946f704a99a6878baa30bbac4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}] Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 89f850adf9a7432798f86fe9d2d17b79 Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance baf23289-3f9f-4689-9908-a3b1d38601e5 could not be found. Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'baf23289-3f9f-4689-9908-a3b1d38601e5'} Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf23289-3f9f-4689-9908-a3b1d38601e5 could not be found. Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf23289-3f9f-4689-9908-a3b1d38601e5 could not be found. Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:41.943535 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:41.947861 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:41.947861 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:41.947861 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:41.947861 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:41.947861 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:41.947861 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf23289-3f9f-4689-9908-a3b1d38601e5 could not be found. Aug 27 03:34:41.947861 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:41.950391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Returning 404 to user: Instance baf23289-3f9f-4689-9908-a3b1d38601e5 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:41.951971 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ce5601f-ff2e-4e05-aa29-765760547070 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5" status: 404 len: 111 microversion: 2.1 time: 0.098156 Aug 27 03:34:41.957489 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2624/5459] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:41 2022] GET /compute/v2.1/servers/baf23289-3f9f-4689-9908-a3b1d38601e5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:41.971812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:41.972996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:41.983555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:41.990566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:41.996475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:41.998814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:42.003368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:42.005196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:42.121988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:42.273143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:42.273804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:42.287867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:42.290331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:42.292927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:42.293982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:42.301329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:42.302759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:42.444012 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dbac5180-8025-4511-a7b5-8721cf9a103d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 204 len: 0 microversion: 2.1 time: 0.472818 Aug 27 03:34:42.450796 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2836/5460] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:41 2022] DELETE /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:42.479400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:42.480688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:42.528557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:42.538139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:42.543649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:42.555028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:42.560529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:42.563179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:42.595953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:42.623772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:42.634000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:42.640159 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a3d83a2-7a41-434e-939b-3020e3a74814 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.371107 Aug 27 03:34:42.644794 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2625/5461] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:42 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:43.212282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a80e363-2486-4a57-8638-118ad0f28eaf"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:43.217884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:43.230340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.232699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.233778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.235863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.236947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.237991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.436552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:43.449711 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38c2b532-0b24-4059-ba02-9eebb8e2142c tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1506 microversion: 2.1 time: 0.987751 Aug 27 03:34:43.450547 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2837/5462] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:42 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1506 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:43.473864 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Invalid volume: volume 8a80e363-2486-4a57-8638-118ad0f28eaf is already attached to instances: 69718556-4ec9-430e-b09b-5481ceea5320 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments HTTP/1.1 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 74 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: {"volumeAttachment": {"volumeId": "8a80e363-2486-4a57-8638-118ad0f28eaf"}} Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: exception: Invalid volume: volume 8a80e363-2486-4a57-8638-118ad0f28eaf is already attached to instances: 69718556-4ec9-430e-b09b-5481ceea5320 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': '69718556-4ec9-430e-b09b-5481ceea5320', 'body': {'volumeAttachment': {'volumeId': '8a80e363-2486-4a57-8638-118ad0f28eaf'}}} Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8a80e363-2486-4a57-8638-118ad0f28eaf is already attached to instances: 69718556-4ec9-430e-b09b-5481ceea5320 Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:34:43.476568 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8a80e363-2486-4a57-8638-118ad0f28eaf is already attached to instances: 69718556-4ec9-430e-b09b-5481ceea5320 Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8a80e363-2486-4a57-8638-118ad0f28eaf is already attached to instances: 69718556-4ec9-430e-b09b-5481ceea5320 Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 400 to user: Invalid volume: volume 8a80e363-2486-4a57-8638-118ad0f28eaf is already attached to instances: 69718556-4ec9-430e-b09b-5481ceea5320 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:43.481635 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4a0eba6-fe25-4e70-b19b-50a67b83fa00 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.278025 Aug 27 03:34:43.490273 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2626/5463] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:34:43 2022] POST /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 174 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:34:43.625682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:43.628004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:43.641215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.641755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.642285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.645995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.646661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.647051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.689818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:43.690495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:43.702880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.704023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.706112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.707189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:43.709519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:43.710686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:43.891899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lazy-loading 'services' on Instance uuid 69718556-4ec9-430e-b09b-5481ceea5320 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:44.098884 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-168163d1-2bee-438a-86b8-67c1864cbbed tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments/8a80e363-2486-4a57-8638-118ad0f28eaf" status: 202 len: 0 microversion: 2.1 time: 0.477180 Aug 27 03:34:44.100092 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2838/5464] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:34:43 2022] DELETE /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments/8a80e363-2486-4a57-8638-118ad0f28eaf => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:44.109849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.120074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:44.125200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:44.133734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.137698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:44.137925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:44.138765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:44.139427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:44.140367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:44.141304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4fbce99-9c07-4f57-b2bf-039ede7d37c7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.456555 Aug 27 03:34:44.142822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:44.143459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:44.159473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2627/5465] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:43 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:44.208791 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49cdd9c6-c602-4074-9d79-3754a8232565 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093307 Aug 27 03:34:44.217771 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2839/5466] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:44 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:44.475240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:44.476859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:44.507104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:44.510922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:44.511384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:44.526337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:44.526337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:44.526337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.168259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.169017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:45.184492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:45.187763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:45.188371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.190937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:45.191579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:45.194843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.516688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.546770 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7289cf0e-3f8b-4be4-b10b-0f34935b7b86 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1506 microversion: 2.1 time: 1.075071 Aug 27 03:34:45.547404 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2628/5467] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:44 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1506 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:45.579970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:45.585496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:45.600699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:45.601215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:45.601657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.605928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:45.608614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:45.609262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.742401 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b2a5dbf-8516-4fb3-b6de-42bece4b0653 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173093 Aug 27 03:34:45.751137 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2629/5468] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:45 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:45.779868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1011d199-4e86-4a63-b526-7c6eaa26ab24 req-4581af0b-7fab-463c-892b-d6508f91e5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0c11ae-a7c0-4357-9a52-f9f88968dd51", "name": "network-vif-deleted", "tag": "cb74d178-d308-49fb-b21f-7934d0b01bd7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:45.788808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.806546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.814218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:45.815603 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34754422-a852-4b3b-88f7-6385a27e876f tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.652138 Aug 27 03:34:45.825066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1011d199-4e86-4a63-b526-7c6eaa26ab24 req-4581af0b-7fab-463c-892b-d6508f91e5cc service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:45.825584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1011d199-4e86-4a63-b526-7c6eaa26ab24 req-4581af0b-7fab-463c-892b-d6508f91e5cc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:45.826729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1011d199-4e86-4a63-b526-7c6eaa26ab24 req-4581af0b-7fab-463c-892b-d6508f91e5cc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:45.832147 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2840/5469] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:45 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:45.881746 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1011d199-4e86-4a63-b526-7c6eaa26ab24 req-4581af0b-7fab-463c-892b-d6508f91e5cc service nova] Creating event network-vif-deleted:cb74d178-d308-49fb-b21f-7934d0b01bd7 for instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 on n-h2-852086-5 Aug 27 03:34:45.894808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1011d199-4e86-4a63-b526-7c6eaa26ab24 req-4581af0b-7fab-463c-892b-d6508f91e5cc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141988 Aug 27 03:34:45.895430 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2630/5470] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:46.569749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.571133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:46.584811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.589714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.590184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:46.590986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.591734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.592278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:46.728619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.729132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.729582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:46.730044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lazy-loading 'fault' on Instance uuid bb0c11ae-a7c0-4357-9a52-f9f88968dd51 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:46.765845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.768277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:46.792431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.795623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.796367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:46.797895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.804572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.805328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:46.885886 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afbfb400-eefa-4b81-b4a1-6195811011e7 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126446 Aug 27 03:34:46.891130 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2631/5471] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:46 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:46.906268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:46.907746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:46.920439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:46.932760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.933648 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32e74133-ba2e-4cdd-af17-2f4e3b28dd67 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 200 len: 1304 microversion: 2.1 time: 0.368801 Aug 27 03:34:46.933783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.934411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:46.936537 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2841/5472] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:46 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 1304 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:46.937785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:46.940305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:46.943306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:47.209901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:47.242319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:47.245930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:47.249059 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfd58031-1037-4a6e-8c3b-a91fafb5ec48 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.355262 Aug 27 03:34:47.250013 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2632/5473] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:46 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:47.909543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:47.937475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:47.958405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:47.959619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: bb0c11ae-a7c0-4357-9a52-f9f88968dd51] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:47.971335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:47.973952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:47.975852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:47.977019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:47.979076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:47.980752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:47.984248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:47.984994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:47.985991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:47.986816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:47.987467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:47.989456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.033725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] HTTP exception thrown: Instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 could not be found. Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Request method failure captured: Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 HTTP/1.1 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY6PyU9G282NEdwSwHsiROIz1Eu_XdsqX3gr0HhwBWpaVMzo466A22nQxIVm50JlaNZzes4ofckv_xopoFJrGs3_EIks4LyAEi7CyHYtIbyI8n8LwBG44Uyy1pgMqyhAoHyAskI44CnCaGYD1OQ3yW99l2rNGNLuz0cPhfen0pBuFP4 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a0cf74946f704a99a6878baa30bbac4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}] Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 89f850adf9a7432798f86fe9d2d17b79 Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 could not be found. Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'bb0c11ae-a7c0-4357-9a52-f9f88968dd51'} Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 could not be found. Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 could not be found. Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:48.039243 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:48.049059 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:48.049059 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:48.049059 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:48.049059 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:48.049059 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:48.049059 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 could not be found. Aug 27 03:34:48.049059 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:34:48.057259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Returning 404 to user: Instance bb0c11ae-a7c0-4357-9a52-f9f88968dd51 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:48.062189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9efccaec-bbe8-45e1-acb1-bfd50a3e367e tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51" status: 404 len: 111 microversion: 2.1 time: 0.107699 Aug 27 03:34:48.063345 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2633/5474] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:47 2022] GET /compute/v2.1/servers/bb0c11ae-a7c0-4357-9a52-f9f88968dd51 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:34:48.072204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:48.075113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:48.089421 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54a00c7f-026e-4710-9056-6b8338f9d10b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191373 Aug 27 03:34:48.094067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.096582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.097073 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2842/5475] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:47 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:48.097910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.099177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.099984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.100781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.142941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:48.277167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:48.278061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:48.304756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.305554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.313919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.315390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.321910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.341966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.376035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7632ce03-c7c6-46dd-b79e-9d5d3b5eb166 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "DELETE /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 204 len: 0 microversion: 2.1 time: 0.308320 Aug 27 03:34:48.377563 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2634/5476] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:48 2022] DELETE /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:34:48.612212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:48.624389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:48.644236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:48.648924 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-561a59e5-7f5b-4bcc-b09d-e12e4ec5e23e tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.378303 Aug 27 03:34:48.660100 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2843/5477] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:48 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:48.676682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:48.679111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:48.703729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.704719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.705354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:48.706401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:48.707054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:48.707474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:49.215174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1114726450", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "31ee4311-c342-465b-9f4f-efc8ca42b002"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:49.390688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] validate_networks() for [('31ee4311-c342-465b-9f4f-efc8ca42b002', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:34:49.705945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:49.723448 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-035f8957-929b-4ceb-bd3b-8e4d5fa70cfc tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1494 microversion: 2.1 time: 1.060416 Aug 27 03:34:49.734189 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2844/5478] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:48 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1494 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:49.740049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:49.750352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:49.782325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:49.800720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:49.802985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:49.805543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:49.813708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:49.814523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.003862 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4c828bb8-f851-4cea-8f12-00d3acd2b1e1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.278683 Aug 27 03:34:50.004481 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2845/5479] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:49 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:50.024404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.025043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:50.050602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.051118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.051710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.052715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.053187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.053618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.298365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.312742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.323992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:50.331774 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8954d354-c888-4af1-bd31-de56ec0aaea3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.326228 Aug 27 03:34:50.335698 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2846/5480] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:50 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:50.491517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:50.492311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:50.492741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:50.493293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:50.493833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:50.552839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.553580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.554048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.558399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.558904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.559354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.623746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-de1cc6cd-ac3a-4e79-a5a6-d42bc0595b14 req-c3bb716a-71bb-4ac0-92ea-6861398fcccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403261b4-7a18-4902-a794-43403cff3ef9", "name": "network-vif-deleted", "tag": "aa2f1d85-ac39-4576-b588-1e6c99d5a59a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:50.647404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-de1cc6cd-ac3a-4e79-a5a6-d42bc0595b14 req-c3bb716a-71bb-4ac0-92ea-6861398fcccd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.648189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-de1cc6cd-ac3a-4e79-a5a6-d42bc0595b14 req-c3bb716a-71bb-4ac0-92ea-6861398fcccd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.648457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-de1cc6cd-ac3a-4e79-a5a6-d42bc0595b14 req-c3bb716a-71bb-4ac0-92ea-6861398fcccd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.657147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Getting quotas for project 20f32baf755b42fbbdafc0b9ebc86ac7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:50.692935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Getting quotas for user f64ab5c3849f4a8189623b1247eed046 and project 20f32baf755b42fbbdafc0b9ebc86ac7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:50.695609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-de1cc6cd-ac3a-4e79-a5a6-d42bc0595b14 req-c3bb716a-71bb-4ac0-92ea-6861398fcccd service nova] Creating event network-vif-deleted:aa2f1d85-ac39-4576-b588-1e6c99d5a59a for instance 403261b4-7a18-4902-a794-43403cff3ef9 on n-h2-852086-5 Aug 27 03:34:50.706500 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-de1cc6cd-ac3a-4e79-a5a6-d42bc0595b14 req-c3bb716a-71bb-4ac0-92ea-6861398fcccd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086539 Aug 27 03:34:50.708245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2847/5481] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:50.753693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:50.772404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:34:50.773386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:50.777750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:34:50.806499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.814435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.820288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.824623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:50.825825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:50.834188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:50.967465 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a2bd246-47a0-4674-9648-e24c415e378e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.584179 Aug 27 03:34:50.977440 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2635/5482] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:34:51.002303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a65e85e4-3076-4db2-afd8-4212b15eb488 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.003216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a65e85e4-3076-4db2-afd8-4212b15eb488 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:51.007388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.014745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.016979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.018642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lazy-loading 'fault' on Instance uuid 403261b4-7a18-4902-a794-43403cff3ef9 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:51.234943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a65e85e4-3076-4db2-afd8-4212b15eb488 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.249432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a65e85e4-3076-4db2-afd8-4212b15eb488 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1225 microversion: 2.1 time: 0.258255 Aug 27 03:34:51.251363 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2636/5483] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:50 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1225 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:51.281059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.283827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:51.308190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.308423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.309623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.313616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.315706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.320033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.320792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.327291 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2e6797b-e834-4f0f-ab92-da85231fb146 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 200 len: 1305 microversion: 2.1 time: 0.579184 Aug 27 03:34:51.351748 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2848/5484] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:50 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 1305 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:51.370660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:51.373911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:51.390967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.391915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.392861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.394620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:51.395822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:51.396509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:51.411569 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c62ef171-d008-4a9b-86d9-62fa131f614d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154867 Aug 27 03:34:51.420897 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2637/5485] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:51 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:51.423856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:51.579308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.600583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.602977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:51.604727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-368f2a2c-f3ef-481f-8091-de62777b4de7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.245229 Aug 27 03:34:51.605914 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2849/5486] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:51 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:52.313144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.320464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:52.367917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.368746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: 403261b4-7a18-4902-a794-43403cff3ef9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:52.385173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.394470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.399000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.400352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.402889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.405042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.406687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.409915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.414723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.419268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.423406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.433642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.539868 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] HTTP exception thrown: Instance 403261b4-7a18-4902-a794-43403cff3ef9 could not be found. Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Request method failure captured: Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 HTTP/1.1 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6PyU9G282NEdwSwHsiROIz1Eu_XdsqX3gr0HhwBWpaVMzo466A22nQxIVm50JlaNZzes4ofckv_xopoFJrGs3_EIks4LyAEi7CyHYtIbyI8n8LwBG44Uyy1pgMqyhAoHyAskI44CnCaGYD1OQ3yW99l2rNGNLuz0cPhfen0pBuFP4 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a0cf74946f704a99a6878baa30bbac4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}] Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89f850adf9a7432798f86fe9d2d17b79 Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 403261b4-7a18-4902-a794-43403cff3ef9 could not be found. Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '403261b4-7a18-4902-a794-43403cff3ef9'} Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403261b4-7a18-4902-a794-43403cff3ef9 could not be found. Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403261b4-7a18-4902-a794-43403cff3ef9 could not be found. Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:52.559413 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403261b4-7a18-4902-a794-43403cff3ef9 could not be found. Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:34:52.566044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Returning 404 to user: Instance 403261b4-7a18-4902-a794-43403cff3ef9 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:52.569519 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc3188a3-ec1a-4d58-a352-0790593e3bb6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9" status: 404 len: 111 microversion: 2.1 time: 0.205756 Aug 27 03:34:52.582827 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2850/5487] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:52 2022] GET /compute/v2.1/servers/403261b4-7a18-4902-a794-43403cff3ef9 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:52.594851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.597670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:52.641031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.642696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.645476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.646623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.649171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.649937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.740508 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62078a4e-41a7-4b0a-a14e-815eddd9bd73 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164670 Aug 27 03:34:52.743475 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2851/5488] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:52 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:52.750712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.751697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:52.756188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:52.759251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:52.767916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.768543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.769066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.769743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.770231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.770662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.791243 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-547dd1f7-345b-4ce7-a402-5687af6d5d2a tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1229 microversion: 2.1 time: 0.484970 Aug 27 03:34:52.792661 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2638/5489] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:52 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1229 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:52.816589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:52.821568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:52.850874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.852183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.854944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.856955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:52.858434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:52.864652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:52.935679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:53.094846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.137698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.139788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.151759 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-96ad3c4e-a453-4478-9c9f-7bdf37667f01 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.357639 Aug 27 03:34:53.163110 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2639/5490] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:52 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:53.166766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d376541c-ee03-45e4-a625-f98d7326a972 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 204 len: 0 microversion: 2.1 time: 0.419524 Aug 27 03:34:53.172885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.175106 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2852/5491] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:52 2022] DELETE /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:53.178838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:53.185652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.186419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:53.212150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.212997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.213682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.214427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.214892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.215028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.215376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.215822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.216482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.223073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.223449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.224231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.261937 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8555d3e2-b660-4b53-84ae-c4bfdcd826ac tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096974 Aug 27 03:34:53.263087 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2640/5492] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:34:53.420448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.421878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:53.434763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.436480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.437405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.438445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.439201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.439839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.514314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:53.685669 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13065fe5-7a1f-43a5-aa51-894ff25ad108 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 204 len: 0 microversion: 2.1 time: 0.261724 Aug 27 03:34:53.686655 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2641/5493] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:53 2022] DELETE /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:34:53.721129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:53.729961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:53.768382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.769426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.770374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.774885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:53.781978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:53.781978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:53.912240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:53.963304 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-386f33f2-5b15-4bd5-b6b7-d0d375810638 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1674 microversion: 2.1 time: 0.786665 Aug 27 03:34:53.978767 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2853/5494] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1674 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:54.000655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.003696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:54.019441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.031068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.033252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.036776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.037542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.038233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.119366 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4f05173-7f90-41c1-bcaa-37a3b684352b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138791 Aug 27 03:34:54.120653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2854/5495] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:54.138516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.148468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:54.162935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.163804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.164488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.166197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.167954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.170315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.321054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.343067 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61c5127b-2065-4f1f-8531-b24c4919d5ef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1675 microversion: 2.1 time: 0.645999 Aug 27 03:34:54.358196 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2642/5496] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:53 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1675 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:54.358196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.358196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:54.364735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.365935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.367209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.370087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:54.370661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:54.375108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:54.615235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.637651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.641441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.651376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30b678fd-a4fd-47a3-8510-6024cdc2c774 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1365 microversion: 2.47 time: 0.304522 Aug 27 03:34:54.652686 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2643/5497] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:54 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:54.964110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:54.992130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4646336-044c-45ab-ae95-e028d6c3a1f6 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1285 microversion: 2.1 time: 0.861263 Aug 27 03:34:54.992934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:54.993770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:55.008527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.016041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.018746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2855/5498] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:54 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1285 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.022258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.023247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.027285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.028136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.149365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.164705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:55.182504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.187061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.187871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.189242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.189706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.190325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.264444 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c5558f7-41e1-4887-b00a-6058cb2ac5b9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130108 Aug 27 03:34:55.265511 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2856/5499] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:55 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:55.371648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.373204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:55.391194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.394329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.394980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.395982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.398289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.399042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.637865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.650952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80b2d66a-f757-4852-88f6-bbee65dbf3f6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1674 microversion: 2.1 time: 0.659584 Aug 27 03:34:55.657735 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2644/5500] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:54 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1674 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:55.684725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:55.686437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:55.698934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.700036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.701614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.702676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:55.705895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:55.706716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:55.837551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.856174 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6e05493-91d0-4c44-bb17-c7e97dec682b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1675 microversion: 2.1 time: 0.489031 Aug 27 03:34:55.862095 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2857/5501] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:55 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1675 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:55.917181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.936981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.941503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:55.943145 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b16297d-e166-4d38-b0f6-0a7913b5652a tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1383 microversion: 2.47 time: 0.265814 Aug 27 03:34:55.965690 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2645/5502] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:55 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1383 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:34:56.054544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.056051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:56.072258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.073178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.073821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.077307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.078027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.079496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.277884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.281680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:56.308495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.309851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.310950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.312738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.313628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.314512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.430844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:56.444733 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a7c9635a-3cca-4219-a8e3-380af417b91b tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1283 microversion: 2.1 time: 0.396771 Aug 27 03:34:56.446024 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2858/5503] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:56 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1283 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:56.456385 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d46420b-b349-41a5-b555-743aa8c71512 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.182321 Aug 27 03:34:56.459408 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2646/5504] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:34:56 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:34:56.557291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.562460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:56.572837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.574701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.581969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.583915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.585264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.586270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.664034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:56.681026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.681676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:56.708813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.712634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.714149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.721078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.742022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.742624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.920916 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9a217595-c8f9-4345-b1f5-da7823f4812b tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 204 len: 0 microversion: 2.1 time: 0.366014 Aug 27 03:34:56.931364 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2859/5505] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:56 2022] DELETE /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:56.937200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:56.941879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:56.961213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.961899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.962495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:56.963513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:56.964254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:56.964963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.312784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:57.322388 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4868914-b754-47a1-ab80-104c4ccb23ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1675 microversion: 2.1 time: 0.389809 Aug 27 03:34:57.327240 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2860/5506] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:56 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1675 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:57.339923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.340819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:57.359208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.360202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.360805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.361720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.362383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.362974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.824539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:57.833215 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-211e90cd-c525-4f18-88da-e929f8cc785a tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1674 microversion: 2.1 time: 1.159768 Aug 27 03:34:57.838131 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2647/5507] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:56 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1674 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:57.849030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.849664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:57.865502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.866020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.866507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.867242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.867703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.868135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.897134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:57.912712 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-73787fbc-d196-4cc4-80d2-966feda40782 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1680 microversion: 2.1 time: 0.584113 Aug 27 03:34:57.913634 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2861/5508] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:57 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1680 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:57.918797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:57.920008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:57.940141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:57.948493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.951527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.954923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:57.956007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:57.956666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:57.965557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:58.131890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.166716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.175521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.181694 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5a271b4-4515-49aa-8b17-89b7dd50ddbf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1371 microversion: 2.47 time: 0.342015 Aug 27 03:34:58.183077 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2648/5509] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:57 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:34:58.252751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.261547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34075dbe-000f-4c41-a742-1f25fe35be04 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1283 microversion: 2.1 time: 0.346575 Aug 27 03:34:58.282645 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2862/5510] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:57 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1283 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:58.349234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:58.349874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:58.363115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:58.368751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:58.369401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:58.370369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:58.371011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:58.371621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:58.546704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:58.566801 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bce047fc-add5-41fe-91d9-915da2786f15 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1607 microversion: 2.1 time: 0.221369 Aug 27 03:34:58.588488 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2649/5511] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:58 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1607 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:58.855488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:58.857266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:58.867290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:58.868083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:58.868719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:58.874982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:58.875785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:58.876436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:58.930020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:58.951166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:58.952973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:58.972291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:58.972695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:58.973140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:58.984184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:58.984683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:58.985135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:59.382117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:59.391244 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-663c4795-7fa8-46b9-9390-ce390ac8ba4f tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1674 microversion: 2.1 time: 0.539182 Aug 27 03:34:59.408028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2863/5512] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:58 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1674 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:59.418893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1258222804", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d36d19a7-9bab-4392-80cf-64340234c2d0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:59.592754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:34:59.927380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:59.940384 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-301d339b-e702-4488-9629-43d528325bbe tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1680 microversion: 2.1 time: 0.993557 Aug 27 03:34:59.957586 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2650/5513] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:58 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1680 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:59.965319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:59.966627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:59.975542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:59.976055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:59.976496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:59.977250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:59.977858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:59.978321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.149506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:00.170637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:00.173562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:00.177704 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d634efa7-d4ee-449f-a55d-2039dba91281 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1356 microversion: 2.47 time: 0.218024 Aug 27 03:35:00.179549 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2651/5514] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:34:59 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1356 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:00.193728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:00.197660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:00.222374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:00.225730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:00.226228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.233366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:00.234396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:00.239001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.493216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:00.493839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:00.494653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:00.495326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:00.495915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:00.507326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:00.508092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:00.508701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.520280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:00.522561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:00.523944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.555683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:00.566605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:00.583592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:35:00.586184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d36d19a7-9bab-4392-80cf-64340234c2d0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:35:00.594957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:00.709113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-71db19d2-47f8-4e68-b037-cb98813a1a4b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297825 Aug 27 03:35:00.711332 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2864/5515] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:00.725059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:00.727509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:00.747021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:00.748620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:00.750019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.751751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:00.753270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:00.754371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.806497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:00.807868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:00.808778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:00.809473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lazy-loading 'fault' on Instance uuid 3a7db87c-e21a-4282-90f4-a393fe1104b8 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:35:00.915572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:00.929957 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e5700d9-9476-4d01-a608-96d6fc935e65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 200 len: 1328 microversion: 2.1 time: 0.215128 Aug 27 03:35:00.945958 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2865/5516] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:00 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 1328 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:01.239814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:01.258755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fdadc20d-6f04-4bd8-953a-4acc4225774b req-c236c6fc-5a59-4e75-a8c5-72f000d3a175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7db87c-e21a-4282-90f4-a393fe1104b8", "name": "network-vif-deleted", "tag": "f20f1ec1-d2ba-4dee-8de9-1a3971b9103f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:01.276938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fdadc20d-6f04-4bd8-953a-4acc4225774b req-c236c6fc-5a59-4e75-a8c5-72f000d3a175 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.277670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fdadc20d-6f04-4bd8-953a-4acc4225774b req-c236c6fc-5a59-4e75-a8c5-72f000d3a175 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.278961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fdadc20d-6f04-4bd8-953a-4acc4225774b req-c236c6fc-5a59-4e75-a8c5-72f000d3a175 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:01.296641 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fdadc20d-6f04-4bd8-953a-4acc4225774b req-c236c6fc-5a59-4e75-a8c5-72f000d3a175 service nova] Creating event network-vif-deleted:f20f1ec1-d2ba-4dee-8de9-1a3971b9103f for instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 on n-h1-852086-5 Aug 27 03:35:01.303497 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fdadc20d-6f04-4bd8-953a-4acc4225774b req-c236c6fc-5a59-4e75-a8c5-72f000d3a175 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365014 Aug 27 03:35:01.304556 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2866/5517] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:01.311103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.316593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.317814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Searching by: {'deleted': False, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:35:01.327177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.328089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.328734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:01.329973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.330630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.331241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:01.538477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:35:01.721916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.730178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.730938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.732246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:01.745746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.748420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.859509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:01.880713 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b66562e-63e0-4704-8f94-b84f8eab1c3e tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1325 microversion: 2.1 time: 1.698196 Aug 27 03:35:01.883487 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2652/5518] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:00 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1325 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:01.893757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.895780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:01.913779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.919100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.921726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:01.925781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.926461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.927110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:01.928983 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d624ef08-05aa-4ac6-ab1e-3fac8d6ac907 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.622527 Aug 27 03:35:01.942191 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2867/5519] 10.222.0.69 () {60 vars in 1187 bytes} [Sat Aug 27 03:35:01 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:01.942191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:01.942191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:01.969152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.969985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.970629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:01.971504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:01.972027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:01.972528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.123782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f850adf9a7432798f86fe9d2d17b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf74946f704a99a6878baa30bbac4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:02.133694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:02.141791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff5cae5c-90d2-4372-8a0e-c67ecb952cc6 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 200 len: 1606 microversion: 2.1 time: 0.256171 Aug 27 03:35:02.145807 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2653/5520] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:01 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 1606 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:02.156702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.157659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:02.176286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.177138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.179426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.180550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.189024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.189664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.295599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:02.328476 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5039b93-defb-4210-80d3-973699c7a2b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1053 microversion: 2.1 time: 0.396131 Aug 27 03:35:02.334229 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2868/5521] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:01 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1053 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:02.340544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4beb1a89-d129-4208-bebf-2e04172784cc req-c122684e-7ba1-4dc2-94c6-706eccbb4d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69718556-4ec9-430e-b09b-5481ceea5320", "name": "network-vif-unplugged", "status": "completed", "tag": "bbd206aa-6c48-4e45-b9ed-feff2f0d2aed"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:02.360692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4beb1a89-d129-4208-bebf-2e04172784cc req-c122684e-7ba1-4dc2-94c6-706eccbb4d58 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.361502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4beb1a89-d129-4208-bebf-2e04172784cc req-c122684e-7ba1-4dc2-94c6-706eccbb4d58 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.362139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4beb1a89-d129-4208-bebf-2e04172784cc req-c122684e-7ba1-4dc2-94c6-706eccbb4d58 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.418993 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4beb1a89-d129-4208-bebf-2e04172784cc req-c122684e-7ba1-4dc2-94c6-706eccbb4d58 service nova] Creating event network-vif-unplugged:bbd206aa-6c48-4e45-b9ed-feff2f0d2aed for instance 69718556-4ec9-430e-b09b-5481ceea5320 on n-h1-852086-5 Aug 27 03:35:02.456780 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4beb1a89-d129-4208-bebf-2e04172784cc req-c122684e-7ba1-4dc2-94c6-706eccbb4d58 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119662 Aug 27 03:35:02.460908 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2869/5522] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:02.487289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.492303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:02.507227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.510460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.511324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.513066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.515020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.516113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.574649 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] HTTP exception thrown: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Request method failure captured: Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 HTTP/1.1 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_5mfKpWJxQM2I95jFDlFV9BTiIrEgJjdrSrzDSQDTG2th5co2TwBGU8N6pt3dl52WXPSzFaM2vPsEo6htvMUSY4Tihhhf3z5dJ6J5MdIyrq9M48i-RA0afRl4CmUP2Hbxxm7OoTLu0VFVoTDAiOPJGS2-B-rMOGUF81dtu2ks65wY Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed2fea313a2a429eaed4fd7250fb137d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}] Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 1470dd7c067e4c3c86b6f610d3e59262 Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '3a7db87c-e21a-4282-90f4-a393fe1104b8'} Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:02.578101 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:02.583461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:02.583461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:02.583461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:02.583461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:02.583461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:02.583461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:35:02.583461 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:02.586951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Returning 404 to user: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:02.588130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-966df302-2705-4ce6-ad00-5a06f033a10e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 404 len: 111 microversion: 2.1 time: 0.127588 Aug 27 03:35:02.589243 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2870/5523] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:02 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:02.611205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.614058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:02.627351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.629305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.630074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.631325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.632025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.632809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.723572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:35:02.797161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:02.823974 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1cdbfba7-9264-4a7d-88c8-f4350eb40e34 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1680 microversion: 2.1 time: 0.676772 Aug 27 03:35:02.846347 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2654/5524] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:02 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1680 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:02.851748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-938385f5-b9a1-4b2d-a69c-911dae90b764 req-8ae2e636-cbcc-4f1b-9c6a-727374c9517d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79642ca-ff1b-4d0b-b6d7-574372aa25ec", "name": "network-vif-deleted", "tag": "cde96fb4-637a-4780-ab2c-ef6b8aef25ac"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:02.863106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-938385f5-b9a1-4b2d-a69c-911dae90b764 req-8ae2e636-cbcc-4f1b-9c6a-727374c9517d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.864004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-938385f5-b9a1-4b2d-a69c-911dae90b764 req-8ae2e636-cbcc-4f1b-9c6a-727374c9517d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.864669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-938385f5-b9a1-4b2d-a69c-911dae90b764 req-8ae2e636-cbcc-4f1b-9c6a-727374c9517d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.882634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-938385f5-b9a1-4b2d-a69c-911dae90b764 req-8ae2e636-cbcc-4f1b-9c6a-727374c9517d service nova] Creating event network-vif-deleted:cde96fb4-637a-4780-ab2c-ef6b8aef25ac for instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec on n-h2-852086-5 Aug 27 03:35:02.892613 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-938385f5-b9a1-4b2d-a69c-911dae90b764 req-8ae2e636-cbcc-4f1b-9c6a-727374c9517d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042207 Aug 27 03:35:02.895028 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2655/5525] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:02.902257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ce86ab0-bc57-43b7-bdba-172a0c3e7630 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '.version_select at 0x7fe45c0df550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.915187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:02.931758 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ce86ab0-bc57-43b7-bdba-172a0c3e7630 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774491639" status: 202 len: 0 microversion: 2.1 time: 0.033170 Aug 27 03:35:02.933171 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2656/5526] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774491639 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:02.941887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.943350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:02.947219 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-721e3559-95f5-4883-b8d8-045a3214defe tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "DELETE /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 204 len: 0 microversion: 2.47 time: 0.355199 Aug 27 03:35:02.947449 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2871/5527] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:35:02 2022] DELETE /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:35:02.969891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:02.976783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.977739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.980388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:02.984468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.986577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.987652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.989470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.992138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.993714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.994250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:02.997371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:02.998148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:02.998769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:03.386263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.396398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.397866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.405318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5dce2542-3ded-473d-8550-98b8cf8fded7 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1362 microversion: 2.47 time: 0.452641 Aug 27 03:35:03.405932 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2872/5528] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:02 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:03.421157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.421157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] [instance: d79642ca-ff1b-4d0b-b6d7-574372aa25ec] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:03.432131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:03.439272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:03.439904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:03.441290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:03.441783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:03.442247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:03.467744 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] HTTP exception thrown: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec could not be found. Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Request method failure captured: Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec HTTP/1.1 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY6PyU9G282NEdwSwHsiROIz1Eu_XdsqX3gr0HhwBWpaVMzo466A22nQxIVm50JlaNZzes4ofckv_xopoFJrGs3_EIks4LyAEi7CyHYtIbyI8n8LwBG44Uyy1pgMqyhAoHyAskI44CnCaGYD1OQ3yW99l2rNGNLuz0cPhfen0pBuFP4 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a0cf74946f704a99a6878baa30bbac4e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a0cf74946f704a99a6878baa30bbac4e"}]}] Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-422182183 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a0cf74946f704a99a6878baa30bbac4e Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-422182183 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 89f850adf9a7432798f86fe9d2d17b79 Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-422182183-project Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec could not be found. Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd79642ca-ff1b-4d0b-b6d7-574372aa25ec'} Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec could not be found. Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec could not be found. Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:03.470206 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec could not be found. Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Returning 404 to user: Instance d79642ca-ff1b-4d0b-b6d7-574372aa25ec could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5cb556ce-29ca-479f-b591-8b04a587281d tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec" status: 404 len: 111 microversion: 2.1 time: 0.062943 Aug 27 03:35:03.478615 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2873/5529] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:03 2022] GET /compute/v2.1/servers/d79642ca-ff1b-4d0b-b6d7-574372aa25ec => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:03.483806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.484442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:03.491222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:03.491716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:03.492776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:03.493515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:03.493974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:03.494428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:03.656634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:03.668712 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d16efa8d-8e3b-4ce1-a622-35ff15b3efe5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1127 microversion: 2.1 time: 0.189864 Aug 27 03:35:03.670837 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2874/5530] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:03 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1127 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:03.684276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-406e4ff2-d7b4-4acb-a291-30ec04777184 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] Calling method '.version_select at 0x7fe4572be160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.731655 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-406e4ff2-d7b4-4acb-a291-30ec04777184 tempest-ServerActionsTestJSON-422182183 tempest-ServerActionsTestJSON-422182183-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907814670" status: 202 len: 0 microversion: 2.1 time: 0.057794 Aug 27 03:35:03.732579 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2875/5531] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:35:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907814670 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:03.853082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:03.854257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:03.868856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:03.869464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:03.870581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:03.871703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:03.872774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:03.873429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:04.086349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.100244 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d102d04-9c0b-495b-9f27-a30bd0709d63 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1325 microversion: 2.1 time: 1.165635 Aug 27 03:35:04.102121 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2657/5532] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:02 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1325 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.129854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.145618 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f45ebeb7-6646-4c55-8812-6a5a0dec6984 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1613 microversion: 2.1 time: 0.294665 Aug 27 03:35:04.146901 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2876/5533] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:03 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1613 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:04.433077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.435023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:04.455546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:04.457410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:04.458100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:04.459062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:04.459697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:04.460287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:04.703020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:04.704450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:04.720532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:04.723805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:04.724527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:04.725544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:04.727091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:04.729731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:04.942189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.963904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.972945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:04.980433 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8827fe06-8126-43a5-b4af-726d8c403ae3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1362 microversion: 2.47 time: 0.551201 Aug 27 03:35:04.982919 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2658/5534] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:04 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:05.003464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b9c9f403-b521-4b3b-8430-96a14081bfa9 req-7cea0822-e1b4-410a-b4ba-2693bebc0991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bc49e1-3563-4c78-86f1-d5a28f36ee64", "tag": "7f69d769-9071-4065-b92d-704767607585"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:05.033960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b9c9f403-b521-4b3b-8430-96a14081bfa9 req-7cea0822-e1b4-410a-b4ba-2693bebc0991 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:05.035080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b9c9f403-b521-4b3b-8430-96a14081bfa9 req-7cea0822-e1b4-410a-b4ba-2693bebc0991 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:05.035961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b9c9f403-b521-4b3b-8430-96a14081bfa9 req-7cea0822-e1b4-410a-b4ba-2693bebc0991 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:05.061932 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b9c9f403-b521-4b3b-8430-96a14081bfa9 req-7cea0822-e1b4-410a-b4ba-2693bebc0991 service nova] Creating event network-changed:7f69d769-9071-4065-b92d-704767607585 for instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 on n-h1-852086-5 Aug 27 03:35:05.067902 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b9c9f403-b521-4b3b-8430-96a14081bfa9 req-7cea0822-e1b4-410a-b4ba-2693bebc0991 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068876 Aug 27 03:35:05.069586 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2659/5535] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:05.127145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.128839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:05.132285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:05.143306 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c7f71f69-48bf-4a7c-ac84-fd42c73f27aa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1127 microversion: 2.1 time: 0.445184 Aug 27 03:35:05.144006 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2877/5536] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:04 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1127 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:05.179894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:05.185001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:05.187589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:05.188692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:05.194553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:05.196434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:05.199777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:05.200414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:05.223669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:05.224174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:05.236284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:05.237083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:05.245466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:05.246341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:05.833018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:05.882382 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f03c11b-96da-4988-a3ef-fd15d937dada tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1325 microversion: 2.1 time: 0.761003 Aug 27 03:35:05.888151 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2660/5537] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:05 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1325 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:06.013730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.014902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:06.030390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.031280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.032124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:06.036481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.037284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.037937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:06.066510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:06.097388 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d64d8b1-96eb-4c95-a362-49543bce99b0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 200 len: 1326 microversion: 2.1 time: 0.928817 Aug 27 03:35:06.115821 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2878/5538] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:05 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 1326 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:06.165533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.166868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:06.177678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.178659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.179692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:06.180915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.181668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.182417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:06.716471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:06.733349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:06.736720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:06.738650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:06.745203 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-52d0ba59-7118-4262-9081-79e9a38166a9 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 200 len: 1362 microversion: 2.47 time: 0.735826 Aug 27 03:35:06.747869 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2661/5539] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:06 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 1362 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:06.775754 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-48db2203-0519-41e4-8747-e6292711d9fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1127 microversion: 2.1 time: 0.602894 Aug 27 03:35:06.776846 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2879/5540] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:06 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1127 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:06.919102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:06.919899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:06.937589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.939272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.940839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:06.943500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:06.945202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:06.947181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.126224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:07.126859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:07.142740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.143279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.143882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.144656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.145307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.145964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.180879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 HTTP/1.1 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '69718556-4ec9-430e-b09b-5481ceea5320'} Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:07.185422 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0ee78e2-5605-4d5e-84b9-d0b9895ad227 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 404 len: 111 microversion: 2.1 time: 0.067743 Aug 27 03:35:07.191678 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2880/5541] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:07 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:07.198308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aa73838a-f29a-44d8-aaab-eecdb41af13d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '.version_select at 0x7fe4572284c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:07.244535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aa73838a-f29a-44d8-aaab-eecdb41af13d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110190476" status: 202 len: 0 microversion: 2.1 time: 0.050123 Aug 27 03:35:07.245134 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2881/5542] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:35:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110190476 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:07.666199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-daf26f4f-f1db-41fb-aa72-80fbf093d41a req-9ca5464e-08eb-4736-804b-04a9beb949c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69718556-4ec9-430e-b09b-5481ceea5320", "name": "network-vif-deleted", "tag": "bbd206aa-6c48-4e45-b9ed-feff2f0d2aed"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:07.696215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-daf26f4f-f1db-41fb-aa72-80fbf093d41a req-9ca5464e-08eb-4736-804b-04a9beb949c8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.696809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-daf26f4f-f1db-41fb-aa72-80fbf093d41a req-9ca5464e-08eb-4736-804b-04a9beb949c8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.697313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-daf26f4f-f1db-41fb-aa72-80fbf093d41a req-9ca5464e-08eb-4736-804b-04a9beb949c8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.730472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-daf26f4f-f1db-41fb-aa72-80fbf093d41a req-9ca5464e-08eb-4736-804b-04a9beb949c8 service nova] Creating event network-vif-deleted:bbd206aa-6c48-4e45-b9ed-feff2f0d2aed for instance 69718556-4ec9-430e-b09b-5481ceea5320 on n-h1-852086-5 Aug 27 03:35:07.746933 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-daf26f4f-f1db-41fb-aa72-80fbf093d41a req-9ca5464e-08eb-4736-804b-04a9beb949c8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085954 Aug 27 03:35:07.750905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2882/5543] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:07.775942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:07.776681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: 796ac05c-2be8-4675-b66b-96e792ef0b9c] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:07.793002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.797710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.798643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.800134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.800651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.805212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.828331 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] HTTP exception thrown: Instance 796ac05c-2be8-4675-b66b-96e792ef0b9c could not be found. Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Request method failure captured: Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c HTTP/1.1 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZC2QX_rM8y4EKnkawPp-nWKiknIAKjsBzjwYHAuJU7oM47dM0M4umrOt7QH60RB_r0K13YTISjfoIwI131aF_1cl7Hc2NVxo10udeioVCEyOb7URMb7v-Pvzu2pn5q4qxe09jBRpuCldU5OpCqKFJkkp4Ipj0J2XIPzil36raUHie8 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d2c9aeeba04f4d18b40d07b996a3d12a Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerShowV247Test-444831147 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d2c9aeeba04f4d18b40d07b996a3d12a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2c9aeeba04f4d18b40d07b996a3d12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d2c9aeeba04f4d18b40d07b996a3d12a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2c9aeeba04f4d18b40d07b996a3d12a"}]}] Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerShowV247Test-444831147 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d2c9aeeba04f4d18b40d07b996a3d12a Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerShowV247Test-444831147 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerShowV247Test-444831147-project Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 62a93a28048e4fb58f346e686cc09894 Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerShowV247Test-444831147-project Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 796ac05c-2be8-4675-b66b-96e792ef0b9c could not be found. Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '796ac05c-2be8-4675-b66b-96e792ef0b9c'} Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796ac05c-2be8-4675-b66b-96e792ef0b9c could not be found. Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796ac05c-2be8-4675-b66b-96e792ef0b9c could not be found. Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:07.830794 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.836568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:07.836568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:07.836568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:07.836568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:07.836568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:07.836568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796ac05c-2be8-4675-b66b-96e792ef0b9c could not be found. Aug 27 03:35:07.836568 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:07.838224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Returning 404 to user: Instance 796ac05c-2be8-4675-b66b-96e792ef0b9c could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:07.839302 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-06cae44c-ce8f-4a74-b9c0-b678f96c2015 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c" status: 404 len: 111 microversion: 2.47 time: 0.067897 Aug 27 03:35:07.840405 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2883/5544] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:07 2022] GET /compute/v2.1/servers/796ac05c-2be8-4675-b66b-96e792ef0b9c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:35:07.845605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:07.846572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:07.853415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.854197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.854827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.855739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.857060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.857997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.877419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:07.888312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:07.902228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1141dfd-1238-42e6-bf11-c825295f6d71 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1325 microversion: 2.1 time: 0.989273 Aug 27 03:35:07.905677 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2662/5545] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:06 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1325 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:07.913339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:07.918730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:07.928528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.929262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.930089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.931200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:07.931852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:07.932460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:07.966136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:35:08.108594 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-536ea164-0c31-4d0b-a518-f59ac87aa7c0 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b" status: 204 len: 0 microversion: 2.47 time: 0.201144 Aug 27 03:35:08.110996 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2663/5546] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:35:07 2022] DELETE /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:35:08.118800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6fb251c-5873-43c8-94d0-849343ca5d00 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'create', calling method: .version_select at 0x7fe45c0df670>, body: {"keypair": {"name": "tempest-keypair-282556348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMNbybyqejIDVh0OF97vWRnu/ijUAxNz1JHKzbpFEtSUdAa/2wsq1wuKhnqTmz0i1k48Ek6ItHb49BI7fK3xeglwzs1wdCcvuThC2u7fGRbANQ8pCv5horH+rC7tcKeMw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:08.146911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a6fb251c-5873-43c8-94d0-849343ca5d00 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:08.156601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a6fb251c-5873-43c8-94d0-849343ca5d00 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for user 1470dd7c067e4c3c86b6f610d3e59262 and project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:08.191193 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6fb251c-5873-43c8-94d0-849343ca5d00 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078406 Aug 27 03:35:08.192822 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2664/5547] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:35:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:08.200422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.202231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:08.217009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:08.217731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:08.218677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:08.221439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:08.223249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:08.225506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:08.426095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.439482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.442869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.445640 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-51d5cd90-d24d-41db-93e4-cd78e50210cf tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b" status: 200 len: 1363 microversion: 2.47 time: 0.250990 Aug 27 03:35:08.469038 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2665/5548] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:08 2022] GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:08.822332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:08.832176 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 0.990206 Aug 27 03:35:08.850550 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2884/5549] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:07 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:08.927438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:08.928237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:08.948432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:08.951718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:08.953755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:08.956961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:08.957754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:08.960056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:09.350650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.351710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e6864e8-daee-4ac2-9679-1bf09887d4da tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001541 Aug 27 03:35:09.352144 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2885/5550] 10.222.0.69 () {56 vars in 886 bytes} [Sat Aug 27 03:35:09 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 27 03:35:09.476492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.477004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:09.489204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:09.491936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:09.492606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:09.493528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:09.504221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:09.507084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:09.717193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:09.741630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:09.743473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:09.751290 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21feef0e-0038-4343-bde3-bdc620c82325 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b" status: 200 len: 1363 microversion: 2.47 time: 0.278980 Aug 27 03:35:09.752455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2886/5551] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:09 2022] GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:09.856209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:09.858279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:09.868172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:09.868814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:09.869055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:09.870504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:09.873892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:09.875253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:09.952890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:09.970816 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-526a1bfd-440a-45fc-bfab-6eea8ef80c05 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1325 microversion: 2.1 time: 1.045724 Aug 27 03:35:09.977656 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2666/5552] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:08 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1325 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:10.503967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-72a7d636-945e-4db6-887e-95003c2a5abc req-99892cf4-3d7a-4dda-b10f-46ca7f7d5018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e034924-61bd-42a5-a090-6ba7f7a5cca1", "tag": "a2598959-09aa-488d-b7b8-d769d4a80c7c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:10.535625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-72a7d636-945e-4db6-887e-95003c2a5abc req-99892cf4-3d7a-4dda-b10f-46ca7f7d5018 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:10.540097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-72a7d636-945e-4db6-887e-95003c2a5abc req-99892cf4-3d7a-4dda-b10f-46ca7f7d5018 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:10.546747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-72a7d636-945e-4db6-887e-95003c2a5abc req-99892cf4-3d7a-4dda-b10f-46ca7f7d5018 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:10.599674 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-72a7d636-945e-4db6-887e-95003c2a5abc req-99892cf4-3d7a-4dda-b10f-46ca7f7d5018 service nova] Creating event network-changed:a2598959-09aa-488d-b7b8-d769d4a80c7c for instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 on n-h1-852086-5 Aug 27 03:35:10.620711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-72a7d636-945e-4db6-887e-95003c2a5abc req-99892cf4-3d7a-4dda-b10f-46ca7f7d5018 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120283 Aug 27 03:35:10.624219 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2667/5553] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:10.776712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:10.777880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:10.791932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:10.796458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:10.797280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:10.798344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:10.801112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:10.801843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:11.036982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:11.051234 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d80d4be9-2a5b-4139-b53c-fa3d41cc1114 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 1.198910 Aug 27 03:35:11.052521 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2887/5554] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:09 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:11.057093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:11.058340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:11.059256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:11.068565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:11.070408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:11.071520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:11.072530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:11.073231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:11.075704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:11.100125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:11.105761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62a93a28048e4fb58f346e686cc09894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9aeeba04f4d18b40d07b996a3d12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:11.107866 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aab4f10c-f6e7-488c-9f3f-9395243f6fb3 tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b" status: 200 len: 1363 microversion: 2.47 time: 0.335782 Aug 27 03:35:11.113287 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2668/5555] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:10 2022] GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:11.404360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:11.720160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:12.073889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:12.076447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:12.099824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:12.102000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:12.111334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:12.112490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:12.113206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:12.117319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:12.444851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:12.465965 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd920224-c800-4940-8929-3a2cda304c79 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1325 microversion: 2.1 time: 1.403247 Aug 27 03:35:12.487724 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2888/5556] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:11 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1325 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:12.501805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:12.502834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] [instance: fb755874-b508-4801-b0bd-7afce12f448b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:12.514481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:12.515342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:12.515975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:12.516892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:12.517543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:12.518177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:12.537534 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] HTTP exception thrown: Instance fb755874-b508-4801-b0bd-7afce12f448b could not be found. Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Request method failure captured: Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b HTTP/1.1 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZC2QX_rM8y4EKnkawPp-nWKiknIAKjsBzjwYHAuJU7oM47dM0M4umrOt7QH60RB_r0K13YTISjfoIwI131aF_1cl7Hc2NVxo10udeioVCEyOb7URMb7v-Pvzu2pn5q4qxe09jBRpuCldU5OpCqKFJkkp4Ipj0J2XIPzil36raUHie8 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: d2c9aeeba04f4d18b40d07b996a3d12a Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerShowV247Test-444831147 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d2c9aeeba04f4d18b40d07b996a3d12a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2c9aeeba04f4d18b40d07b996a3d12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d2c9aeeba04f4d18b40d07b996a3d12a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d2c9aeeba04f4d18b40d07b996a3d12a"}]}] Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerShowV247Test-444831147 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: d2c9aeeba04f4d18b40d07b996a3d12a Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerShowV247Test-444831147 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerShowV247Test-444831147-project Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 62a93a28048e4fb58f346e686cc09894 Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerShowV247Test-444831147-project Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance fb755874-b508-4801-b0bd-7afce12f448b could not be found. Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'fb755874-b508-4801-b0bd-7afce12f448b'} Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb755874-b508-4801-b0bd-7afce12f448b could not be found. Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb755874-b508-4801-b0bd-7afce12f448b could not be found. Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:12.539932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:12.547626 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:12.547626 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:12.547626 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:12.547626 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:12.547626 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:12.547626 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb755874-b508-4801-b0bd-7afce12f448b could not be found. Aug 27 03:35:12.547626 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:12.552640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] Returning 404 to user: Instance fb755874-b508-4801-b0bd-7afce12f448b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:12.553660 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac3da5d0-fa94-4a2b-bf85-9b6bb822c24d tempest-ServerShowV247Test-444831147 tempest-ServerShowV247Test-444831147-project] 10.222.0.69 "GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b" status: 404 len: 111 microversion: 2.47 time: 0.064541 Aug 27 03:35:12.554806 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2889/5557] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:12 2022] GET /compute/v2.1/servers/fb755874-b508-4801-b0bd-7afce12f448b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:35:12.585534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfe12d7c-77e2-44fd-b9d8-0fe88a6338ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: .version_select at 0x7fe457228b80>, body: {"keypair": {"name": "tempest-keypair-1852413846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM97r9WjmG1iH9xkloWaNqDzRqp1hcupKhhElLUx5fOhU1uHFhdSNwNcPTwm0ngdSr2QlPA7HR1cY+L1YnlEHPUlIMLpBaYeB+lVMrdEEA0ULgLHxsdQs3vUsPAFm7u6BQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:12.664234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cfe12d7c-77e2-44fd-b9d8-0fe88a6338ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:12.708263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cfe12d7c-77e2-44fd-b9d8-0fe88a6338ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:12.784699 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfe12d7c-77e2-44fd-b9d8-0fe88a6338ca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227260 Aug 27 03:35:12.787464 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2890/5558] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:35:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:12.805776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b50492e8-67c0-42df-833b-3658d91a43f4 req-2c09dc67-9c24-4335-ab57-13ca1a842399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bc49e1-3563-4c78-86f1-d5a28f36ee64", "name": "network-vif-plugged", "status": "completed", "tag": "7f69d769-9071-4065-b92d-704767607585"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:12.840422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b50492e8-67c0-42df-833b-3658d91a43f4 req-2c09dc67-9c24-4335-ab57-13ca1a842399 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:12.848551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b50492e8-67c0-42df-833b-3658d91a43f4 req-2c09dc67-9c24-4335-ab57-13ca1a842399 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:12.849126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b50492e8-67c0-42df-833b-3658d91a43f4 req-2c09dc67-9c24-4335-ab57-13ca1a842399 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:12.893470 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b50492e8-67c0-42df-833b-3658d91a43f4 req-2c09dc67-9c24-4335-ab57-13ca1a842399 service nova] Creating event network-vif-plugged:7f69d769-9071-4065-b92d-704767607585 for instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 on n-h1-852086-5 Aug 27 03:35:12.910466 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b50492e8-67c0-42df-833b-3658d91a43f4 req-2c09dc67-9c24-4335-ab57-13ca1a842399 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114256 Aug 27 03:35:12.912318 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2891/5559] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:13.005093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:13.032512 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-340fd142-74c9-40ef-95ca-4960091a5a96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 0.960795 Aug 27 03:35:13.036861 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2669/5560] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:12 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:13.515703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:13.517602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:13.545951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:13.552709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:13.553883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:13.554964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:13.566095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:13.571422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:14.064019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:14.064640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:14.081465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:14.082746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:14.083381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:14.084546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:14.085171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:14.085764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:14.553671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:14.572150 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83ebfd38-3469-4270-8ac3-be65b5956187 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1325 microversion: 2.1 time: 1.078624 Aug 27 03:35:14.573635 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2892/5561] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:13 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1325 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:15.191633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:15.212911 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55be8811-dd6b-4b44-817a-4a83904316c2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 1.155616 Aug 27 03:35:15.217376 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2670/5562] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:14 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:15.600079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:15.603676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:15.623625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.625973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.626673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:15.629241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:15.629890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:15.630524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.237466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:16.238062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:16.251927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.252506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.252983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.253715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.254266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.254659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.549767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:16.563805 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6cded7d-4a5c-427e-b3e9-f1e76bc142d4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1521 microversion: 2.1 time: 0.971804 Aug 27 03:35:16.564411 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2893/5563] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:15 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1521 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:16.591455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:16.593623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:16.607914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:16.632822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.637273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.638536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.643764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.647119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.648014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.750874 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] HTTP exception thrown: Action 999 not found Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Request method failure captured: Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64/os-instance-actions/999 HTTP/1.1 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZDYbucPO3ybPL8ZxnlL8upRSL1KZWPKD8ETcnNGDwrggxlwsPq3CY8Bv1o39Xy_gkTY5RS4KGOTtLgFTnJJfWuGlzDbpOEAQkOlr1OtR8btWgEW5N-jMDhVYWksR5FXE9bTiDb1swHA3y121fRqyxLpD3oHE-Cw-iAydkIVgkVkoFQ Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 20f32baf755b42fbbdafc0b9ebc86ac7 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/20f32baf755b42fbbdafc0b9ebc86ac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20f32baf755b42fbbdafc0b9ebc86ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_20f32baf755b42fbbdafc0b9ebc86ac7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20f32baf755b42fbbdafc0b9ebc86ac7"}]}] Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 20f32baf755b42fbbdafc0b9ebc86ac7 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-InstanceActionsNegativeTestJSON-798494215-project Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f64ab5c3849f4a8189623b1247eed046 Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-798494215-project Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: exception: Action 999 not found Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '60bc49e1-3563-4c78-86f1-d5a28f36ee64', 'id': '999'} Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 27 03:35:16.765861 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.772178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Returning 404 to user: Action 999 not found {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:16.776101 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10c07af5-bb72-405d-ba5f-5e5a6979b877 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.186615 Aug 27 03:35:16.777702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2894/5564] 10.222.0.69 () {58 vars in 1308 bytes} [Sat Aug 27 03:35:16 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64/os-instance-actions/999 => generated 66 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:35:16.789386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c510313-596e-454a-adc3-483af5a85512 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '.version_select at 0x7fe457112f70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:16.790083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5c510313-596e-454a-adc3-483af5a85512 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 9bc909b0-af5e-414e-8f61-75ceed27e655] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:16.798983 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-5c510313-596e-454a-adc3-483af5a85512 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] HTTP exception thrown: Instance 9bc909b0-af5e-414e-8f61-75ceed27e655 could not be found. Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c510313-596e-454a-adc3-483af5a85512 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Request method failure captured: Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/9bc909b0-af5e-414e-8f61-75ceed27e655/os-instance-actions HTTP/1.1 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZDYbucPO3ybPL8ZxnlL8upRSL1KZWPKD8ETcnNGDwrggxlwsPq3CY8Bv1o39Xy_gkTY5RS4KGOTtLgFTnJJfWuGlzDbpOEAQkOlr1OtR8btWgEW5N-jMDhVYWksR5FXE9bTiDb1swHA3y121fRqyxLpD3oHE-Cw-iAydkIVgkVkoFQ Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 20f32baf755b42fbbdafc0b9ebc86ac7 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/20f32baf755b42fbbdafc0b9ebc86ac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20f32baf755b42fbbdafc0b9ebc86ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_20f32baf755b42fbbdafc0b9ebc86ac7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20f32baf755b42fbbdafc0b9ebc86ac7"}]}] Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 20f32baf755b42fbbdafc0b9ebc86ac7 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-InstanceActionsNegativeTestJSON-798494215-project Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f64ab5c3849f4a8189623b1247eed046 Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-798494215-project Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 9bc909b0-af5e-414e-8f61-75ceed27e655 could not be found. Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '9bc909b0-af5e-414e-8f61-75ceed27e655'} Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc909b0-af5e-414e-8f61-75ceed27e655 could not be found. Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:16.803234 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc909b0-af5e-414e-8f61-75ceed27e655 could not be found. Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc909b0-af5e-414e-8f61-75ceed27e655 could not be found. Aug 27 03:35:16.819068 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:16.826239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5c510313-596e-454a-adc3-483af5a85512 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Returning 404 to user: Instance 9bc909b0-af5e-414e-8f61-75ceed27e655 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:16.830857 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5c510313-596e-454a-adc3-483af5a85512 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/9bc909b0-af5e-414e-8f61-75ceed27e655/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.045318 Aug 27 03:35:16.832754 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2895/5565] 10.222.0.69 () {58 vars in 1296 bytes} [Sat Aug 27 03:35:16 2022] GET /compute/v2.1/servers/9bc909b0-af5e-414e-8f61-75ceed27e655/os-instance-actions => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:16.864591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:16.865210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:16.896995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.897503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.897944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.898699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:16.899235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:16.899578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:16.916064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:16.930738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a6522d3-6543-4b82-b2b1-83ecde28befb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 0.697137 Aug 27 03:35:16.931328 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2671/5566] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:16 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:16.992733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:35:17.224197 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7d7bba65-9386-499e-a494-692f0a3c0c7f tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "DELETE /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 204 len: 0 microversion: 2.1 time: 0.379899 Aug 27 03:35:17.233138 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2896/5567] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:35:16 2022] DELETE /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:17.237586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.238880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:17.245710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:17.259166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:17.259999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:17.261023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:17.261548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:17.262250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:17.956582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:17.958579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:17.989497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:17.994260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:18.013074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.016499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.019052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.024690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.025238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c608c995-54f1-4b99-83af-6054780832e4 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1527 microversion: 2.1 time: 0.784824 Aug 27 03:35:18.030251 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2672/5568] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:17 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1527 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:18.031403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.035812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.053866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-237613310", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bfc3c8c-fa3d-497c-bef6-083c416b049d"}], "security_groups": [{"name": "tempest-securitygroup--1265998252"}], "key_name": "tempest-keypair-282556348", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:18.166693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:18.869102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] validate_networks() for [('3bfc3c8c-fa3d-497c-bef6-083c416b049d', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:35:19.013548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:19.025844 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4126d0a6-842b-4bca-8be9-cc1f31646cdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 1.073999 Aug 27 03:35:19.027850 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2897/5569] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:17 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:19.224928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-197812203", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": "none"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:19.307860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:19.309048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:19.310067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:19.310742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:19.311389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:19.323969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:19.325698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:19.326792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:19.327964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:19.328649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:19.329432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:19.359652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Getting quotas for project 65aa843cafd04b06877d3d5a5a4b58ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:19.365898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Getting quotas for user 8e9a08e74f794fefaa0da77a868fb354 and project 65aa843cafd04b06877d3d5a5a4b58ad. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:19.394983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:35:19.399740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:35:19.477710 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1607b182-90cd-4fb9-a4fa-398e2abb22fa tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.447341 Aug 27 03:35:19.479582 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2898/5570] 10.222.0.69 () {62 vars in 1188 bytes} [Sat Aug 27 03:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:35:19.485634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:19.486266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:19.502282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:19.502832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:19.521303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:19.521303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:19.521303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:19.521303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:19.896329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:19.904627 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9db7684-d4d0-4fac-88fb-84e962d5526d tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1485 microversion: 2.1 time: 0.423759 Aug 27 03:35:19.919789 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2899/5571] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:19 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1485 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:19.919789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6ca62765-06f9-422e-a1ad-d4b2906fa020 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:19.930659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6ca62765-06f9-422e-a1ad-d4b2906fa020 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:20.134745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6ca62765-06f9-422e-a1ad-d4b2906fa020 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.144429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6ca62765-06f9-422e-a1ad-d4b2906fa020 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.146218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6ca62765-06f9-422e-a1ad-d4b2906fa020 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.161245 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6ca62765-06f9-422e-a1ad-d4b2906fa020 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1277 microversion: 2.57 time: 0.246636 Aug 27 03:35:20.162378 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2900/5572] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:19 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:20.179260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:20.180435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:20.189868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:20.190676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:20.193454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:20.194341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:20.194740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:20.195165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:20.730660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:20.745547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bc84dfe6-18cb-46f3-be64-6acd91386bc3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 0.581768 Aug 27 03:35:20.776546 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2901/5573] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:20 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:20.785822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5d8e87a5-ae5c-4729-bcb9-1435d0ce769a req-b580fdd7-77ca-49da-8733-1b213ffaf939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bc49e1-3563-4c78-86f1-d5a28f36ee64", "name": "network-vif-deleted", "tag": "7f69d769-9071-4065-b92d-704767607585"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:20.814203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5d8e87a5-ae5c-4729-bcb9-1435d0ce769a req-b580fdd7-77ca-49da-8733-1b213ffaf939 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:20.815120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5d8e87a5-ae5c-4729-bcb9-1435d0ce769a req-b580fdd7-77ca-49da-8733-1b213ffaf939 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:20.815756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5d8e87a5-ae5c-4729-bcb9-1435d0ce769a req-b580fdd7-77ca-49da-8733-1b213ffaf939 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:20.849294 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5d8e87a5-ae5c-4729-bcb9-1435d0ce769a req-b580fdd7-77ca-49da-8733-1b213ffaf939 service nova] Creating event network-vif-deleted:7f69d769-9071-4065-b92d-704767607585 for instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 on n-h1-852086-5 Aug 27 03:35:20.870953 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5d8e87a5-ae5c-4729-bcb9-1435d0ce769a req-b580fdd7-77ca-49da-8733-1b213ffaf939 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087649 Aug 27 03:35:20.872409 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2902/5574] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:20.926669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:20.927395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:20.942581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:20.953988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:20.954758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:20.955737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:20.956387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:20.963183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:21.083326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:21.084622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:21.085287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:21.088100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lazy-loading 'fault' on Instance uuid 60bc49e1-3563-4c78-86f1-d5a28f36ee64 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:35:21.193875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64ab5c3849f4a8189623b1247eed046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f32baf755b42fbbdafc0b9ebc86ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:21.206593 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c34447d8-d9c4-4dfa-b523-287659bf1223 tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 200 len: 1315 microversion: 2.1 time: 0.284519 Aug 27 03:35:21.212869 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2903/5575] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:20 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:21.231872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-279135136", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37d2c35e-4ba5-4e30-b147-136ed6948e64"}], "security_groups": [{"name": "tempest-securitygroup--1517851902"}], "key_name": "tempest-keypair-1852413846", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:21.485060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] validate_networks() for [('37d2c35e-4ba5-4e30-b147-136ed6948e64', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:35:21.550220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:21.550986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:21.552144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:21.552750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:21.553291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:21.578496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:21.578885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:21.579620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:21.580836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:21.581513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:21.583512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:21.636935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:21.654616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Getting quotas for user 1470dd7c067e4c3c86b6f610d3e59262 and project ed2fea313a2a429eaed4fd7250fb137d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:21.680656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:35:21.686949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:35:21.765325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1859bd4b-2f5c-4c5f-8ada-0b2986720de5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.727362 Aug 27 03:35:21.771993 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2673/5576] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:35:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 3739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:21.792755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:21.793397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:21.812408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:21.813618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:21.814083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:21.817081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:21.817557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:21.823138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:22.141397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:22.157883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:22.163103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:22.164289 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6d30be5-4593-4763-8726-042149de5b8d tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1335 microversion: 2.57 time: 0.384670 Aug 27 03:35:22.169779 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2674/5577] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:21 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1335 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:22.189438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:22.190373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:22.203476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.204300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.204923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:22.205851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.206369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.206843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:22.568150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:22.568880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:22.569724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:22.570146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:22.570734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:22.604385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.606568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.610572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:22.611787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.614127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.619617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:22.714368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:22.733731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Getting quotas for user 6cf3abb780384295820b4c18d6f1f415 and project f3cad21a3ff3460692e93bed5ffc47ea. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:22.790266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:35:22.793138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:35:22.870052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82ed9681-afd0-4d43-a7d7-46f44d8a5892 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.653063 Aug 27 03:35:22.871060 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2904/5578] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:35:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:22.878745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:22.884506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:22.897568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.909471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.909989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:22.913417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:22.915596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:22.916764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:23.082372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.094612 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e467b50-8fde-45f9-b7c6-f232f263188f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1240 microversion: 2.1 time: 0.217760 Aug 27 03:35:23.095454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2905/5579] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:22 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1240 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:23.103063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:23.103915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] [instance: 60bc49e1-3563-4c78-86f1-d5a28f36ee64] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:23.138852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:23.139376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:23.139917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:23.140753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:23.141222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:23.141656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:23.193900 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] HTTP exception thrown: Instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 could not be found. Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Request method failure captured: Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 HTTP/1.1 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZDYbucPO3ybPL8ZxnlL8upRSL1KZWPKD8ETcnNGDwrggxlwsPq3CY8Bv1o39Xy_gkTY5RS4KGOTtLgFTnJJfWuGlzDbpOEAQkOlr1OtR8btWgEW5N-jMDhVYWksR5FXE9bTiDb1swHA3y121fRqyxLpD3oHE-Cw-iAydkIVgkVkoFQ Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 20f32baf755b42fbbdafc0b9ebc86ac7 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/20f32baf755b42fbbdafc0b9ebc86ac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20f32baf755b42fbbdafc0b9ebc86ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_20f32baf755b42fbbdafc0b9ebc86ac7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20f32baf755b42fbbdafc0b9ebc86ac7"}]}] Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 20f32baf755b42fbbdafc0b9ebc86ac7 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-798494215 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-InstanceActionsNegativeTestJSON-798494215-project Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: f64ab5c3849f4a8189623b1247eed046 Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-798494215-project Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 could not be found. Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '60bc49e1-3563-4c78-86f1-d5a28f36ee64'} Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 could not be found. Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 could not be found. Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:23.198055 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 could not be found. Aug 27 03:35:23.203636 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:35:23.205779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] Returning 404 to user: Instance 60bc49e1-3563-4c78-86f1-d5a28f36ee64 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:35:23.210919 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14b137b7-daa0-4652-8d3c-469ea4cbb2ec tempest-InstanceActionsNegativeTestJSON-798494215 tempest-InstanceActionsNegativeTestJSON-798494215-project] 10.222.0.69 "GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64" status: 404 len: 111 microversion: 2.1 time: 0.111855 Aug 27 03:35:23.213189 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2906/5580] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:23 2022] GET /compute/v2.1/servers/60bc49e1-3563-4c78-86f1-d5a28f36ee64 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:23.222697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f80e26a-a3a7-46ad-b8a3-9f19c7d011eb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:23.232186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3f80e26a-a3a7-46ad-b8a3-9f19c7d011eb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:23.661905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3f80e26a-a3a7-46ad-b8a3-9f19c7d011eb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.671109 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f80e26a-a3a7-46ad-b8a3-9f19c7d011eb tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1241 microversion: 2.1 time: 0.455285 Aug 27 03:35:23.678252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.682685 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2907/5581] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:23 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1241 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:23.689073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:23.689673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:23.691702 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2fc96fa8-ac9f-4ea8-a2a6-fa4ab981acb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 1.520523 Aug 27 03:35:23.698003 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2675/5582] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:22 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:23.699263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:23.700411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:23.701409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:23.702031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:23.702588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:23.703022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:23.718655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:23.852902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.862098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.863900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:23.865277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-314cb2e3-cf35-4a3f-9a12-ff4cd895e533 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1335 microversion: 2.57 time: 0.181415 Aug 27 03:35:23.866851 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2908/5583] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:23 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1335 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:24.124571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:24.125525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:24.139618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.143312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.144005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:24.148685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.149464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.150083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:24.310322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:24.321006 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a1f9600-6650-43d3-b27e-7bf66a3aeaec tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1288 microversion: 2.1 time: 0.201603 Aug 27 03:35:24.322392 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2676/5584] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:24 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1288 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:24.706111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:24.706757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:24.724590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:24.725205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:24.736059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.736781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.737453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.738080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:24.738772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.741334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.741986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:24.743787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.744978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:24.747773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:24.748574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:24.751801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.367096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.381937 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0e394ba-7dc3-4fbc-bb9e-8bafeb58a654 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1237 microversion: 2.1 time: 0.680371 Aug 27 03:35:25.382586 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2909/5585] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:24 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1237 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:25.396112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.422935 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58a34389-b976-4897-8322-0ed7c2eb7138 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 0.702476 Aug 27 03:35:25.424363 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2677/5586] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:24 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:25.426146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:25.429058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:25.433488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:25.440472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:25.447083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.447840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.449445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.451894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.454128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.454811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.460423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.461186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.462094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.463557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.467191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.467899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.728415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.740989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.747152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.751466 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f82be3aa-ce1b-4ce2-8b65-61655ab9528e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1356 microversion: 2.57 time: 0.334937 Aug 27 03:35:25.769821 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2910/5587] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:25 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1356 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:25.781817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:25.785426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:25.792444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.793442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.794399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.795423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:25.796143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:25.796960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:25.900113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:25.917800 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd8077b0-32ef-4bbb-a62b-101c8a7548da tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1294 microversion: 2.1 time: 0.490156 Aug 27 03:35:25.931757 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2678/5588] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:25 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1294 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:25.976996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:25.978319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:25.978944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:25.979898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:25.980500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:26.093776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:26.107674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.108194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.110460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.112073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.120761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.121409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.186383 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9cf5bcd4-0369-4bb6-a66e-e2b8614e1237 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "POST /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf/action" status: 202 len: 1137 microversion: 2.57 time: 0.410283 Aug 27 03:35:26.187906 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2911/5589] 10.222.0.69 () {62 vars in 1320 bytes} [Sat Aug 27 03:35:25 2022] POST /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf/action => generated 1137 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 03:35:26.212223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.214329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:26.242108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.250091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.250809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.260160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.260736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.266109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.412795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.415081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:26.429747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.430710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.431354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.432321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.432956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.433560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.539303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.554030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.555628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.556861 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-289f2e9e-47c5-4959-a5d5-5daa748e141b tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.350872 Aug 27 03:35:26.557435 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2679/5590] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:26 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:26.561342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:26.572773 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fb0ed230-953f-452e-8280-4f1f4cff3ac4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1299 microversion: 2.1 time: 0.167591 Aug 27 03:35:26.577434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.578321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:26.592550 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2912/5591] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:26 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:26.594738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.595244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.600386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.601317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.601806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.602271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.861947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9413b61-afe5-47de-b6d0-a0c7eb233b2a tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] Calling method '.version_select at 0x7fe457228ca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.932358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9413b61-afe5-47de-b6d0-a0c7eb233b2a tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07/defaults" status: 200 len: 371 microversion: 2.1 time: 0.338425 Aug 27 03:35:26.933587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2913/5592] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:35:26 2022] GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07/defaults => generated 371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:26.943272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:26.944852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:26.962004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.963424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.966901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:26.970060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:26.971737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:26.972841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:27.080040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:27.095713 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4362bb4d-f0a4-47f7-ab8b-7dfab3ca392e tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1294 microversion: 2.1 time: 0.156887 Aug 27 03:35:27.097088 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2914/5593] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:26 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:27.117334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d23a388e-8fc0-4b16-897d-ddf6669bc5f4 tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] Calling method '.version_select at 0x7fe457117160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.260353 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d23a388e-8fc0-4b16-897d-ddf6669bc5f4 tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07" status: 200 len: 371 microversion: 2.1 time: 0.161745 Aug 27 03:35:27.271264 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2915/5594] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:35:27 2022] GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07 => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:27.281894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6a7371a6-a918-4aeb-835c-4825dfb58d29 tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] Calling method '.version_select at 0x7fe457cce670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.383079 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6a7371a6-a918-4aeb-835c-4825dfb58d29 tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07/defaults" status: 200 len: 371 microversion: 2.1 time: 0.106916 Aug 27 03:35:27.394353 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2916/5595] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 03:35:27 2022] GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07/defaults => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:27.400821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed313a32-9a83-4d77-9a82-641f2a63894f tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] Calling method '.version_select at 0x7fe457cce4c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.482062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed313a32-9a83-4d77-9a82-641f2a63894f tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07" status: 200 len: 371 microversion: 2.1 time: 0.084418 Aug 27 03:35:27.490104 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2917/5596] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 03:35:27 2022] GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:27.495654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2059f68-290f-45d5-ad90-0224dfd5e5d5 tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] Calling method '.version_select at 0x7fe457112d30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.598247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:27.618305 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2059f68-290f-45d5-ad90-0224dfd5e5d5 tempest-QuotasTestJSON-1653142332 tempest-QuotasTestJSON-1653142332-project] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07?user_id=731fe4991854491cb4bde679a836f3c8" status: 200 len: 371 microversion: 2.1 time: 0.126477 Aug 27 03:35:27.633096 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2918/5597] 10.222.0.69 () {58 vars in 1323 bytes} [Sat Aug 27 03:35:27 2022] GET /compute/v2.1/os-quota-sets/f0bcdc0839e74bb79181318be580fa07?user_id=731fe4991854491cb4bde679a836f3c8 => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:27.648757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.653481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:27.673261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:27.674070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:27.679607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:27.680593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:27.681728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:27.682365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:27.834038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:27.850553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:27.854511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:27.863743 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-116c4af2-534c-4d9c-a6f5-49426599bf2a tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.216359 Aug 27 03:35:27.878623 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2919/5598] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:27 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:27.878623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:27.878623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:27.885631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:27.893076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:27.894970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:27.897230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:27.898923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:27.902445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:28.073323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:28.083185 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b288b1e7-a1c0-4a71-9043-6ea5bee08927 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1169 microversion: 2.1 time: 1.520485 Aug 27 03:35:28.091225 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2680/5599] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:26 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1169 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:28.117062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:28.117682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:28.129353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:28.130457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:28.133048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:28.134869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:28.135610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:28.137845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:28.238358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:28.246833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-46a349b4-c47b-4195-8aea-49a8f3b9b2f9 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1299 microversion: 2.1 time: 0.380075 Aug 27 03:35:28.254883 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2920/5600] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:27 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1299 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:28.348059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:28.379926 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eaf7f193-8d55-4635-aafa-b3707e13e26d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1294 microversion: 2.1 time: 0.263192 Aug 27 03:35:28.379926 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2681/5601] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:28 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1294 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:28.892773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:28.893587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:28.905971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:28.907565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:28.908602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:28.910905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:28.911556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:28.918615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.020027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.037614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.039908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.041606 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5688e861-3f03-49bb-82d6-35c000448199 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.154374 Aug 27 03:35:29.042597 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2921/5602] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:28 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:29.121067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:29.122990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:29.135640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.136870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.139297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.141882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.144176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.145257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.275309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:29.276005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:29.283388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.284309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.284967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.285905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.286584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.287391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.411662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.454297 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e7725d0-014e-4c63-8ee3-dad9aa0e996f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1299 microversion: 2.1 time: 0.183511 Aug 27 03:35:29.456506 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2922/5603] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:29 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:29.477779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:29.479133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:29.493726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.495533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.498149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.499370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.501653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.503292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.901948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.923157 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d475c32-4cd9-47ec-a56e-6a09f7c52574 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.807282 Aug 27 03:35:29.924097 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2682/5604] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:29 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:30.072551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:30.073861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:30.089298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.092849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.094770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.095775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.098912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.099743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.276813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.303462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.308112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.319004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb9ebf98-e102-4fcc-ab4f-0ba307cb4626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.256016 Aug 27 03:35:30.321695 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2683/5605] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:30 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:35:30.407042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.425992 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a2df85a-a762-47d4-b4e7-95309914af8f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.967290 Aug 27 03:35:30.438666 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2923/5606] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:29 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:30.491664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:30.493431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:30.530550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.543013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.544260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.549271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.549271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.549271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.945224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:30.946155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:30.955043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.955849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.956465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.957361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.957992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.958649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.187979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.201143 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-809f116b-75d7-48fa-91d5-1756fab687a7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.258375 Aug 27 03:35:31.204080 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2924/5607] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:30 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:31.346997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:31.347861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:31.355558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.356603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.357041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.357754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.358231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.358664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.536801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.550654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.553679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.557058 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a9c608d-e04f-4046-8dbd-eca399d03a8c tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.214102 Aug 27 03:35:31.560602 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2925/5608] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:31 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:31.584760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:31.586753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:31.603709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:31.605327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.607360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.608078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.609043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.610640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.611319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.663055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:31.677825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.694851 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fcbc185a-8742-4843-82e6-c7ec06c4bb81 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 1.221618 Aug 27 03:35:31.715257 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2684/5609] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:30 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:31.961317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:31.970832 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-72d8d2d3-eebf-42ee-9d82-73f01af0ba2c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.408630 Aug 27 03:35:31.976115 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2926/5610] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:31 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:32.223913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:32.224920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:32.240576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.241419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.242089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.243093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.243803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.246935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.351119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8b279cdf-b02a-4f46-ad70-14aa91181b4b req-0d558df3-9c2f-40ee-8d5c-c2fb76fcc28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522a469d-b53a-4510-ae9f-51003ace8d65", "tag": "5937c398-8938-40bd-8c60-16b11ade4875"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:32.367978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b279cdf-b02a-4f46-ad70-14aa91181b4b req-0d558df3-9c2f-40ee-8d5c-c2fb76fcc28c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.371151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b279cdf-b02a-4f46-ad70-14aa91181b4b req-0d558df3-9c2f-40ee-8d5c-c2fb76fcc28c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.374448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8b279cdf-b02a-4f46-ad70-14aa91181b4b req-0d558df3-9c2f-40ee-8d5c-c2fb76fcc28c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.400693 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8b279cdf-b02a-4f46-ad70-14aa91181b4b req-0d558df3-9c2f-40ee-8d5c-c2fb76fcc28c service nova] Creating event network-changed:5937c398-8938-40bd-8c60-16b11ade4875 for instance 522a469d-b53a-4510-ae9f-51003ace8d65 on n-h2-852086-5 Aug 27 03:35:32.407818 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8b279cdf-b02a-4f46-ad70-14aa91181b4b req-0d558df3-9c2f-40ee-8d5c-c2fb76fcc28c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062897 Aug 27 03:35:32.409066 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2927/5611] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:32.584618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:32.586152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:32.595191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.596097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.596811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.597978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.598751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.599412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.678624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:32.682956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:32.788630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.819116 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58cf1374-22e1-4ac3-a699-5f160ec6d4e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.586142 Aug 27 03:35:32.819116 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2685/5612] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:32 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:32.819297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:32.819990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:32.847335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.848736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.849531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.850889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:32.852477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:32.853109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.905611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.925914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.928571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.930107 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7be4b027-53a5-482b-a5c6-107552b5d1cb tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.350497 Aug 27 03:35:32.931365 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2928/5613] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:32 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:33.002489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:33.003506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:33.009954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.011686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.013003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.014054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.014603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.015105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.285918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:33.295837 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f8b36d7-fa85-4a92-aaea-f059387278ed tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.299242 Aug 27 03:35:33.298089 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2929/5614] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:32 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:33.425185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:33.437261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4e95229-7fab-4688-b35a-efc21a95026f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.622581 Aug 27 03:35:33.438593 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2686/5615] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:32 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:33.839705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:33.842471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:33.849907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.850922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.851501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.852627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.855139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.856708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.956576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:33.958724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:33.961678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:33.989103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.989618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.990065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.991024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.991467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.991903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.184627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.196044 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-84dcb502-a42e-4439-8408-976830f894d0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.360600 Aug 27 03:35:34.211883 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2930/5616] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:33 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:34.247523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.274288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.276123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.278277 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3cdfa62-df20-4a99-a0ff-1790d940e839 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.328234 Aug 27 03:35:34.290205 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2687/5617] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:33 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:34.321869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:34.322973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:34.338193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.345338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.346532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.347571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.349115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.350205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.457734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6b084eae-706d-44b4-8c95-8048cfd96af0 req-d4a58e27-4f19-4dfa-9f31-bf258ea1b5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef08a1a2-c052-4cb7-880c-fc452640df30", "tag": "4d430637-16ae-4b87-8d93-0213f6b43dd8"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:34.487074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6b084eae-706d-44b4-8c95-8048cfd96af0 req-d4a58e27-4f19-4dfa-9f31-bf258ea1b5e5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.487989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6b084eae-706d-44b4-8c95-8048cfd96af0 req-d4a58e27-4f19-4dfa-9f31-bf258ea1b5e5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.488801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6b084eae-706d-44b4-8c95-8048cfd96af0 req-d4a58e27-4f19-4dfa-9f31-bf258ea1b5e5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.509693 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6b084eae-706d-44b4-8c95-8048cfd96af0 req-d4a58e27-4f19-4dfa-9f31-bf258ea1b5e5 service nova] Creating event network-changed:4d430637-16ae-4b87-8d93-0213f6b43dd8 for instance ef08a1a2-c052-4cb7-880c-fc452640df30 on n-h2-852086-5 Aug 27 03:35:34.516902 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6b084eae-706d-44b4-8c95-8048cfd96af0 req-d4a58e27-4f19-4dfa-9f31-bf258ea1b5e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068179 Aug 27 03:35:34.517830 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2688/5618] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:34.526956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:34.528633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:34.543743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.544532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.545336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.546523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.547196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.547814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.854512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.872625 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d37bdb0-1742-4eaf-b326-c14b5a47f713 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.353019 Aug 27 03:35:34.873455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2689/5619] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:34 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:34.886558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.895344 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4ea39d22-2df0-4c46-bb86-3ac0dd709808 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.580626 Aug 27 03:35:34.896299 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2931/5620] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:34 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:35.204638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9dde970-1492-487d-bd6b-590a40928b43 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe4577891f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:35.218824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:35.219450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:35.232517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.233023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.233469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:35.234219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.234685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.235119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:35.314479 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9dde970-1492-487d-bd6b-590a40928b43 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4558e006-42ea-4599-a0a2-e0b1ea370be8" status: 200 len: 350 microversion: 2.1 time: 0.114064 Aug 27 03:35:35.332633 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2690/5621] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:35:35 2022] GET /compute/v2.1/os-volumes/4558e006-42ea-4599-a0a2-e0b1ea370be8 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:35.340919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:35.341580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:35.361095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.361517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.365003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:35.368125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.368831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.369294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:35.773219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.780573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:35.785011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.792249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.794255 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba1b5f6a-340e-4744-bef6-f0a656a200ba tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.460075 Aug 27 03:35:35.804601 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2691/5622] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:35 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:35.894747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:35.895524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:35.923841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.926749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.928676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:35.931178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.939953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.941022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.203233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.220255 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9cfe552-5923-44ac-877d-eb14b1b2292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 1.005906 Aug 27 03:35:36.221155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2932/5623] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:35 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:36.229881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:36.232020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:36.253830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.254119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.254597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.255415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.255884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.256343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.551419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.567097 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-877dca89-f409-41ad-8d0e-a3c6bb1e577d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.676828 Aug 27 03:35:36.568487 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2692/5624] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:35 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:36.811895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.825264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d15f4e92-60dc-4bda-8131-28dc8c45b7e4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.602829 Aug 27 03:35:36.828448 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2933/5625] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:36 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:36.829566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:36.830321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:36.846100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.846783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.847295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.848335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.849326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.849918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.079501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:37.098295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:37.101778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:37.103845 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab807ef2-3508-4114-ab85-a4f4cf97839e tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.278925 Aug 27 03:35:37.104936 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2693/5626] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:36 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:37.257431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:37.258278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:37.280185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.281008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.281672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.282587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.286347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.287195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.589198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:37.590674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:37.609539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.609824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=28 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:37.611756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.612517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.613475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.615025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.616014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.661189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:37.671041 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7744b63c-7b8a-4daa-8a4d-34efcc1a292a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.424078 Aug 27 03:35:37.672769 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2934/5627] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:37 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:37.851630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:37.852382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:37.869045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.869553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.869988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.870743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.871274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.872699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:38.181839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.187041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.200762 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd9c4958-5afb-4725-8946-5ed50dda6df0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.615236 Aug 27 03:35:38.203208 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2694/5628] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:37 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:38.205186 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b52e4d85-ab71-4752-8870-a5dc660dec07 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.361679 Aug 27 03:35:38.206665 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2935/5629] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:37 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:38.212007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a650ee87-a965-4593-8060-a9e5f0efd01d tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe457d724c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:38.233682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:38.237031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:38.253164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:38.255979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:38.256488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:38.261498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:38.262999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:38.264051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:38.312334 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a650ee87-a965-4593-8060-a9e5f0efd01d tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/ffc91664-680c-4670-94b9-9fe9e5007cb9" status: 200 len: 351 microversion: 2.1 time: 0.104281 Aug 27 03:35:38.315383 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2936/5630] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:35:38 2022] GET /compute/v2.1/os-volumes/ffc91664-680c-4670-94b9-9fe9e5007cb9 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:38.581900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.596789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.602962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:38.608027 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e57a6fb8-665a-4901-a82e-ffeeac754677 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.400280 Aug 27 03:35:38.610712 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2695/5631] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:38 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:38.693497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:38.694123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:38.715623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:38.718903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:38.719531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:38.722615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:38.726694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:38.728996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.106979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:39.119565 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbc4b6ef-fe67-48f4-8168-7f649ae45a1a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.429965 Aug 27 03:35:39.134932 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2937/5632] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:38 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:39.224372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:39.225075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:39.232603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:39.233502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:39.241295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.242184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.242812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.243705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.244342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.244926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.252890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.253421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.253921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.261232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.262408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.262869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.987153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.023570 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6851e2d9-585d-4150-a465-cc4e29e29563 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.792499 Aug 27 03:35:40.024707 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2938/5633] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:39 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:40.033800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:40.037784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:40.062077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.062726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.067521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:40.068556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.070084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.071139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:40.097659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.112020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd2944e8-9b12-4b4b-bd0c-bb7432e58d58 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.891656 Aug 27 03:35:40.113407 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2696/5634] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:39 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:40.142829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:40.143730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:40.159300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.160113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.160732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:40.161628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.162288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.162879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:40.371856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.385885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.390511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.394117 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7dc7fe3b-047a-4e93-b1c7-279c9922ca4f tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.366696 Aug 27 03:35:40.397177 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2939/5635] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:40 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:40.862545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.871153 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb13cca1-ef89-4d98-a4d3-dcfbb6ae2e2b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.732514 Aug 27 03:35:40.883251 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2697/5636] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:40 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:41.052711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:41.053706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:41.064580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:41.073328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2885305-db0f-4c22-b9c0-9f3e5fba5be7 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe4573e3a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:41.081762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:41.082606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:41.083619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:41.085517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:41.086986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:41.204540 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2885305-db0f-4c22-b9c0-9f3e5fba5be7 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/6c194e31-f8fc-4ca2-adac-eaa6409f694b" status: 200 len: 350 microversion: 2.1 time: 0.135029 Aug 27 03:35:41.206652 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2698/5637] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:35:41 2022] GET /compute/v2.1/os-volumes/6c194e31-f8fc-4ca2-adac-eaa6409f694b => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:41.217446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:41.219213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:41.228346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:41.230076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:41.231543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:41.232796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:41.233508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:41.234369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:41.740209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:41.761643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-daca6fcf-a153-4ff6-bc47-0ce25a262ab4 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.715749 Aug 27 03:35:41.765212 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2940/5638] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:41 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:41.778005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20abd1ad-543d-42cd-8d56-2efca5e123fc tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe457026940>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:41.928429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:41.947979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bfad54f4-bb8c-4284-8624-69e293c90b16 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.737484 Aug 27 03:35:41.954011 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2699/5639] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:41 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:41.974390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:41.978441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:41.997961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:41.998484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:41.999143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.000051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.000700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.001296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.001668 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20abd1ad-543d-42cd-8d56-2efca5e123fc tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.233782 Aug 27 03:35:42.002854 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2941/5640] 10.222.0.69 () {58 vars in 1134 bytes} [Sat Aug 27 03:35:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:42.018957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.021166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:42.039431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.041352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.042713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.045676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.047448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.048126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.192752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.216653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.218553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.220657 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-323c17fe-dbd6-4edc-ae7e-636e8797c9c7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.264925 Aug 27 03:35:42.235309 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2700/5641] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:41 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:42.240487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c5d4968-45ef-489b-9d1f-f539f46ded56 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe457541c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.361167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.375779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6dd54367-40c8-41f1-80de-e9df4acbb408 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.371018 Aug 27 03:35:42.376103 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2942/5642] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:42.441299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c5d4968-45ef-489b-9d1f-f539f46ded56 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.204682 Aug 27 03:35:42.442406 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2701/5643] 10.222.0.69 () {58 vars in 1149 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:42.461212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eb530e9c-df12-49bb-8ccc-fcbab1c44127 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe457ce4d30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.563988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7b593231-9d28-4de1-8695-11453c45fd24 req-f1df9133-643c-4e09-94a3-2e0fdcd6d3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e034924-61bd-42a5-a090-6ba7f7a5cca1", "name": "network-vif-plugged", "status": "completed", "tag": "a2598959-09aa-488d-b7b8-d769d4a80c7c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:42.612915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b593231-9d28-4de1-8695-11453c45fd24 req-f1df9133-643c-4e09-94a3-2e0fdcd6d3bf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.615355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b593231-9d28-4de1-8695-11453c45fd24 req-f1df9133-643c-4e09-94a3-2e0fdcd6d3bf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.616244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b593231-9d28-4de1-8695-11453c45fd24 req-f1df9133-643c-4e09-94a3-2e0fdcd6d3bf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.634455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eb530e9c-df12-49bb-8ccc-fcbab1c44127 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.179456 Aug 27 03:35:42.635069 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2943/5644] 10.222.0.69 () {58 vars in 1134 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:42.650887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1241ab5d-9886-4307-9260-79e7ad8ca5a7 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe45700bca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.664490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7b593231-9d28-4de1-8695-11453c45fd24 req-f1df9133-643c-4e09-94a3-2e0fdcd6d3bf service nova] Creating event network-vif-plugged:a2598959-09aa-488d-b7b8-d769d4a80c7c for instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 on n-h1-852086-5 Aug 27 03:35:42.709876 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7b593231-9d28-4de1-8695-11453c45fd24 req-f1df9133-643c-4e09-94a3-2e0fdcd6d3bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161165 Aug 27 03:35:42.711503 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2702/5645] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:42.789466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.792495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:42.805611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.810345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.811262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.812511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.815930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.824899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.877523 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1241ab5d-9886-4307-9260-79e7ad8ca5a7 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.230559 Aug 27 03:35:42.886365 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2944/5646] 10.222.0.69 () {58 vars in 1167 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:42.892697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8dc5c246-0459-43d8-ac5c-b2ae554d4d37 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe45700b160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.079953 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8dc5c246-0459-43d8-ac5c-b2ae554d4d37 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.191188 Aug 27 03:35:43.080599 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2945/5647] 10.222.0.69 () {58 vars in 1170 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:43.091023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.091685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:43.114853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.115351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.115790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.116510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.116965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.117391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.568218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:43.607634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f99d26a-c546-427f-800e-677256b566ff tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.811938 Aug 27 03:35:43.610856 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2703/5648] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:43.628885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bd62732-61b6-43c9-baca-daf2d644119b tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe4601cee50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.750369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:43.764972 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f3090ca-8617-4e9f-bfe5-fc1a4720e4d8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.679314 Aug 27 03:35:43.781432 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2946/5649] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:43 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:43.802277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.802896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:43.811133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.811656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.812107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.819946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.820467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.820912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.826439 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bd62732-61b6-43c9-baca-daf2d644119b tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.214068 Aug 27 03:35:43.827892 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2704/5650] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:35:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:43.833335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.836789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:43.875379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.876239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.877872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.878903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.879932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.880772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:44.015295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.026334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.036426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.039216 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e05d4f35-ac33-4d85-97b7-cb8e159866a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.254472 Aug 27 03:35:44.055695 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2947/5651] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:43 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:44.068401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bbd6c7e8-b021-4c78-84be-5c037a30a3b4 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe45700bc10>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:44.228797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bbd6c7e8-b021-4c78-84be-5c037a30a3b4 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.165472 Aug 27 03:35:44.237548 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2948/5652] 10.222.0.69 () {58 vars in 1188 bytes} [Sat Aug 27 03:35:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:44.260608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab7f7d73-5797-422d-aed6-d9bc620ecef5 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] Calling method '.version_select at 0x7fe457e03a60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:44.448810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab7f7d73-5797-422d-aed6-d9bc620ecef5 tempest-VolumesTestJSON-1685378948 tempest-VolumesTestJSON-1685378948-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197375 Aug 27 03:35:44.449437 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2949/5653] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:35:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:44.636287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:44.645871 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f56e54f7-518d-44bc-a8dc-bf07fd6b7746 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1203 microversion: 2.1 time: 0.816648 Aug 27 03:35:44.646528 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2705/5654] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:43 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1203 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:44.679280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:44.680215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:44.698696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:44.699968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:44.700616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:44.701492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:44.702017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:44.702554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:44.836636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-229577467", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "a7e3906b-d65d-47c7-ab34-e15c1fbccb18"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:44.917130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] validate_networks() for [('a7e3906b-d65d-47c7-ab34-e15c1fbccb18', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:35:45.472175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:45.503586 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5953a4fb-d072-43d0-bad6-5a7953c3859c tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.838588 Aug 27 03:35:45.514553 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2706/5655] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:44 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:45.529814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d9ad9b27-eee5-4c42-aee5-1a2fc2565667 req-614ada10-4655-4abb-9e28-8233a4f381cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522a469d-b53a-4510-ae9f-51003ace8d65", "name": "network-vif-plugged", "status": "completed", "tag": "5937c398-8938-40bd-8c60-16b11ade4875"}, {"server_uuid": "ef08a1a2-c052-4cb7-880c-fc452640df30", "name": "network-vif-plugged", "status": "completed", "tag": "4d430637-16ae-4b87-8d93-0213f6b43dd8"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:45.588364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d9ad9b27-eee5-4c42-aee5-1a2fc2565667 req-614ada10-4655-4abb-9e28-8233a4f381cb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:45.589598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d9ad9b27-eee5-4c42-aee5-1a2fc2565667 req-614ada10-4655-4abb-9e28-8233a4f381cb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:45.590782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d9ad9b27-eee5-4c42-aee5-1a2fc2565667 req-614ada10-4655-4abb-9e28-8233a4f381cb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:45.653487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d9ad9b27-eee5-4c42-aee5-1a2fc2565667 req-614ada10-4655-4abb-9e28-8233a4f381cb service nova] Creating event network-vif-plugged:5937c398-8938-40bd-8c60-16b11ade4875 for instance 522a469d-b53a-4510-ae9f-51003ace8d65 on n-h2-852086-5 Aug 27 03:35:45.659276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d9ad9b27-eee5-4c42-aee5-1a2fc2565667 req-614ada10-4655-4abb-9e28-8233a4f381cb service nova] Creating event network-vif-plugged:4d430637-16ae-4b87-8d93-0213f6b43dd8 for instance ef08a1a2-c052-4cb7-880c-fc452640df30 on n-h2-852086-5 Aug 27 03:35:45.684506 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d9ad9b27-eee5-4c42-aee5-1a2fc2565667 req-614ada10-4655-4abb-9e28-8233a4f381cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.167002 Aug 27 03:35:45.688269 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2707/5656] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:45.722745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:45.724070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:45.765206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:45.768149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:45.769382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:45.770935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:45.772032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:45.773029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.196394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:46.197021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:46.197299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:46.197724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:46.198142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:46.215046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.215948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.216718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.217682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.218365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.219233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.243503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Getting quotas for project bf2bcb968fd242fea700be1c43281923. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:46.251255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Getting quotas for user d9257fe1d3c941b59aa67541acdebcd9 and project bf2bcb968fd242fea700be1c43281923. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:46.268374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:35:46.271484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:35:46.363084 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3abdc34b-fe28-4a8a-88ee-10bf0632337d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.911980 Aug 27 03:35:46.366253 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2950/5657] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:35:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:46.378024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:46.389045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:46.400572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.401077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.401593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.402985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.403992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.404655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.568827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.577228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eec4b9a5-3eda-4ca8-b79c-f1feecc20e9c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.887146 Aug 27 03:35:46.581099 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2708/5658] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:45 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:46.594272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:46.599176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:46.610891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.620925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.621978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.622608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.623369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.623836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.624263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.630066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.641850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.646355 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9998d8f2-131e-4072-ae96-9caeb5f309af tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.276754 Aug 27 03:35:46.650736 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2951/5659] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:46 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:46.662318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f2260a4-1302-4a20-919d-1cb8c149fc61 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:46.685214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2f2260a4-1302-4a20-919d-1cb8c149fc61 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:46.862282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2f2260a4-1302-4a20-919d-1cb8c149fc61 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.872554 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f2260a4-1302-4a20-919d-1cb8c149fc61 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1215 microversion: 2.1 time: 0.218804 Aug 27 03:35:46.873418 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2952/5660] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:46 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:46.898916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:46.899527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:46.924069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.924559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.925263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.925993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.926920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.933567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.321131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:47.323698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:47.341742 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2863222-91ff-4dbd-a17f-b43cb055d6ae tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1362 microversion: 2.1 time: 0.446570 Aug 27 03:35:47.349660 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2953/5661] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:46 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1362 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:47.604332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:47.606640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:47.635401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.637995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.639309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.641137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.641936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.642691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.756228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:47.842002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cf2a1c6-18f9-4ac3-a768-de1a7ff3c6b8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1390 microversion: 2.1 time: 1.258905 Aug 27 03:35:47.847220 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2709/5662] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:46 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1390 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:47.878490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:47.881434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:47.921642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.923115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.923902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.928313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.932053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.932896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.229003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.255383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.264584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.272268 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-840c7a4a-7b2c-4942-856f-9898c07b50b7 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.421037 Aug 27 03:35:48.275007 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2710/5663] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:47 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:48.288290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:48.290488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:48.321280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.323752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.323991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.331782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.333694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.335122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.336128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.365925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64c7ca6e-bf27-4327-a447-445270c8d865 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1367 microversion: 2.1 time: 0.767475 Aug 27 03:35:48.376839 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2954/5664] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:47 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1367 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:48.404657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:48.408746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:48.443405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.448211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.451416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.459964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.461249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.463112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.715331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.733612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd2a088c-bf47-4c93-94bc-3f6cc6b486ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1390 microversion: 2.1 time: 0.453487 Aug 27 03:35:48.734418 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2711/5665] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:48 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1390 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:48.794485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.805311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-812d6ef7-02b0-47f4-8c74-180ebccd79c6 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1267 microversion: 2.1 time: 0.426868 Aug 27 03:35:48.805892 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2955/5666] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:48 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1267 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:48.815425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:48.816564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:48.842151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.843617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.844849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.846273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.847339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.848080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.986302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1612474146", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:49.151406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] validate_networks() for [('422db272-c487-4add-b323-265f4522d2a6', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:35:49.324574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:49.344414 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e87f8a60-1505-44db-a1e2-1a972801eb11 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1549 microversion: 2.1 time: 0.532901 Aug 27 03:35:49.345483 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2956/5667] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:48 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1549 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:49.353342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:49.353955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:49.380974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.381485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.381926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:49.382663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.385599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.389545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:49.876608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:49.886193 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-794fdbce-5851-47d3-a130-73c239957ee1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1390 microversion: 2.1 time: 0.539413 Aug 27 03:35:49.891944 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2957/5668] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:49 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1390 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:49.900850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:49.906116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:49.915745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.917168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.919879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:49.921482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.923985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.924726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.124742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:50.125843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:50.127427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:50.128167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:50.128797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:50.144335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.145160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.145815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.146770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.147438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.148053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.159471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:50.171455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:50.173045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:50.178119 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fe7c3257-869d-44c0-acce-7415bc76a849 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.283660 Aug 27 03:35:50.178883 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2958/5669] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:49 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:50.184516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Getting quotas for project 20304639bd4b4e86a15f459737018380. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:35:50.197342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Getting quotas for user 54e1a51938c84fa2ba09cb6794883dd5 and project 20304639bd4b4e86a15f459737018380. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:35:50.200549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:50.203271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:50.221590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.222602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.223624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.224631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.225187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.225840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.234248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:35:50.240344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:35:50.323648 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-711ec5ce-d9fa-4a63-a941-10104d4fe26e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.587118 Aug 27 03:35:50.327490 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2712/5670] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:35:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:35:50.342401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:50.346410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:50.356114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.356643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.357098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.357915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.358411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.358852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.382440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:50.613538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:50.630142 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f511d3db-18dd-4fef-a44c-12fba0c4ee59 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1556 microversion: 2.1 time: 0.299845 Aug 27 03:35:50.631428 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2713/5671] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:50 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1556 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:50.710710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:50.721096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:50.748871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.749737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.763912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.765420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.768936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.769767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:51.117589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:51.154225 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e302f417-a872-4999-b87e-f442e86f2152 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1273 microversion: 2.1 time: 0.464062 Aug 27 03:35:51.160215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2714/5672] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:50 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1273 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:51.202935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:51.204231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:51.240367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:51.246397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:51.251454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:51.255313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:51.258932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:51.263043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:51.430649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:35:51.614289 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e142cc9-9b17-4bfb-bb59-75317411f058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 204 len: 0 microversion: 2.1 time: 0.452296 Aug 27 03:35:51.615400 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2715/5673] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:35:51 2022] DELETE /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:35:51.629279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:51.630338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:51.655347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:51.656158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:51.656723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:51.657851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:51.658452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:51.659159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:51.684126 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-09eb66e6-73f3-4bad-996c-433eb3384edb tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.499960 Aug 27 03:35:51.710028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2959/5674] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:35:50 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-interface => generated 285 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:51.733276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:51.733702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:51.761614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:51.761998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:51.762668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:51.763481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:51.764019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:51.775306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.020325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.031420 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97d6d624-3466-4996-80cb-6429c694a0b6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1227 microversion: 2.1 time: 0.414370 Aug 27 03:35:52.032028 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2716/5675] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:51 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1227 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:52.052386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:52.053021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:52.092807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.093329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.094435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.095210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.101267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.101651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.343639 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f8c8ea88-a5a6-4e80-bade-f2359c48b3f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.631366 Aug 27 03:35:52.344722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.345957 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2960/5676] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 03:35:51 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-interface => generated 284 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:52.360189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:52.361299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:52.376735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.378614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.379827 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0778273a-ef5e-40f7-9a17-7dfb2ab3ee95 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.346862 Aug 27 03:35:52.380401 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2717/5677] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:52 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:52.396314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.396817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.397296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.398202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.398677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.399104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.407520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:52.408141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:52.448645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.449199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.449920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.475893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.477165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.479833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.791489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.813069 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba364ac2-5c3c-4745-a3bb-4ac67ad92e1e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1396 microversion: 2.1 time: 0.464913 Aug 27 03:35:52.813916 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2961/5678] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:52 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1396 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:53.053521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:53.055401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:53.066014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.070326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.071046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.071978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.072442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.072860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.333470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:53.358670 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-88caf510-c9e7-4938-a2ec-fc5c8b1893b0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1219 microversion: 2.1 time: 0.307951 Aug 27 03:35:53.367107 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2962/5679] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:53 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1219 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:53.419272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:53.422783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:53.457467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.458393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.459169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.460407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.461220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.467457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.771082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:53.787938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4491ec5-a457-432a-a604-98b99f252ba2 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 1.406481 Aug 27 03:35:53.788853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2718/5680] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:52 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:53.838406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:53.839295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:53.862505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.873346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.887317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.888660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.889539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.890789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:54.233770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.256629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.262349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.265935 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-75511095-9446-46c3-9212-1f7da1750861 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.855834 Aug 27 03:35:54.267793 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2963/5681] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:53 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:54.391238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:54.391854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:54.406806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:54.408961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:54.412408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:54.414819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:54.418759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:54.425484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:54.631982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.672924 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-becd0507-9406-4a5e-b9f7-c8537f6e71c6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1281 microversion: 2.1 time: 0.285544 Aug 27 03:35:54.675775 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2964/5682] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:54 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1281 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:54.829067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:54.834982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:54.871088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:54.904168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:54.912718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:54.916927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:54.921897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:54.932445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.143730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:55.183246 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a661e8f9-f928-4766-98ca-6d51092c1848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1396 microversion: 2.1 time: 1.349076 Aug 27 03:35:55.205354 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2719/5683] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:53 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1396 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:55.229693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f4e03440-6503-46cf-8b63-aa21149ac6a7 req-1b378823-990e-4148-bf27-ce89d7a266dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b529418-81b1-42de-99b0-7d2421807d26", "tag": "97d09275-55cd-4616-afbe-14ab8a369fba"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:55.255816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f4e03440-6503-46cf-8b63-aa21149ac6a7 req-1b378823-990e-4148-bf27-ce89d7a266dc service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.256305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f4e03440-6503-46cf-8b63-aa21149ac6a7 req-1b378823-990e-4148-bf27-ce89d7a266dc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.256745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f4e03440-6503-46cf-8b63-aa21149ac6a7 req-1b378823-990e-4148-bf27-ce89d7a266dc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.291270 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f4e03440-6503-46cf-8b63-aa21149ac6a7 req-1b378823-990e-4148-bf27-ce89d7a266dc service nova] Creating event network-changed:97d09275-55cd-4616-afbe-14ab8a369fba for instance 1b529418-81b1-42de-99b0-7d2421807d26 on n-h1-852086-5 Aug 27 03:35:55.303096 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f4e03440-6503-46cf-8b63-aa21149ac6a7 req-1b378823-990e-4148-bf27-ce89d7a266dc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095595 Aug 27 03:35:55.307711 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2720/5684] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:55.321904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:55.322726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:55.347619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.348760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.349460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.353665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.354446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.355259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.647985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:55.658783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:55.665333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:55.666660 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e46c2ea-3a23-4d38-8d2f-1561558e3ef6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.357470 Aug 27 03:35:55.690510 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2721/5685] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:55 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:55.707166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:55.708077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:55.729157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.731056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.731849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.738354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.738999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.739625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.073709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.076396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.110223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-609c8a5a-abda-4242-960a-29b95604bd09 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 1.298502 Aug 27 03:35:56.122664 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8daf458-37e9-44eb-8bea-bae9b07195b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1281 microversion: 2.1 time: 0.419182 Aug 27 03:35:56.123968 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2965/5686] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:54 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:56.125280 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2722/5687] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:55 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:56.204918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:56.205612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:56.207692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:56.225593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.226285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.226843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.229771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.231046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.233540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.236542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:56.471157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.483539 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f10a782-0f65-4c8e-9eab-5776f02bcf96 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1396 microversion: 2.1 time: 0.283080 Aug 27 03:35:56.498234 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2966/5688] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:56 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1396 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:56.715182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:56.722117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:56.747150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.749525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.752798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.754820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.758366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.761908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.005299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.075290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.078667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.085727 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-784381bc-db24-4d8a-9bd7-8ab2315658ee tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.387536 Aug 27 03:35:57.089555 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2723/5689] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:56 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:57.153020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.153901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:57.156439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.157050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:57.161627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:57.173318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.173826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.174286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.178885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.179348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.185451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.186094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.190061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.190607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.191361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.191820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.200798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.469913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.482644 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2eda34c7-a401-4e30-8c5d-4cbb8ec88cf6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1281 microversion: 2.1 time: 0.337359 Aug 27 03:35:57.483673 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2724/5690] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:57 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:57.507344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.508262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:57.515860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.516636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.517304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.518213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.519071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.520243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.604802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.618200 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-29fe1376-5f45-48cf-8aba-01ae3a442b68 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 0.474012 Aug 27 03:35:57.639923 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2967/5691] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:57 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:57.879233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:57.892794 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67363214-682b-4431-90e8-1cd0c7dadf3c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1354 microversion: 2.1 time: 0.389675 Aug 27 03:35:57.919250 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2725/5692] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:57 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1354 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:58.048672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-33f219b4-f4ae-4e68-8a73-2f0c772c28b7 req-52eb204c-05bf-43fb-ad84-d657d72e60c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e034924-61bd-42a5-a090-6ba7f7a5cca1", "name": "network-vif-deleted", "tag": "a2598959-09aa-488d-b7b8-d769d4a80c7c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:58.069985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-33f219b4-f4ae-4e68-8a73-2f0c772c28b7 req-52eb204c-05bf-43fb-ad84-d657d72e60c9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:58.070537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-33f219b4-f4ae-4e68-8a73-2f0c772c28b7 req-52eb204c-05bf-43fb-ad84-d657d72e60c9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:58.072436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-33f219b4-f4ae-4e68-8a73-2f0c772c28b7 req-52eb204c-05bf-43fb-ad84-d657d72e60c9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.101478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-33f219b4-f4ae-4e68-8a73-2f0c772c28b7 req-52eb204c-05bf-43fb-ad84-d657d72e60c9 service nova] Creating event network-vif-deleted:a2598959-09aa-488d-b7b8-d769d4a80c7c for instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 on n-h1-852086-5 Aug 27 03:35:58.110942 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-33f219b4-f4ae-4e68-8a73-2f0c772c28b7 req-52eb204c-05bf-43fb-ad84-d657d72e60c9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084440 Aug 27 03:35:58.116681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:58.117308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:58.125825 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2968/5693] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:58.127498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:58.128039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:58.128445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.129162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:58.138151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:58.139153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.290663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:58.304863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:58.306518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:58.311092 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ad78774-7fcb-4849-8c8a-395e069d0626 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1365 microversion: 2.57 time: 0.198381 Aug 27 03:35:58.313866 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2726/5694] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:58 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:35:58.506848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:58.507741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:58.522880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:58.529142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:58.530080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.530889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:58.531380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:58.531815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.649703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:58.650434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:58.668653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:58.669170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:58.669616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.670376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:58.670836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:58.671471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.994799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:59.007371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-455ea8bd-7b94-4394-96d4-f317e2d85361 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.504997 Aug 27 03:35:59.009242 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2969/5695] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:58 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:59.022589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:59.024220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:59.042833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:59.045201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:59.045878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:59.050193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:59.050975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:59.052158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:59.729270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:59.754335 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be24f5b7-6786-4220-913d-5ee23548928f tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 1.109493 Aug 27 03:35:59.773031 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2727/5696] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:58 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:59.786756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:59.788481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:59.818945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:59.822933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:59.825339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:59.830764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:59.831547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:59.832212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:59.991876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.007719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.011791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.013340 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3449ef35-23e0-49bc-84cd-d46a387098a8 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1371 microversion: 2.57 time: 0.238036 Aug 27 03:36:00.016626 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2728/5697] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:35:59 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:00.042415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:00.044334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:00.070293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:00.071964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:00.074374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:00.076099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:00.078466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:00.079183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:00.097206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:00.164942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:00.182629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.217088 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9f5b246b-b5b2-4a1d-a06f-efb8f3d197dc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1188 microversion: 2.1 time: 1.206204 Aug 27 03:36:00.217346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:00.235265 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2970/5698] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:59 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1188 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:00.264198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b0cf1eec-b1fc-4cac-a760-e1a3ce198dab req-734de703-43ec-48e4-91d8-3ae6612c29ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522a469d-b53a-4510-ae9f-51003ace8d65", "tag": "5937c398-8938-40bd-8c60-16b11ade4875"}, {"name": "network-changed", "server_uuid": "ef08a1a2-c052-4cb7-880c-fc452640df30", "tag": "4d430637-16ae-4b87-8d93-0213f6b43dd8"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:00.298215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0cf1eec-b1fc-4cac-a760-e1a3ce198dab req-734de703-43ec-48e4-91d8-3ae6612c29ce service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:00.311715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0cf1eec-b1fc-4cac-a760-e1a3ce198dab req-734de703-43ec-48e4-91d8-3ae6612c29ce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:00.312561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0cf1eec-b1fc-4cac-a760-e1a3ce198dab req-734de703-43ec-48e4-91d8-3ae6612c29ce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:00.367914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b0cf1eec-b1fc-4cac-a760-e1a3ce198dab req-734de703-43ec-48e4-91d8-3ae6612c29ce service nova] Creating event network-changed:5937c398-8938-40bd-8c60-16b11ade4875 for instance 522a469d-b53a-4510-ae9f-51003ace8d65 on n-h2-852086-5 Aug 27 03:36:00.369947 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b0cf1eec-b1fc-4cac-a760-e1a3ce198dab req-734de703-43ec-48e4-91d8-3ae6612c29ce service nova] Creating event network-changed:4d430637-16ae-4b87-8d93-0213f6b43dd8 for instance ef08a1a2-c052-4cb7-880c-fc452640df30 on n-h2-852086-5 Aug 27 03:36:00.385007 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b0cf1eec-b1fc-4cac-a760-e1a3ce198dab req-734de703-43ec-48e4-91d8-3ae6612c29ce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.146812 Aug 27 03:36:00.393855 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2971/5699] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:00.614026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.629546 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c5eabc5-8132-46a8-9e5c-c46d12d277e8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.595435 Aug 27 03:36:00.648616 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2729/5700] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:00 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:00.779705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:00.781478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:00.799726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:00.802713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:00.803420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:00.804426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:00.815030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:00.815826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:00.844964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:01.048039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:01.049329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:01.083583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.086902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.091683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.096005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.099278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.102190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.553166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.565075 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-611bdabf-19d1-4ee3-8ab9-309f785ef095 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 0.789720 Aug 27 03:36:01.592681 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2972/5701] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:00 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:01.597640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:01.598300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:01.631481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.638614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.641515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.642342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.645421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.646183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.690947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.700605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.702079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.703451 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5759cb09-908c-44ba-bbdd-ed949fb72a44 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1371 microversion: 2.57 time: 0.665308 Aug 27 03:36:01.716305 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2730/5702] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:01 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1371 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:01.721860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:01.737035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:01.739110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:01.762731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.763378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.763830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.764788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.765535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.766176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.798073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.808727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ff8633e-5b18-4040-b539-abbf0969d308 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1188 microversion: 2.1 time: 0.214805 Aug 27 03:36:01.821262 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2973/5703] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:01 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1188 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:02.439538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-02afd0ac-1f91-4bfb-9d49-2573ed08f788 req-69416e0c-543e-4062-bc69-82f17cc6e601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec0648d-27c7-4265-8a06-4a5f2e947782", "tag": "42155f03-9d9d-4f7e-81d2-82aacb240280"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:02.468588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-02afd0ac-1f91-4bfb-9d49-2573ed08f788 req-69416e0c-543e-4062-bc69-82f17cc6e601 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:02.469483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-02afd0ac-1f91-4bfb-9d49-2573ed08f788 req-69416e0c-543e-4062-bc69-82f17cc6e601 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:02.471330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-02afd0ac-1f91-4bfb-9d49-2573ed08f788 req-69416e0c-543e-4062-bc69-82f17cc6e601 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:02.491298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:02.492221 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-02afd0ac-1f91-4bfb-9d49-2573ed08f788 req-69416e0c-543e-4062-bc69-82f17cc6e601 service nova] Creating event network-changed:42155f03-9d9d-4f7e-81d2-82aacb240280 for instance dec0648d-27c7-4265-8a06-4a5f2e947782 on n-h1-852086-5 Aug 27 03:36:02.502103 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-02afd0ac-1f91-4bfb-9d49-2573ed08f788 req-69416e0c-543e-4062-bc69-82f17cc6e601 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070263 Aug 27 03:36:02.503439 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2974/5704] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:02.519017 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d051612c-b582-44ce-a02a-75c79946768d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.800702 Aug 27 03:36:02.534711 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2731/5705] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:01 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:02.596887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:02.599062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:02.607952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:02.608761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:02.609377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:02.610579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:02.611661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:02.612663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:02.738407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:02.739785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:02.765560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:02.766857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:02.767649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:02.770211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:02.772544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:02.773829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:02.957236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:02.994307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:02.996937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:02.999861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:03.002059 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98c43ff7-3a58-4419-9d1f-271b80d227a6 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1371 microversion: 2.57 time: 0.272286 Aug 27 03:36:03.008821 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2732/5706] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:02 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:03.023521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:03.024526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:03.024763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5a3f532-4e34-42e0-8d5b-d9a6f7a99875 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 0.429569 Aug 27 03:36:03.050910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:03.052177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:03.053396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:03.055951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:03.056238 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2975/5707] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:02 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:03.057935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:03.059140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:03.207465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:03.216919 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-896ffcc6-6b2a-4135-8867-afd64c2ba0e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1188 microversion: 2.1 time: 0.206314 Aug 27 03:36:03.231186 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2733/5708] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:03 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1188 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:03.576521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:03.583882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:03.630195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:03.632066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:03.638838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:03.639622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:03.640102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:03.640533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.034681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:04.035992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:04.048374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.049425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.050633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.054502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.055225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.055845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.217629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.241160 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f834f23-c32a-4994-a1eb-a103ce033c09 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.703152 Aug 27 03:36:04.246591 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2976/5709] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:03 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:04.257788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:04.259965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:04.286682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.302689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.305320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.308586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.310311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.310964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.379889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.394022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.395507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.397011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8cea15e-c626-4709-aee8-02d667a883a4 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1356 microversion: 2.57 time: 0.366490 Aug 27 03:36:04.401617 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2734/5710] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:04 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1356 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:36:04.419379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:04.420771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:04.440034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.441061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.441603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.442912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.443387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.443793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.641956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.670679 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f02c42f-92f0-4488-bf65-4febc2304f05 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1188 microversion: 2.1 time: 0.263130 Aug 27 03:36:04.685910 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2735/5711] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:04 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:04.686359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.688189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:04.693634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:04.710908 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-122270d7-b77a-4b59-aaa5-57ddd345b917 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 0.460658 Aug 27 03:36:04.711998 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2977/5712] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:04 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:04.716897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.725772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.726906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.728661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-55d92928-e104-4eab-a3a6-092dbefa0946 req-5ecc2e1e-5828-4e7c-9211-ea34b33a86a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b529418-81b1-42de-99b0-7d2421807d26", "name": "network-vif-plugged", "status": "completed", "tag": "97d09275-55cd-4616-afbe-14ab8a369fba"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:04.742285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.747090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.747090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.786810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-55d92928-e104-4eab-a3a6-092dbefa0946 req-5ecc2e1e-5828-4e7c-9211-ea34b33a86a0 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:04.789887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-55d92928-e104-4eab-a3a6-092dbefa0946 req-5ecc2e1e-5828-4e7c-9211-ea34b33a86a0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:04.790929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-55d92928-e104-4eab-a3a6-092dbefa0946 req-5ecc2e1e-5828-4e7c-9211-ea34b33a86a0 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.808635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:36:04.842256 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-55d92928-e104-4eab-a3a6-092dbefa0946 req-5ecc2e1e-5828-4e7c-9211-ea34b33a86a0 service nova] Creating event network-vif-plugged:97d09275-55cd-4616-afbe-14ab8a369fba for instance 1b529418-81b1-42de-99b0-7d2421807d26 on n-h1-852086-5 Aug 27 03:36:04.852806 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-55d92928-e104-4eab-a3a6-092dbefa0946 req-5ecc2e1e-5828-4e7c-9211-ea34b33a86a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138792 Aug 27 03:36:04.863586 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2978/5713] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:05.057691 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4c50c87-238b-4baf-8fec-7add8ff3c928 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 204 len: 0 microversion: 2.57 time: 0.382935 Aug 27 03:36:05.070237 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2736/5714] 10.222.0.69 () {60 vars in 1280 bytes} [Sat Aug 27 03:36:04 2022] DELETE /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:36:05.086563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.091138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:05.114542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.116390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.117159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.118491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.119478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.120037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.273318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.278645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.279830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:05.305370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.306637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.306822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.306933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.308598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.309478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.309621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.310058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.318271 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d24de321-4e50-414f-a855-36ef038a8e23 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1362 microversion: 2.57 time: 0.243040 Aug 27 03:36:05.338246 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2979/5715] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:05 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:05.701405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.702091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:05.710595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.712018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.722607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.724084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.725047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.725761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.905945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.924708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.931438 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-68d288b3-12ea-401d-b5c8-97ae70875014 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1188 microversion: 2.1 time: 0.235313 Aug 27 03:36:05.938856 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2980/5716] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:05 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1188 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:05.939633 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdcfb055-653c-4f9f-9dee-d4f462c6b913 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.667004 Aug 27 03:36:05.941996 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2737/5717] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:05 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:05.972280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.973285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:05.988084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.988588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.989231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.990137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.990779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.991376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:06.247828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.269327 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-01a08bf4-540e-47a3-93cd-8b104f885bdf tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1315 microversion: 2.1 time: 0.324455 Aug 27 03:36:06.270239 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2981/5718] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:05 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:06.356169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:06.358138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:06.377872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:06.378527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:06.379238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:06.380814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:06.381369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:06.381862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:06.573721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.584525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.589551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.595699 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f1e804cf-6d79-467d-a468-f96dd04d4c56 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1362 microversion: 2.57 time: 0.245305 Aug 27 03:36:06.599588 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2738/5719] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:06 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:06.988544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:06.990491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:06.993407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:06.994907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:06.999424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.000013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.000763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.001614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.002399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.003294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.006059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.009548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.010389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.012338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.013679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.014757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.163874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.180862 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-187fb6bf-af7f-4277-b662-d5208a743fc7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1188 microversion: 2.1 time: 0.195452 Aug 27 03:36:07.194648 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2739/5720] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:06 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1188 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:07.239004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.260132 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-27d03b29-9a23-430d-bff5-d4de5621851c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.276062 Aug 27 03:36:07.262525 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2982/5721] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:06 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:07.304649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.305421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:07.321977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.322922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.324251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.325551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.326732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.328427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.594618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.603579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ff6027e-f19f-4d6d-a5d0-c9f1f84018d0 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1502 microversion: 2.1 time: 0.304203 Aug 27 03:36:07.618590 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2740/5722] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:07 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:07.629935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.631047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:07.631519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.632227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:07.639095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.639908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.640576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.641557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.642271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.642928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.650670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.651184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.651634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.662612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.663189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.665996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.804304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-10eeec08-f435-4c3f-b585-22db03bee56e tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.179668 Aug 27 03:36:07.806954 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2741/5723] 10.222.0.69 () {58 vars in 1296 bytes} [Sat Aug 27 03:36:07 2022] DELETE /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26/os-server-password => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:07.812673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.826613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.828290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:07.833270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.834777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:07.835981 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ffc9e960-8820-47f4-806d-553365f224c9 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1362 microversion: 2.57 time: 0.212908 Aug 27 03:36:07.836550 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2983/5724] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:07 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:07.852723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.853659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.854247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.859341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.859990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.861036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.894466 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5a02225-bd6a-4c43-a9ae-cf6e3b942491 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.079982 Aug 27 03:36:07.895558 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2742/5725] 10.222.0.69 () {58 vars in 1293 bytes} [Sat Aug 27 03:36:07 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26/os-server-password => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:36:07.913839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.914593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:07.929635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.929996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.930480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:07.932758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:07.933478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:07.938605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.002662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:36:08.122009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a64372ce-dd39-4e6f-8aa5-879582a966eb req-9e7dab40-fac3-45f4-9d82-85fea812e2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec0648d-27c7-4265-8a06-4a5f2e947782", "name": "network-vif-plugged", "status": "completed", "tag": "42155f03-9d9d-4f7e-81d2-82aacb240280"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:08.134497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a64372ce-dd39-4e6f-8aa5-879582a966eb req-9e7dab40-fac3-45f4-9d82-85fea812e2bd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.135533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a64372ce-dd39-4e6f-8aa5-879582a966eb req-9e7dab40-fac3-45f4-9d82-85fea812e2bd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.137104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a64372ce-dd39-4e6f-8aa5-879582a966eb req-9e7dab40-fac3-45f4-9d82-85fea812e2bd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.141899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:08.153455 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a64372ce-dd39-4e6f-8aa5-879582a966eb req-9e7dab40-fac3-45f4-9d82-85fea812e2bd service nova] Creating event network-vif-plugged:42155f03-9d9d-4f7e-81d2-82aacb240280 for instance dec0648d-27c7-4265-8a06-4a5f2e947782 on n-h1-852086-5 Aug 27 03:36:08.164294 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a64372ce-dd39-4e6f-8aa5-879582a966eb req-9e7dab40-fac3-45f4-9d82-85fea812e2bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047588 Aug 27 03:36:08.166641 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2743/5726] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:36:08.212004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.212728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:08.231335 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac5d9816-955c-42f3-88e7-1208a41253e4 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 204 len: 0 microversion: 2.1 time: 0.325552 Aug 27 03:36:08.234561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.243551 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2984/5727] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:07 2022] DELETE /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:08.252000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.252710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.254537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.255492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.260674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.266579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.270365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:08.293259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.293807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.294303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.295039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.295502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.295942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.327908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.328445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.330389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.330922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid 5e034924-61bd-42a5-a090-6ba7f7a5cca1 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:36:08.405308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:08.415491 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e6205e1-6ebb-48b0-9f65-05d62efb9bbf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1193 microversion: 2.1 time: 0.209117 Aug 27 03:36:08.431715 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2744/5728] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:08 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1193 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:08.437899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.438815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:08.445405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.446356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.447103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.448004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.449446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.450504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.632982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:08.668066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:08.668597 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f24bb7f-94a6-4c90-8352-776ce59b181d tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1508 microversion: 2.1 time: 0.422755 Aug 27 03:36:08.670743 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2985/5729] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:08 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:08.687992 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28d4a414-9a40-4aa9-877b-7b589c77abf0 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.254391 Aug 27 03:36:08.689140 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2745/5730] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:08 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:08.883765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:08.885235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:08.905514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.906870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.907125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.911582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.918823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.919836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.001747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.004073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.006602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.007805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lazy-loading 'fault' on Instance uuid cb0a811e-8972-4ad6-991a-af07b289bddf {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:36:09.112106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.128476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.130134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e9a08e74f794fefaa0da77a868fb354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65aa843cafd04b06877d3d5a5a4b58ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.131506 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e7e27989-d0db-4f0b-bba0-464ee998b239 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 200 len: 1367 microversion: 2.57 time: 0.253727 Aug 27 03:36:09.132533 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2986/5731] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:08 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:36:09.450514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.459032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:09.476136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.478271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.480985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.482192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.483932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.488939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.549706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.550734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.551403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.552052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid 5e034924-61bd-42a5-a090-6ba7f7a5cca1 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:36:09.693846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.694578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:09.710741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.711880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.715550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.718844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.719906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.720437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.786459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.799647 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd980982-6cca-48e6-b137-8cb0660eda0f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 200 len: 1193 microversion: 2.1 time: 0.358446 Aug 27 03:36:09.803437 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2746/5732] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:09 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 1193 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:09.823437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.828157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:09.843030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.843688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.844144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.844889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.845407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.846057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.099082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.116947 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44283441-382e-4c2f-9cff-20cb2116ba07 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1323 microversion: 2.1 time: 0.312207 Aug 27 03:36:10.119876 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2747/5733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:09 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:10.159328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.160133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] [instance: cb0a811e-8972-4ad6-991a-af07b289bddf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:10.166853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.168207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.168787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.169666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.170364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.170901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.188399 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] HTTP exception thrown: Instance cb0a811e-8972-4ad6-991a-af07b289bddf could not be found. Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Request method failure captured: Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf HTTP/1.1 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZD2DzIVuXChuEWI34HCHpxqkiDeDiyfx1wFTDIZMgsLKejZ9n66i3MGe3E-ey8rqYrOSloBRB-V5SWSfMOpbMiU7XKeGT6ZqxGaSmUC83557dkptle7w0m7JcQ1vrctemjVXAA8s2Ubz1ZT6c7cqqtGtr61JcW5xW19sJoLnLbfTAk Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.57 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 65aa843cafd04b06877d3d5a5a4b58ad Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerShowV257Test-199288936 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/65aa843cafd04b06877d3d5a5a4b58ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/65aa843cafd04b06877d3d5a5a4b58ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_65aa843cafd04b06877d3d5a5a4b58ad", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/65aa843cafd04b06877d3d5a5a4b58ad"}]}] Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerShowV257Test-199288936 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 65aa843cafd04b06877d3d5a5a4b58ad Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerShowV257Test-199288936 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerShowV257Test-199288936-project Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 8e9a08e74f794fefaa0da77a868fb354 Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerShowV257Test-199288936-project Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance cb0a811e-8972-4ad6-991a-af07b289bddf could not be found. Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'cb0a811e-8972-4ad6-991a-af07b289bddf'} Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb0a811e-8972-4ad6-991a-af07b289bddf could not be found. Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb0a811e-8972-4ad6-991a-af07b289bddf could not be found. Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:10.193616 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb0a811e-8972-4ad6-991a-af07b289bddf could not be found. Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] Returning 404 to user: Instance cb0a811e-8972-4ad6-991a-af07b289bddf could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bad8c7f9-045a-4c2f-80e2-9f7f56415305 tempest-ServerShowV257Test-199288936 tempest-ServerShowV257Test-199288936-project] 10.222.0.69 "GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf" status: 404 len: 111 microversion: 2.57 time: 0.041169 Aug 27 03:36:10.205128 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2748/5734] 10.222.0.69 () {60 vars in 1277 bytes} [Sat Aug 27 03:36:10 2022] GET /compute/v2.1/servers/cb0a811e-8972-4ad6-991a-af07b289bddf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:36:10.215879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.231629 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-602526d7-bff3-47c6-9482-584a5a665948 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1508 microversion: 2.1 time: 0.541986 Aug 27 03:36:10.233654 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2987/5735] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:09 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:10.834258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.835388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:10.865587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.868867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.869353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.871701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.874283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.877015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.937848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 HTTP/1.1 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '5e034924-61bd-42a5-a090-6ba7f7a5cca1'} Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:10.945102 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:10.950292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:10.953870 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1467f1f-4568-4089-a884-238131ea4248 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 404 len: 111 microversion: 2.1 time: 0.123343 Aug 27 03:36:10.955301 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2749/5736] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:10 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:11.007824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-63dd95a0-13a8-4fa0-818a-d6ed10f8cf32 req-a1cb9dcf-6068-4e99-9097-4126d5eff4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b529418-81b1-42de-99b0-7d2421807d26", "name": "network-vif-deleted", "tag": "97d09275-55cd-4616-afbe-14ab8a369fba"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:11.049039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-63dd95a0-13a8-4fa0-818a-d6ed10f8cf32 req-a1cb9dcf-6068-4e99-9097-4126d5eff4aa service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.050979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-63dd95a0-13a8-4fa0-818a-d6ed10f8cf32 req-a1cb9dcf-6068-4e99-9097-4126d5eff4aa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.051749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-63dd95a0-13a8-4fa0-818a-d6ed10f8cf32 req-a1cb9dcf-6068-4e99-9097-4126d5eff4aa service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.092168 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-63dd95a0-13a8-4fa0-818a-d6ed10f8cf32 req-a1cb9dcf-6068-4e99-9097-4126d5eff4aa service nova] Creating event network-vif-deleted:97d09275-55cd-4616-afbe-14ab8a369fba for instance 1b529418-81b1-42de-99b0-7d2421807d26 on n-h1-852086-5 Aug 27 03:36:11.111809 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-63dd95a0-13a8-4fa0-818a-d6ed10f8cf32 req-a1cb9dcf-6068-4e99-9097-4126d5eff4aa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110720 Aug 27 03:36:11.119629 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2988/5737] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:11.141818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:11.143503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:11.158068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.162867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.163573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.168122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.171884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.177190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.255991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:11.256883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:11.295760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.297159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.301604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.309019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.309946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.314729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.350797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:11.509539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.512360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.512999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.513625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lazy-loading 'fault' on Instance uuid 1b529418-81b1-42de-99b0-7d2421807d26 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:36:11.630580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9257fe1d3c941b59aa67541acdebcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bcb968fd242fea700be1c43281923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.649450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9e19170-6bc8-4887-a807-482269ab530c tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 200 len: 1305 microversion: 2.1 time: 0.399431 Aug 27 03:36:11.653721 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2989/5738] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:11 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 1305 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:11.667463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.693573 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0aac1bb0-34fd-473e-8cc8-c56896aa5bbd tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1518 microversion: 2.1 time: 0.555578 Aug 27 03:36:11.696149 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2750/5739] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:11 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1518 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:11.727761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:11.738103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:11.752016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.765321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.767295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.770049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.771531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.772715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.862686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lazy-loading 'flavor' on Instance uuid dec0648d-27c7-4265-8a06-4a5f2e947782 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:36:12.287475 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8a6b99d3-9de0-41ef-bdf3-64e71d75dbc6 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action" status: 200 len: 32 microversion: 2.1 time: 0.565880 Aug 27 03:36:12.298022 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2990/5740] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:11 2022] POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action => generated 32 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:36:12.303164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:12.304303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:12.316513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:12.320048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:12.322962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:12.324020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:12.326734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:12.327338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:12.629676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.654516 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aeb39655-07f3-44f9-a1ff-f43f938a16b5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.357120 Aug 27 03:36:12.658360 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2751/5741] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:12 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:12.685529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:12.686560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] [instance: 1b529418-81b1-42de-99b0-7d2421807d26] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:12.703803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:12.712150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:12.713031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:12.714657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:12.717843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:12.719864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:12.757047 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] HTTP exception thrown: Instance 1b529418-81b1-42de-99b0-7d2421807d26 could not be found. Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Request method failure captured: Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 HTTP/1.1 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZEQum-c0kL03fJFlmRuF8g7bgHyvoKqFX9Z3-PyfniVT5NPl_6I7O471EA5zTaqblwQwxsRSHarqcH-NJ-EF027OUQ3u7To7AvDfH35LHSSBspU5xGgToS1_K_nlh6_4zhcaTVWJmEwBf6N3inaCgmB3DKX1QBaNQN_kbr_yOA64dk Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: bf2bcb968fd242fea700be1c43281923 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerPasswordTestJSON-347019572 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/bf2bcb968fd242fea700be1c43281923"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bf2bcb968fd242fea700be1c43281923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_bf2bcb968fd242fea700be1c43281923", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/bf2bcb968fd242fea700be1c43281923"}]}] Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerPasswordTestJSON-347019572 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: bf2bcb968fd242fea700be1c43281923 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerPasswordTestJSON-347019572 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerPasswordTestJSON-347019572-project Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d9257fe1d3c941b59aa67541acdebcd9 Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerPasswordTestJSON-347019572-project Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 1b529418-81b1-42de-99b0-7d2421807d26 could not be found. Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1b529418-81b1-42de-99b0-7d2421807d26'} Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b529418-81b1-42de-99b0-7d2421807d26 could not be found. Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b529418-81b1-42de-99b0-7d2421807d26 could not be found. Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:12.759319 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:12.765789 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:12.765789 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:12.765789 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:12.765789 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:12.765789 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:12.765789 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b529418-81b1-42de-99b0-7d2421807d26 could not be found. Aug 27 03:36:12.765789 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:12.772146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] Returning 404 to user: Instance 1b529418-81b1-42de-99b0-7d2421807d26 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:12.775352 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9dc4549e-d96d-43f5-8e1d-77e079f9b9b8 tempest-ServerPasswordTestJSON-347019572 tempest-ServerPasswordTestJSON-347019572-project] 10.222.0.69 "GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26" status: 404 len: 111 microversion: 2.1 time: 0.096237 Aug 27 03:36:12.783140 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2991/5742] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:12 2022] GET /compute/v2.1/servers/1b529418-81b1-42de-99b0-7d2421807d26 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:13.267099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.267609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:13.282898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.283432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.283877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.286285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.286801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.287250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.345738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 HTTP/1.1 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '5e034924-61bd-42a5-a090-6ba7f7a5cca1'} Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:13.347372 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:13.354539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-504a9a36-ed9f-440f-b4c5-e56cf73885fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 404 len: 111 microversion: 2.1 time: 0.085770 Aug 27 03:36:13.359007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.359636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 5e034924-61bd-42a5-a090-6ba7f7a5cca1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:13.380249 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2752/5743] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:13 2022] DELETE /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:13.387713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.388254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.388708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.399775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.400387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.400853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.443583 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 HTTP/1.1 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5e034924-61bd-42a5-a090-6ba7f7a5cca1'} Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:13.445298 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 5e034924-61bd-42a5-a090-6ba7f7a5cca1 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:13.449958 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c15ca1ee-ad3e-4833-aea9-42a297e394d3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1" status: 404 len: 111 microversion: 2.1 time: 0.092458 Aug 27 03:36:13.483801 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2992/5744] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:13 2022] GET /compute/v2.1/servers/5e034924-61bd-42a5-a090-6ba7f7a5cca1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:36:13.679054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.679737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:13.692570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.695895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.696650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.698305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.699467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.700160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:14.156133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.166369 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c703d37-d5f5-4e9e-8e0b-eb6150dd1869 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.491494 Aug 27 03:36:14.166369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2753/5745] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:13 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:15.187226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.187852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:15.208705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.218816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.219491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.220467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.223173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.223909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.924448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.945208 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39a1f20b-f082-43a0-b38b-12f9d88af4ef tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.762372 Aug 27 03:36:15.945803 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2993/5746] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:15 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:16.971056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:16.973575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:16.982488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.982987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.983422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.984144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.984601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.985016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:17.287582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:17.296015 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a235af0d-51b5-40e0-b4d2-21ebc1424e30 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.330749 Aug 27 03:36:17.296608 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2754/5747] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:16 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:18.334573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:18.335429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:18.358378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:18.359101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:18.359527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:18.360304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:18.360811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:18.366741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:18.876412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:18.899156 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-69b11a9d-afa2-47c2-b9fe-b3435b8ea9c9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.580938 Aug 27 03:36:18.906569 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2994/5748] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:18 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:19.927340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:19.928214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:19.948074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:19.948626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:19.949078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:19.949820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:19.950448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:19.950742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:20.231460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:20.248942 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f4a92dc-02cc-4d5e-a9b4-c1a987bd261b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.325871 Aug 27 03:36:20.260678 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2755/5749] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:19 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:21.273645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:21.274079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:21.287055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:21.287347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:21.287904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:21.289671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:21.290924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:21.293775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:21.561378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.574899 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd1c94dc-85c1-4cbb-8f3e-d33de147e623 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.306101 Aug 27 03:36:21.575714 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2995/5750] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:21 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:22.598214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:22.598876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:22.614278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:22.614665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:22.617734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:22.619445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:22.619969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:22.620515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:23.206123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.226496 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6cd797ec-6c2b-435a-8d8c-45739209fe4d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.633093 Aug 27 03:36:23.228459 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2756/5751] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:22 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:24.262539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:24.263918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:24.271951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.272726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.273417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:24.274399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.275028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.275624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:24.608766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:24.621613 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6f7179b-22fc-48f2-8b45-1250fee83f0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.368815 Aug 27 03:36:24.622256 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2996/5752] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:24 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:25.658684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:25.661216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:25.675481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.677198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.678192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.679601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.680561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.681777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.877573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.890490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af8649bf-6c74-4905-8c74-edff93249a0e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.239755 Aug 27 03:36:25.902716 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2757/5753] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:25 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:26.921042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:26.921737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:26.925670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:26.941200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:26.949951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:26.949951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:26.949951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:26.950421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:26.950564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:27.334786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:27.375248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9ddc69a-6982-412d-961c-a98db35fd7f8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.452926 Aug 27 03:36:27.378259 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2997/5754] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:26 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:28.412073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:28.412877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:28.431743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:28.433060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:28.434707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:28.436005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:28.436919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:28.437536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:28.770449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:28.787789 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18ced957-b790-4833-be02-d799ae3fb3b2 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.386447 Aug 27 03:36:28.798250 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2758/5755] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:28 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:29.820847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:29.821707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:29.842761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:29.844514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:29.844980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:29.850029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:29.850814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:29.852507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:30.274045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:30.291001 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f3e0a0f1-5a86-4892-adcc-55fb7291949d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.482438 Aug 27 03:36:30.292403 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2998/5756] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:29 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:31.314705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:31.316202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:31.333252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:31.334009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:31.336085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:31.336985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:31.339556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:31.342247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:31.699681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:31.712120 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd6dc7cb-4463-4ab1-a38d-f59f9c5dc718 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.402437 Aug 27 03:36:31.714912 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2759/5757] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:31 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:32.737233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:32.737854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:32.749330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:32.749838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:32.752627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:32.755075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:32.755756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:32.757402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.092769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:33.102771 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14bcffe0-f816-470c-b6e6-cdc95b9bf32d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.369536 Aug 27 03:36:33.106440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 2999/5758] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:32 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:33.644369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:33.647274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:33.662894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:33.666371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.667093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.668767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.669568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.670006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.670505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.726657 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4081abfd-ee37-4b3d-b917-7cec4dfe62f2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/ips" status: 200 len: 149 microversion: 2.1 time: 0.095243 Aug 27 03:36:33.735424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2760/5759] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:36:33 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/ips => generated 149 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:34.129302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:34.130880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:34.144956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:34.148634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:34.149506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:34.153138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:34.154268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:34.154719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:34.561087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:34.561772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:34.576387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:34.576959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:34.577249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:34.595446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:34.595959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:34.596583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:34.740323 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8e6cd48f-44a6-4706-86cd-5cbf2ea273c3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/ips" status: 200 len: 147 microversion: 2.1 time: 0.881613 Aug 27 03:36:34.741174 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3000/5760] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:36:33 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/ips => generated 147 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:34.824449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:34.841497 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83d6d804-709b-4607-b8e3-1db294413f56 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.713410 Aug 27 03:36:34.842829 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2761/5761] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:34 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:35.863821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:35.864447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:35.875348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:35.877836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:35.879428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:35.884517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:35.885174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:35.886135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.268585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:36.282012 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-137e7669-b83c-4cae-aeb8-0c490ba0677d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.422372 Aug 27 03:36:36.290447 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3001/5762] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:35 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:37.328291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:37.330153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:37.346885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.347741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.348420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.351372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.352811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.357074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.417402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:37.832801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:37.848300 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5aef0dac-e52a-47c5-acbf-be904b9c7bf8 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.526876 Aug 27 03:36:37.865399 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2762/5763] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:37 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:38.103648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b5b289e-bbd7-4f73-bae6-bc2556cffa53"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:38.111284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:38.130154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:38.131071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:38.131893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:38.133000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:38.133642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:38.134273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:38.653967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-77c2baac-e191-4539-b604-299a85875068 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "POST /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.556585 Aug 27 03:36:38.654654 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3002/5764] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:36:38 2022] POST /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:38.892530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:38.893781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:38.912336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:38.914805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:38.915980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:38.922112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:38.925473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:38.926403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:39.329396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe4fb994-1427-4fd5-aca0-e7e280d9082b"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:39.332590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:39.353608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:39.356151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:39.358155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:39.360716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:39.362597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:39.363443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:39.623074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:39.665596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:39.676975 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff90809e-5dee-4afe-bc6e-b6a2faaec194 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.804794 Aug 27 03:36:39.681248 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2763/5765] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:38 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:40.138332 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae8dee57-f2d8-4451-9272-e2e142895363 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814326 Aug 27 03:36:40.145989 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3003/5766] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:36:39 2022] POST /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:36:40.698743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:40.699521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:40.721176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:40.721686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:40.722137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:40.722898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:40.732150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:40.732661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:41.559435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:41.569417 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a54f5896-e405-460a-b09b-2d7c2fd1faf9 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.875213 Aug 27 03:36:41.569998 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2764/5767] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:40 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:42.597042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:42.597919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:42.610219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:42.610735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:42.611186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:42.611923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:42.612387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:42.612893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:43.186307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:43.196954 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3cc49bb-0952-425c-ade5-93df8802df9e tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1524 microversion: 2.1 time: 0.605182 Aug 27 03:36:43.200233 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3004/5768] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:42 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1524 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:44.225783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:44.226774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:44.256166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:44.266250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:44.267236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:44.278846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:44.279527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:44.279983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:44.773145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:44.782400 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71c22e7d-b9f2-4d94-be18-7a77c037b989 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1504 microversion: 2.1 time: 0.562450 Aug 27 03:36:44.783298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2765/5769] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:44 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1504 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:44.804811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8aa6783d-9cd1-4264-b411-6da73037622f tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'create', calling method: .version_select at 0x7fe457e5b940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-182569969", "description": "tempest-description-1583008391"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:45.138417 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8aa6783d-9cd1-4264-b411-6da73037622f tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.338104 Aug 27 03:36:45.142807 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3005/5770] 10.222.0.69 () {60 vars in 1180 bytes} [Sat Aug 27 03:36:44 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:45.154872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-182569969"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:45.155972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:45.178913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:45.180186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:45.181026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:45.183341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:45.184296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:45.184984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:46.094725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Adding security group d3ce8af9-9c37-4d6b-b77a-49f3cdb04372 to port 42155f03-9d9d-4f7e-81d2-82aacb240280 Aug 27 03:36:46.979594 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b82a47f1-e666-4db5-b00f-48402bcb1c85 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action" status: 202 len: 0 microversion: 2.1 time: 1.829303 Aug 27 03:36:46.980595 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2766/5771] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:45 2022] POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action => generated 0 bytes in 1832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:46.989829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-182569969"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:46.990502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:47.019781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.023976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.026791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.030089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.030845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.034796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.067360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4e65f385-52fd-4523-a591-ed93f412ce30 req-b41d44a1-eefb-437e-9675-6214d1326fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec0648d-27c7-4265-8a06-4a5f2e947782", "tag": "42155f03-9d9d-4f7e-81d2-82aacb240280"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:47.085707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4e65f385-52fd-4523-a591-ed93f412ce30 req-b41d44a1-eefb-437e-9675-6214d1326fed service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.086569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4e65f385-52fd-4523-a591-ed93f412ce30 req-b41d44a1-eefb-437e-9675-6214d1326fed service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.087252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4e65f385-52fd-4523-a591-ed93f412ce30 req-b41d44a1-eefb-437e-9675-6214d1326fed service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.112592 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4e65f385-52fd-4523-a591-ed93f412ce30 req-b41d44a1-eefb-437e-9675-6214d1326fed service nova] Creating event network-changed:42155f03-9d9d-4f7e-81d2-82aacb240280 for instance dec0648d-27c7-4265-8a06-4a5f2e947782 on n-h1-852086-5 Aug 27 03:36:47.130004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4e65f385-52fd-4523-a591-ed93f412ce30 req-b41d44a1-eefb-437e-9675-6214d1326fed service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066542 Aug 27 03:36:47.131563 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2767/5772] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:36:47.771098 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.network.security_group_api [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Removing security group d3ce8af9-9c37-4d6b-b77a-49f3cdb04372 from port 42155f03-9d9d-4f7e-81d2-82aacb240280 Aug 27 03:36:49.079056 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a510e8aa-3bab-44ca-94ff-718624465fa1 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action" status: 202 len: 0 microversion: 2.1 time: 2.094162 Aug 27 03:36:49.080071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3006/5773] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:46 2022] POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action => generated 0 bytes in 2096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:49.093367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4ec30fb-7b6d-4a63-89a7-f4e8a50bdf40 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'create', calling method: .version_select at 0x7fe46023e3a0>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:49.122919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-37471724-6152-424a-a9bc-7d29578deb1d req-6a9ac08f-b5a1-4964-9fe9-fc1865601a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec0648d-27c7-4265-8a06-4a5f2e947782", "tag": "42155f03-9d9d-4f7e-81d2-82aacb240280"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:49.149442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-37471724-6152-424a-a9bc-7d29578deb1d req-6a9ac08f-b5a1-4964-9fe9-fc1865601a2c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:49.156177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-37471724-6152-424a-a9bc-7d29578deb1d req-6a9ac08f-b5a1-4964-9fe9-fc1865601a2c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:49.157127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-37471724-6152-424a-a9bc-7d29578deb1d req-6a9ac08f-b5a1-4964-9fe9-fc1865601a2c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:49.183763 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-37471724-6152-424a-a9bc-7d29578deb1d req-6a9ac08f-b5a1-4964-9fe9-fc1865601a2c service nova] Creating event network-changed:42155f03-9d9d-4f7e-81d2-82aacb240280 for instance dec0648d-27c7-4265-8a06-4a5f2e947782 on n-h1-852086-5 Aug 27 03:36:49.205243 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-37471724-6152-424a-a9bc-7d29578deb1d req-6a9ac08f-b5a1-4964-9fe9-fc1865601a2c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088556 Aug 27 03:36:49.210688 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3007/5774] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:36:53.347059 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4ec30fb-7b6d-4a63-89a7-f4e8a50bdf40 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.260106 Aug 27 03:36:53.347669 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2768/5775] 10.222.0.69 () {60 vars in 1170 bytes} [Sat Aug 27 03:36:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:53.360460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.89"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:53.363298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:53.376384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:53.376878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:53.377316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:53.378029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:53.378515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:53.379088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:53.444882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "refresh_cache-dec0648d-27c7-4265-8a06-4a5f2e947782" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:36:53.445288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquired lock "refresh_cache-dec0648d-27c7-4265-8a06-4a5f2e947782" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:36:56.991333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Building network info cache for instance {{(pid=122407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:36:57.008881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fce9d878-a3f3-463d-97dc-394397dd26d9 req-d397b2cc-840b-477a-8eae-1e2cfff1b5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec0648d-27c7-4265-8a06-4a5f2e947782", "tag": "42155f03-9d9d-4f7e-81d2-82aacb240280"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:57.045558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fce9d878-a3f3-463d-97dc-394397dd26d9 req-d397b2cc-840b-477a-8eae-1e2cfff1b5b5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:57.048572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fce9d878-a3f3-463d-97dc-394397dd26d9 req-d397b2cc-840b-477a-8eae-1e2cfff1b5b5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:57.049251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fce9d878-a3f3-463d-97dc-394397dd26d9 req-d397b2cc-840b-477a-8eae-1e2cfff1b5b5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:57.098619 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fce9d878-a3f3-463d-97dc-394397dd26d9 req-d397b2cc-840b-477a-8eae-1e2cfff1b5b5 service nova] Creating event network-changed:42155f03-9d9d-4f7e-81d2-82aacb240280 for instance dec0648d-27c7-4265-8a06-4a5f2e947782 on n-h1-852086-5 Aug 27 03:36:57.116697 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fce9d878-a3f3-463d-97dc-394397dd26d9 req-d397b2cc-840b-477a-8eae-1e2cfff1b5b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112385 Aug 27 03:36:57.122016 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2769/5776] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:59.276922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Updating instance_info_cache with network_info: [{"id": "42155f03-9d9d-4f7e-81d2-82aacb240280", "address": "fa:16:3e:35:af:37", "network": {"id": "422db272-c487-4add-b323-265f4522d2a6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1994042046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "20304639bd4b4e86a15f459737018380", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42155f03-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:36:59.298705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Releasing lock "refresh_cache-dec0648d-27c7-4265-8a06-4a5f2e947782" {{(pid=122407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:36:59.300094 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b893738e-1ffc-4c5e-afb8-b6ab7f846668 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action" status: 202 len: 0 microversion: 2.1 time: 5.943954 Aug 27 03:36:59.301110 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3008/5777] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:53 2022] POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action => generated 0 bytes in 5946 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:36:59.312167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.89"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:59.720557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:59.729932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:59.730345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:59.730653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:59.731584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:59.732071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:59.735696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:59.889596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1681393390", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6c7813f4-ba5c-466b-a76d-8640efc5320e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:59.911490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=22 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:00.025942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:37:00.332451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "refresh_cache-dec0648d-27c7-4265-8a06-4a5f2e947782" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 03:37:00.333759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquired lock "refresh_cache-dec0648d-27c7-4265-8a06-4a5f2e947782" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 03:37:00.849517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:37:00.850020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:37:00.850446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:37:00.850859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:37:00.851275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:37:00.868149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:00.868644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:00.869636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:00.870708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:00.871190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:00.871609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:00.900178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:37:00.923493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:37:01.030755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:37:01.032886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c7813f4-ba5c-466b-a76d-8640efc5320e',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:37:01.303266 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f7cc322-7825-4cbc-ad2d-24122ed1cb00 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416714 Aug 27 03:37:01.311597 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3009/5778] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:36:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:37:01.320698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fb8aff0a-1f0f-407b-a424-e20e22cd2af4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:01.323967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fb8aff0a-1f0f-407b-a424-e20e22cd2af4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:01.481617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fb8aff0a-1f0f-407b-a424-e20e22cd2af4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:01.503261 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fb8aff0a-1f0f-407b-a424-e20e22cd2af4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1071 microversion: 2.1 time: 0.185598 Aug 27 03:37:01.505535 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3010/5779] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:01 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1071 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:01.866817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:01.868091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:01.875299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.876085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.876823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.877726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.878685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.879289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:02.026086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lazy-loading 'services' on Instance uuid ef08a1a2-c052-4cb7-880c-fc452640df30 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:37:02.148730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Building network info cache for instance {{(pid=122408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 03:37:02.192715 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b315793-22ce-410c-955a-0f3cb6df08f6 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments/8b5b289e-bbd7-4f73-bae6-bc2556cffa53" status: 202 len: 0 microversion: 2.1 time: 0.329546 Aug 27 03:37:02.193652 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3011/5780] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:37:01 2022] DELETE /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments/8b5b289e-bbd7-4f73-bae6-bc2556cffa53 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:37:02.225349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fb48dd17-a11a-4abb-81d1-f2c669820aef req-ed8f0e08-8fb0-4614-84e9-5b1508a12038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec0648d-27c7-4265-8a06-4a5f2e947782", "tag": "42155f03-9d9d-4f7e-81d2-82aacb240280"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:02.250939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb48dd17-a11a-4abb-81d1-f2c669820aef req-ed8f0e08-8fb0-4614-84e9-5b1508a12038 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:02.251518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb48dd17-a11a-4abb-81d1-f2c669820aef req-ed8f0e08-8fb0-4614-84e9-5b1508a12038 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:02.252161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fb48dd17-a11a-4abb-81d1-f2c669820aef req-ed8f0e08-8fb0-4614-84e9-5b1508a12038 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:02.281233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fb48dd17-a11a-4abb-81d1-f2c669820aef req-ed8f0e08-8fb0-4614-84e9-5b1508a12038 service nova] Creating event network-changed:42155f03-9d9d-4f7e-81d2-82aacb240280 for instance dec0648d-27c7-4265-8a06-4a5f2e947782 on n-h1-852086-5 Aug 27 03:37:02.296278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fb48dd17-a11a-4abb-81d1-f2c669820aef req-ed8f0e08-8fb0-4614-84e9-5b1508a12038 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088081 Aug 27 03:37:02.297216 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3012/5781] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:02.303311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:02.305630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:02.322007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:02.322475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:02.322927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:02.323663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:02.324126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:02.324557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:02.410596 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3607172-eb34-4b9c-b554-35f1606c06a2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111976 Aug 27 03:37:02.415955 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3013/5782] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:02 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:02.993182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:02.993871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:03.007017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:03.009335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:03.011477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:03.012493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:03.014778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:03.015508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:03.149036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Updating instance_info_cache with network_info: [{"id": "42155f03-9d9d-4f7e-81d2-82aacb240280", "address": "fa:16:3e:35:af:37", "network": {"id": "422db272-c487-4add-b323-265f4522d2a6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1994042046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "20304639bd4b4e86a15f459737018380", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap42155f03-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 03:37:03.170617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Releasing lock "refresh_cache-dec0648d-27c7-4265-8a06-4a5f2e947782" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 03:37:03.173114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-054936f8-4f7b-470b-80c2-60ead75b53ac tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action" status: 202 len: 0 microversion: 2.1 time: 3.867576 Aug 27 03:37:03.176252 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2770/5783] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:59 2022] POST /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782/action => generated 0 bytes in 3871 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 03:37:03.188386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f06e0f9a-bbf4-4c97-a347-f68ac73099a3 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '.version_select at 0x7fe4573a8160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:03.319886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:03.329225 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0cc314ae-2592-4cda-aafc-e995bb741542 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1169 microversion: 2.1 time: 0.803606 Aug 27 03:37:03.354397 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3014/5784] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:02 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1169 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:03.425035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:03.429129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:03.447836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:03.448347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:03.448807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:03.449545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:03.450011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:03.455180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:03.551299 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56b4c07a-92d3-4a4b-b9db-c0b223a182dc tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131688 Aug 27 03:37:03.551924 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3015/5785] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:03 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:04.368535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:04.370012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:04.384557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.385400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.386104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.387067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.387745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.388357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.497990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.512606 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4efee0bf-cb84-4cf4-9147-024977223a6d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1187 microversion: 2.1 time: 0.147990 Aug 27 03:37:04.514119 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3016/5786] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:04 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1187 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:04.570105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:04.574001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:04.582348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.583220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.584036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.585631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.586329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.586939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.651254 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5fef1eeb-ddee-462c-b21f-87bb8c7d9480 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090159 Aug 27 03:37:04.656599 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3017/5787] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:04 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:05.550848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:05.552204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:05.563709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.565008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.567475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.568248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.570595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.573389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.664030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:05.679823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-afc37dda-2f39-4de4-9960-f02923a7b9d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1187 microversion: 2.1 time: 0.136950 Aug 27 03:37:05.681215 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3018/5788] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:05 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1187 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:05.694476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:05.701115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:05.717395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.718198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.721359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.722796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.724518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.726241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.815275 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-561b6c1a-26be-4549-b42c-08f6623b6ba0 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131658 Aug 27 03:37:05.822573 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3019/5789] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:05 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:06.371601 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f06e0f9a-bbf4-4c97-a347-f68ac73099a3 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "DELETE /compute/v2.1/os-floating-ips/304d9370-9363-4227-a456-997d5ff9ed27" status: 202 len: 0 microversion: 2.1 time: 3.191006 Aug 27 03:37:06.376901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2771/5790] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:37:03 2022] DELETE /compute/v2.1/os-floating-ips/304d9370-9363-4227-a456-997d5ff9ed27 => generated 0 bytes in 3197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:06.382540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2f5b8648-9d4b-493d-89b0-0f1fc5a73c0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '.version_select at 0x7fe457b46280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:06.702015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:06.702731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:06.714307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=20 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:06.718682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:06.721444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:06.721904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:06.722683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:06.725783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:06.726296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.006460 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2f5b8648-9d4b-493d-89b0-0f1fc5a73c0b tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "DELETE /compute/v2.1/os-security-groups/d3ce8af9-9c37-4d6b-b77a-49f3cdb04372" status: 202 len: 0 microversion: 2.1 time: 0.627855 Aug 27 03:37:07.011398 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3020/5791] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 03:37:06 2022] DELETE /compute/v2.1/os-security-groups/d3ce8af9-9c37-4d6b-b77a-49f3cdb04372 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:07.017870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:07.020477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:07.041127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.041980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.042714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.043808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.054424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.055204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.169974 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1281ffe5-7e3a-45a6-b94c-de8f64f0454d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156916 Aug 27 03:37:07.178028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3021/5792] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:07 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:07.187410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:07.191510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:07.227595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.229769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.231777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.249135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.249708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.252498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.328636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:37:07.341545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:07.449626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:07.452238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=44,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:07.464623 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d38311c1-3cf2-434b-99d6-b0f9d5da283c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 0.767553 Aug 27 03:37:07.465219 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2772/5793] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:06 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:07.523867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5316aa2-c673-49f8-9b8f-4b52e353364a tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 204 len: 0 microversion: 2.1 time: 0.340323 Aug 27 03:37:07.526216 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3022/5794] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:07 2022] DELETE /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:07.533822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:07.535089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:07.558796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.561680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.566457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.567657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.568518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.574844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.875267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:07.885795 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e40f5378-bc55-4727-b229-04ab5f9c940d tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1510 microversion: 2.1 time: 0.356236 Aug 27 03:37:07.903768 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2773/5795] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:07 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:08.190697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:08.193273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:08.206712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.207398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.207993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.208851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.209612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.210755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.317311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f7d558c-4345-4c6d-b004-dd9b73a5bcec tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131652 Aug 27 03:37:08.327814 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3023/5796] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:08 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:08.445440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c0491ba6-c4cd-413b-8566-93584d231c7b req-ce0a2bc0-22f8-45de-aac7-c719019e2523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9995bdf5-e8fa-49ea-bced-51a01fd0db33", "tag": "24518df2-156b-4070-a643-77f07962e24e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:08.487323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c0491ba6-c4cd-413b-8566-93584d231c7b req-ce0a2bc0-22f8-45de-aac7-c719019e2523 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.491384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:08.491915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c0491ba6-c4cd-413b-8566-93584d231c7b req-ce0a2bc0-22f8-45de-aac7-c719019e2523 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.492080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:08.492681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c0491ba6-c4cd-413b-8566-93584d231c7b req-ce0a2bc0-22f8-45de-aac7-c719019e2523 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.504546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.506652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.507259 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c0491ba6-c4cd-413b-8566-93584d231c7b req-ce0a2bc0-22f8-45de-aac7-c719019e2523 service nova] Creating event network-changed:24518df2-156b-4070-a643-77f07962e24e for instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 on n-h2-852086-5 Aug 27 03:37:08.507903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.512394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.514472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.515127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.521470 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c0491ba6-c4cd-413b-8566-93584d231c7b req-ce0a2bc0-22f8-45de-aac7-c719019e2523 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079761 Aug 27 03:37:08.527269 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2774/5797] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:08.912430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:08.913592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:08.929433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.931279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.935115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.937051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.941320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.942029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.961106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:08.977474 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e88607f9-8309-4af6-9c71-8d40c0ee2cfa tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 0.495325 Aug 27 03:37:08.980444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3024/5798] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:08 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:09.246022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:09.254848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-962b41c2-3598-4418-bae2-7ae2ba0f0491 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1510 microversion: 2.1 time: 0.347869 Aug 27 03:37:09.258526 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2775/5799] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:08 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:09.333633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:09.336762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:09.365005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:09.374972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:09.375743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:09.376694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:09.377337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:09.382498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:09.469466 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-097254ed-d25e-41c6-a72e-12b0af590ac5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140123 Aug 27 03:37:09.474673 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3025/5800] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:09 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:10.004946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:10.006269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:10.015789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.016694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.017352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.018384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.019264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.019988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.279951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:10.281191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:10.295773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.299894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.304090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.305556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.309489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.310389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.375829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:10.389197 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccffcadd-478a-4732-8931-41c19dacf7c3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 0.390484 Aug 27 03:37:10.394488 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2776/5801] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:09 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:10.486360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:10.489389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:10.508838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.510650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.514150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.516065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.520218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.521693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.588490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b96a1608-8ea2-4396-9c58-139aa8748b23 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110088 Aug 27 03:37:10.589844 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2777/5802] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:10 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:10.889657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:11.066368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.098947 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f4d08e2-1557-4425-a3da-2a4aaa43ba24 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1510 microversion: 2.1 time: 0.806513 Aug 27 03:37:11.101703 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3026/5803] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:10 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1510 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:11.414110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.414895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:11.437554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.440006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.440758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.444197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.445940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.449727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.605522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.610731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:11.664809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:11.675200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.680317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.682431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.683302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.685746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.687451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.794508 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a25ba82-f52f-4023-9f89-c69dc6a6d259 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.195341 Aug 27 03:37:11.803998 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3027/5804] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:11 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30/os-volume_attachments => generated 25 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:37:11.927507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.928093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:11.941401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.943161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.943611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.946770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.947926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.949838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.012154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.026407 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0db448b7-f7f6-41b2-87e5-b8ba8f24a8ae tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 0.617092 Aug 27 03:37:12.027461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2778/5805] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:11 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:12.049815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:37:12.127505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.128118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:12.136636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.149958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.150676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.151853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.152332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.153346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.274650 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34399d38-137a-4ae3-b126-2a84940f3dc8 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 204 len: 0 microversion: 2.1 time: 0.351173 Aug 27 03:37:12.278873 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3028/5806] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:11 2022] DELETE /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:12.283188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.285890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:12.293860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.294397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.294899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.295598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.296147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.296596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.382980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7dfa132-b218-400f-a859-1b578d7e1452 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100837 Aug 27 03:37:12.383732 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3029/5807] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:12 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:12.390585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e1a51938c84fa2ba09cb6794883dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20304639bd4b4e86a15f459737018380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.394716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2037d08d-ef13-4196-9643-cc1c98b564eb req-b46066e7-602b-4ded-94ff-36b3844499dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec0648d-27c7-4265-8a06-4a5f2e947782", "name": "network-vif-deleted", "tag": "42155f03-9d9d-4f7e-81d2-82aacb240280"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:12.399461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b549c30c-37c0-45e2-8168-5a5e0847ede5 tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 200 len: 1468 microversion: 2.1 time: 0.276064 Aug 27 03:37:12.405400 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2779/5808] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:12 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:12.410590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.421716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2037d08d-ef13-4196-9643-cc1c98b564eb req-b46066e7-602b-4ded-94ff-36b3844499dd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.423105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2037d08d-ef13-4196-9643-cc1c98b564eb req-b46066e7-602b-4ded-94ff-36b3844499dd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.424752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2037d08d-ef13-4196-9643-cc1c98b564eb req-b46066e7-602b-4ded-94ff-36b3844499dd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.438152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:12.455195 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-2037d08d-ef13-4196-9643-cc1c98b564eb req-b46066e7-602b-4ded-94ff-36b3844499dd service nova] Creating event network-vif-deleted:42155f03-9d9d-4f7e-81d2-82aacb240280 for instance dec0648d-27c7-4265-8a06-4a5f2e947782 on n-h1-852086-5 Aug 27 03:37:12.462136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.463206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.463720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.464450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.464806 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2037d08d-ef13-4196-9643-cc1c98b564eb req-b46066e7-602b-4ded-94ff-36b3844499dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079107 Aug 27 03:37:12.465452 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3030/5809] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:12.477090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.477657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.511609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.527411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:12.554721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.556620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.559707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.561070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.563075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.565098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.628564 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b09055f-6599-455c-a26a-bfb494144ed2 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/fe4fb994-1427-4fd5-aca0-e7e280d9082b" status: 200 len: 194 microversion: 2.1 time: 0.129078 Aug 27 03:37:12.629677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3031/5810] 10.222.0.69 () {58 vars in 1413 bytes} [Sat Aug 27 03:37:12 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/fe4fb994-1427-4fd5-aca0-e7e280d9082b => generated 194 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:12.919609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.942069 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32104ec3-1cad-4b1a-983a-bed2b8658b6c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1681 microversion: 2.1 time: 0.535182 Aug 27 03:37:12.944274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2780/5811] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:12 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1681 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:13.050003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.051728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:13.097084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.097613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.100379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.107424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.109924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.115460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.433490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.436543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] [instance: dec0648d-27c7-4265-8a06-4a5f2e947782] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:13.456067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.457084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.457782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.461267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.462125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.463368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.481738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] HTTP exception thrown: Instance dec0648d-27c7-4265-8a06-4a5f2e947782 could not be found. Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Request method failure captured: Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 HTTP/1.1 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZETWOpY8Lg1qLzOv7y8iSTy1DuZx61g6fV0OX46s_pBLc_VWtivksCzOoIynpJn3AHk-h0BSOYxlyiLKeeksQxKrWAsFsUPs1q9gMKNmW-Ycs2JBWaGFQdeH6kfQ_71EKiqhCkJ67SKmkpA3GuAdvHgIBP6W965Z9jtkP8VYxbkDHY Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 20304639bd4b4e86a15f459737018380 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-397798506 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/20304639bd4b4e86a15f459737018380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20304639bd4b4e86a15f459737018380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_20304639bd4b4e86a15f459737018380", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/20304639bd4b4e86a15f459737018380"}]}] Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-397798506 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 20304639bd4b4e86a15f459737018380 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-397798506 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerRescueTestJSONUnderV235-397798506-project Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 54e1a51938c84fa2ba09cb6794883dd5 Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-397798506-project Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance dec0648d-27c7-4265-8a06-4a5f2e947782 could not be found. Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'dec0648d-27c7-4265-8a06-4a5f2e947782'} Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec0648d-27c7-4265-8a06-4a5f2e947782 could not be found. Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec0648d-27c7-4265-8a06-4a5f2e947782 could not be found. Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:13.485623 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec0648d-27c7-4265-8a06-4a5f2e947782 could not be found. Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] Returning 404 to user: Instance dec0648d-27c7-4265-8a06-4a5f2e947782 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-102795b8-c007-4e25-99cb-a233e828557c tempest-ServerRescueTestJSONUnderV235-397798506 tempest-ServerRescueTestJSONUnderV235-397798506-project] 10.222.0.69 "GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782" status: 404 len: 111 microversion: 2.1 time: 0.062984 Aug 27 03:37:13.491852 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2781/5812] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:13 2022] GET /compute/v2.1/servers/dec0648d-27c7-4265-8a06-4a5f2e947782 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:13.789030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:13.803256 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4208677-7b56-4175-9d6e-16b7568c15ea tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 0.759233 Aug 27 03:37:13.819766 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3032/5813] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:13 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:13.970344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.971084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:13.989510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.990216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:14.004355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:14.010902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:14.011507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:14.014425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:14.815668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:14.836128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:14.837441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:14.847271 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73875a0d-2db8-41bb-b11f-10b21695e594 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1681 microversion: 2.1 time: 0.881812 Aug 27 03:37:14.849720 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2782/5814] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:13 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1681 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:14.851556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:14.852430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:14.853166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:14.854603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:14.855299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:14.856022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.131805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:15.142141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f82bf9d-93d3-476b-8eeb-ef4b8406544b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 0.313937 Aug 27 03:37:15.143331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3033/5815] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:14 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:15.403509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "636c39cb-e27e-40e4-91ab-26435341dbbc"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:15.407707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:15.416386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.417413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.418185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.419143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.420115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.420774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.862073 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59097511-5aef-48b4-8a12-2afefc6ccb65 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "POST /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460728 Aug 27 03:37:15.863666 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2783/5816] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:37:15 2022] POST /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:15.881414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:15.884244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:15.903813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.915506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.916357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.922070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.922759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.923571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.166565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:16.167508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:16.184544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.189002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.189776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.193436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.194181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.205960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.219864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:16.234044 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eab0f3b8-b8d7-4627-bd5b-6a47d3d230d4 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1681 microversion: 2.1 time: 0.369061 Aug 27 03:37:16.237647 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3034/5817] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:15 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1681 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:17.263382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.265020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:17.283511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.284282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.285407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.287365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.288405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.289087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.413233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.429271 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-035ee1e7-00df-4fc2-9745-1969ea203403 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 1.269777 Aug 27 03:37:17.434712 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2784/5818] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:16 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:17.658560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.669931 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-daa1559d-ed79-42ec-8ab6-3f329d5bd262 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1681 microversion: 2.1 time: 0.412671 Aug 27 03:37:17.686778 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3035/5819] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:17 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1681 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:18.458284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.459082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.480688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.482120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.482694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.489385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.495821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.497226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.695465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.696084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.698823 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:37:18.699233 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 03:37:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 (ip 10.222.0.69) !!! Aug 27 03:37:18.737583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.741745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.742821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.750082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.752701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.756210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:19.269940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:19.275297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:19.286152 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-163f58c8-6439-426a-a8a0-5200b74dc1b2 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1613 microversion: 2.1 time: 0.593275 Aug 27 03:37:19.299887 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3036/5820] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1613 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:19.928740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:19.956993 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8da2787-c6ce-4843-a7ec-95f9c20d7e7d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1229 microversion: 2.1 time: 1.502839 Aug 27 03:37:19.961475 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2785/5821] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1229 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:20.012944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fd0f7f5b-cfda-468c-a74c-ff8936920bd1 req-e477b274-b0ad-4877-989a-63ced31d736e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef08a1a2-c052-4cb7-880c-fc452640df30", "name": "network-vif-deleted", "tag": "4d430637-16ae-4b87-8d93-0213f6b43dd8"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:20.041047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd0f7f5b-cfda-468c-a74c-ff8936920bd1 req-e477b274-b0ad-4877-989a-63ced31d736e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.041864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd0f7f5b-cfda-468c-a74c-ff8936920bd1 req-e477b274-b0ad-4877-989a-63ced31d736e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.042402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd0f7f5b-cfda-468c-a74c-ff8936920bd1 req-e477b274-b0ad-4877-989a-63ced31d736e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:20.061592 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fd0f7f5b-cfda-468c-a74c-ff8936920bd1 req-e477b274-b0ad-4877-989a-63ced31d736e service nova] Creating event network-vif-deleted:4d430637-16ae-4b87-8d93-0213f6b43dd8 for instance ef08a1a2-c052-4cb7-880c-fc452640df30 on n-h2-852086-5 Aug 27 03:37:20.080508 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fd0f7f5b-cfda-468c-a74c-ff8936920bd1 req-e477b274-b0ad-4877-989a-63ced31d736e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072898 Aug 27 03:37:20.081406 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3037/5822] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:20.313236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:20.313864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:20.339090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.347987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.350942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:20.351846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.352216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.352892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:20.893452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf3abb780384295820b4c18d6f1f415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3cad21a3ff3460692e93bed5ffc47ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:20.921767 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-014a73a5-994b-49a9-a8f7-b15f242b113e tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 200 len: 1613 microversion: 2.1 time: 0.613099 Aug 27 03:37:20.923191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2786/5823] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:20 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 1613 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:20.984225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:20.984974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:20.998044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.004373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.005108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.009117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.010146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.010918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.384545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.414373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-249d32a1-adbd-4c7f-8948-dbe2307e882f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1217 microversion: 2.1 time: 0.437051 Aug 27 03:37:21.414976 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3038/5824] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:20 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1217 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:21.950874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:21.954412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:21.982013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.982636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.984061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.985862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.988652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.989113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:22.038422 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 HTTP/1.1 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ef08a1a2-c052-4cb7-880c-fc452640df30'} Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:22.044766 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.049521 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:22.049521 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:22.049521 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:22.049521 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:22.049521 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:22.049521 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:22.049521 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.060858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:22.062968 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e01df23e-58ad-44f8-ac3e-c3decd914c51 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 404 len: 111 microversion: 2.1 time: 0.119133 Aug 27 03:37:22.064230 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2787/5825] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:21 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:22.078094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33373d45-d8e2-4a23-bc4c-b53deb190451 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '.version_select at 0x7fe456aa7d30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:22.136370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33373d45-d8e2-4a23-bc4c-b53deb190451 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852413846" status: 202 len: 0 microversion: 2.1 time: 0.059642 Aug 27 03:37:22.140560 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3039/5826] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 03:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852413846 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:37:22.445732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:22.447727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:22.498341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:22.499760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:22.500518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:22.506183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:22.508269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:22.508723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:23.997834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:24.026077 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6ff237c-1ae5-4b8f-bebc-3c2a33b694d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1217 microversion: 2.1 time: 1.589107 Aug 27 03:37:24.051200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2788/5827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:22 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1217 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:25.051991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:25.053431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:25.079738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:25.084562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:25.091405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:25.112451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:25.113058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:25.118545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:25.586143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:25.604813 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7d77daca-1a75-4a76-828d-0a5661aad422 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1217 microversion: 2.1 time: 0.556705 Aug 27 03:37:25.626457 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3040/5828] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:25 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1217 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:26.639993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:26.641222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:26.649905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:26.650790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:26.652793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:26.654262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:26.655072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:26.655935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:27.922714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:27.937496 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d282bd09-599c-42a4-9cc9-83005a51662b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1217 microversion: 2.1 time: 1.303961 Aug 27 03:37:27.946129 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2789/5829] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:26 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1217 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:28.968536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:28.971129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:28.987717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:28.989133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:28.990687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:28.994301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:28.998548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:29.000148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:29.297476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:29.310007 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aca3294a-b44b-43dd-9f63-cce43492939e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1217 microversion: 2.1 time: 0.345369 Aug 27 03:37:29.311336 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3041/5830] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:28 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1217 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:30.335128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:30.335758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:30.382121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:30.388111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:30.390250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:30.395587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:30.397204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:30.398487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:30.460473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:31.307414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:31.321233 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c39c263-7052-4a48-b9a2-45b74e1c07fe tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1217 microversion: 2.1 time: 0.990124 Aug 27 03:37:31.325889 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2790/5831] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:30 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1217 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:31.684941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:31.685514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:31.705633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:31.714779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:31.715590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:31.716797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:31.718762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:31.720581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:31.722246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:31.785642 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 HTTP/1.1 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ef08a1a2-c052-4cb7-880c-fc452640df30'} Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:31.792757 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.796141 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.799960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:31.802878 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ace47d7e-380f-4761-b972-f5d127b85db5 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 404 len: 111 microversion: 2.1 time: 0.122660 Aug 27 03:37:31.808132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3042/5832] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:31 2022] DELETE /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:31.815646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:31.816271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: ef08a1a2-c052-4cb7-880c-fc452640df30] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:31.831976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:31.832538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:31.832978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:31.833756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:31.834235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:31.834741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:31.862627 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 HTTP/1.1 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ef08a1a2-c052-4cb7-880c-fc452640df30'} Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:31.864192 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance ef08a1a2-c052-4cb7-880c-fc452640df30 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:31.870026 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88677362-ee0f-4a89-8c73-b5b2c62c399d tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30" status: 404 len: 111 microversion: 2.1 time: 0.054157 Aug 27 03:37:31.877254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2791/5833] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:31 2022] GET /compute/v2.1/servers/ef08a1a2-c052-4cb7-880c-fc452640df30 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:31.993445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3ccb0532-4546-4a48-a247-643b93512355 req-9179c6d5-23f1-4fe9-bb79-ce85ef655795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9995bdf5-e8fa-49ea-bced-51a01fd0db33", "name": "network-vif-plugged", "status": "completed", "tag": "24518df2-156b-4070-a643-77f07962e24e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:32.017103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3ccb0532-4546-4a48-a247-643b93512355 req-9179c6d5-23f1-4fe9-bb79-ce85ef655795 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:32.022976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3ccb0532-4546-4a48-a247-643b93512355 req-9179c6d5-23f1-4fe9-bb79-ce85ef655795 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:32.025969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3ccb0532-4546-4a48-a247-643b93512355 req-9179c6d5-23f1-4fe9-bb79-ce85ef655795 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:32.072026 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3ccb0532-4546-4a48-a247-643b93512355 req-9179c6d5-23f1-4fe9-bb79-ce85ef655795 service nova] Creating event network-vif-plugged:24518df2-156b-4070-a643-77f07962e24e for instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 on n-h2-852086-5 Aug 27 03:37:32.081332 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3ccb0532-4546-4a48-a247-643b93512355 req-9179c6d5-23f1-4fe9-bb79-ce85ef655795 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097092 Aug 27 03:37:32.084922 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3043/5834] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:37:32.343416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:32.344255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:32.354709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:32.361276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:32.361919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:32.366439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:32.369900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:32.377265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:32.763498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:32.785234 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0dde0ad5-77b9-43f4-ac98-1975478dff93 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1217 microversion: 2.1 time: 0.444215 Aug 27 03:37:32.786382 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2792/5835] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:32 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1217 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:33.827990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:33.835158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:33.887912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:33.889664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:33.892261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:33.894031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:33.905411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:33.908962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:34.387942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:34.398960 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-947327c0-64f6-4d28-9178-2175c13cf274 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1403 microversion: 2.1 time: 0.589743 Aug 27 03:37:34.400125 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3044/5836] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:33 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1403 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:34.420480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:34.421100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:34.449469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:34.450408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:34.453905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:34.456095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:34.457701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:34.460649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:34.796563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:34.808757 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9db3585-9425-4414-bbd0-4d55a0ddd89a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1403 microversion: 2.1 time: 0.392021 Aug 27 03:37:34.809565 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2793/5837] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:34 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1403 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:34.847407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1279434323"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:34.854903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:34.875636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:34.876440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:34.877255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:34.878628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:34.879235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:34.880254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:35.082388 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Attempting to quiesce instance before volume snapshot. Aug 27 03:37:35.158454 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 27 03:37:35.316026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Creating snapshot from volume 6c7813f4-ba5c-466b-a76d-8640efc5320e. {{(pid=122408) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 27 03:37:35.459048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d4f8ccd-fdce-469d-8fc1-190f43ac2d38 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Action: 'create', calling method: .version_select at 0x7fe457a54280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1368386001", "metadata": {"Type": "work"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d4f8ccd-fdce-469d-8fc1-190f43ac2d38 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Request method failure captured: Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 122 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZF-qOl4sNwcJPwiJ11UD3QVRncjBVePdxtxfknK9z8bFl1uw4dkJ3iNU_DgIF0Xlawza3lITKSr_e-gSykm8cL4qHhtVnmWuRNhGQl5NvQJ-XjTkFPrahBpM7gzn5mt9mIzBSjDE43r3adVMpIRBnnEL69x-zo-hfk0lEIRiUUBamU Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b1590883a5a04f66a28a58623aa4341b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}] Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: faff1d30922441f6ad55d454970ca136 Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1368386001", "metadata": {"Type": "work"}}} Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1368386001', 'metadata': {'Type': 'work'}}}} Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '#$%' Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:37:35.469501 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d4f8ccd-fdce-469d-8fc1-190f43ac2d38 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:35.472751 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d4f8ccd-fdce-469d-8fc1-190f43ac2d38 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.728044 Aug 27 03:37:35.473689 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3045/5838] 10.222.0.69 () {60 vars in 1156 bytes} [Sat Aug 27 03:37:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 729 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 03:37:35.496034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dd42a91-f5c6-4bac-a469-eb59c90560b5 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Action: 'create', calling method: .version_select at 0x7fe4579be820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1261684329", "metadata": {"Type": "work"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dd42a91-f5c6-4bac-a469-eb59c90560b5 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Request method failure captured: Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 120 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZF-qOl4sNwcJPwiJ11UD3QVRncjBVePdxtxfknK9z8bFl1uw4dkJ3iNU_DgIF0Xlawza3lITKSr_e-gSykm8cL4qHhtVnmWuRNhGQl5NvQJ-XjTkFPrahBpM7gzn5mt9mIzBSjDE43r3adVMpIRBnnEL69x-zo-hfk0lEIRiUUBamU Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b1590883a5a04f66a28a58623aa4341b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}] Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: faff1d30922441f6ad55d454970ca136 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1261684329", "metadata": {"Type": "work"}}} Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1261684329', 'metadata': {'Type': 'work'}}}} Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '0' Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:37:35.521735 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.528156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9dd42a91-f5c6-4bac-a469-eb59c90560b5 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:35.529171 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9dd42a91-f5c6-4bac-a469-eb59c90560b5 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045431 Aug 27 03:37:35.537424 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3046/5839] 10.222.0.69 () {60 vars in 1156 bytes} [Sat Aug 27 03:37:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:37:35.565735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-058dfe2e-f794-478e-b259-4104acce47c9 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Action: 'create', calling method: .version_select at 0x7fe45c5cff70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-396046841", "metadata": {"Type": "work"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-058dfe2e-f794-478e-b259-4104acce47c9 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Request method failure captured: Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 118 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZF-qOl4sNwcJPwiJ11UD3QVRncjBVePdxtxfknK9z8bFl1uw4dkJ3iNU_DgIF0Xlawza3lITKSr_e-gSykm8cL4qHhtVnmWuRNhGQl5NvQJ-XjTkFPrahBpM7gzn5mt9mIzBSjDE43r3adVMpIRBnnEL69x-zo-hfk0lEIRiUUBamU Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b1590883a5a04f66a28a58623aa4341b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}] Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: faff1d30922441f6ad55d454970ca136 Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-396046841", "metadata": {"Type": "work"}}} Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-396046841', 'metadata': {'Type': 'work'}}}} Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '' Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:37:35.584714 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.588661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-058dfe2e-f794-478e-b259-4104acce47c9 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:35.589782 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-058dfe2e-f794-478e-b259-4104acce47c9 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.048773 Aug 27 03:37:35.600713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3047/5840] 10.222.0.69 () {60 vars in 1156 bytes} [Sat Aug 27 03:37:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:37:35.619937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44e659ca-47e6-4206-bf99-d47f22a3c0c6 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Calling method '.version_select at 0x7fe4578cc160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:35.703686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-44e659ca-47e6-4206-bf99-d47f22a3c0c6 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] HTTP exception thrown: Volume tempest-invalid-1300662048 could not be found. Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44e659ca-47e6-4206-bf99-d47f22a3c0c6 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Request method failure captured: Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1300662048 HTTP/1.1 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZF-qOl4sNwcJPwiJ11UD3QVRncjBVePdxtxfknK9z8bFl1uw4dkJ3iNU_DgIF0Xlawza3lITKSr_e-gSykm8cL4qHhtVnmWuRNhGQl5NvQJ-XjTkFPrahBpM7gzn5mt9mIzBSjDE43r3adVMpIRBnnEL69x-zo-hfk0lEIRiUUBamU Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b1590883a5a04f66a28a58623aa4341b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}] Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: faff1d30922441f6ad55d454970ca136 Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume tempest-invalid-1300662048 could not be found. Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'tempest-invalid-1300662048'} Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1300662048 could not be found. (HTTP 404) (Request-ID: req-1c8560d7-20a9-4321-92e8-3fb825c7ca20) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:37:35.706911 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1300662048 could not be found. Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1300662048 could not be found. Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1300662048 could not be found. Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44e659ca-47e6-4206-bf99-d47f22a3c0c6 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Returning 404 to user: Volume tempest-invalid-1300662048 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:35.709996 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44e659ca-47e6-4206-bf99-d47f22a3c0c6 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1300662048" status: 404 len: 99 microversion: 2.1 time: 0.106786 Aug 27 03:37:35.719971 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3048/5841] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:37:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1300662048 => generated 99 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 03:37:35.728787 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3714eb5d-7e66-456d-ad11-4baf1f048bda tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006037 Aug 27 03:37:35.751527 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3049/5842] 10.222.0.69 () {58 vars in 1140 bytes} [Sat Aug 27 03:37:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:37:35.783188 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64b9ace9-8d49-489d-ae42-a5fc95a79752 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020928 Aug 27 03:37:35.783770 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3050/5843] 10.222.0.69 () {58 vars in 1137 bytes} [Sat Aug 27 03:37:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 03:37:35.797405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56df56cc-14d1-4c53-8559-b992c6ee9497 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Calling method '.version_select at 0x7fe4579fc0d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:35.881182 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-56df56cc-14d1-4c53-8559-b992c6ee9497 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] HTTP exception thrown: Volume 985336fb-1fe2-443b-bb82-703ac85fc4dc could not be found. Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56df56cc-14d1-4c53-8559-b992c6ee9497 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Request method failure captured: Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/os-volumes/985336fb-1fe2-443b-bb82-703ac85fc4dc HTTP/1.1 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZF-qOl4sNwcJPwiJ11UD3QVRncjBVePdxtxfknK9z8bFl1uw4dkJ3iNU_DgIF0Xlawza3lITKSr_e-gSykm8cL4qHhtVnmWuRNhGQl5NvQJ-XjTkFPrahBpM7gzn5mt9mIzBSjDE43r3adVMpIRBnnEL69x-zo-hfk0lEIRiUUBamU Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b1590883a5a04f66a28a58623aa4341b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}] Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: faff1d30922441f6ad55d454970ca136 Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume 985336fb-1fe2-443b-bb82-703ac85fc4dc could not be found. Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '985336fb-1fe2-443b-bb82-703ac85fc4dc'} Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 985336fb-1fe2-443b-bb82-703ac85fc4dc could not be found. (HTTP 404) (Request-ID: req-07f6d8fb-0eaa-4d88-b70e-413cc5561d23) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:37:35.884389 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 985336fb-1fe2-443b-bb82-703ac85fc4dc could not be found. Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 985336fb-1fe2-443b-bb82-703ac85fc4dc could not be found. Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 985336fb-1fe2-443b-bb82-703ac85fc4dc could not be found. Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56df56cc-14d1-4c53-8559-b992c6ee9497 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Returning 404 to user: Volume 985336fb-1fe2-443b-bb82-703ac85fc4dc could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56df56cc-14d1-4c53-8559-b992c6ee9497 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/985336fb-1fe2-443b-bb82-703ac85fc4dc" status: 404 len: 109 microversion: 2.1 time: 0.093384 Aug 27 03:37:35.887888 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3051/5844] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:37:35 2022] DELETE /compute/v2.1/os-volumes/985336fb-1fe2-443b-bb82-703ac85fc4dc => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:35.906666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-021e0ef8-f3f2-49a6-8709-822e64b0b368 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Calling method '.version_select at 0x7fe45c435430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:35.993185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-021e0ef8-f3f2-49a6-8709-822e64b0b368 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] HTTP exception thrown: Volume 0eff5641-6c83-43f1-ba6f-72b2108acfd7 could not be found. Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-021e0ef8-f3f2-49a6-8709-822e64b0b368 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Request method failure captured: Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-volumes/0eff5641-6c83-43f1-ba6f-72b2108acfd7 HTTP/1.1 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZF-qOl4sNwcJPwiJ11UD3QVRncjBVePdxtxfknK9z8bFl1uw4dkJ3iNU_DgIF0Xlawza3lITKSr_e-gSykm8cL4qHhtVnmWuRNhGQl5NvQJ-XjTkFPrahBpM7gzn5mt9mIzBSjDE43r3adVMpIRBnnEL69x-zo-hfk0lEIRiUUBamU Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b1590883a5a04f66a28a58623aa4341b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b1590883a5a04f66a28a58623aa4341b"}]}] Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b1590883a5a04f66a28a58623aa4341b Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesNegativeTest-1592238523 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: faff1d30922441f6ad55d454970ca136 Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesNegativeTest-1592238523-project Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume 0eff5641-6c83-43f1-ba6f-72b2108acfd7 could not be found. Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '0eff5641-6c83-43f1-ba6f-72b2108acfd7'} Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0eff5641-6c83-43f1-ba6f-72b2108acfd7 could not be found. (HTTP 404) (Request-ID: req-d39ae783-2fc0-49a1-a000-e004f85fdce9) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:37:35.998497 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0eff5641-6c83-43f1-ba6f-72b2108acfd7 could not be found. Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0eff5641-6c83-43f1-ba6f-72b2108acfd7 could not be found. Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0eff5641-6c83-43f1-ba6f-72b2108acfd7 could not be found. Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-021e0ef8-f3f2-49a6-8709-822e64b0b368 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] Returning 404 to user: Volume 0eff5641-6c83-43f1-ba6f-72b2108acfd7 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-021e0ef8-f3f2-49a6-8709-822e64b0b368 tempest-VolumesNegativeTest-1592238523 tempest-VolumesNegativeTest-1592238523-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0eff5641-6c83-43f1-ba6f-72b2108acfd7" status: 404 len: 109 microversion: 2.1 time: 0.105645 Aug 27 03:37:36.002916 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3052/5845] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:37:35 2022] GET /compute/v2.1/os-volumes/0eff5641-6c83-43f1-ba6f-72b2108acfd7 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:37:38.197151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:38.208947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:38.237010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.237816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.253388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.262518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.263023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.263478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.413090 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92753914-33d1-4df4-a033-cb9e37cc7298 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.224669 Aug 27 03:37:38.418259 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9075c4dd-f4cf-4842-ae14-9409ff1400bb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33/action" status: 202 len: 0 microversion: 2.1 time: 3.589124 Aug 27 03:37:38.428630 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3053/5847] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:37:38 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments => generated 371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:37:38.435636 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2794/5847] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:37:34 2022] POST /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33/action => generated 0 bytes in 3601 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:37:38.560992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:38.561503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:38.578415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.579926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.580436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.581198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.581655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.582090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.679573 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-28717192-a19f-4883-bd40-a107fb83eec7 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/fe4fb994-1427-4fd5-aca0-e7e280d9082b" status: 200 len: 194 microversion: 2.1 time: 0.120645 Aug 27 03:37:38.693250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:38.694087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:38.696883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=46 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:38.697406 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3054/5848] 10.222.0.69 () {58 vars in 1413 bytes} [Sat Aug 27 03:37:38 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/fe4fb994-1427-4fd5-aca0-e7e280d9082b => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:38.718027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.721645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.722396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.723320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.728431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.729137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.872706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:38.873224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:38.884306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.886107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.886737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.894839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:38.895329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:38.895774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:38.982209 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 HTTP/1.1 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '69718556-4ec9-430e-b09b-5481ceea5320'} Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:38.984353 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:38.987833 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:38.989319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:38.993721 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ecfa6332-7b77-4ca2-8a2c-e482dc21d8a1 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 404 len: 111 microversion: 2.1 time: 0.125211 Aug 27 03:37:38.999589 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3055/5849] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:38 2022] DELETE /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:37:39.010271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:39.013288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 69718556-4ec9-430e-b09b-5481ceea5320] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:39.034694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.038389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.042811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.046884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.048354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.052845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.105228 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 HTTP/1.1 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '69718556-4ec9-430e-b09b-5481ceea5320'} Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:39.112210 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.116932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 69718556-4ec9-430e-b09b-5481ceea5320 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:39.120054 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2f15561-7c21-46da-83a1-c8d6ee143aca tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320" status: 404 len: 111 microversion: 2.1 time: 0.117625 Aug 27 03:37:39.120685 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3056/5850] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:38 2022] GET /compute/v2.1/servers/69718556-4ec9-430e-b09b-5481ceea5320 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:39.151783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:39.152489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:39.176138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.176641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.177088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.186696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lazy-loading 'services' on Instance uuid 522a469d-b53a-4510-ae9f-51003ace8d65 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:37:39.189198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.189801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.193588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.256012 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 HTTP/1.1 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5'} Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:39.275254 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:39.279683 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d989965d-9735-4b60-b1d9-f88695bc720c tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 404 len: 111 microversion: 2.1 time: 0.151343 Aug 27 03:37:39.284291 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3057/5851] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:39 2022] DELETE /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:39.289920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:39.290311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:39.320087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.330742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.336530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.338337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:39.339127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:39.339720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:39.373612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d43e4b2c-10a8-4695-8fac-681bfcbbc5ee tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/fe4fb994-1427-4fd5-aca0-e7e280d9082b" status: 202 len: 0 microversion: 2.1 time: 0.684930 Aug 27 03:37:39.384751 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2795/5852] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:37:38 2022] DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/fe4fb994-1427-4fd5-aca0-e7e280d9082b => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:39.404373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 HTTP/1.1 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5'} Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:39.409060 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.413402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:39.413402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:39.413402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:39.413402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:39.413402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:39.413402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. Aug 27 03:37:39.413402 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:39.427001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:39.428300 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbc1dca1-8640-4e64-b569-a35dffb9bb6a tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5" status: 404 len: 111 microversion: 2.1 time: 0.142911 Aug 27 03:37:39.433804 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3058/5853] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:39 2022] GET /compute/v2.1/servers/47fdad00-5121-4f5a-a2eb-f8aae0a1b5a5 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:41.295265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1524477801", "imageRef": "041332e8-bce1-434b-b74a-1f723c5550f6", "flavorRef": "452", "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:41.345731 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:37:41.349123 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 03:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.69) !!! Aug 27 03:37:41.521786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:37:44.227100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:37:44.227840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:37:44.228509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:37:44.229229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:37:44.229831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:37:44.266149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:44.266732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:44.267160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:44.267937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:44.268402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:44.268965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:44.372745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:37:44.395752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:37:44.439558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:37:44.452230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ce51adbe-da15-4414-b4fd-85c1c7010507',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:37:44.667170 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dcf1e976-4ad4-442f-8ec2-482328d5dabd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.378609 Aug 27 03:37:44.674295 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2796/5854] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:37:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:37:44.684214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-476298d8-a4ed-433d-9734-a615f9eaff5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:44.685466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-476298d8-a4ed-433d-9734-a615f9eaff5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:45.433636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-476298d8-a4ed-433d-9734-a615f9eaff5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:45.452787 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-476298d8-a4ed-433d-9734-a615f9eaff5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1230 microversion: 2.1 time: 0.772890 Aug 27 03:37:45.454329 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3059/5855] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:44 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1230 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:46.483843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:46.484638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:46.557039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:46.560768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:46.563898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:46.566591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:46.567149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:46.567611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:46.966402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:46.996635 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b7d8e7f-4560-4f33-bc83-2f51d6c0f471 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1226 microversion: 2.1 time: 0.518403 Aug 27 03:37:46.999191 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2797/5856] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:46 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1226 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:48.032620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:48.033098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:48.046129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:48.052938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:48.053769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:48.054719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:48.055666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:48.056393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:48.385829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:48.409745 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9f3f7c74-dcf0-4812-8a0d-1f53eae215f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1300 microversion: 2.1 time: 0.380943 Aug 27 03:37:48.412997 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3060/5857] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:48 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1300 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:48.864715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:48.865857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:48.904275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:48.905441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:48.909792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:48.910780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:48.913782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:48.916239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:48.981185 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 HTTP/1.1 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '1a62a379-69d5-41ac-ad6a-7d481ff57538'} Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:48.989060 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:37:48.993012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:48.998544 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-608cbad6-d699-4804-a8a6-ca8e175c184f tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 404 len: 111 microversion: 2.1 time: 0.137266 Aug 27 03:37:49.001324 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2798/5858] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:48 2022] DELETE /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:49.007818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:49.009649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] [instance: 1a62a379-69d5-41ac-ad6a-7d481ff57538] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:49.041500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.045653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.049089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.050132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.061528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.070562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.137485 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] HTTP exception thrown: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Request method failure captured: Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 HTTP/1.1 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY-WnabIvQLFOJDFVWgrrkk7ZLKloPZwD1uT6zmyMQqNpv-iCtK7vdt0MewHUsdxQyvEeFuAkfU_GEWXqZ0iRlMUsHD3EL_cuejfIN1cRSsH91KTKMxo5jzf3MFG4yremtkq93NyzSt4N7iUQrZr9WlMJEtk7KqCqeJzouqpPUZv5nw Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f3cad21a3ff3460692e93bed5ffc47ea", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f3cad21a3ff3460692e93bed5ffc47ea"}]}] Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: f3cad21a3ff3460692e93bed5ffc47ea Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1169248430 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 6cf3abb780384295820b4c18d6f1f415 Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeNegativeTest-1169248430-project Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1a62a379-69d5-41ac-ad6a-7d481ff57538'} Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:49.143591 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.147750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:49.147750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:49.147750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:49.147750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:49.147750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:49.147750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. Aug 27 03:37:49.147750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:37:49.154812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] Returning 404 to user: Instance 1a62a379-69d5-41ac-ad6a-7d481ff57538 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:49.156296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a0dcc1b5-e88b-4ca7-8d6f-e46b21c29c45 tempest-AttachVolumeNegativeTest-1169248430 tempest-AttachVolumeNegativeTest-1169248430-project] 10.222.0.69 "GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538" status: 404 len: 111 microversion: 2.1 time: 0.152612 Aug 27 03:37:49.166128 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3061/5859] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:49 2022] GET /compute/v2.1/servers/1a62a379-69d5-41ac-ad6a-7d481ff57538 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:49.436346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:49.437204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:49.467208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.470523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.471008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.478214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:49.485438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:49.488346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:49.736083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:49.753205 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c56fa2a1-795c-4dee-8bc8-83b99809a160 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1300 microversion: 2.1 time: 0.324183 Aug 27 03:37:49.764023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2799/5860] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:49 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1300 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:50.813297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:50.814802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:50.833300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:50.833804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:50.834996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:50.836590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:50.837968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:50.838594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:50.842607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=59 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:51.059648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:51.073942 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e97530f5-d5bb-4215-927a-9096137b49f3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1300 microversion: 2.1 time: 0.285909 Aug 27 03:37:51.092279 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3062/5861] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:50 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1300 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:52.099087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:52.100278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:52.141882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:52.162667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:52.163220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:52.164023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:52.164638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:52.165060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:52.340578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:52.351168 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eeb6c5b4-bb86-47e3-bfe8-bc7d76b9b707 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1300 microversion: 2.1 time: 0.255733 Aug 27 03:37:52.352064 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2800/5862] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:52 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1300 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:53.382143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:53.385856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:53.415351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:53.416837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:53.417483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:53.418419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:53.426346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:53.429332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:54.455261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:54.464700 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-561465c6-883a-4842-812c-9acbd24de8b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 1.095748 Aug 27 03:37:54.497664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3063/5863] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:53 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:55.505341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:55.506455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:55.525281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:55.527882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:55.537632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:55.547750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:55.551179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:55.551985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:55.552527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:55.552973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:55.772522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:55.773233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:55.785513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:55.794125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:55.794852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:55.806699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:55.811772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:55.817737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:55.820178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:55.912701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e2f984a-a6ca-4baf-b824-3b5d56970641 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/636c39cb-e27e-40e4-91ab-26435341dbbc" status: 200 len: 194 microversion: 2.1 time: 0.143381 Aug 27 03:37:55.916714 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3064/5864] 10.222.0.69 () {58 vars in 1413 bytes} [Sat Aug 27 03:37:55 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/636c39cb-e27e-40e4-91ab-26435341dbbc => generated 194 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:55.949724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:55.950300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:55.977017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:55.977858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:55.986027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:55.989839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:55.990544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:55.992312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:56.169760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:56.204945 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4eebb04f-5551-4a78-9998-1d3f8cfecb0b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.697014 Aug 27 03:37:56.206085 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2801/5865] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:55 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:56.340313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lazy-loading 'services' on Instance uuid 522a469d-b53a-4510-ae9f-51003ace8d65 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:37:56.573547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a570e0c9-7f74-4633-89d7-590e0465a7a1 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/636c39cb-e27e-40e4-91ab-26435341dbbc" status: 202 len: 0 microversion: 2.1 time: 0.626544 Aug 27 03:37:56.576330 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3065/5866] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:37:55 2022] DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments/636c39cb-e27e-40e4-91ab-26435341dbbc => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:37:57.233501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:57.234660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:57.285128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:57.288634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:57.289116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:57.293814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:57.321199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:57.323784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:58.609318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:58.636991 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8aaef5d9-84f3-47f1-9fbc-349e679395d2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 1.400985 Aug 27 03:37:58.640899 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2802/5867] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:57 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:59.685360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:59.701872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:59.736160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:59.757425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:59.761258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:59.763330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:59.764089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:59.765470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:59.870589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2ef53a24-54ff-445c-b194-0ed2fbe399b8 req-9f4605f0-5582-4a2d-8fca-65b13ec387c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6", "tag": "bdca6817-7f55-45c8-ba84-eb5f4b531d25"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:59.895317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2ef53a24-54ff-445c-b194-0ed2fbe399b8 req-9f4605f0-5582-4a2d-8fca-65b13ec387c6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:59.895821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2ef53a24-54ff-445c-b194-0ed2fbe399b8 req-9f4605f0-5582-4a2d-8fca-65b13ec387c6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:59.896273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2ef53a24-54ff-445c-b194-0ed2fbe399b8 req-9f4605f0-5582-4a2d-8fca-65b13ec387c6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:59.980228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2ef53a24-54ff-445c-b194-0ed2fbe399b8 req-9f4605f0-5582-4a2d-8fca-65b13ec387c6 service nova] Creating event network-changed:bdca6817-7f55-45c8-ba84-eb5f4b531d25 for instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 on n-h1-852086-5 Aug 27 03:37:59.997325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2ef53a24-54ff-445c-b194-0ed2fbe399b8 req-9f4605f0-5582-4a2d-8fca-65b13ec387c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132513 Aug 27 03:37:59.999401 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2803/5868] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:01.023712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:01.033521 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c7209899-6479-4978-965b-6a00755fae33 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 1.366932 Aug 27 03:38:01.035704 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3066/5869] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:59 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:02.098958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:02.100932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:02.134377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:02.134818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:02.141510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:02.144206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:02.146063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:02.146764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:02.270450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:02.898576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:02.911835 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7ac3a7d-9d56-44d3-8178-ea0dc048bccb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.820007 Aug 27 03:38:02.912771 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2804/5870] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:02 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:38:03.935260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:03.936686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:03.954601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=36 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:03.957221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:03.957847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:03.958491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:03.959331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:03.960060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:03.960735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:04.613458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:04.650320 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7bee3606-4e7d-473d-a1c2-a544577a8465 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.718004 Aug 27 03:38:04.656952 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3067/5871] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:03 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:05.679854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:05.682073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:05.693805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:05.699214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:05.700011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:05.700985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:05.709348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:05.710066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:07.405679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:07.421533 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3005bbdc-6018-4407-9836-57cb2110de90 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 1.751071 Aug 27 03:38:07.422126 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2805/5872] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:05 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:08.455004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:08.456674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:08.513866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:08.515897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:08.516918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:08.517694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:08.518698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:08.519148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:08.614584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:08.624240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:08.643826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:08.650097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:08.652993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:08.654537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:08.656224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:08.658003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:08.758048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ded57164-4288-436b-8dd7-007b3e8e3b67 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157822 Aug 27 03:38:08.759439 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2806/5873] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:08 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:38:08.951923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:08.965508 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3e520e9-78c1-4942-89fa-f114b40a1e58 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.521384 Aug 27 03:38:08.982005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3068/5874] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:08 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:08.992204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:08.996389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:09.017528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:09.030324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.031114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.031777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.032763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.034064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.034809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.081549 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55e3cc10-734f-40a0-ae79-8641029d7941 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095001 Aug 27 03:38:09.082483 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2807/5875] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:08 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:38:09.187833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:09.188415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:09.200547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.204238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.205526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.208652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.211691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.211691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.279638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:38:09.568248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bebd1c4a-7c82-41f7-81e9-8e318c8ff4a5 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 204 len: 0 microversion: 2.1 time: 0.384737 Aug 27 03:38:09.571132 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3069/5876] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:38:09 2022] DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:38:09.580700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:09.582311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:09.595578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.598476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.599273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.600907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.603493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.605623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:10.009906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:10.011038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:10.036882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:10.037418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:10.037867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:10.043003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:10.043599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:10.044055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:10.555759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:10.571247 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efe8787f-b97a-4113-a0cc-19c1916f5335 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1674 microversion: 2.1 time: 0.994675 Aug 27 03:38:10.572489 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2808/5877] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:09 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1674 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:11.601207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:11.601928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:11.602834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:11.611773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:11.612857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:11.613551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:11.614838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:11.615661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:11.616307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:11.636313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-281be111-928e-4aed-8b47-6e1595df906e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 1.643907 Aug 27 03:38:11.653973 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3070/5878] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:09 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:12.614180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:12.639979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edd8626d-2bb8-494b-b59d-a477b9798f7d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1674 microversion: 2.1 time: 1.039614 Aug 27 03:38:12.642335 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2809/5879] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:11 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1674 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:12.667459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:12.668106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:12.690543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:12.691821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:12.695262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:12.710419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:12.714610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:12.718472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:13.135056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:13.186764 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a65223af-cdfd-4d3f-9705-3e09c62bf0bf tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.524734 Aug 27 03:38:13.208020 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3071/5880] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:12 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:13.679515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:13.682450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:13.705001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:13.705789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:13.710113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:13.713606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:13.715041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:13.716510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:14.232548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:14.238057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:14.239511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:14.249773 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab98e3a8-6c03-48fb-8f6b-af1040cc5e7b tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1674 microversion: 2.1 time: 0.577322 Aug 27 03:38:14.254547 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2810/5881] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:13 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1674 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:14.255703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:14.259352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:14.260265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:14.263241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:14.265586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:14.267787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:14.635914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:14.648597 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec06a14b-df84-4f90-9fbf-38b704858fca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.414446 Aug 27 03:38:14.651170 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3072/5882] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:14 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:15.281570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:15.282526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:15.311105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:15.313239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:15.313724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:15.317497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:15.319795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:15.320790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:15.588387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:15.604637 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3aba52b6-9040-4ffb-bb2b-ee21834ff69d tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1606 microversion: 2.1 time: 0.331131 Aug 27 03:38:15.611526 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2811/5883] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:15 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1606 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:15.677087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:15.677701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:15.696724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:15.698957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:15.700434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:15.702309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:15.703042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:15.704718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:16.102002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:16.128039 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-787df079-c638-4c36-b18d-a69146697499 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.456058 Aug 27 03:38:16.143063 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3073/5884] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:15 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:16.456293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7e5301b7-381a-4f45-8363-f529dcb9f95a req-ac689323-46a4-4121-b0d1-339f604f8865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522a469d-b53a-4510-ae9f-51003ace8d65", "name": "network-vif-deleted", "tag": "5937c398-8938-40bd-8c60-16b11ade4875"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:16.481410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7e5301b7-381a-4f45-8363-f529dcb9f95a req-ac689323-46a4-4121-b0d1-339f604f8865 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:16.484768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7e5301b7-381a-4f45-8363-f529dcb9f95a req-ac689323-46a4-4121-b0d1-339f604f8865 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:16.485977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7e5301b7-381a-4f45-8363-f529dcb9f95a req-ac689323-46a4-4121-b0d1-339f604f8865 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:16.530453 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7e5301b7-381a-4f45-8363-f529dcb9f95a req-ac689323-46a4-4121-b0d1-339f604f8865 service nova] Creating event network-vif-deleted:5937c398-8938-40bd-8c60-16b11ade4875 for instance 522a469d-b53a-4510-ae9f-51003ace8d65 on n-h2-852086-5 Aug 27 03:38:16.549180 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7e5301b7-381a-4f45-8363-f529dcb9f95a req-ac689323-46a4-4121-b0d1-339f604f8865 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096028 Aug 27 03:38:16.551606 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2812/5885] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:16.641882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:16.642506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:16.653606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:16.656086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:16.657629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:16.658627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:16.663907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:16.664614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:16.761526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:16.762257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:16.763189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:16.763677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lazy-loading 'fault' on Instance uuid 522a469d-b53a-4510-ae9f-51003ace8d65 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:38:16.887439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1470dd7c067e4c3c86b6f610d3e59262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2fea313a2a429eaed4fd7250fb137d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:16.897962 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8e318f81-49aa-4ae4-b5cd-871f5398fef8 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 200 len: 1326 microversion: 2.1 time: 0.259882 Aug 27 03:38:16.898653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3074/5886] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:16 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 1326 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:17.165359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:17.166240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:17.207332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:17.208877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:17.209541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:17.231072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:17.234430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:17.237760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:17.549479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:17.563880 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5fafc14-4696-490d-8d68-4d1b9dad4a20 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.406212 Aug 27 03:38:17.564493 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2813/5887] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:17 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:17.935865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:17.938254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:17.965701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:17.968195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:17.972800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:17.977424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:17.979760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:17.980708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:18.008963 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] HTTP exception thrown: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Request method failure captured: Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 HTTP/1.1 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_5mfKpWJxQM2I95jFDlFV9BTiIrEgJjdrSrzDSQDTG2th5co2TwBGU8N6pt3dl52WXPSzFaM2vPsEo6htvMUSY4Tihhhf3z5dJ6J5MdIyrq9M48i-RA0afRl4CmUP2Hbxxm7OoTLu0VFVoTDAiOPJGS2-B-rMOGUF81dtu2ks65wY Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed2fea313a2a429eaed4fd7250fb137d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}] Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 1470dd7c067e4c3c86b6f610d3e59262 Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '522a469d-b53a-4510-ae9f-51003ace8d65'} Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:18.011611 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:18.018734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:18.018734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:18.018734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:18.018734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:18.018734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:18.018734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:18.018734 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:18.021134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Returning 404 to user: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:18.022360 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6b9f284e-e35e-4952-98ce-8e4d54e1a9f9 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 404 len: 111 microversion: 2.1 time: 0.093758 Aug 27 03:38:18.024183 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3075/5888] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:17 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:18.046122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-63f29cb2-ab72-45e2-957a-0055f38e0e5f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '.version_select at 0x7fe457b5db80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:18.124653 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-63f29cb2-ab72-45e2-957a-0055f38e0e5f tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282556348" status: 202 len: 0 microversion: 2.1 time: 0.094342 Aug 27 03:38:18.127967 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3076/5889] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 03:38:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282556348 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:18.587321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:18.588096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:18.604198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:18.607400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:18.608129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:18.615071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:18.618477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:18.619677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:18.726297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2024df63-92ec-4663-8bad-1072f7766d9a tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Action: 'create', calling method: .version_select at 0x7fe457078280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-380392050"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:19.288475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:19.292360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:19.338004 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b0484957-1113-4b43-8b2b-a37e318123e8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1342 microversion: 2.1 time: 0.747434 Aug 27 03:38:19.355644 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3077/5890] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:18 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1342 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:19.521588 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2024df63-92ec-4663-8bad-1072f7766d9a tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.517383 Aug 27 03:38:19.522926 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2814/5891] 10.222.0.69 () {60 vars in 1155 bytes} [Sat Aug 27 03:38:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1519 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 27 03:38:19.546384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a1bf2c43-24ce-48d8-a256-052c8042da27 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457178700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:19.687759 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a1bf2c43-24ce-48d8-a256-052c8042da27 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 200 len: 344 microversion: 2.1 time: 0.154417 Aug 27 03:38:19.696387 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3078/5892] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:19 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:20.380486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:20.381869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:20.412899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:20.414411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:20.416693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:20.422307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:20.423245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:20.425145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:20.703236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3dffbbc-53f0-401d-9e9a-7ed74c4d31a0 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe4579be1f0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:20.722062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:20.735894 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76cd7197-3394-4eee-87ec-59dfeadc1aa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1388 microversion: 2.1 time: 0.369989 Aug 27 03:38:20.739714 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2815/5893] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:20 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1388 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:20.843776 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3dffbbc-53f0-401d-9e9a-7ed74c4d31a0 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 200 len: 344 microversion: 2.1 time: 0.145373 Aug 27 03:38:20.844531 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3079/5894] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:20 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:21.763868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:21.764743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:21.784271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:21.786038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:21.786787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:21.789956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:21.794845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:21.798784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:21.865985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c7ef12c-0037-4915-a46f-88cfbb2d603a tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457178b80>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:22.009805 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c7ef12c-0037-4915-a46f-88cfbb2d603a tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 200 len: 345 microversion: 2.1 time: 0.154495 Aug 27 03:38:22.010837 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3080/5895] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:21 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:22.028855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85b8a761-2942-46c6-b815-4f78213c2c12 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Action: 'create', calling method: .version_select at 0x7fe457b5d670>, body: {"snapshot": {"volume_id": "4378ba0b-71e9-42bb-ad85-9e1fbdae2686", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-408080005"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:22.454780 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85b8a761-2942-46c6-b815-4f78213c2c12 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.433129 Aug 27 03:38:22.456325 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3081/5896] 10.222.0.69 () {60 vars in 1162 bytes} [Sat Aug 27 03:38:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:22.481403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-05c5b49a-f7dd-44d7-a9c5-476bf8516abe tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457c9e0d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:22.569874 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-05c5b49a-f7dd-44d7-a9c5-476bf8516abe tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.096116 Aug 27 03:38:22.571131 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3082/5897] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:22 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:22.582882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b926250-d6eb-46ea-b930-872acc50e912 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457bb7040>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:22.689892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b926250-d6eb-46ea-b930-872acc50e912 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.110819 Aug 27 03:38:22.690797 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3083/5898] 10.222.0.69 () {58 vars in 1140 bytes} [Sat Aug 27 03:38:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:22.704588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b2f8b13-7b2a-4cce-8f5a-cbafff3f32a4 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe4578ed700>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:22.722666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:22.733546 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f00f9a2-209e-43e0-9f60-29a57366714a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1376 microversion: 2.1 time: 0.973732 Aug 27 03:38:22.734152 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2816/5899] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:21 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1376 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:22.780386 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b2f8b13-7b2a-4cce-8f5a-cbafff3f32a4 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.081779 Aug 27 03:38:22.781190 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3084/5900] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:22 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:23.790126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:23.793830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b412b9a3-ffbe-4795-86b2-b40bb9cd8d1a tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457c113a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:23.796350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:23.842792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:23.844161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:23.849905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:23.853718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:23.866614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:23.869692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:23.885497 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b412b9a3-ffbe-4795-86b2-b40bb9cd8d1a tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.096413 Aug 27 03:38:23.886082 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3085/5901] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:23 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:24.903072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c52b0039-ef61-4bd7-a7aa-30dc7b15de7b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457cef3a0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:24.976219 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c52b0039-ef61-4bd7-a7aa-30dc7b15de7b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.082258 Aug 27 03:38:24.978096 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3086/5902] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:24 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:25.056732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:25.073408 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e48bfdce-c66e-405e-b346-da387fa1cf1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1376 microversion: 2.1 time: 1.316671 Aug 27 03:38:25.074038 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2817/5903] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:23 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1376 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:25.991719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4b78c01d-9cba-4707-9254-625c74503b8b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457ba6310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:26.070971 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4b78c01d-9cba-4707-9254-625c74503b8b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.084503 Aug 27 03:38:26.072914 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3087/5904] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:25 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:26.096720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:26.098046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:26.119491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:26.121103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:26.122298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:26.128837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:26.129435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:26.129971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:26.799256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:26.825006 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ebb0e2d-6d9e-4c49-8724-62045f2ff610 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1376 microversion: 2.1 time: 0.729213 Aug 27 03:38:26.830573 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2818/5905] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:26 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1376 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:27.085881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-674c954c-9a36-4fca-92b8-31d85a0ec69b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457cefaf0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:27.169015 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-674c954c-9a36-4fca-92b8-31d85a0ec69b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 287 microversion: 2.1 time: 0.088262 Aug 27 03:38:27.175645 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3088/5906] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:27 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:27.182470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-153bb7a0-0fbf-4a45-b5d6-a0f1d3b25182 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe4572da550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:27.299963 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-153bb7a0-0fbf-4a45-b5d6-a0f1d3b25182 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 202 len: 0 microversion: 2.1 time: 0.122615 Aug 27 03:38:27.301287 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2819/5907] 10.222.0.69 () {58 vars in 1254 bytes} [Sat Aug 27 03:38:27 2022] DELETE /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:27.310764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1bda4a53-da17-477d-87ed-7ffd43a9c650 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457cef4c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:27.377029 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1bda4a53-da17-477d-87ed-7ffd43a9c650 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.070711 Aug 27 03:38:27.377709 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3089/5908] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:27 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:27.856101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:27.856911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:27.877900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:27.879041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:27.881681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:27.886530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:27.887063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:27.889709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:28.390694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f784190-dfa7-4f7f-885f-da45d0aeed05 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457c9e280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:28.445373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f784190-dfa7-4f7f-885f-da45d0aeed05 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.059607 Aug 27 03:38:28.446808 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3090/5909] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:28 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:29.456128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:29.461949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d73ac9ea-0a63-4253-8767-2b326ba8e29c tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457c11430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:29.536716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:29.573530 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d73ac9ea-0a63-4253-8767-2b326ba8e29c tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.117713 Aug 27 03:38:29.574790 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3091/5910] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:29 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:29.601080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:29.614394 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3e2b562-95f5-4b0e-a967-6036744e84a8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1376 microversion: 2.1 time: 1.760157 Aug 27 03:38:29.616284 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2820/5911] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:27 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1376 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:30.588803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-501da2e9-0d23-4bba-ad3c-fd1f4eabcade tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe4578d3f70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:30.653750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:30.655311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:30.665264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-501da2e9-0d23-4bba-ad3c-fd1f4eabcade tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 200 len: 286 microversion: 2.1 time: 0.082556 Aug 27 03:38:30.670643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:30.670850 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3092/5912] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:30 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:30.671771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:30.673540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:30.674895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:30.676310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:30.677133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:31.679904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80cba62f-d80b-4ac9-91b0-a8c693889d0e tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457cef5e0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:31.687344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:31.705323 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9da6f8df-0caa-4ac3-a90c-25e11039cba4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1376 microversion: 2.1 time: 1.061290 Aug 27 03:38:31.711593 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2821/5913] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:30 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1376 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:38:31.745435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-80cba62f-d80b-4ac9-91b0-a8c693889d0e tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] HTTP exception thrown: Snapshot 5c3de90c-a5ad-45ad-a897-9b0fedf82d54 could not be found. Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80cba62f-d80b-4ac9-91b0-a8c693889d0e tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Request method failure captured: Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 HTTP/1.1 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZGp8td2pXgYTgXvXFR9gesiR7Z8kDjzx41prhqEXPAn73ae49j1qxIbfGgJuLDMakyPGqWJJD0H0YxBs3RaaYLwl8BS5l8CUXFaD-p-phdbr3m8uDJ1sdqPqinNlG4EpZ4fv9rTd7Njln1VSSzC_pKc6Xg-mONIW1ujkLlGz5qSEI4 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b648b57ac7f4810ab932fcd2daecf32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}] Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fc090e01e7f9405fb81aca6c88ab38f7 Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: exception: Snapshot 5c3de90c-a5ad-45ad-a897-9b0fedf82d54 could not be found. Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5c3de90c-a5ad-45ad-a897-9b0fedf82d54'} Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5c3de90c-a5ad-45ad-a897-9b0fedf82d54 could not be found. (HTTP 404) (Request-ID: req-f3abe593-9064-4951-bedf-4b66578a2d15) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:38:31.751958 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5c3de90c-a5ad-45ad-a897-9b0fedf82d54 could not be found. Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5c3de90c-a5ad-45ad-a897-9b0fedf82d54 could not be found. Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5c3de90c-a5ad-45ad-a897-9b0fedf82d54 could not be found. Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80cba62f-d80b-4ac9-91b0-a8c693889d0e tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Returning 404 to user: Snapshot 5c3de90c-a5ad-45ad-a897-9b0fedf82d54 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-80cba62f-d80b-4ac9-91b0-a8c693889d0e tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54" status: 404 len: 111 microversion: 2.1 time: 0.079447 Aug 27 03:38:31.756272 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3093/5914] 10.222.0.69 () {58 vars in 1251 bytes} [Sat Aug 27 03:38:31 2022] GET /compute/v2.1/os-snapshots/5c3de90c-a5ad-45ad-a897-9b0fedf82d54 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:38:31.764044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c05a5ef-e0b9-420d-94f9-c01fe5fed8a6 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457789b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:31.928690 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c05a5ef-e0b9-420d-94f9-c01fe5fed8a6 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 202 len: 0 microversion: 2.1 time: 0.169688 Aug 27 03:38:31.930484 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2822/5915] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:38:31 2022] DELETE /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:31.939621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4ee3606-d798-4d88-b122-33e70255b5ff tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe4578edf70>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:32.069697 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4ee3606-d798-4d88-b122-33e70255b5ff tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 200 len: 344 microversion: 2.1 time: 0.134467 Aug 27 03:38:32.071415 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3094/5916] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:31 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:32.737431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:32.738345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:32.763509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:32.769063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:32.772400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:32.778225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:32.781601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:32.784526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:32.802708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=92 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:33.085708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-636c9974-1c38-4d48-8ea3-52da0952ef56 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe4572aca60>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:33.209137 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-636c9974-1c38-4d48-8ea3-52da0952ef56 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 200 len: 344 microversion: 2.1 time: 0.127779 Aug 27 03:38:33.215925 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3095/5917] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:33 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:33.552744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-88167456-5ecf-494f-b41f-de4e3fa9fccf req-ac03a2e0-2e37-4273-a19b-289dda5d0215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6", "name": "network-vif-plugged", "status": "completed", "tag": "bdca6817-7f55-45c8-ba84-eb5f4b531d25"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:33.589963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-88167456-5ecf-494f-b41f-de4e3fa9fccf req-ac03a2e0-2e37-4273-a19b-289dda5d0215 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:33.595525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-88167456-5ecf-494f-b41f-de4e3fa9fccf req-ac03a2e0-2e37-4273-a19b-289dda5d0215 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:33.596857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-88167456-5ecf-494f-b41f-de4e3fa9fccf req-ac03a2e0-2e37-4273-a19b-289dda5d0215 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:33.652474 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-88167456-5ecf-494f-b41f-de4e3fa9fccf req-ac03a2e0-2e37-4273-a19b-289dda5d0215 service nova] Creating event network-vif-plugged:bdca6817-7f55-45c8-ba84-eb5f4b531d25 for instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 on n-h1-852086-5 Aug 27 03:38:33.669427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-88167456-5ecf-494f-b41f-de4e3fa9fccf req-ac03a2e0-2e37-4273-a19b-289dda5d0215 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433980 Aug 27 03:38:33.676400 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3096/5918] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:33.685277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:33.752173 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cdc14046-c576-40b8-80bc-8c80e585f4d8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1376 microversion: 2.1 time: 1.014850 Aug 27 03:38:33.756113 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2823/5919] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:32 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1376 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:34.224681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-62f80573-1c14-43ba-a3b7-563decf3c2ee tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe4572ac160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:34.390549 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-62f80573-1c14-43ba-a3b7-563decf3c2ee tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 200 len: 344 microversion: 2.1 time: 0.170152 Aug 27 03:38:34.391126 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3097/5920] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:34 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:34.776312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:34.778722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:34.797026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:34.803057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:34.806577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:34.807990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:34.808684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:34.810711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:35.407748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-79af6c33-bfc7-4325-a721-9f08972e689b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457d32670>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:35.512054 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-79af6c33-bfc7-4325-a721-9f08972e689b tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 200 len: 344 microversion: 2.1 time: 0.111166 Aug 27 03:38:35.512936 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3098/5921] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:35 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:35.794312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:35.811923 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff934f95-0015-4773-9a61-5638ff59afa7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1376 microversion: 2.1 time: 1.039635 Aug 27 03:38:35.812565 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2824/5922] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:34 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1376 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:35.967685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:35.968442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:35.979598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:35.980093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:35.985198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:35.986117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:35.986622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:35.987052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:36.036154 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] HTTP exception thrown: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Request method failure captured: Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 HTTP/1.1 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_5mfKpWJxQM2I95jFDlFV9BTiIrEgJjdrSrzDSQDTG2th5co2TwBGU8N6pt3dl52WXPSzFaM2vPsEo6htvMUSY4Tihhhf3z5dJ6J5MdIyrq9M48i-RA0afRl4CmUP2Hbxxm7OoTLu0VFVoTDAiOPJGS2-B-rMOGUF81dtu2ks65wY Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed2fea313a2a429eaed4fd7250fb137d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}] Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 1470dd7c067e4c3c86b6f610d3e59262 Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '522a469d-b53a-4510-ae9f-51003ace8d65'} Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:38:36.046597 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.054750 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.060178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Returning 404 to user: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:36.064706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f27d3b2-517c-4b54-a840-78b736de99bd tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 404 len: 111 microversion: 2.1 time: 0.105757 Aug 27 03:38:36.068639 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3099/5923] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:38:35 2022] DELETE /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:38:36.082370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:36.083620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 522a469d-b53a-4510-ae9f-51003ace8d65] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:36.104561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:36.105829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:36.108230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:36.109161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:36.110451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:36.112605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:36.157630 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] HTTP exception thrown: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Request method failure captured: Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 HTTP/1.1 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY_5mfKpWJxQM2I95jFDlFV9BTiIrEgJjdrSrzDSQDTG2th5co2TwBGU8N6pt3dl52WXPSzFaM2vPsEo6htvMUSY4Tihhhf3z5dJ6J5MdIyrq9M48i-RA0afRl4CmUP2Hbxxm7OoTLu0VFVoTDAiOPJGS2-B-rMOGUF81dtu2ks65wY Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed2fea313a2a429eaed4fd7250fb137d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}] Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 1470dd7c067e4c3c86b6f610d3e59262 Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '522a469d-b53a-4510-ae9f-51003ace8d65'} Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.163172 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.170369 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.170369 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.170369 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.170369 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:36.170369 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:36.170369 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. Aug 27 03:38:36.170369 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.188971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Returning 404 to user: Instance 522a469d-b53a-4510-ae9f-51003ace8d65 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:36.194240 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cd1fafd-babe-43ae-9c56-402317df7d69 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65" status: 404 len: 111 microversion: 2.1 time: 0.116807 Aug 27 03:38:36.199158 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2825/5924] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:36 2022] GET /compute/v2.1/servers/522a469d-b53a-4510-ae9f-51003ace8d65 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:36.527252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c89567f7-ee2c-4340-bc46-3311d93e24e9 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457c11280>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:36.605756 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c89567f7-ee2c-4340-bc46-3311d93e24e9 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] HTTP exception thrown: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c89567f7-ee2c-4340-bc46-3311d93e24e9 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Request method failure captured: Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 HTTP/1.1 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZGp8td2pXgYTgXvXFR9gesiR7Z8kDjzx41prhqEXPAn73ae49j1qxIbfGgJuLDMakyPGqWJJD0H0YxBs3RaaYLwl8BS5l8CUXFaD-p-phdbr3m8uDJ1sdqPqinNlG4EpZ4fv9rTd7Njln1VSSzC_pKc6Xg-mONIW1ujkLlGz5qSEI4 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b648b57ac7f4810ab932fcd2daecf32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}] Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fc090e01e7f9405fb81aca6c88ab38f7 Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4378ba0b-71e9-42bb-ad85-9e1fbdae2686'} Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. (HTTP 404) (Request-ID: req-9fb46bbf-4e48-4bed-a244-2f42339c6dad) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:38:36.607800 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c89567f7-ee2c-4340-bc46-3311d93e24e9 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Returning 404 to user: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c89567f7-ee2c-4340-bc46-3311d93e24e9 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 404 len: 109 microversion: 2.1 time: 0.087158 Aug 27 03:38:36.611315 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3100/5925] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:36 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:36.623923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7909f1c-44ef-4311-a37c-914211a6b909 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe43c7cb820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:36.714917 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c7909f1c-44ef-4311-a37c-914211a6b909 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] HTTP exception thrown: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7909f1c-44ef-4311-a37c-914211a6b909 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Request method failure captured: Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 HTTP/1.1 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZGp8td2pXgYTgXvXFR9gesiR7Z8kDjzx41prhqEXPAn73ae49j1qxIbfGgJuLDMakyPGqWJJD0H0YxBs3RaaYLwl8BS5l8CUXFaD-p-phdbr3m8uDJ1sdqPqinNlG4EpZ4fv9rTd7Njln1VSSzC_pKc6Xg-mONIW1ujkLlGz5qSEI4 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b648b57ac7f4810ab932fcd2daecf32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}] Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: fc090e01e7f9405fb81aca6c88ab38f7 Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: method: Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: exception: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '4378ba0b-71e9-42bb-ad85-9e1fbdae2686'} Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. (HTTP 404) (Request-ID: req-ae74e485-63c1-4cf5-8967-6454e460c0ee) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:38:36.719916 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.725220 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.751444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7909f1c-44ef-4311-a37c-914211a6b909 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Returning 404 to user: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:36.752503 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7909f1c-44ef-4311-a37c-914211a6b909 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 404 len: 109 microversion: 2.1 time: 0.132970 Aug 27 03:38:36.755842 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2826/5926] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:38:36 2022] DELETE /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:36.766149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7cce95ca-85fd-4d7a-8fc5-756bf05550b6 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Calling method '.version_select at 0x7fe457cefca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:36.837272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:36.843037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:36.853161 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7cce95ca-85fd-4d7a-8fc5-756bf05550b6 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] HTTP exception thrown: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7cce95ca-85fd-4d7a-8fc5-756bf05550b6 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Request method failure captured: Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 HTTP/1.1 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZGp8td2pXgYTgXvXFR9gesiR7Z8kDjzx41prhqEXPAn73ae49j1qxIbfGgJuLDMakyPGqWJJD0H0YxBs3RaaYLwl8BS5l8CUXFaD-p-phdbr3m8uDJ1sdqPqinNlG4EpZ4fv9rTd7Njln1VSSzC_pKc6Xg-mONIW1ujkLlGz5qSEI4 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8b648b57ac7f4810ab932fcd2daecf32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8b648b57ac7f4810ab932fcd2daecf32"}]}] Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8b648b57ac7f4810ab932fcd2daecf32 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1976366963 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: fc090e01e7f9405fb81aca6c88ab38f7 Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1976366963-project Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4378ba0b-71e9-42bb-ad85-9e1fbdae2686'} Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. (HTTP 404) (Request-ID: req-980e4e8b-d3a0-4611-a138-60ff54d828d7) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:38:36.859043 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. Aug 27 03:38:36.863904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:36.875130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7cce95ca-85fd-4d7a-8fc5-756bf05550b6 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] Returning 404 to user: Volume 4378ba0b-71e9-42bb-ad85-9e1fbdae2686 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:36.884888 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7cce95ca-85fd-4d7a-8fc5-756bf05550b6 tempest-VolumesSnapshotsTestJSON-1976366963 tempest-VolumesSnapshotsTestJSON-1976366963-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686" status: 404 len: 109 microversion: 2.1 time: 0.120933 Aug 27 03:38:36.892616 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3101/5927] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:36 2022] GET /compute/v2.1/os-volumes/4378ba0b-71e9-42bb-ad85-9e1fbdae2686 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:36.909028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:36.913880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:36.919160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:36.921523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:36.922735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:36.927949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:37.434153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:37.463686 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-479a6cbd-04ac-40a5-98b7-8bcbacd0c3c4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1562 microversion: 2.1 time: 0.630838 Aug 27 03:38:37.466484 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2827/5928] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:36 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1562 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:37.488795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:37.489417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:37.503927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:37.504544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:37.504999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:37.510054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:37.511884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:37.512960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:38.452875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:38.465439 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87420258-c791-4897-96ea-da87b238af4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1562 microversion: 2.1 time: 0.981342 Aug 27 03:38:38.470201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3102/5929] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:37 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1562 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:38.656452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:38.657017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:38.673963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:38.677574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:38.678268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:38.690222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:38.696028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:38.701020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:38.805166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:38:39.073208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=38 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:39.081940 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bfc7ddd-6dea-4f57-92bc-e43602a0f624 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 204 len: 0 microversion: 2.1 time: 0.429287 Aug 27 03:38:39.085157 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2828/5930] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:38:38 2022] DELETE /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:38:39.095628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:39.096333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:39.116958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:39.117708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:39.118609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:39.119797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:39.120511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:39.121100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:40.303551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:40.319219 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2446ba5d-b025-4772-a428-10ff01781de5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1568 microversion: 2.1 time: 1.224657 Aug 27 03:38:40.321476 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3103/5931] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:39 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1568 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:41.345360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:41.345993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:41.359799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:41.370423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:41.370915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:41.375034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:41.375541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:41.375977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:41.751787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5863c70-17e3-440e-9921-28bb9d96cd4e tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Action: 'create', calling method: .version_select at 0x7fe45737da60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-334121711", "metadata": {"Type": "work"}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:42.222117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:42.243747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-07b7d22f-def4-4f50-b232-03ade3ebef8e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1568 microversion: 2.1 time: 0.900540 Aug 27 03:38:42.244473 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3104/5932] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:41 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1568 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:38:42.792692 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5863c70-17e3-440e-9921-28bb9d96cd4e tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.583895 Aug 27 03:38:42.794840 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2829/5933] 10.222.0.69 () {60 vars in 1156 bytes} [Sat Aug 27 03:38:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1587 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:38:42.807302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aebebf93-4c8b-40a7-bbf6-5e86c34246fe tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe457cc0e50>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:43.004858 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aebebf93-4c8b-40a7-bbf6-5e86c34246fe tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 200 len: 352 microversion: 2.1 time: 0.201644 Aug 27 03:38:43.005968 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3105/5934] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:42 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:43.257637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:43.258228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:43.260397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9f71cdf3-1a1d-45ae-9c28-08accf3c82b2 req-656e69b2-9ff1-4759-b272-6cdb5024e261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6", "name": "network-vif-deleted", "tag": "bdca6817-7f55-45c8-ba84-eb5f4b531d25"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:43.297974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.303002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.303362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.310322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.316247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.318491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9f71cdf3-1a1d-45ae-9c28-08accf3c82b2 req-656e69b2-9ff1-4759-b272-6cdb5024e261 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.323674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9f71cdf3-1a1d-45ae-9c28-08accf3c82b2 req-656e69b2-9ff1-4759-b272-6cdb5024e261 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.324863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.332473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9f71cdf3-1a1d-45ae-9c28-08accf3c82b2 req-656e69b2-9ff1-4759-b272-6cdb5024e261 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.395899 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] HTTP exception thrown: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Request method failure captured: Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 HTTP/1.1 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCY_5mfKpWJxQM2I95jFDlFV9BTiIrEgJjdrSrzDSQDTG2th5co2TwBGU8N6pt3dl52WXPSzFaM2vPsEo6htvMUSY4Tihhhf3z5dJ6J5MdIyrq9M48i-RA0afRl4CmUP2Hbxxm7OoTLu0VFVoTDAiOPJGS2-B-rMOGUF81dtu2ks65wY Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed2fea313a2a429eaed4fd7250fb137d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}] Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 1470dd7c067e4c3c86b6f610d3e59262 Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '3a7db87c-e21a-4282-90f4-a393fe1104b8'} Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:38:43.399842 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Returning 404 to user: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:43.403294 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37b88d61-1f7a-432d-b61e-278926f789f3 tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 404 len: 111 microversion: 2.1 time: 0.153612 Aug 27 03:38:43.406122 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3106/5935] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:38:43 2022] DELETE /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:43.416152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:43.417158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:43.423433 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9f71cdf3-1a1d-45ae-9c28-08accf3c82b2 req-656e69b2-9ff1-4759-b272-6cdb5024e261 service nova] Creating event network-vif-deleted:bdca6817-7f55-45c8-ba84-eb5f4b531d25 for instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 on n-h1-852086-5 Aug 27 03:38:43.426110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.426688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.427425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.428263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.428839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.429420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.455880 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9f71cdf3-1a1d-45ae-9c28-08accf3c82b2 req-656e69b2-9ff1-4759-b272-6cdb5024e261 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203408 Aug 27 03:38:43.458018 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2830/5936] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:43.481196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:43.489509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] [instance: 3a7db87c-e21a-4282-90f4-a393fe1104b8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:43.521500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.528719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.530613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.531429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.531924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.535950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.605939 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] HTTP exception thrown: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Request method failure captured: Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 HTTP/1.1 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCY_5mfKpWJxQM2I95jFDlFV9BTiIrEgJjdrSrzDSQDTG2th5co2TwBGU8N6pt3dl52WXPSzFaM2vPsEo6htvMUSY4Tihhhf3z5dJ6J5MdIyrq9M48i-RA0afRl4CmUP2Hbxxm7OoTLu0VFVoTDAiOPJGS2-B-rMOGUF81dtu2ks65wY Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed2fea313a2a429eaed4fd7250fb137d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed2fea313a2a429eaed4fd7250fb137d"}]}] Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: ed2fea313a2a429eaed4fd7250fb137d Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1267869994 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 1470dd7c067e4c3c86b6f610d3e59262 Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeTestJSON-1267869994-project Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3a7db87c-e21a-4282-90f4-a393fe1104b8'} Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:43.617817 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.621480 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:43.621480 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:43.621480 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:43.621480 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:43.621480 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:43.621480 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. Aug 27 03:38:43.621480 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:43.622421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] Returning 404 to user: Instance 3a7db87c-e21a-4282-90f4-a393fe1104b8 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:43.626229 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-265bc2eb-5cc1-468c-af3b-1b76ed6ddcef tempest-AttachVolumeTestJSON-1267869994 tempest-AttachVolumeTestJSON-1267869994-project] 10.222.0.69 "GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8" status: 404 len: 111 microversion: 2.1 time: 0.163015 Aug 27 03:38:43.630625 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2831/5937] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:43 2022] GET /compute/v2.1/servers/3a7db87c-e21a-4282-90f4-a393fe1104b8 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:43.895334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:43.912233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16d19774-91f8-4f1f-8697-7a4b3c5b57ca tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1361 microversion: 2.1 time: 0.495634 Aug 27 03:38:43.912898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3107/5938] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:43 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1361 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:44.020361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45e3c243-961e-479a-83b0-83f92317b6ab tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe43c7cd1f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:44.199471 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45e3c243-961e-479a-83b0-83f92317b6ab tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 200 len: 352 microversion: 2.1 time: 0.183742 Aug 27 03:38:44.200050 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2832/5939] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:44 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:44.941400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:44.942032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:44.952881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:44.953382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:44.953820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:44.963450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:44.966674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:44.967125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:45.214528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48560d34-e46d-41a4-a7af-9b43f9cfc97d tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe43c7cd040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:45.236104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:45.283751 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11baf7e8-7896-4f5b-88ad-490cd1bfb333 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1361 microversion: 2.1 time: 0.347708 Aug 27 03:38:45.290353 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3108/5940] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:44 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:45.455428 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48560d34-e46d-41a4-a7af-9b43f9cfc97d tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 200 len: 353 microversion: 2.1 time: 0.245971 Aug 27 03:38:45.456443 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2833/5941] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:45 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:45.472908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e71b0eca-2067-40a0-a832-2a685b56f461 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe457b5d430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:45.616205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e71b0eca-2067-40a0-a832-2a685b56f461 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 200 len: 353 microversion: 2.1 time: 0.148096 Aug 27 03:38:45.626660 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3109/5942] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:45 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:45.639686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4a6195d-a256-4930-bbcb-76f64c903e15 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe43c7cd8b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:45.799583 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4a6195d-a256-4930-bbcb-76f64c903e15 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 202 len: 0 microversion: 2.1 time: 0.172893 Aug 27 03:38:45.804495 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2834/5943] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 03:38:45 2022] DELETE /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:38:45.810949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b2d2e0a-dbef-407f-9651-a6027fd4ec35 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe457c899d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:45.931142 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b2d2e0a-dbef-407f-9651-a6027fd4ec35 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 200 len: 352 microversion: 2.1 time: 0.125619 Aug 27 03:38:45.931907 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3110/5944] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:45 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:46.309850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:46.311102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:46.326620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.330888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.331535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.332850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:46.343194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:46.343908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:46.684484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:46.700348 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a9daf14-b445-4848-b465-ea92ce94a103 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1361 microversion: 2.1 time: 0.396297 Aug 27 03:38:46.704469 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2835/5945] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:46 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:46.947711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bcb36003-61f7-464e-8225-b3e9b3cdf0bc tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe45c40f4c0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:47.041672 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bcb36003-61f7-464e-8225-b3e9b3cdf0bc tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 200 len: 352 microversion: 2.1 time: 0.100258 Aug 27 03:38:47.049321 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3111/5946] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:46 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:47.728276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:47.729532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:47.743110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:47.745163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:47.747760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:47.748963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:47.751453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:47.752096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:47.945365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:47.956183 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbfcf9f1-7c55-441c-b26f-d0ba8836788f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1361 microversion: 2.1 time: 0.234082 Aug 27 03:38:47.963256 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2836/5947] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:47 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:48.057427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-60106ced-b7e2-45ac-83d2-d25d204123c9 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe4579fc0d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:48.155295 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-60106ced-b7e2-45ac-83d2-d25d204123c9 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 200 len: 352 microversion: 2.1 time: 0.103417 Aug 27 03:38:48.156119 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3112/5948] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:48 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:48.987016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:48.989309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:49.008503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:49.009013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:49.016204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:49.020202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:49.031288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:49.031955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:49.175506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8f00336-d968-4299-844b-67be1a51dea6 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Calling method '.version_select at 0x7fe45c40f310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:49.275156 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a8f00336-d968-4299-844b-67be1a51dea6 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] HTTP exception thrown: Volume 25f23b37-8047-40fe-b070-b1c010305ed8 could not be found. Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8f00336-d968-4299-844b-67be1a51dea6 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Request method failure captured: Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 HTTP/1.1 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZHBCjCK4rdRkNgpgVEzmfHPz2YVdMIAob2422wp6HXDdnFso3zt9HqjpHAH7HgnrAC7-oNzoFBhbBTuU9LNVSk0Kg8Ij0EYDMz3oRZ_6KXkgeOaNlOyp5o0I-86mDmt0MusubGjkAZiKSaCDF5LCf26q3JAqArM9ADn3qFJl66uH4I Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: e043ddec386b4e70af61444a9b3affd7 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesGetTestJSON-360044667 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e043ddec386b4e70af61444a9b3affd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e043ddec386b4e70af61444a9b3affd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e043ddec386b4e70af61444a9b3affd7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e043ddec386b4e70af61444a9b3affd7"}]}] Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesGetTestJSON-360044667 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: e043ddec386b4e70af61444a9b3affd7 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesGetTestJSON-360044667 Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesGetTestJSON-360044667-project Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: d0bb4c254e6a4f42960449de41f4192b Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesGetTestJSON-360044667-project Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: method: Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: exception: Volume 25f23b37-8047-40fe-b070-b1c010305ed8 could not be found. Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '25f23b37-8047-40fe-b070-b1c010305ed8'} Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f23b37-8047-40fe-b070-b1c010305ed8 could not be found. (HTTP 404) (Request-ID: req-7d1a3205-51f1-47fc-8280-ad53b2d6fa48) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:38:49.277238 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f23b37-8047-40fe-b070-b1c010305ed8 could not be found. Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f23b37-8047-40fe-b070-b1c010305ed8 could not be found. Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f23b37-8047-40fe-b070-b1c010305ed8 could not be found. Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8f00336-d968-4299-844b-67be1a51dea6 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] Returning 404 to user: Volume 25f23b37-8047-40fe-b070-b1c010305ed8 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a8f00336-d968-4299-844b-67be1a51dea6 tempest-VolumesGetTestJSON-360044667 tempest-VolumesGetTestJSON-360044667-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8" status: 404 len: 109 microversion: 2.1 time: 0.114201 Aug 27 03:38:49.281642 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3113/5949] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:38:49 2022] GET /compute/v2.1/os-volumes/25f23b37-8047-40fe-b070-b1c010305ed8 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:38:49.301294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:49.312080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61b46aca-18ad-41f2-876c-cc8d795022b9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1361 microversion: 2.1 time: 0.329060 Aug 27 03:38:49.316041 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2837/5950] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:48 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:50.340577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:50.342071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:50.362908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:50.365997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:50.366946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:50.370246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:50.371070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:50.377925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:50.756650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:50.774828 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b17ab870-c310-45b8-ae39-0d9564e9453b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1361 microversion: 2.1 time: 0.435519 Aug 27 03:38:50.777707 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3114/5951] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:50 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:51.799619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:51.800881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:51.814754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:51.816463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:51.817611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:51.819787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:51.822075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:51.823661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:52.034673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:52.057782 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2529c5e8-cc8f-4d09-9100-02e95ed47da3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1361 microversion: 2.1 time: 0.264948 Aug 27 03:38:52.058944 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2838/5952] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:51 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:53.091115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:53.091854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:53.106688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:53.107146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:53.109276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:53.110505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:53.112179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:53.112788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:53.180086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:53.182919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:53.183433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:53.184640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:38:53.296210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:53.306949 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-916a82f8-3eb0-4c23-8d08-5a0583989dee tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 200 len: 1366 microversion: 2.1 time: 0.232293 Aug 27 03:38:53.324774 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3115/5953] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:53 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:54.330311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:54.330943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:54.354544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:54.356205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:54.357686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:54.358597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:54.359086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:54.361983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:54.411338 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 HTTP/1.1 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6'} Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:54.412930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:54.418753 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36e4a70d-1f21-4e5d-824e-2d6c815b7c09 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 404 len: 111 microversion: 2.1 time: 0.089449 Aug 27 03:38:54.428235 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2839/5954] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:54 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:03.355773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:03.356357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:03.374379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=22 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:03.375080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=50 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:03.399102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:03.400003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:03.404654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:03.405644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:03.406522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:03.407253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:03.504535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:39:03.688535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b89028c3-54d5-481b-b76b-ea736b851e49 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 204 len: 0 microversion: 2.1 time: 0.343660 Aug 27 03:39:03.690087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3116/5955] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:39:03 2022] DELETE /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:39:03.698109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:03.698994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:03.720166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:03.720778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:03.721251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:03.724385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:03.727289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:03.727839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:03.745160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:04.993698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:05.004047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c32824c-874e-4c5d-8fa1-c26f4fd3ae74 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1409 microversion: 2.1 time: 1.309921 Aug 27 03:39:05.012757 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2840/5956] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:03 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1409 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:39:06.036138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:06.037611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:06.052294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.058185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.058798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:06.059782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.060395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.063129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:06.863943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4276ec98-2138-4ba4-b521-7ad1aa9ed52e req-ebffab45-ca4c-4a2f-bd43-14ac3d37aeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9995bdf5-e8fa-49ea-bced-51a01fd0db33", "name": "network-vif-deleted", "tag": "24518df2-156b-4070-a643-77f07962e24e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:06.891221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4276ec98-2138-4ba4-b521-7ad1aa9ed52e req-ebffab45-ca4c-4a2f-bd43-14ac3d37aeb6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.892102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4276ec98-2138-4ba4-b521-7ad1aa9ed52e req-ebffab45-ca4c-4a2f-bd43-14ac3d37aeb6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.896256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4276ec98-2138-4ba4-b521-7ad1aa9ed52e req-ebffab45-ca4c-4a2f-bd43-14ac3d37aeb6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:06.932225 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4276ec98-2138-4ba4-b521-7ad1aa9ed52e req-ebffab45-ca4c-4a2f-bd43-14ac3d37aeb6 service nova] Creating event network-vif-deleted:24518df2-156b-4070-a643-77f07962e24e for instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 on n-h2-852086-5 Aug 27 03:39:06.948483 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4276ec98-2138-4ba4-b521-7ad1aa9ed52e req-ebffab45-ca4c-4a2f-bd43-14ac3d37aeb6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.505780 Aug 27 03:39:06.954651 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2841/5957] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:39:07.452710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:07.468687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a59c4103-60e2-40e7-aebb-c0ce0266b758 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1409 microversion: 2.1 time: 1.437217 Aug 27 03:39:07.475094 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3117/5958] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:06 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1409 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:08.509629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:08.510427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:08.535076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:08.535891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:08.540753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:08.542028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:08.542764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:08.543947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.020201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:09.030374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93d923da-091b-4004-973d-03f8a641ccd7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1202 microversion: 2.1 time: 0.536059 Aug 27 03:39:09.036619 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2842/5959] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:08 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1202 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:10.061895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:10.062910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:10.081539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:10.082179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:10.082718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:10.083594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:10.084312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:10.085121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:10.273445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:10.292049 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c13a88f0-58d7-44a4-800e-d397d4b89cd5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1202 microversion: 2.1 time: 0.238566 Aug 27 03:39:10.292921 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3118/5960] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:10 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1202 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:11.315968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:11.316613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:11.338458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:11.349300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.349863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.352754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.356273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.357227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.361156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:12.408017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:12.423693 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01404303-1a4f-4237-9485-66b9fa9ac84b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1202 microversion: 2.1 time: 1.112147 Aug 27 03:39:12.426299 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2843/5961] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:11 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1202 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:13.447717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:13.448281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:13.458971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:13.460198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:13.460946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:13.461844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:13.462345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:13.462785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:13.832691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:13.846879 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3bc26e46-23df-4359-b074-39947838cb9b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1202 microversion: 2.1 time: 0.403614 Aug 27 03:39:13.854338 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3119/5962] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:13 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:14.872532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:14.874372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:14.892262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:14.894078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:14.898280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:14.900593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:14.902197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:14.903905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.058875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.059402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.059871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.070358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid 9995bdf5-e8fa-49ea-bced-51a01fd0db33 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:39:15.244542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:15.267047 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a13431af-6343-4f9f-ae4c-85ed9fda7f54 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 200 len: 1207 microversion: 2.1 time: 0.402787 Aug 27 03:39:15.282187 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2844/5963] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:14 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 1207 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:16.295171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:16.295730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:16.308554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:16.320012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:16.320483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:16.321254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:16.321721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:16.322151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:16.377336 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 HTTP/1.1 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '9995bdf5-e8fa-49ea-bced-51a01fd0db33'} Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:16.379496 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:16.383475 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:16.383475 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:16.383475 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:16.383475 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:16.383475 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:16.383475 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:16.383475 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:16.386596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:16.387721 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec9c24af-0a67-49f4-84c3-4d721170d6d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 404 len: 111 microversion: 2.1 time: 0.096586 Aug 27 03:39:16.392245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3120/5964] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:16 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:20.001121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:20.003363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:20.029783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.032807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.034147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.040084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.041140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.042698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.083310 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 HTTP/1.1 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6'} Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:20.091054 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.094645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:20.098369 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7879da9f-95d8-4ccd-b06f-596087912493 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 404 len: 111 microversion: 2.1 time: 0.099693 Aug 27 03:39:20.105093 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2845/5965] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:39:19 2022] DELETE /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:20.108994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:20.109987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:20.132719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.133226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.133674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.134447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.134913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.135345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.190115 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 HTTP/1.1 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6'} Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:20.193352 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.198197 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:20.198197 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:20.198197 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:20.198197 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:20.198197 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:20.198197 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. Aug 27 03:39:20.198197 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:20.202876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:20.204071 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7e3e8134-c582-4214-adad-d9df001967b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6" status: 404 len: 111 microversion: 2.1 time: 0.099002 Aug 27 03:39:20.207850 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3121/5966] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:20 2022] GET /compute/v2.1/servers/fe5232d8-adf8-44bb-be6a-26d5d5e5bdd6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:39:21.874214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:21.874727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:21.905137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:21.907092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:21.907733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:21.910035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:21.914860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:21.916402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:21.952615 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 HTTP/1.1 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '9995bdf5-e8fa-49ea-bced-51a01fd0db33'} Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:21.958474 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:21.963627 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:39:21.966546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:21.967690 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d97c16a8-3ed8-45f8-8ba4-22af81afe729 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 404 len: 111 microversion: 2.1 time: 0.098863 Aug 27 03:39:21.976265 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2846/5967] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:39:21 2022] DELETE /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:21.985972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:21.986611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 9995bdf5-e8fa-49ea-bced-51a01fd0db33] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:22.019645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:22.020199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:22.020649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:22.026014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:22.027388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:22.028244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:22.065446 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 HTTP/1.1 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '9995bdf5-e8fa-49ea-bced-51a01fd0db33'} Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:22.074057 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 9995bdf5-e8fa-49ea-bced-51a01fd0db33 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:22.080150 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ada53754-595a-4f69-957b-80609d388d13 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33" status: 404 len: 111 microversion: 2.1 time: 0.100505 Aug 27 03:39:22.085489 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3122/5968] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:21 2022] GET /compute/v2.1/servers/9995bdf5-e8fa-49ea-bced-51a01fd0db33 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:22.212727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0a9154c-5c59-4c78-b2f5-e830f74aff06 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: .version_select at 0x7fe45c471f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1842421952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqVcYa2pGHxWDVqE8rXkssShmz2HO1/jcCPaMfwboSrxxzyS4yOwI0evI79r8XiDg/CmU+Yv/DQuc1NLawEg4zVDE7DOFpvEBrwankt5jNsYZ7Udya//pF872IWeTYvEA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:22.235895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f0a9154c-5c59-4c78-b2f5-e830f74aff06 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:39:22.247154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f0a9154c-5c59-4c78-b2f5-e830f74aff06 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:39:22.302152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0a9154c-5c59-4c78-b2f5-e830f74aff06 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.097579 Aug 27 03:39:22.303839 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2847/5969] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:39:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:05.005743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-200069699", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1842421952", "security_groups": [{"name": "tempest-secgroup-smoke-1427944589"}], "block_device_mapping_v2": [{"uuid": "4af86a88-fc8c-4648-8dfe-58942a84d199", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:05.022318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:05.024222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:06.065863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:40:10.323660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:40:10.324272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:40:10.324546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:40:10.325060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:40:10.325383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:40:10.350090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:10.350558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:10.351044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:10.351823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:10.352294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:10.352821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:10.423158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:40:10.457212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:40:10.567899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:40:10.573933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4af86a88-fc8c-4648-8dfe-58942a84d199',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:40:10.971159 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-472d82c7-f923-474b-a58a-56352f74ffeb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.969861 Aug 27 03:40:10.971838 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3123/5970] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:40:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 5971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:40:10.981589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=31 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:10.983305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:10.983797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:10.988482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ded231c8-b463-441d-a29a-8cc16902e4ad tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:10.989063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ded231c8-b463-441d-a29a-8cc16902e4ad tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:11.200554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ded231c8-b463-441d-a29a-8cc16902e4ad tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:11.208725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ded231c8-b463-441d-a29a-8cc16902e4ad tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1094 microversion: 2.1 time: 0.228421 Aug 27 03:40:11.209241 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2848/5971] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:10 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1094 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:12.232398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4132398e-20a2-4e36-9ecc-073403939340 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:12.233007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4132398e-20a2-4e36-9ecc-073403939340 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:13.076588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4132398e-20a2-4e36-9ecc-073403939340 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:13.088406 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4132398e-20a2-4e36-9ecc-073403939340 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1094 microversion: 2.1 time: 0.859799 Aug 27 03:40:13.094579 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3124/5972] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:12 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1094 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:14.129195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:14.130300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:14.170838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:14.171378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:14.171844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:14.172604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:14.173077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:14.174106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:15.754289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:15.766843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8962da2-4a7b-42e0-81af-0f74668e614a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1210 microversion: 2.1 time: 1.648854 Aug 27 03:40:15.770576 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2849/5973] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:14 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1210 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:16.794582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:16.796304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:16.823919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:16.824614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:16.828116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:16.829042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:16.829631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:16.830207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:17.024540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:17.041941 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-53aca607-23d8-423f-bc1d-beac472f3c9a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1210 microversion: 2.1 time: 0.256588 Aug 27 03:40:17.044377 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3125/5974] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:16 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1210 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:18.067825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:18.070316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:18.089807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:18.091800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:18.092457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:18.093924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:18.095696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:18.097522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:18.852590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:18.862554 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f06af4d8-81db-408b-8f98-e4d04894d497 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1210 microversion: 2.1 time: 0.799219 Aug 27 03:40:18.871716 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2850/5975] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:18 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1210 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:19.891559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:19.892851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:19.904242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:19.915822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:19.916569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:19.917586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:19.918312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:19.918982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:20.218180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:20.246213 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c1bf60f-7270-4c98-bc29-4224eb586904 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1210 microversion: 2.1 time: 0.358330 Aug 27 03:40:20.248913 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3126/5976] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:19 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1210 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:21.277588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:21.280239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:21.295941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:21.306421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:21.307212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:21.308385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:21.312140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:21.314728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:21.318409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:23.624743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:23.639191 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97e2b66e-e453-4a16-932d-1693105ef5df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1278 microversion: 2.1 time: 2.367544 Aug 27 03:40:23.641001 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2851/5977] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:21 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1278 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:24.661762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:24.662612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:24.675472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:24.678697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:24.681420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.683574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.684908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.685692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.686187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.686642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:25.392217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a9e41b7c-66a2-45f1-877f-2ded91b11338 req-034a0317-1de3-4d17-bec2-c114f8227c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac73f172-0385-4669-a0a4-028ad9c648b7", "tag": "3c9b8bbf-00d4-4961-88b0-f3c076b72672"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:25.420522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a9e41b7c-66a2-45f1-877f-2ded91b11338 req-034a0317-1de3-4d17-bec2-c114f8227c00 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:25.420522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a9e41b7c-66a2-45f1-877f-2ded91b11338 req-034a0317-1de3-4d17-bec2-c114f8227c00 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:25.420522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a9e41b7c-66a2-45f1-877f-2ded91b11338 req-034a0317-1de3-4d17-bec2-c114f8227c00 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:25.442954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a9e41b7c-66a2-45f1-877f-2ded91b11338 req-034a0317-1de3-4d17-bec2-c114f8227c00 service nova] Creating event network-changed:3c9b8bbf-00d4-4961-88b0-f3c076b72672 for instance ac73f172-0385-4669-a0a4-028ad9c648b7 on n-h2-852086-5 Aug 27 03:40:25.455118 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a9e41b7c-66a2-45f1-877f-2ded91b11338 req-034a0317-1de3-4d17-bec2-c114f8227c00 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066556 Aug 27 03:40:25.456655 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2852/5978] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:25.786517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:25.798124 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87c0384f-b243-4479-a01e-6826811153a3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1278 microversion: 2.1 time: 1.140732 Aug 27 03:40:25.798928 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3127/5979] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:24 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1278 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:26.831942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:26.834532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:26.858800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.859425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.859988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.862126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.862779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.867073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:27.565388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:27.591089 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bcd7e361-8bbc-4143-a317-6151a71c75df tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 0.769779 Aug 27 03:40:27.591764 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2853/5980] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:26 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:28.620805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:28.622435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:28.651380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:28.653344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:28.654708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:28.657141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:28.659092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:28.662179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:29.701709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:29.712141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-058368bd-4e64-47ae-8113-c39f54962e11 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 1.096443 Aug 27 03:40:29.713071 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3128/5981] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:28 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:30.736721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:30.737741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:30.746569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.747348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.747931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.749248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.753366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.754105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:31.779600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:31.803423 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67b4aad5-f1bf-4b5c-9fb9-ffb493129117 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 1.064708 Aug 27 03:40:31.810333 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2854/5982] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:30 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:32.822314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:32.823629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:32.840641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.841669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.842451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.843372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.844009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.844627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:33.452134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:33.474130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-308bed22-7fd8-4cf2-a192-1cbb8b210e59 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 0.655560 Aug 27 03:40:33.492586 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3129/5983] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:32 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:34.509869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:34.511235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:34.523532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:34.524055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:34.524514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:34.525269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:34.525731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:34.526671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:35.520010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:35.534970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0bc462e-3550-4e24-b0d7-f610b01f1038 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 1.027892 Aug 27 03:40:35.536454 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2855/5984] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:34 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:36.569274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:36.569787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:36.586810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:36.588727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:36.592981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:36.593535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:36.594303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:36.594773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:36.597012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:36.609129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=33 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:37.087269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:37.108385 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-63eb5dbf-0968-4f04-8878-6c6ef6560ae6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 0.540301 Aug 27 03:40:37.109780 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3130/5985] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:36 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:38.130403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:38.131180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:38.138928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:38.139440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:38.140080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:38.141216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:38.142205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:38.142381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:38.578933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7c05fea0-5af0-47a1-92ca-3a7e50e04055 req-f6760dab-25e6-4192-b0a6-816a0332e5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac73f172-0385-4669-a0a4-028ad9c648b7", "name": "network-vif-plugged", "status": "completed", "tag": "3c9b8bbf-00d4-4961-88b0-f3c076b72672"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:38.593270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:38.608329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7c05fea0-5af0-47a1-92ca-3a7e50e04055 req-f6760dab-25e6-4192-b0a6-816a0332e5fd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:38.610364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7c05fea0-5af0-47a1-92ca-3a7e50e04055 req-f6760dab-25e6-4192-b0a6-816a0332e5fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:38.611025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7c05fea0-5af0-47a1-92ca-3a7e50e04055 req-f6760dab-25e6-4192-b0a6-816a0332e5fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:38.617443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a281a572-64ce-4dc1-9b34-a40637f87f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 0.490879 Aug 27 03:40:38.618593 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2856/5986] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:38 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:38.647250 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7c05fea0-5af0-47a1-92ca-3a7e50e04055 req-f6760dab-25e6-4192-b0a6-816a0332e5fd service nova] Creating event network-vif-plugged:3c9b8bbf-00d4-4961-88b0-f3c076b72672 for instance ac73f172-0385-4669-a0a4-028ad9c648b7 on n-h2-852086-5 Aug 27 03:40:38.655635 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7c05fea0-5af0-47a1-92ca-3a7e50e04055 req-f6760dab-25e6-4192-b0a6-816a0332e5fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082110 Aug 27 03:40:38.658144 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3131/5987] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:39.639591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:39.650575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:39.679643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:39.680537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:39.681275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:39.682228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:39.682869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:39.684128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:39.768357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Calling method '.version_select at 0x7fe43c797790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:39.770417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:39.771139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:39.771779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:39.787687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:39.788523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:39.789150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:39.802649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:39.803462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:39.804090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:39.812021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c49d6820-86bc-4c83-a402-0e1ca1e322f8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1550243986-project-admin] 10.222.0.69 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.356215 Aug 27 03:40:39.821319 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2857/5988] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 03:40:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:40.124288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:40.141872 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ba688bc7-e750-4e5e-8049-5e56d2e0e008 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1266 microversion: 2.1 time: 0.506161 Aug 27 03:40:40.144635 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3132/5989] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:39 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1266 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:41.174835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:41.188867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:41.195938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=25 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:41.241482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:41.249824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:41.249824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:41.251084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:41.251668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:41.252310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:41.307036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=51 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:42.183341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:42.197451 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7af958d3-98b2-475c-9121-d55b7beb1eac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1452 microversion: 2.1 time: 1.035770 Aug 27 03:40:42.198454 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2858/5990] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:41 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1452 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:42.221201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:42.221868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:42.233616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:42.234321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:42.235127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:42.236071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:42.237279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:42.237884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:43.143401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:43.165777 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1ac623df-df3e-4ca0-bb54-668355ed3bac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1452 microversion: 2.1 time: 0.948819 Aug 27 03:40:43.178558 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3133/5991] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:42 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1452 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:50.477283 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:40:50.477871 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 03:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.69) !!! Aug 27 03:40:50.755604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9b2cbfb8-05ac-4003-98b2-9cd62af41194 req-7bf913d9-15db-4f14-8a2b-40975c7ba9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac73f172-0385-4669-a0a4-028ad9c648b7", "tag": "3c9b8bbf-00d4-4961-88b0-f3c076b72672"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:50.780264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9b2cbfb8-05ac-4003-98b2-9cd62af41194 req-7bf913d9-15db-4f14-8a2b-40975c7ba9d7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:50.780771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9b2cbfb8-05ac-4003-98b2-9cd62af41194 req-7bf913d9-15db-4f14-8a2b-40975c7ba9d7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:50.783917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9b2cbfb8-05ac-4003-98b2-9cd62af41194 req-7bf913d9-15db-4f14-8a2b-40975c7ba9d7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:50.816518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9b2cbfb8-05ac-4003-98b2-9cd62af41194 req-7bf913d9-15db-4f14-8a2b-40975c7ba9d7 service nova] Creating event network-changed:3c9b8bbf-00d4-4961-88b0-f3c076b72672 for instance ac73f172-0385-4669-a0a4-028ad9c648b7 on n-h2-852086-5 Aug 27 03:40:50.826503 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9b2cbfb8-05ac-4003-98b2-9cd62af41194 req-7bf913d9-15db-4f14-8a2b-40975c7ba9d7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354347 Aug 27 03:40:50.828235 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2859/5992] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:42:44.023748 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:42:44.024680 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:42:44.037303 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 03:42:44.037492 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 03:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 (ip 10.222.0.69) !!! Aug 27 03:42:44.038748 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:42:44.039058 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 03:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 (ip 10.222.0.69) !!! Aug 27 03:42:44.040600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:44.042043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=19 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:44.474688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:44.475130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:44.491263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:44.493211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:44.494242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:44.496438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:44.498272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:44.498902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:44.585340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:42:44.769277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-05af6949-7184-4ce5-810a-1bf5454f0289 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 204 len: 0 microversion: 2.1 time: 0.744914 Aug 27 03:42:44.772602 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3134/5993] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:42:44 2022] DELETE /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:42:44.779328 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:42:44.780796 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96abbb2e-fa0f-416e-845b-4c5358f3aaa0] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:42:44.781408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:44.783595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=7 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:44.786305 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 03:42:44.786711 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 03:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 (ip 10.222.0.69) !!! Aug 27 03:42:44.802862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:44.803926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:44.827108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:44.827968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:44.828620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:44.830535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:44.831240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:44.831877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:45.805071 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [96abbb2e-fa0f-416e-845b-4c5358f3aaa0] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44758. Aug 27 03:42:45.815492 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44756. Aug 27 03:42:45.838137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:45.869584 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e1f8bce-fd48-4c0f-ad9d-1954fda22936 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1577 microversion: 2.1 time: 1.087532 Aug 27 03:42:45.871855 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2860/5994] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:44 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1577 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:46.900632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:46.901409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:46.935167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:46.937021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:46.938617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:46.939533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:46.940026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:46.940474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:46.959408 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44780. Aug 27 03:42:46.976709 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 44782. Aug 27 03:42:49.114585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:49.124732 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a004fef7-85fd-4ee5-92ea-70f15e02fbb1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1577 microversion: 2.1 time: 2.228745 Aug 27 03:42:49.130281 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3135/5995] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:46 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1577 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:50.152017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:50.152702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:50.169054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:50.169985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:50.170658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:50.171696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:50.172558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:50.174115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:51.120081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:51.136521 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba030408-c6ed-48ef-bbd9-1a2ba8add928 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1509 microversion: 2.1 time: 0.986918 Aug 27 03:42:51.140530 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2861/5996] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:50 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1509 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:51.651796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5efbeeab-697c-4893-9b34-37fbbf01dcf3 req-f8cfb68f-3423-4e17-9d53-2980e67bcf47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac73f172-0385-4669-a0a4-028ad9c648b7", "name": "network-vif-deleted", "tag": "3c9b8bbf-00d4-4961-88b0-f3c076b72672"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:42:51.696355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5efbeeab-697c-4893-9b34-37fbbf01dcf3 req-f8cfb68f-3423-4e17-9d53-2980e67bcf47 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:51.696876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5efbeeab-697c-4893-9b34-37fbbf01dcf3 req-f8cfb68f-3423-4e17-9d53-2980e67bcf47 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:51.697316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5efbeeab-697c-4893-9b34-37fbbf01dcf3 req-f8cfb68f-3423-4e17-9d53-2980e67bcf47 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:51.752253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5efbeeab-697c-4893-9b34-37fbbf01dcf3 req-f8cfb68f-3423-4e17-9d53-2980e67bcf47 service nova] Creating event network-vif-deleted:3c9b8bbf-00d4-4961-88b0-f3c076b72672 for instance ac73f172-0385-4669-a0a4-028ad9c648b7 on n-h2-852086-5 Aug 27 03:42:51.769404 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5efbeeab-697c-4893-9b34-37fbbf01dcf3 req-f8cfb68f-3423-4e17-9d53-2980e67bcf47 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131517 Aug 27 03:42:51.774200 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3136/5997] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:42:52.167146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:52.167782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:52.217669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:52.223868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:52.224912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:52.226082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:52.226607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:52.227045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:52.849879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:52.863731 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3387912c-c3ab-42ad-92be-eb86e949d19d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1225 microversion: 2.1 time: 0.704059 Aug 27 03:42:52.877789 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2862/5998] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:52 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1225 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:53.890562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:53.891799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:53.920126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:53.923752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:53.929584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:53.932916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:53.934649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:53.938220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:54.352139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:54.367023 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d0a844a-b881-4a89-9b9d-6ae4c0f021d1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1225 microversion: 2.1 time: 0.482242 Aug 27 03:42:54.379581 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3137/5999] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:53 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1225 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:55.392636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:55.394340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:55.407159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:55.409899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:55.414053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:55.416089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:55.416621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:55.418805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:55.687295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:55.699264 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-274cb360-2b11-4b33-8ed4-5ecbd23ced5a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1225 microversion: 2.1 time: 0.311843 Aug 27 03:42:55.722336 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2863/6000] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:55 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1225 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:56.740337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:56.741142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:56.763738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:56.767834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:56.769045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:56.772734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:56.773610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:56.775194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:57.038189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:57.052052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40a95d47-aad1-4c11-8d32-521228f3ac04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1225 microversion: 2.1 time: 0.316996 Aug 27 03:42:57.056077 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3138/6001] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:56 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1225 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:58.087835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:58.088833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:58.119720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:58.121021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:58.121511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:58.122278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:58.127485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:58.128022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:58.792434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:58.805960 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-076e4cd0-2f45-4eef-a04f-13c9c0fc259c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1225 microversion: 2.1 time: 0.733292 Aug 27 03:42:58.807078 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2864/6002] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:58 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1225 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:59.830116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:59.830786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:59.841481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:59.841987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:59.862358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:59.863417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:59.863923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:59.864367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:00.120901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:00.142579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-26bef6ec-253b-4007-83b9-0a0ef0cefe5e tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1225 microversion: 2.1 time: 0.306774 Aug 27 03:43:00.144016 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3139/6003] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:59 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1225 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:01.165363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:01.166004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:01.188692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:01.189658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:01.189658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:01.190383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:01.190853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:01.191292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:01.512927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:01.522949 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9e3d8a7-12b3-432b-81e1-652895a7d329 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 200 len: 1225 microversion: 2.1 time: 0.361383 Aug 27 03:43:01.529401 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2865/6004] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:01 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 1225 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:02.551861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:02.552826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:02.561217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:02.561797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:02.562494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:02.563721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:02.564731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:02.565246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:02.613146 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 HTTP/1.1 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ac73f172-0385-4669-a0a4-028ad9c648b7'} Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:02.627879 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:02.632037 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-358e96dd-a044-4787-9e30-6f00e52b0c5c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 404 len: 111 microversion: 2.1 time: 0.078612 Aug 27 03:43:02.633176 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3140/6005] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:02 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:03.339076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1878031656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1842421952", "security_groups": [{"name": "tempest-secgroup-smoke-1427944589"}], "block_device_mapping_v2": [{"uuid": "4af86a88-fc8c-4648-8dfe-58942a84d199", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:03.933362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:43:06.106132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:43:06.107635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:43:06.108986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:43:06.110807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:43:06.112555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:43:06.195358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:06.199782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:06.201091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:06.204631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:06.206479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:06.209117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:06.317457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:43:06.346245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:43:06.519548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:43:06.522942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4af86a88-fc8c-4648-8dfe-58942a84d199',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:43:06.898598 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec17ee20-fda1-4e8f-97cc-ad8ea5e765ac tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.565172 Aug 27 03:43:06.899404 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2866/6006] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:43:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 3569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:43:06.910671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8bbc6f76-58e1-49a6-bceb-877523338878 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:06.918698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8bbc6f76-58e1-49a6-bceb-877523338878 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:07.979666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bbc6f76-58e1-49a6-bceb-877523338878 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:08.003378 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8bbc6f76-58e1-49a6-bceb-877523338878 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1095 microversion: 2.1 time: 1.093322 Aug 27 03:43:08.011473 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3141/6007] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:06 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1095 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:09.048912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:09.051622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:09.092312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:09.093070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:09.096087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:09.100628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:09.103439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:09.104781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:09.561355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:09.585109 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f8981da-7b82-4748-93aa-e51a0becc7c8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1193 microversion: 2.1 time: 0.548165 Aug 27 03:43:09.585732 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2867/6008] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:09 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1193 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:10.606891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:10.607586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:10.622279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:10.638775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:10.650479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:10.651748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:10.657905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:10.660031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:10.923862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:10.937739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-612bcc94-8d69-4d7d-a009-eab82d099196 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1211 microversion: 2.1 time: 0.335001 Aug 27 03:43:10.956005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3142/6009] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:10 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1211 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:11.976590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:11.977222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:11.997794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:12.004718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:12.005429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:12.006503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:12.009134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:12.009768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:13.332021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:13.350006 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec8c15c8-8aa4-45c8-a541-a4acebe18684 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1211 microversion: 2.1 time: 1.377152 Aug 27 03:43:13.353228 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2868/6010] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:11 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1211 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:14.372827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:14.373463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:14.392080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:14.398986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:14.399609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:14.400138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:14.403441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:14.404121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:14.404644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:14.421610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:15.573511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:15.595751 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a227c2e7-a924-4bbc-9b97-7fa27ac904c0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1279 microversion: 2.1 time: 1.215781 Aug 27 03:43:15.599947 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3143/6011] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:14 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1279 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:16.622880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:16.624298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:16.627866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:16.631607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:16.632550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:16.646558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:16.657744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:16.660207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:16.664055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:16.666263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:16.667447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:16.680696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=51 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:18.076783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:18.089979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c1e3a07-39d9-4f7f-a9f1-add13c0b31d9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1279 microversion: 2.1 time: 1.471542 Aug 27 03:43:18.096837 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2869/6012] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:16 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1279 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:18.577865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d2fc6647-0769-4388-9eb8-79e5c4052220 req-78f7d396-669f-490b-9ab3-057fb4716888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744be0ab-3af2-45d4-89a0-b0a2d15eb0b2", "tag": "dfa97205-e8ed-40ef-892c-c2007fc91a5b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:18.599578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:18.603562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d2fc6647-0769-4388-9eb8-79e5c4052220 req-78f7d396-669f-490b-9ab3-057fb4716888 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:18.608007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d2fc6647-0769-4388-9eb8-79e5c4052220 req-78f7d396-669f-490b-9ab3-057fb4716888 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:18.608787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d2fc6647-0769-4388-9eb8-79e5c4052220 req-78f7d396-669f-490b-9ab3-057fb4716888 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:18.647527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d2fc6647-0769-4388-9eb8-79e5c4052220 req-78f7d396-669f-490b-9ab3-057fb4716888 service nova] Creating event network-changed:dfa97205-e8ed-40ef-892c-c2007fc91a5b for instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 on n-h2-852086-5 Aug 27 03:43:18.675653 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d2fc6647-0769-4388-9eb8-79e5c4052220 req-78f7d396-669f-490b-9ab3-057fb4716888 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100410 Aug 27 03:43:18.676972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3144/6013] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:43:19.141872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:19.147958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:19.188015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:19.189536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:19.194869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:19.197704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:19.199519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:19.203207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:19.779790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:19.824107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a87028c5-7493-4a07-9205-2082246572c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1279 microversion: 2.1 time: 0.699379 Aug 27 03:43:19.825176 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2870/6014] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:19 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1279 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:20.867120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:20.868456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:20.894997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:20.896156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:20.899825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:20.900780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:20.901416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:20.902023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:21.676382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:21.684687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad0bdb77-0db5-41ff-8bb4-4ff37a2544e2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1279 microversion: 2.1 time: 0.821619 Aug 27 03:43:21.685292 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3145/6015] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:20 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1279 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:22.710185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:22.710809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:22.718458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.723555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.727541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:22.735189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:22.735901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:22.736536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:24.491129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:24.510816 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15a6a967-6e32-4078-8445-5d975ed62f1c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1279 microversion: 2.1 time: 1.804358 Aug 27 03:43:24.524992 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2871/6016] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:22 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1279 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:25.537258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:25.538479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:25.554224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:25.555013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:25.555621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:25.556530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:25.567101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:25.567835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:27.541873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:27.557995 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9ab3b1e-9425-4779-9580-7bf9a94326e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1267 microversion: 2.1 time: 2.024934 Aug 27 03:43:27.574219 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3146/6017] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:25 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1267 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:28.580440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:28.581084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:28.606644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:28.607399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:28.608024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:28.614196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:28.620391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:28.620946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:29.187461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:29.203698 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-290446c9-55fd-49c1-aa86-079e650121b0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1267 microversion: 2.1 time: 0.627386 Aug 27 03:43:29.204776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2872/6018] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:28 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1267 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:30.228022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:30.228800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:30.246914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:30.247601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:30.251007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:30.252045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:30.252807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:30.253379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:30.981571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1167270541", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:31.076911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:31.086556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c6477629-b6e9-4377-9a6e-e3d9f1ff92f0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1267 microversion: 2.1 time: 0.862708 Aug 27 03:43:31.092933 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3147/6019] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:30 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1267 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:31.115591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:43:31.610687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:43:31.611130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:43:31.611630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:43:31.613096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:43:31.613535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:43:31.644835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:31.645359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:31.645825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:31.650599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:31.651128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:31.651591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:31.704423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Getting quotas for project 3a835bbd87b74a989c2304944b48e4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:43:31.718021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Getting quotas for user 52e5a5d910e94148821a8585275146ab and project 3a835bbd87b74a989c2304944b48e4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:43:31.765226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:43:31.770527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:43:31.939466 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2fed756-0d20-48f4-96f8-0a7406d0c0b4 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963223 Aug 27 03:43:31.962108 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2873/6020] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:43:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:43:31.967595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41842927-8cd4-4a6e-af84-c261ca1b477a tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:31.980016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-41842927-8cd4-4a6e-af84-c261ca1b477a tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:32.113076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:32.114755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:32.151792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:32.153337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:32.155784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:32.157123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:32.160531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:32.161247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:32.412819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-41842927-8cd4-4a6e-af84-c261ca1b477a tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:32.425637 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41842927-8cd4-4a6e-af84-c261ca1b477a tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1215 microversion: 2.1 time: 0.462144 Aug 27 03:43:32.428013 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3148/6021] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:31 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1215 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:33.002794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:33.012331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a83e53e-53e6-4a1f-8c63-70f1941a11e7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1267 microversion: 2.1 time: 0.904344 Aug 27 03:43:33.020669 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2874/6022] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:32 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1267 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:33.447715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:33.448913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:33.481550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:33.482056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:33.490331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:33.494139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:33.494863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:33.495475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:33.806283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:33.816321 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9e28788-01d5-4a53-abd5-ac96fe5bb0d9 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1267 microversion: 2.1 time: 0.372386 Aug 27 03:43:33.822554 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3149/6023] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:33 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1267 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:34.042423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:34.043736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:34.081589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:34.086223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:34.086786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:34.089186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:34.089770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:34.094692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:34.475423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:34.484781 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e3f3f70-15b0-4beb-bd52-d0a1ab6084b1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1267 microversion: 2.1 time: 0.446426 Aug 27 03:43:34.489183 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2875/6024] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:34 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1267 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:34.857300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:34.858666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:34.876414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:34.881612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:34.882462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:34.883449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:34.887986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:34.888864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:35.404788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:35.413905 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fa26f8a2-3c20-4f6a-81ed-82a2fad88ad6 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1273 microversion: 2.1 time: 0.569809 Aug 27 03:43:35.433073 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3150/6025] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:34 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1273 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:35.515792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:35.516920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:35.539129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:35.539784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:35.543899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:35.564194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:35.565170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:35.570839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:35.914298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744be0ab-3af2-45d4-89a0-b0a2d15eb0b2", "name": "network-vif-plugged", "status": "completed", "tag": "dfa97205-e8ed-40ef-892c-c2007fc91a5b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:35.937001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:35.938470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:35.939149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:35.971418 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] Creating event network-vif-plugged:dfa97205-e8ed-40ef-892c-c2007fc91a5b for instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 on n-h2-852086-5 Aug 27 03:43:35.982812 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] [27905f94-0ed4-4c2d-9c32-54115e2d9611] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:43:36.694548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:36.717884 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50d8ddc7-5350-4993-8ee1-d3b9baf28121 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1267 microversion: 2.1 time: 1.206593 Aug 27 03:43:36.730464 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3151/6026] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:35 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1267 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:43:36.740169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:36.741019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:36.752562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:36.754755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:36.758782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:36.759735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:36.760354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:36.761053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:36.997681 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] [27905f94-0ed4-4c2d-9c32-54115e2d9611] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 45848. Aug 27 03:43:37.002287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fe8aa177-3c6d-4905-8fee-fab82339595b req-6cb06787-4fed-47c6-8c9c-211f5c463459 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.656910 Aug 27 03:43:37.008310 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2876/6027] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:37.051501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:37.060751 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6be8c45-94fd-4126-bd75-2e086c47376c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1273 microversion: 2.1 time: 0.328984 Aug 27 03:43:37.068226 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3152/6028] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:36 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:37.757646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:37.759432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:37.779070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:37.779793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:37.781113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:37.782061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:37.783329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:37.784006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:38.094901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:38.096889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:38.109952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:38.111684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:38.119355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:38.121046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:38.121703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:38.122587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:38.352747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:38.368718 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-acdeffb8-9107-42b7-ab76-1d376ad56790 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1273 microversion: 2.1 time: 0.277289 Aug 27 03:43:38.383039 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3153/6029] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:38 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:38.940484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:38.997802 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e5cff89-47fd-4aa9-8b12-6ff4235711e3 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1267 microversion: 2.1 time: 1.242969 Aug 27 03:43:39.012831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2877/6030] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:37 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1267 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:39.391133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:39.391954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:39.416244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:39.416751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:39.417195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:39.417919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:39.434816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:39.435303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:40.026390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:40.028029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:40.029409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:40.044285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-120553f2-2ca7-47fc-a04a-36ffe42821fd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 0.658778 Aug 27 03:43:40.045081 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3154/6031] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:39 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:40.054864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:40.059137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:40.060584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:40.062981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:40.063851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:40.064931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:40.598781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:40.612213 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f93368d6-e549-46e6-8f37-9db16e867823 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1453 microversion: 2.1 time: 0.593713 Aug 27 03:43:40.615551 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2878/6032] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:40 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1453 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:43:40.636266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:40.638182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:40.658683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:40.659573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:40.660457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:40.661421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:40.662384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:40.663157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:41.071662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:41.072886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:41.085091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:41.086646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:41.089107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:41.090049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:41.092766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:41.097675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:41.678048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:41.752228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:41.761395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:41.777107 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b740ea7-c820-4b56-ab68-0c885343590b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1453 microversion: 2.1 time: 1.145090 Aug 27 03:43:41.791521 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3155/6033] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:40 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1453 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:42.194409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:42.208661 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8fa7f950-ccdc-46fd-a8fa-a53874d7e8bf tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 1.141101 Aug 27 03:43:42.230262 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2879/6034] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:41 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:43.035987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-695cea94-2b0c-48ea-977e-9ac1bbdeec23 req-46a94c7d-9dec-4c8a-b96e-83bdc51ca929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97eb18ce-d41a-4136-a831-d0cf237920ca", "tag": "dc2c0cf9-e7bd-4d63-8467-83a04c279c71"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:43.063132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:43.072398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-695cea94-2b0c-48ea-977e-9ac1bbdeec23 req-46a94c7d-9dec-4c8a-b96e-83bdc51ca929 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.080303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-695cea94-2b0c-48ea-977e-9ac1bbdeec23 req-46a94c7d-9dec-4c8a-b96e-83bdc51ca929 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.081823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-695cea94-2b0c-48ea-977e-9ac1bbdeec23 req-46a94c7d-9dec-4c8a-b96e-83bdc51ca929 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:43.105818 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-695cea94-2b0c-48ea-977e-9ac1bbdeec23 req-46a94c7d-9dec-4c8a-b96e-83bdc51ca929 service nova] Creating event network-changed:dc2c0cf9-e7bd-4d63-8467-83a04c279c71 for instance 97eb18ce-d41a-4136-a831-d0cf237920ca on n-h1-852086-5 Aug 27 03:43:43.115370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-695cea94-2b0c-48ea-977e-9ac1bbdeec23 req-46a94c7d-9dec-4c8a-b96e-83bdc51ca929 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087180 Aug 27 03:43:43.117104 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3156/6035] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:43.235503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:43.236254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:43.246308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.247350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.248224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:43.249179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.251998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.252656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:43.760387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:43.776457 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b558d43-325b-4c18-bdd8-6b2a6bde5e19 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 0.545143 Aug 27 03:43:43.782572 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2880/6036] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:43 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:44.808732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:44.809502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:44.822299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=30 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:44.826804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:44.827677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:44.829011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:44.830725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:44.831421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:44.832062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:44.839937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=70 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:45.356855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:45.382455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2da9e0da-55ed-4018-93b4-f92bc006dbcd tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 0.577184 Aug 27 03:43:45.422600 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3157/6037] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:44 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:46.412791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:46.413458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:46.420672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:46.421842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:46.422547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:46.423506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:46.424142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:46.424762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:47.196229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:47.198778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=68 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:47.215376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22008e19-d5fc-4bb8-996e-ffff77c942b8 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 0.802716 Aug 27 03:43:47.216011 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2881/6038] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:46 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:48.245601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:48.246884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:48.258767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:48.261323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:48.261928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:48.263072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:48.263973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:48.264712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:49.171731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:49.182864 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a10b6737-8a39-4846-806e-c6a0008ea658 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 0.949646 Aug 27 03:43:49.197056 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3158/6039] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:48 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:49.950679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7c642293-1a7e-48fc-84a2-b78472299573 req-e9e05b33-c884-4531-bbe9-2eaf52491e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97eb18ce-d41a-4136-a831-d0cf237920ca", "name": "network-vif-plugged", "status": "completed", "tag": "dc2c0cf9-e7bd-4d63-8467-83a04c279c71"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:49.994991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:49.999052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c642293-1a7e-48fc-84a2-b78472299573 req-e9e05b33-c884-4531-bbe9-2eaf52491e97 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:49.999607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c642293-1a7e-48fc-84a2-b78472299573 req-e9e05b33-c884-4531-bbe9-2eaf52491e97 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.000458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c642293-1a7e-48fc-84a2-b78472299573 req-e9e05b33-c884-4531-bbe9-2eaf52491e97 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.025593 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7c642293-1a7e-48fc-84a2-b78472299573 req-e9e05b33-c884-4531-bbe9-2eaf52491e97 service nova] Creating event network-vif-plugged:dc2c0cf9-e7bd-4d63-8467-83a04c279c71 for instance 97eb18ce-d41a-4136-a831-d0cf237920ca on n-h1-852086-5 Aug 27 03:43:50.037020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7c642293-1a7e-48fc-84a2-b78472299573 req-e9e05b33-c884-4531-bbe9-2eaf52491e97 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091987 Aug 27 03:43:50.039917 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2882/6040] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:50.206024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:50.206853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:50.221821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.222376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.226674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.227819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.228329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.231993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.967168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:50.985669 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7bf68ede-2af6-4def-a6b3-52068711a203 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 0.784537 Aug 27 03:43:51.010201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3159/6041] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:50 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:51.513389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-70e3eb67-5de0-427b-b439-23d1a214edec req-aa2f8d92-5eab-4c3c-a57b-fea28f95988e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744be0ab-3af2-45d4-89a0-b0a2d15eb0b2", "tag": "dfa97205-e8ed-40ef-892c-c2007fc91a5b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:51.532173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70e3eb67-5de0-427b-b439-23d1a214edec req-aa2f8d92-5eab-4c3c-a57b-fea28f95988e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:51.540416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70e3eb67-5de0-427b-b439-23d1a214edec req-aa2f8d92-5eab-4c3c-a57b-fea28f95988e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:51.541091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70e3eb67-5de0-427b-b439-23d1a214edec req-aa2f8d92-5eab-4c3c-a57b-fea28f95988e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:51.564441 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-70e3eb67-5de0-427b-b439-23d1a214edec req-aa2f8d92-5eab-4c3c-a57b-fea28f95988e service nova] Creating event network-changed:dfa97205-e8ed-40ef-892c-c2007fc91a5b for instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 on n-h2-852086-5 Aug 27 03:43:51.603711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-70e3eb67-5de0-427b-b439-23d1a214edec req-aa2f8d92-5eab-4c3c-a57b-fea28f95988e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096058 Aug 27 03:43:51.604548 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2883/6042] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:52.022335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:52.023453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:52.082003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:52.085883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:52.087679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:52.093245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:52.096120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:52.099587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:52.590596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:52.600521 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d48b6385-6672-40b8-803f-eea4dc39f13c tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1315 microversion: 2.1 time: 0.585378 Aug 27 03:43:52.617274 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3160/6043] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:52 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:53.076199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-188495076", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "7cb3a677-8b06-4b3f-b94b-6ad93b763e5a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:53.177451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] validate_networks() for [('7cb3a677-8b06-4b3f-b94b-6ad93b763e5a', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:43:53.627765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:53.628364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:53.652078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:53.654355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:53.654830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:53.657305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:53.657970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:53.669331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.224526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:43:54.225071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:43:54.226457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:43:54.226457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:43:54.227357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:43:54.241199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.242139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.243414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.244471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.245263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.245949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.273343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Getting quotas for project e2766e9669794d37bc235377da5764ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:43:54.274852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:54.281159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Getting quotas for user ec574e7595134f35a2b8a74b288a185c and project e2766e9669794d37bc235377da5764ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:43:54.293157 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5375dc90-5253-42f8-ab16-8596ab92278f tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1464 microversion: 2.1 time: 0.671673 Aug 27 03:43:54.308863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:43:54.309649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3161/6044] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:53 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1464 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:54.313060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:43:54.358264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.359863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.372556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.373144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.375413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.378066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.381236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.381910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.392020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d99bb991-e71c-4d79-be6b-7ee62fc84d85 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.756150 Aug 27 03:43:54.396990 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2884/6045] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:43:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:43:54.409303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab8f386a-6415-45ab-962b-5dc5223bccd8 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.424070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab8f386a-6415-45ab-962b-5dc5223bccd8 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.439527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:43:54.595734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab8f386a-6415-45ab-962b-5dc5223bccd8 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:54.617212 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab8f386a-6415-45ab-962b-5dc5223bccd8 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1214 microversion: 2.1 time: 0.215181 Aug 27 03:43:54.618693 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2885/6046] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:54 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:54.666110 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a736e55-ddab-4c45-b159-1e08333f7dd5 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "DELETE /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 204 len: 0 microversion: 2.1 time: 0.311785 Aug 27 03:43:54.671811 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3162/6047] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:43:54 2022] DELETE /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:43:54.680540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.681377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.697212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.697731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.698191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.704023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.704712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.705175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:55.152234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:55.169689 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78ba39a6-9a91-48f8-b034-bef77d0d9aad tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1470 microversion: 2.1 time: 0.496261 Aug 27 03:43:55.187175 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2886/6048] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:54 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1470 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:55.647459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:55.651677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:55.687651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:55.692650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:55.695056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:55.700398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:55.701286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:55.703389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:55.879019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:55.895628 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1fe10e52-ea90-4779-b17a-416f4d55b43b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1266 microversion: 2.1 time: 0.260634 Aug 27 03:43:55.896651 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3163/6049] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:55 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:56.194849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:56.199357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:56.216341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.218623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.219511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:56.220537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.221320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.222026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:56.921969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:56.922995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:56.931035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.931922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.932579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:56.933673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.934451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.936014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:57.089807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:57.103271 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0b41981-5749-4208-a053-12f5780239f0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1272 microversion: 2.1 time: 0.186068 Aug 27 03:43:57.103871 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3164/6050] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:56 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:57.124541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:57.146421 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a224cdc-c365-4a04-a0aa-eadbc0ad9fa3 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1470 microversion: 2.1 time: 0.956503 Aug 27 03:43:57.154233 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2887/6051] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:56 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1470 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:57.778955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7fc72503-ee13-4c0f-80bf-9832e4bfd066 req-465c4936-97c5-4dd4-a315-0cf323eb4940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97eb18ce-d41a-4136-a831-d0cf237920ca", "name": "network-vif-deleted", "tag": "dc2c0cf9-e7bd-4d63-8467-83a04c279c71"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:57.807741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7fc72503-ee13-4c0f-80bf-9832e4bfd066 req-465c4936-97c5-4dd4-a315-0cf323eb4940 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:57.808418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7fc72503-ee13-4c0f-80bf-9832e4bfd066 req-465c4936-97c5-4dd4-a315-0cf323eb4940 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:57.808929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7fc72503-ee13-4c0f-80bf-9832e4bfd066 req-465c4936-97c5-4dd4-a315-0cf323eb4940 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:57.840880 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7fc72503-ee13-4c0f-80bf-9832e4bfd066 req-465c4936-97c5-4dd4-a315-0cf323eb4940 service nova] Creating event network-vif-deleted:dc2c0cf9-e7bd-4d63-8467-83a04c279c71 for instance 97eb18ce-d41a-4136-a831-d0cf237920ca on n-h1-852086-5 Aug 27 03:43:57.853932 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7fc72503-ee13-4c0f-80bf-9832e4bfd066 req-465c4936-97c5-4dd4-a315-0cf323eb4940 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079392 Aug 27 03:43:57.857335 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3165/6052] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:58.125140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:58.125788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:58.133689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:58.134823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:58.139225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:58.140828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:58.141498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:58.142118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:58.176278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:58.179040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:58.201903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:58.203425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:58.204039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:58.204645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:58.206596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:58.208314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:58.307156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:58.307702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:58.313841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:58.314834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lazy-loading 'fault' on Instance uuid 97eb18ce-d41a-4136-a831-d0cf237920ca {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:43:58.382387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:58.393964 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48be8b81-f473-4000-9882-cf4aac3ac292 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1272 microversion: 2.1 time: 0.272978 Aug 27 03:43:58.400614 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2888/6053] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:58 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:58.480364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e5a5d910e94148821a8585275146ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a835bbd87b74a989c2304944b48e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:58.495035 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6161400-c050-412f-9e01-307879888c94 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 200 len: 1305 microversion: 2.1 time: 0.327247 Aug 27 03:43:58.502549 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3166/6054] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:58 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 1305 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:43:59.419247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:59.419882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:59.430248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:59.431707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:59.432383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:59.434057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:59.435578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:59.436265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:59.525888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:59.548381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] [instance: 97eb18ce-d41a-4136-a831-d0cf237920ca] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:59.556095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:59.556862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:59.557483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:59.558407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:59.559849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:59.560288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:59.577123 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] HTTP exception thrown: Instance 97eb18ce-d41a-4136-a831-d0cf237920ca could not be found. Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Request method failure captured: Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca HTTP/1.1 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZLfGnK151OMCuCqYaVWq3CV3OdTyQfu5hr-qeiTHdv-7KPUYgmOcklUz9xLhr9Re_P2mCT8VSz_vckyoM9SPAkRckhCz8OnvtwKlKNvlxslFZR6y-p933ma4k6HHRvOC_KotDVbSTCGzFxcPU_wYawOeHMkR3HsoEvtzCDtTT3qqac Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 3a835bbd87b74a989c2304944b48e4f0 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesNegativeTest-1702978187 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3a835bbd87b74a989c2304944b48e4f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3a835bbd87b74a989c2304944b48e4f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3a835bbd87b74a989c2304944b48e4f0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3a835bbd87b74a989c2304944b48e4f0"}]}] Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesNegativeTest-1702978187 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 3a835bbd87b74a989c2304944b48e4f0 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesNegativeTest-1702978187 Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesNegativeTest-1702978187-project Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 52e5a5d910e94148821a8585275146ab Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesNegativeTest-1702978187-project Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 97eb18ce-d41a-4136-a831-d0cf237920ca could not be found. Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '97eb18ce-d41a-4136-a831-d0cf237920ca'} Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97eb18ce-d41a-4136-a831-d0cf237920ca could not be found. Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97eb18ce-d41a-4136-a831-d0cf237920ca could not be found. Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:59.578856 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:59.583899 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:59.583899 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:59.583899 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:59.583899 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:59.583899 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:59.583899 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97eb18ce-d41a-4136-a831-d0cf237920ca could not be found. Aug 27 03:43:59.583899 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:43:59.585625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] Returning 404 to user: Instance 97eb18ce-d41a-4136-a831-d0cf237920ca could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:59.586696 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4a8e4b65-1a36-45d8-8a83-8c2850230e83 tempest-VolumesNegativeTest-1702978187 tempest-VolumesNegativeTest-1702978187-project] 10.222.0.69 "GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca" status: 404 len: 111 microversion: 2.1 time: 0.065565 Aug 27 03:43:59.587978 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3167/6055] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:59 2022] GET /compute/v2.1/servers/97eb18ce-d41a-4136-a831-d0cf237920ca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:44:00.012883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:00.024887 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6429c75a-78e2-4eda-b64c-67964317b4e2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1314 microversion: 2.1 time: 0.609428 Aug 27 03:44:00.030264 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2889/6056] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:59 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:01.054224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:01.054824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:01.079050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:01.079929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:01.081707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:01.083373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:01.086461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:01.089396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:01.512234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:01.553843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fb5dbe4e-7799-4fd1-97ac-674d9f20a620 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1314 microversion: 2.1 time: 0.506544 Aug 27 03:44:01.555555 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3168/6057] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:01 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:01.685916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a96e8d0b-31c2-44f5-8ee7-74bf84f418b0 req-bdeb905c-eed3-44f8-94c4-0c76af1a3a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b27274-b142-4068-8014-b3635a519b1d", "tag": "511228b8-ef0b-48e3-b5e3-094532c827b0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:01.704422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a96e8d0b-31c2-44f5-8ee7-74bf84f418b0 req-bdeb905c-eed3-44f8-94c4-0c76af1a3a2f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:01.705092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a96e8d0b-31c2-44f5-8ee7-74bf84f418b0 req-bdeb905c-eed3-44f8-94c4-0c76af1a3a2f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:01.705640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a96e8d0b-31c2-44f5-8ee7-74bf84f418b0 req-bdeb905c-eed3-44f8-94c4-0c76af1a3a2f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:01.727448 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a96e8d0b-31c2-44f5-8ee7-74bf84f418b0 req-bdeb905c-eed3-44f8-94c4-0c76af1a3a2f service nova] Creating event network-changed:511228b8-ef0b-48e3-b5e3-094532c827b0 for instance e0b27274-b142-4068-8014-b3635a519b1d on n-h2-852086-5 Aug 27 03:44:01.743269 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a96e8d0b-31c2-44f5-8ee7-74bf84f418b0 req-bdeb905c-eed3-44f8-94c4-0c76af1a3a2f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053661 Aug 27 03:44:01.745779 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2890/6058] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:44:02.587070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:02.587695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:02.630264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:02.638485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:02.640132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:02.649755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:02.653838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:02.656481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:03.066351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:03.079386 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bab80719-5294-4496-8d3c-711915d9c754 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1314 microversion: 2.1 time: 0.494080 Aug 27 03:44:03.081565 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3169/6059] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:02 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:04.106355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:04.107269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:04.123817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:04.126154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:04.129894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:04.132559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:04.133314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:04.136626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:04.273739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:04.520196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:04.554572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6919a498-e906-47b4-a43d-48f92a3d0006 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1314 microversion: 2.1 time: 0.449327 Aug 27 03:44:04.555236 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2891/6060] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:04 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:05.579837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:05.581860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:05.602262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:05.603139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:05.603845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:05.607477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:05.608862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:05.610826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:05.810368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:05.838828 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-678bbb35-ef9b-4613-8b97-42626d3906d0 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1314 microversion: 2.1 time: 0.265622 Aug 27 03:44:05.850690 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3170/6061] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:05 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:06.866110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:06.867266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:06.872698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:06.879741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:06.880250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:06.880701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:06.881419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:06.884320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:06.886956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:07.341598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:07.377076 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25aef3f9-0355-44ae-b0ad-510078b79966 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1314 microversion: 2.1 time: 0.516413 Aug 27 03:44:07.377699 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2892/6062] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:06 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:07.463609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e554bc4e-2b45-4a1f-b248-bde8510a7468 req-e967fdc4-afd5-4d03-9cd3-010ff35d8b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b27274-b142-4068-8014-b3635a519b1d", "name": "network-vif-plugged", "status": "completed", "tag": "511228b8-ef0b-48e3-b5e3-094532c827b0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:07.496795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e554bc4e-2b45-4a1f-b248-bde8510a7468 req-e967fdc4-afd5-4d03-9cd3-010ff35d8b24 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:07.504168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e554bc4e-2b45-4a1f-b248-bde8510a7468 req-e967fdc4-afd5-4d03-9cd3-010ff35d8b24 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:07.504714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e554bc4e-2b45-4a1f-b248-bde8510a7468 req-e967fdc4-afd5-4d03-9cd3-010ff35d8b24 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:07.538006 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e554bc4e-2b45-4a1f-b248-bde8510a7468 req-e967fdc4-afd5-4d03-9cd3-010ff35d8b24 service nova] Creating event network-vif-plugged:511228b8-ef0b-48e3-b5e3-094532c827b0 for instance e0b27274-b142-4068-8014-b3635a519b1d on n-h2-852086-5 Aug 27 03:44:07.564567 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e554bc4e-2b45-4a1f-b248-bde8510a7468 req-e967fdc4-afd5-4d03-9cd3-010ff35d8b24 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101859 Aug 27 03:44:07.572186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3171/6063] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:08.403840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:08.404724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:08.425933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:08.426596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:08.442490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:08.443977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:08.444939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:08.445883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:08.740720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:08.752814 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-16b5dec4-0740-4331-ae68-c6b751833de2 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1314 microversion: 2.1 time: 0.352854 Aug 27 03:44:08.763020 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2893/6064] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:08 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:09.775804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:09.776515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:09.800534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:09.801046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:09.801502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:09.802279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:09.803019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:09.803456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.140707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:10.149026 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21a2e560-59b0-4d0a-9853-bfbc06745c5a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1501 microversion: 2.1 time: 0.377403 Aug 27 03:44:10.149627 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3172/6065] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:09 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1501 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:10.182358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:10.183037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:10.196126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.196914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.197543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.198537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.199202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.199951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.440580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:10.450409 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8ad79ec-d283-472c-bfd8-47cf93df265e tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1501 microversion: 2.1 time: 0.284712 Aug 27 03:44:10.456112 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2894/6066] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:10 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1501 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:10.475584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:10.476443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:10.491956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.495068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.495881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.499560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.500360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.501028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.578703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lazy-loading 'flavor' on Instance uuid e0b27274-b142-4068-8014-b3635a519b1d {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:44:10.585711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:10.754060 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce1c57bb-b519-4031-9e31-0e770cdf9e39 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.283086 Aug 27 03:44:10.755010 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3173/6067] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:10 2022] POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:10.763820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:10.765066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:10.774122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.775191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.776628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.777804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.778979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.779640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:11.249728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:11.267765 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-009e532c-6900-41a2-9651-c95a11fad229 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1509 microversion: 2.1 time: 0.505178 Aug 27 03:44:11.270415 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2895/6068] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:10 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:12.299985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:12.300959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:12.312514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.315420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.315863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.316648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.317056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.317486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.519117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:12.531412 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e08bca3-e1b7-4268-a76b-c8f32ee624ed tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1492 microversion: 2.1 time: 0.237583 Aug 27 03:44:12.532517 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3174/6069] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:12 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1492 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:12.557529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:12.559107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:12.567603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.568350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.569666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.570608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.571801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.572764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.726465 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98a1cff1-bcaf-49e8-a7a7-82dd312f3033 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.170912 Aug 27 03:44:12.728833 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2896/6070] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:12 2022] POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:12.740350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:12.741005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:12.762510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.765943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.766868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.767982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.768891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.769717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:13.213194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:13.226549 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-592c1a72-4f73-4879-80a0-b545630cfc9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1498 microversion: 2.1 time: 0.493630 Aug 27 03:44:13.236876 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3175/6071] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:12 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1498 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:14.258529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:14.260208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:14.277573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:14.279241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:14.281252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:14.284407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:14.286342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:14.287363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:14.525303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:14.560303 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-509de2b2-806f-4829-9b55-3f7db38c39a6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1498 microversion: 2.1 time: 0.311142 Aug 27 03:44:14.560946 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2897/6072] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:14 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1498 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:15.587330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:15.588247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:15.591454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:15.599927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.600917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.601677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.605098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.605932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.607032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.889807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:15.903394 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8fbbfab5-71af-43b6-b4ea-303357ca1a77 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1501 microversion: 2.1 time: 0.319528 Aug 27 03:44:15.921205 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3176/6073] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:15 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1501 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:15.929489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:15.930408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:15.941162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.941680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.942177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.942894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.943367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.943808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.969800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lazy-loading 'flavor' on Instance uuid e0b27274-b142-4068-8014-b3635a519b1d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:44:16.071656 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13eb1d08-a7b3-4f31-a487-2dbd70602b3c tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.143767 Aug 27 03:44:16.078393 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2898/6074] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:15 2022] POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:16.084873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:16.086176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:16.100876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.102855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.105270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.106951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.107454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.111222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.636255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:16.649929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59fc9cc5-4c49-4fb8-982f-d6755e74d466 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1509 microversion: 2.1 time: 0.571367 Aug 27 03:44:16.661779 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3177/6075] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:16 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1509 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:17.684637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:17.688170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:17.705946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:17.707949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:17.709287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:17.711969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:17.714979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:17.716602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:17.733559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:18.085520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:18.094995 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f094f1ec-d82b-4027-9ba6-dddb197f1047 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1492 microversion: 2.1 time: 0.415332 Aug 27 03:44:18.095603 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2899/6076] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:17 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1492 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:18.119809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:18.120943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:18.133554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.136069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.136787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.137745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.140543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.141220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.267308 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-54d97444-abfa-4fca-8824-e56dac23bbb4 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.151634 Aug 27 03:44:18.268928 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3178/6077] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:18 2022] POST /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:18.276784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:18.277422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:18.291961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.292474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.292926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.308056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.309819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.313589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:19.027726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:19.039830 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4134d79-c754-4a93-bfeb-e15864ee603b tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1498 microversion: 2.1 time: 0.766923 Aug 27 03:44:19.059080 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2900/6078] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:18 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1498 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:19.306870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7d987d5e-41eb-407b-aaf4-f7c428f3818a tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Action: 'create', calling method: .version_select at 0x7fe4602ebaf0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1262522443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLWMfO5qZkBOM1W49+I9KM8n93twHEnPvBj/XukrL1aJ4+yqzG14d2VyYie44FvE0xHyKmUJ2dRCGVUYkdit0ITabbyBeeOlau5GpbbzuGW403SL/4TAwV1QbizFhyOTg=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:19.347878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7d987d5e-41eb-407b-aaf4-f7c428f3818a tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Getting quotas for project 68b24ee21d014b1c80af4e05263b269b. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:44:19.357262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-7d987d5e-41eb-407b-aaf4-f7c428f3818a tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Getting quotas for user 005288c5b485480fac0f3885151d7b6d and project 68b24ee21d014b1c80af4e05263b269b. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:44:19.413717 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7d987d5e-41eb-407b-aaf4-f7c428f3818a tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.470311 Aug 27 03:44:19.416715 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3179/6079] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:44:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:20.073460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:20.074180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:20.091551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:20.095773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:20.096520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:20.097338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:20.098634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:20.099370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:20.100244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:21.414855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:21.434004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-118e1d19-04d3-407c-9514-bfce7a9d108f tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1498 microversion: 2.1 time: 1.370434 Aug 27 03:44:21.437606 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2901/6080] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:20 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1498 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:44:22.461448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:22.462942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:22.488809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:22.502075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:22.502823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:22.507341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:22.510618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:22.511314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.239451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:24.258749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca38d78f-5c7b-4e82-9f9a-ce4c97fdca46 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1501 microversion: 2.1 time: 1.801631 Aug 27 03:44:24.262368 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3180/6081] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:22 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1501 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:24.288701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.289301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:24.319356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.322520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.324109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.329990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.330783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.333719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.412973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:44:24.605188 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72af304a-8520-4c03-8c59-7e1ca36f0e9a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 204 len: 0 microversion: 2.1 time: 0.319330 Aug 27 03:44:24.606614 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2902/6082] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:44:24 2022] DELETE /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:44:24.618341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.619188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:24.649341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.649901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.650433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.651166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.651625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.652101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:25.381837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:25.391832 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce01abfe-d597-4540-a946-3a98e35d2ad6 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1507 microversion: 2.1 time: 0.779929 Aug 27 03:44:25.392438 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3181/6083] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:24 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1507 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:26.418965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:26.419580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:26.440060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:26.440912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:26.441645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:26.442786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:26.443489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:26.444240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:27.064951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:27.086713 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f28c15d3-4bf4-4d7e-a299-6df7dcd02f32 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1507 microversion: 2.1 time: 0.671592 Aug 27 03:44:27.087975 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2903/6084] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:26 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:28.116664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:28.117603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:28.139904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:28.140594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:28.144549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:28.146990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:28.147737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:28.148540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:28.682694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:28.697664 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0199a7dc-d0fa-4187-a92d-56f64b761994 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1507 microversion: 2.1 time: 0.585023 Aug 27 03:44:28.702709 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3182/6085] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:28 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1507 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:29.737704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:29.744073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:29.782439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:29.782439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:29.782439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:29.782439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:29.782439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:29.782439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:30.132000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:30.160667 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2382a030-fad7-44bf-b72f-50d200fde186 tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1465 microversion: 2.1 time: 0.439321 Aug 27 03:44:30.162085 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2904/6086] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:29 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1465 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:30.403160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:30.903960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-88c3f39c-6830-4af7-9c1e-e5fb41ad7d5c req-33c66227-9dfe-46a5-8607-fa7d2d43e312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b27274-b142-4068-8014-b3635a519b1d", "name": "network-vif-deleted", "tag": "511228b8-ef0b-48e3-b5e3-094532c827b0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:30.933678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-88c3f39c-6830-4af7-9c1e-e5fb41ad7d5c req-33c66227-9dfe-46a5-8607-fa7d2d43e312 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:30.943761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-88c3f39c-6830-4af7-9c1e-e5fb41ad7d5c req-33c66227-9dfe-46a5-8607-fa7d2d43e312 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:30.945277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-88c3f39c-6830-4af7-9c1e-e5fb41ad7d5c req-33c66227-9dfe-46a5-8607-fa7d2d43e312 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:31.022793 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-88c3f39c-6830-4af7-9c1e-e5fb41ad7d5c req-33c66227-9dfe-46a5-8607-fa7d2d43e312 service nova] Creating event network-vif-deleted:511228b8-ef0b-48e3-b5e3-094532c827b0 for instance e0b27274-b142-4068-8014-b3635a519b1d on n-h2-852086-5 Aug 27 03:44:31.043218 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-88c3f39c-6830-4af7-9c1e-e5fb41ad7d5c req-33c66227-9dfe-46a5-8607-fa7d2d43e312 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.644985 Aug 27 03:44:31.044250 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3183/6087] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:31.186272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:31.187661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:31.200984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.204905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.205906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:31.207319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:31.208756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:31.210658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.423405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:32.423987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:32.424334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:32.424965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lazy-loading 'fault' on Instance uuid e0b27274-b142-4068-8014-b3635a519b1d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:44:32.911492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec574e7595134f35a2b8a74b288a185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2766e9669794d37bc235377da5764ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:32.922773 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c2f500d-6ef6-4f6c-bc0c-73c0fd3c7edb tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 200 len: 1304 microversion: 2.1 time: 1.741251 Aug 27 03:44:32.945538 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2905/6088] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:31 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 1304 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:33.955743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:33.956669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] [instance: e0b27274-b142-4068-8014-b3635a519b1d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:33.985192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:33.998850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:33.999497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:34.001386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:34.008694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:34.012395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:34.079120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] HTTP exception thrown: Instance e0b27274-b142-4068-8014-b3635a519b1d could not be found. Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Request method failure captured: Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d HTTP/1.1 Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZLy3DdVBJCyTF8OYzj4XxuG5e3LkhZZotCy_486P-V9IvM7bxJChiGEJsd1oCUOkljTqjnftI5oBOXX6DUaeQPhbvOQWblSK7gau8kqOpApAazABIjUCRNox8KP_9CWebEyBd54HbGcNGvZMf-DdAe3hdavr-3vuE-OLkM1e2Fs8gk Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: e2766e9669794d37bc235377da5764ff Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestServerAdvancedOps-1302739089 Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e2766e9669794d37bc235377da5764ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e2766e9669794d37bc235377da5764ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e2766e9669794d37bc235377da5764ff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e2766e9669794d37bc235377da5764ff"}]}] Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestServerAdvancedOps-1302739089 Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: e2766e9669794d37bc235377da5764ff Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestServerAdvancedOps-1302739089 Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestServerAdvancedOps-1302739089-project Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: ec574e7595134f35a2b8a74b288a185c Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestServerAdvancedOps-1302739089-project Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance e0b27274-b142-4068-8014-b3635a519b1d could not be found. Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'e0b27274-b142-4068-8014-b3635a519b1d'} Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b27274-b142-4068-8014-b3635a519b1d could not be found. Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b27274-b142-4068-8014-b3635a519b1d could not be found. Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:44:34.081078 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b27274-b142-4068-8014-b3635a519b1d could not be found. Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] Returning 404 to user: Instance e0b27274-b142-4068-8014-b3635a519b1d could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:44:34.086622 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4687514-2b24-4ae2-a8a3-1cbc077d307a tempest-TestServerAdvancedOps-1302739089 tempest-TestServerAdvancedOps-1302739089-project] 10.222.0.69 "GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d" status: 404 len: 111 microversion: 2.1 time: 0.136245 Aug 27 03:44:34.091555 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3184/6089] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:33 2022] GET /compute/v2.1/servers/e0b27274-b142-4068-8014-b3635a519b1d => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:44:39.829299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1956916499-access_point-1250305755", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "1e04ccca-e0ae-47d8-acfa-36476c177c67"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1262522443", "security_groups": [{"name": "tempest-secgroup_access--797601955"}, {"name": "tempest-secgroup_general--1829413925"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:41.814282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] validate_networks() for [('1e04ccca-e0ae-47d8-acfa-36476c177c67', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:44:42.917015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:43.196952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:44:43.197586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:44:43.203395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:44:43.204156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:44:43.204689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:44:43.225797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:43.226510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:43.227766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:43.238564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:43.239240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:43.239783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:43.307652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Getting quotas for project 68b24ee21d014b1c80af4e05263b269b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:44:43.321184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Getting quotas for user 005288c5b485480fac0f3885151d7b6d and project 68b24ee21d014b1c80af4e05263b269b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:44:43.393996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:44:43.414814 n-d-852086-5 devstack@n-api.service[122408]: WARNING nova.utils [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1956916499-access_point-1250305755 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1956916499-ac Aug 27 03:44:43.415768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:44:43.582485 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99e7dc14-f525-4da6-a996-4f9700c4f781 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 3.760629 Aug 27 03:44:43.589603 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2906/6090] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:44:39 2022] POST /compute/v2.1/servers => generated 457 bytes in 3770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:44:43.598389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e1230367-53fc-4bb4-a114-377b6e86bfee tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:43.599216 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e1230367-53fc-4bb4-a114-377b6e86bfee tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:44.019182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:44.110670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e1230367-53fc-4bb4-a114-377b6e86bfee tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:44.129145 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e1230367-53fc-4bb4-a114-377b6e86bfee tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1295 microversion: 2.1 time: 0.533860 Aug 27 03:44:44.137691 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3185/6091] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:43 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1295 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:45.166099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:45.167472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:45.200686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:45.203933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:45.204425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:45.205225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:45.205726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:45.213072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:45.381771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:45.406797 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db9561c9-bc1e-45b6-bac2-3a631c6bfcfa tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1291 microversion: 2.1 time: 0.245878 Aug 27 03:44:45.423278 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2907/6092] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:45 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1291 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:46.432150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:46.433833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:46.453677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:46.456354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:46.457184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:46.458091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:46.459213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:46.459893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:46.460539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:46.765478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:46.776108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00e866be-655c-4498-8f4e-e8c5497dca59 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1365 microversion: 2.1 time: 0.348318 Aug 27 03:44:46.779394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3186/6093] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:46 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:47.801122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:47.801765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:47.817502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:47.818021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:47.818500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:47.827998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:47.828506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:47.838366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:47.960292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:47.971674 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4c4dc6d-a1e8-4426-86aa-014ba6ef71cb tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1353 microversion: 2.1 time: 0.174614 Aug 27 03:44:47.972363 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2908/6094] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:47 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:49.001604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:49.002805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:49.043222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:49.043876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:49.044185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:49.045010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:49.045643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:49.046368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:49.271503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:49.293082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e8c722e9-c27a-43f5-abcc-cb671dd97c5d tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1353 microversion: 2.1 time: 0.297837 Aug 27 03:44:49.294601 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3187/6095] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:48 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1353 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:50.318605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:50.319989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:50.324311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:50.336334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:50.337084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:50.337706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:50.338670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:50.339343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:50.340104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:50.798870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:50.815882 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21f35234-e274-4b10-992e-76cf29b6b397 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1472 microversion: 2.1 time: 0.497744 Aug 27 03:44:50.820146 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2909/6096] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:50 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:44:51.106959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-977ef5c7-b556-4344-825d-6e2b78aaf8dc req-2c00a070-c619-4e8b-a1ee-80f0d5b8f69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8e0267-dcfa-45ca-b8ac-dad339a896ab", "tag": "30acbdaa-903e-4d10-a0db-c3f69ed35fd5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:51.182678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-977ef5c7-b556-4344-825d-6e2b78aaf8dc req-2c00a070-c619-4e8b-a1ee-80f0d5b8f69c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:51.191889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-977ef5c7-b556-4344-825d-6e2b78aaf8dc req-2c00a070-c619-4e8b-a1ee-80f0d5b8f69c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:51.194367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-977ef5c7-b556-4344-825d-6e2b78aaf8dc req-2c00a070-c619-4e8b-a1ee-80f0d5b8f69c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:51.259208 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-977ef5c7-b556-4344-825d-6e2b78aaf8dc req-2c00a070-c619-4e8b-a1ee-80f0d5b8f69c service nova] Creating event network-changed:30acbdaa-903e-4d10-a0db-c3f69ed35fd5 for instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab on n-h1-852086-5 Aug 27 03:44:51.275761 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-977ef5c7-b556-4344-825d-6e2b78aaf8dc req-2c00a070-c619-4e8b-a1ee-80f0d5b8f69c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172452 Aug 27 03:44:51.277959 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3188/6097] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:51.859623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:51.860273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:51.884250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:51.884817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:51.885285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:51.886048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:51.886555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:51.887001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:52.264213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:52.278432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc46b552-4473-42a3-8975-143cb6168059 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1472 microversion: 2.1 time: 0.441848 Aug 27 03:44:52.280946 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2910/6098] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:51 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:53.304080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:53.314849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:53.331386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:53.332135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:53.332803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:53.338120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:53.339069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:53.339682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:53.655413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:53.664705 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3406656b-7c88-4214-856c-648384a253f7 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1472 microversion: 2.1 time: 0.366282 Aug 27 03:44:53.666088 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3189/6099] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:53 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1472 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:54.689265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:54.690943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:54.713042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:54.717777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:54.727799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:54.731049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:54.732172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:54.743347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:54.746544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:54.749599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:55.681052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:55.695297 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f1dc400-68d6-403f-973c-bc67a574fed0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1472 microversion: 2.1 time: 1.012397 Aug 27 03:44:55.708069 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2911/6100] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:54 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1472 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:44:56.745565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:56.747106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:56.764576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:56.770865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:56.777411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:56.778238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:56.779688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:56.782219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:56.782778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:57.218625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:57.253219 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a17cd6f-90df-4490-ade5-f5cfe1e0a821 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1472 microversion: 2.1 time: 0.517354 Aug 27 03:44:57.254028 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3190/6101] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:56 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1472 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:58.276783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:58.277360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:58.292385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:58.293318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:58.293787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:58.294604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:58.295557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:58.296176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:58.590110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-72c6da1b-8170-4613-a177-c5b7f4eb9d09 req-d97e6ca7-a88e-4801-9c32-bee0c955786b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8e0267-dcfa-45ca-b8ac-dad339a896ab", "name": "network-vif-plugged", "status": "completed", "tag": "30acbdaa-903e-4d10-a0db-c3f69ed35fd5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:58.611712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-72c6da1b-8170-4613-a177-c5b7f4eb9d09 req-d97e6ca7-a88e-4801-9c32-bee0c955786b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:58.612207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-72c6da1b-8170-4613-a177-c5b7f4eb9d09 req-d97e6ca7-a88e-4801-9c32-bee0c955786b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:58.612651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-72c6da1b-8170-4613-a177-c5b7f4eb9d09 req-d97e6ca7-a88e-4801-9c32-bee0c955786b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:58.632550 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-72c6da1b-8170-4613-a177-c5b7f4eb9d09 req-d97e6ca7-a88e-4801-9c32-bee0c955786b service nova] Creating event network-vif-plugged:30acbdaa-903e-4d10-a0db-c3f69ed35fd5 for instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab on n-h1-852086-5 Aug 27 03:44:58.639864 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-72c6da1b-8170-4613-a177-c5b7f4eb9d09 req-d97e6ca7-a88e-4801-9c32-bee0c955786b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052650 Aug 27 03:44:58.641085 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3191/6102] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:58.794814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:58.807580 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44646f5d-57ce-4c3b-bc20-659bebdd7fa5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1472 microversion: 2.1 time: 0.534605 Aug 27 03:44:58.814284 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2912/6103] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:58 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:59.833270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:59.834021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:59.846743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:59.847238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:59.849974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:59.855489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:59.857267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:59.857756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:00.313784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:00.331258 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a8277652-acd4-43cb-9301-f00edbc5d16f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1472 microversion: 2.1 time: 0.506043 Aug 27 03:45:00.354554 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3192/6104] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:59 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1472 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:01.352916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:01.354245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:01.371560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:01.371560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:01.379010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:01.383484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:01.384548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:01.386099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:02.128509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:02.149246 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b016a3db-49a0-49a1-bc11-fc587f7d19c4 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1643 microversion: 2.1 time: 0.800095 Aug 27 03:45:02.154276 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2913/6105] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:01 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1643 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:02.175794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:02.177142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:02.226611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:02.232893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:02.244242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:02.254807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:02.255596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:02.258762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:02.655693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:02.664629 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3eb155b-3b82-4c41-9be7-8a32a9142271 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1643 microversion: 2.1 time: 0.494408 Aug 27 03:45:02.666097 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3193/6106] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:02 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1643 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:02.686532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:02.687818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:02.697205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:02.698037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:02.699323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:02.700368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:02.702405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:02.705678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:03.714311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-841fd060-f75b-4ee6-b82d-15725f4fbf4b tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1794 microversion: 2.1 time: 1.028255 Aug 27 03:45:03.731601 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2914/6107] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:02 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1794 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:08.172639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e1db1aaf-1886-4b2a-a27d-8575c2d94f43 req-90fefd8c-09f5-4b49-bf4e-35baff0a73ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8e0267-dcfa-45ca-b8ac-dad339a896ab", "tag": "30acbdaa-903e-4d10-a0db-c3f69ed35fd5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:08.203331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e1db1aaf-1886-4b2a-a27d-8575c2d94f43 req-90fefd8c-09f5-4b49-bf4e-35baff0a73ab service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:08.207936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e1db1aaf-1886-4b2a-a27d-8575c2d94f43 req-90fefd8c-09f5-4b49-bf4e-35baff0a73ab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:08.210930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e1db1aaf-1886-4b2a-a27d-8575c2d94f43 req-90fefd8c-09f5-4b49-bf4e-35baff0a73ab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:08.246370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e1db1aaf-1886-4b2a-a27d-8575c2d94f43 req-90fefd8c-09f5-4b49-bf4e-35baff0a73ab service nova] Creating event network-changed:30acbdaa-903e-4d10-a0db-c3f69ed35fd5 for instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab on n-h1-852086-5 Aug 27 03:45:08.288799 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e1db1aaf-1886-4b2a-a27d-8575c2d94f43 req-90fefd8c-09f5-4b49-bf4e-35baff0a73ab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119167 Aug 27 03:45:08.292628 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3194/6108] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:42.702074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-304963568", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1842421952", "security_groups": [{"name": "tempest-secgroup-smoke-1427944589"}], "block_device_mapping_v2": [{"uuid": "daa9ccc2-2e54-4dab-aa32-1bea9114f06f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "624a27ca-ba59-43cb-b2ee-15e9c315bd25"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:42.724710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=11 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:42.725363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=50 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:43.000860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] validate_networks() for [('624a27ca-ba59-43cb-b2ee-15e9c315bd25', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:45:44.049748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:45:44.050362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:45:44.053059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:45:44.054093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:45:44.055371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:45:44.090071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:44.091214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:44.091976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:44.098994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:44.100137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:44.104849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:44.155031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:45:44.163504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Getting quotas for user 2bc63a76e5f94f06afefd6e61fc3f123 and project b410c14c58534c78a33eaef79c7b60e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:45:44.251896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:45:44.255283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='daa9ccc2-2e54-4dab-aa32-1bea9114f06f',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:45:44.609661 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ddb5ace8-f360-41a6-b6d6-02afba49dea2 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.910949 Aug 27 03:45:44.611862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2915/6109] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:45:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:45:44.628686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19127a69-e1e8-441f-a01c-de7a340d4848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:44.634186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19127a69-e1e8-441f-a01c-de7a340d4848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:44.646888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=17 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:44.653431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=42 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:45.579296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19127a69-e1e8-441f-a01c-de7a340d4848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:45.586835 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19127a69-e1e8-441f-a01c-de7a340d4848 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1094 microversion: 2.1 time: 0.967300 Aug 27 03:45:45.587432 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3195/6110] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:44 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1094 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:46.154409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-456749355", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "3d2ce62b-142b-4702-a695-9b669ed42c24"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:46.257214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] validate_networks() for [('3d2ce62b-142b-4702-a695-9b669ed42c24', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:45:46.615003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:46.615666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:46.633386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:46.636410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:46.636988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:46.637770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:46.641748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:46.642431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:46.794992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:46.817921 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab86d5d7-af55-4e58-8013-07d2c218e76c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1192 microversion: 2.1 time: 0.207312 Aug 27 03:45:46.820767 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3196/6111] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:46 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1192 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:47.847757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:47.851641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:47.885804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:47.895100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:47.897771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:47.898981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:47.920899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:47.923047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.287694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:45:48.288164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:45:48.288677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:45:48.289207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:45:48.289731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:45:48.306520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.313825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.314721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.315797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.316536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.317218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.364845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Getting quotas for project 695ba835bad34da19f4f0a2c84fd9c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:45:48.381181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Getting quotas for user 3e1208dc0446451ca3a7bbef33de7b39 and project 695ba835bad34da19f4f0a2c84fd9c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:45:48.411997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:45:48.421087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:45:48.532320 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46d9a99e-43c0-4994-83e6-a5aa2354bee0 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.617846 Aug 27 03:45:48.533605 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2916/6112] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:45:48.545788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce95d970-aa26-443a-bd82-04881c76bc70 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:48.556672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce95d970-aa26-443a-bd82-04881c76bc70 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:48.754544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:48.778547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a1c4229-4290-480f-b3b8-6a51128a6f04 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1210 microversion: 2.1 time: 0.929080 Aug 27 03:45:48.781429 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3197/6113] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:47 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1210 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:49.391427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ce95d970-aa26-443a-bd82-04881c76bc70 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:49.409131 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce95d970-aa26-443a-bd82-04881c76bc70 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1213 microversion: 2.1 time: 0.867272 Aug 27 03:45:49.413650 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2917/6114] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:48 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1213 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:45:49.807060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:49.808245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:49.827390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:49.827771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:49.829473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:49.830465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:49.830920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:49.844024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:50.436061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:50.436745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:50.468720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:50.473640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:50.474083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:50.491222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:50.501307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:50.502126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:50.964176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:50.981106 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e40a55e-7a88-4fed-915c-e1147839d199 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 1.175884 Aug 27 03:45:50.982821 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3198/6115] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:49 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:51.345303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:51.363131 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6ff47c0-fdd2-49ae-9984-391e137241c9 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1265 microversion: 2.1 time: 0.931529 Aug 27 03:45:51.365895 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2918/6116] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:50 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1265 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:52.005293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:52.006552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:52.031884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.032407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.049326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.056273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.060148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.065091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.384986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:52.386664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:52.412155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.413206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.413928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.414966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.418964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.419965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.797453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:52.815921 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2fa6d20f-e541-49f1-ad36-9bdb154b2551 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.812013 Aug 27 03:45:52.817883 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3199/6117] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:51 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:52.924412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:52.932978 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8fe633f0-bb53-41f9-8d93-950bf2ab7a10 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1271 microversion: 2.1 time: 0.551941 Aug 27 03:45:52.951102 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2919/6118] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:52 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1271 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:45:53.846220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:53.848145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:53.866222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:53.867024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:53.870497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:53.873147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:53.874934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:53.875085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:53.979784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:53.980804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:54.002966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.003486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.004075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.005233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.006630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.007540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.337636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:54.356969 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1292a8a8-35ae-4862-8216-077aa3154852 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1271 microversion: 2.1 time: 0.385003 Aug 27 03:45:54.361853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2920/6119] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:53 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1271 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:54.592861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:54.612834 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d45a75e4-6fc5-40fd-9282-fd841d6a5ab8 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.777462 Aug 27 03:45:54.633081 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3200/6120] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:53 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:55.384918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:55.385543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:55.401425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.404604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.405413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:55.408241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.411027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.411774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:55.643234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:55.649271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:55.650636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:55.660293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:55.661233 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-011d0081-d833-4b9d-b6ff-8011dc2e9ed8 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1271 microversion: 2.1 time: 0.280045 Aug 27 03:45:55.666283 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2921/6121] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:55 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:55.682427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.685067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.685730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:55.691563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.691931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.693422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:56.141474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bc905393-9723-45bf-81ba-19825f1286db req-e524c499-60a1-4fb7-a2e6-d29de11759a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251c38b0-5397-4030-82d8-d356b01c13e4", "tag": "dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:56.158653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bc905393-9723-45bf-81ba-19825f1286db req-e524c499-60a1-4fb7-a2e6-d29de11759a3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:56.159359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bc905393-9723-45bf-81ba-19825f1286db req-e524c499-60a1-4fb7-a2e6-d29de11759a3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:56.164403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bc905393-9723-45bf-81ba-19825f1286db req-e524c499-60a1-4fb7-a2e6-d29de11759a3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:56.189539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bc905393-9723-45bf-81ba-19825f1286db req-e524c499-60a1-4fb7-a2e6-d29de11759a3 service nova] Creating event network-changed:dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f for instance 251c38b0-5397-4030-82d8-d356b01c13e4 on n-h2-852086-5 Aug 27 03:45:56.196405 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bc905393-9723-45bf-81ba-19825f1286db req-e524c499-60a1-4fb7-a2e6-d29de11759a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057763 Aug 27 03:45:56.234873 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2922/6122] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:56.359165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:56.368904 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff42dedb-8613-418a-9f5e-d4f6d16575e0 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.732080 Aug 27 03:45:56.370253 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3201/6123] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:55 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:56.689203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:56.694988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:56.711012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:56.716922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:56.717610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:56.718755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:56.719417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:56.720321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:57.393780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:57.394766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:57.399155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:57.422776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:57.425053 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0eca0d8-e1fe-4a5d-b94a-05e92f216a63 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.730582 Aug 27 03:45:57.435091 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2923/6124] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:56 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:57.435552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:57.436124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:57.436902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:57.437379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:57.437809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:58.259593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:58.269082 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea0296f5-9f5b-405c-8eb0-ded6cab89771 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.879799 Aug 27 03:45:58.275836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3202/6125] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:57 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:45:58.459517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:58.460876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:58.468367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:58.499324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:58.503750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:58.505037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:58.507547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:58.510982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:58.522484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:59.254634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:59.266204 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e77737ac-7228-4c2e-a9ba-993e2a84ad60 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.811806 Aug 27 03:45:59.269310 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2924/6126] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:58 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:59.298840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:59.299844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:59.318246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:59.318796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:59.319258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:59.341378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:59.343174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:59.344003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:59.457162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-80283672", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "2d916032-92cc-4ed1-a45b-e732521ba4dd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1262522443", "security_groups": []}, "os:scheduler_hints": {"different_host": ["2f8e0267-dcfa-45ca-b8ac-dad339a896ab"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:59.489473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:59.588288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] validate_networks() for [('2d916032-92cc-4ed1-a45b-e732521ba4dd', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:45:59.723383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:59.738909 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7253becc-da09-4b65-8750-14dbadd34f4a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.444409 Aug 27 03:45:59.752744 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3203/6127] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:59 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:00.289302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:00.289918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:00.301021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:00.301701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:00.301951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:00.306915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:00.307763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:00.308253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:01.152191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:01.166716 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-191add80-af8b-4b22-bb06-9aaf9f93077a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.881369 Aug 27 03:46:01.167929 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3204/6128] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:00 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:01.176667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fec40b2b-39b6-4c1b-9731-efb7c2766ae1 req-087217fa-f6d7-4057-a150-71154743aea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341ba319-c23f-4a14-b2f9-ae4d4d4969b5", "tag": "49972f63-f934-459b-9714-c96af82f02dc"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:01.196853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fec40b2b-39b6-4c1b-9731-efb7c2766ae1 req-087217fa-f6d7-4057-a150-71154743aea8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:01.198730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fec40b2b-39b6-4c1b-9731-efb7c2766ae1 req-087217fa-f6d7-4057-a150-71154743aea8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:01.206901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fec40b2b-39b6-4c1b-9731-efb7c2766ae1 req-087217fa-f6d7-4057-a150-71154743aea8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:01.223285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fec40b2b-39b6-4c1b-9731-efb7c2766ae1 req-087217fa-f6d7-4057-a150-71154743aea8 service nova] Creating event network-changed:49972f63-f934-459b-9714-c96af82f02dc for instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 on n-h1-852086-5 Aug 27 03:46:01.245272 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fec40b2b-39b6-4c1b-9731-efb7c2766ae1 req-087217fa-f6d7-4057-a150-71154743aea8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075439 Aug 27 03:46:01.247176 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3205/6129] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:01.258354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:01.259431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:01.270460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:01.280327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:01.281058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:01.282121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:01.282805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:01.284022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:01.418023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:46:01.419252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:46:01.420655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:46:01.422461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:46:01.423280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:46:01.444125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:01.456253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:01.456910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:01.457768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:01.458287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:01.461554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:01.533998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Getting quotas for project 68b24ee21d014b1c80af4e05263b269b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:46:01.578525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Getting quotas for user 005288c5b485480fac0f3885151d7b6d and project 68b24ee21d014b1c80af4e05263b269b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:46:01.649538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:46:01.663552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:46:01.719447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:01.730963 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51b27aa9-e0bb-4e6f-8f5d-a46a8d1bb797 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.481917 Aug 27 03:46:01.732666 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3206/6130] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:01 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:01.764938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18e2d303-c3dc-40b0-86f0-fc5ac1fba6cc tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.313879 Aug 27 03:46:01.766260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2925/6131] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:45:59 2022] POST /compute/v2.1/servers => generated 361 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:46:01.777685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b793914e-0b45-48e9-9d76-ddbab2f51b11 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:01.778572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b793914e-0b45-48e9-9d76-ddbab2f51b11 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:02.032784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b793914e-0b45-48e9-9d76-ddbab2f51b11 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:02.078811 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b793914e-0b45-48e9-9d76-ddbab2f51b11 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1240 microversion: 2.1 time: 0.305839 Aug 27 03:46:02.083845 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3207/6132] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:01 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1240 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:02.190870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:02.191732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:02.200733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:02.201569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:02.202268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:02.203203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:02.203896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:02.204693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:02.528023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:02.539826 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b15289d-59e9-47ff-9637-f24963b751cc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.354774 Aug 27 03:46:02.550550 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2926/6133] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:02 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:02.753326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:02.753952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:02.781491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:02.781996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:02.782551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:02.798570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:02.799170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:02.799639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:03.104244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:03.106057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:03.131701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:03.135676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:03.137740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:03.142437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:03.143180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:03.143838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:03.339858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:03.361248 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64253e8f-d3c9-47a2-b6be-97669104121b tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1292 microversion: 2.1 time: 0.258358 Aug 27 03:46:03.362012 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2927/6134] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:03 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:03.520034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:03.529499 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c85cd696-76ad-4415-8671-fa84e4a0e43c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.780646 Aug 27 03:46:03.550040 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3208/6135] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:02 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:03.566451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:03.567096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:03.611600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:03.612132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:03.614674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:03.617774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:03.626014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:03.631392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:04.348213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:04.382439 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a08255f9-550d-40bd-8b7a-4164c5d883bf tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.820707 Aug 27 03:46:04.385068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:04.386847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:04.388023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2928/6136] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:03 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:04.395640 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:46:04.396078 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 03:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 (ip 10.222.0.69) !!! Aug 27 03:46:04.423265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:04.426221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:04.426926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:04.432682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:04.437178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:04.437888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:04.551880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:04.552567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:04.580723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:04.584447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:04.586876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:04.588216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:04.591695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:04.592656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:04.614457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:04.627840 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9b2633e-7282-45e5-80fb-2956492623f1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.246604 Aug 27 03:46:04.639045 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3209/6137] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:04 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:05.157224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:05.175729 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22f1b283-a226-4b00-8478-fcec49e0a5b4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1278 microversion: 2.1 time: 0.629370 Aug 27 03:46:05.177419 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2929/6138] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:04 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1278 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:05.351822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1007601944", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "7fc2ac56-a737-4221-8680-f0cdb83840a1"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:05.412592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:05.414293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:05.444523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:05.449496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:05.458275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:05.459815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:05.469296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:05.470607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:05.492512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] validate_networks() for [('7fc2ac56-a737-4221-8680-f0cdb83840a1', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:46:05.970151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:05.982183 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a8ba85d-1e6f-439b-8da8-7031cf18c953 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.580393 Aug 27 03:46:05.985863 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2930/6139] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:05 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:05.997967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:05.998641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:06.025238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.026055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.028520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:06.029543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.031270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.032686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:06.393924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:46:06.394392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:46:06.394968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:46:06.395506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:46:06.395984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:46:06.414954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.415468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.415911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:06.416658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.419447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.419892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:06.446421 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:46:06.447434 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 03:46:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 (ip 10.222.0.69) !!! Aug 27 03:46:06.476599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Getting quotas for project dc41d85ceb9f48daa8b69ab73061ee54. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:46:06.483446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Getting quotas for user 90176e8b65e3418684f95a4ae06d53a0 and project dc41d85ceb9f48daa8b69ab73061ee54. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:46:06.514013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:46:06.516434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:46:06.665397 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6cb6e0d9-96fd-493a-a6da-fba2cd5bd5d4 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.313825 Aug 27 03:46:06.667872 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3210/6140] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:46:06.682358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:06.683417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:06.695713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.696438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.697061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:06.699222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:06.700585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:06.701212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:07.070647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:07.098788 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-498cd6c7-28d2-4214-8465-17897308f559 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.425509 Aug 27 03:46:07.102918 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3211/6141] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:06 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:07.113596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b6e37ba7-cb2f-4d4b-8a5d-8dab9928c007 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:07.115497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b6e37ba7-cb2f-4d4b-8a5d-8dab9928c007 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:07.179591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:07.192585 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5b62b1a-13ad-4857-a775-ea1098ce6a99 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 1.203476 Aug 27 03:46:07.194832 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2931/6142] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:05 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:07.208701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:07.210535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:07.226049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:07.227117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:07.231441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:07.232457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:07.233115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:07.233730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:07.329484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b6e37ba7-cb2f-4d4b-8a5d-8dab9928c007 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:07.342883 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b6e37ba7-cb2f-4d4b-8a5d-8dab9928c007 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1214 microversion: 2.1 time: 0.237392 Aug 27 03:46:07.345641 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3212/6143] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:07 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:07.488505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:07.503099 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef1e7429-34f2-465d-af76-ec503fb7c161 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.305264 Aug 27 03:46:07.504985 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2932/6144] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:07 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:07.880074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-bfce6c69-2449-4771-a723-5e775a9aed16 req-3bb9cd3e-1b55-4fed-abb7-0cfd53d77e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8057fa-429d-4c51-9e50-957aa22b8362", "tag": "dd6a0d46-b0a4-4a39-b94b-6ebc3bf26655"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:07.910138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bfce6c69-2449-4771-a723-5e775a9aed16 req-3bb9cd3e-1b55-4fed-abb7-0cfd53d77e77 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:07.910978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bfce6c69-2449-4771-a723-5e775a9aed16 req-3bb9cd3e-1b55-4fed-abb7-0cfd53d77e77 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:07.912126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bfce6c69-2449-4771-a723-5e775a9aed16 req-3bb9cd3e-1b55-4fed-abb7-0cfd53d77e77 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:07.958484 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-bfce6c69-2449-4771-a723-5e775a9aed16 req-3bb9cd3e-1b55-4fed-abb7-0cfd53d77e77 service nova] Creating event network-changed:dd6a0d46-b0a4-4a39-b94b-6ebc3bf26655 for instance fd8057fa-429d-4c51-9e50-957aa22b8362 on n-h2-852086-5 Aug 27 03:46:07.970109 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-bfce6c69-2449-4771-a723-5e775a9aed16 req-3bb9cd3e-1b55-4fed-abb7-0cfd53d77e77 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102703 Aug 27 03:46:07.975240 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3213/6145] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:08.126381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:08.127747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:08.141809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.152781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.153949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.155490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.156242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.156960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.229776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:08.231424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:08.242095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.242780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.243288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.244123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.244819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.245793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.519950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:08.577182 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-056d73cf-e856-4c46-b905-20a6f3806bdc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.455165 Aug 27 03:46:08.578177 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2933/6146] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:08 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:08.583082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:08.583713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:08.607947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.612884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.615117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.617658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.618393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.619111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.728744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:08.738022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:08.751444 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b1163672-7731-41d2-a84f-ec2d52c0bc78 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.524083 Aug 27 03:46:08.752142 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3214/6147] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:08 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:08.754963 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cb14c1c-f7c8-429b-ad5d-3333ab3cf735 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1274 microversion: 2.1 time: 0.175256 Aug 27 03:46:08.776109 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2934/6148] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:08 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:08.779143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:08.786457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:08.805992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.806530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.806967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:08.807793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:08.816351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:08.817078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:09.119753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:09.130757 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7131064e-819c-489f-ac29-2dde562dfe31 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.369415 Aug 27 03:46:09.131679 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3215/6149] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:08 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:09.605915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:09.610592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:09.644252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:09.647295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:09.651799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:09.655415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:09.656463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:09.657617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:09.669810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:09.779319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:09.780688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:09.825525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:09.828808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:09.831511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:09.835354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:09.836261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:09.838298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:09.971633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:10.361986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:10.376058 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e7ebaefa-7611-4ec4-bf32-e40ec761b664 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.606591 Aug 27 03:46:10.377000 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3216/6150] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:09 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:10.393172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:10.393869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:10.633447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:10.633447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:10.633447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:10.633447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:10.633447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:10.633447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:10.637406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:10.637406 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af693cb2-f48c-4a86-8a25-b763f9eb8790 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.985246 Aug 27 03:46:10.637406 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2935/6151] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:09 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:10.637406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-afaf3746-acf5-4722-bad7-19fb02e57569 req-ce590a1d-d461-4482-b546-ee44b3c7cb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341ba319-c23f-4a14-b2f9-ae4d4d4969b5", "name": "network-vif-plugged", "status": "completed", "tag": "49972f63-f934-459b-9714-c96af82f02dc"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:10.650281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-afaf3746-acf5-4722-bad7-19fb02e57569 req-ce590a1d-d461-4482-b546-ee44b3c7cb8a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:10.650281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-afaf3746-acf5-4722-bad7-19fb02e57569 req-ce590a1d-d461-4482-b546-ee44b3c7cb8a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:10.650281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-afaf3746-acf5-4722-bad7-19fb02e57569 req-ce590a1d-d461-4482-b546-ee44b3c7cb8a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:10.692941 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-afaf3746-acf5-4722-bad7-19fb02e57569 req-ce590a1d-d461-4482-b546-ee44b3c7cb8a service nova] Creating event network-vif-plugged:49972f63-f934-459b-9714-c96af82f02dc for instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 on n-h1-852086-5 Aug 27 03:46:10.711949 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-afaf3746-acf5-4722-bad7-19fb02e57569 req-ce590a1d-d461-4482-b546-ee44b3c7cb8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123814 Aug 27 03:46:10.713987 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2936/6152] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:10.733256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:10.734133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:10.789217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:10.792056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:10.794393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:10.796681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:10.799397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:10.803144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:10.897356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:10.907280 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a202560-9e37-4a1e-a694-62f5ea47597e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.528985 Aug 27 03:46:10.924627 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3217/6153] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:10 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:11.404024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:11.404599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:11.441318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:11.456365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:11.459422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:11.462991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:11.463503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:11.466494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:11.492052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:11.496310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:11.517261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec8df877-9dd2-44d6-849a-66529fc8aa05 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.800918 Aug 27 03:46:11.517782 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2937/6154] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:10 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:11.604370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:11.605060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:11.619359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:11.625022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:11.625612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:11.626080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:11.626908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:11.627386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:11.627835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.065792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:12.076708 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bb9c7cb2-5e06-44ca-925e-848077945fbd tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.682608 Aug 27 03:46:12.079794 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3218/6155] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:11 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:12.096197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:12.098101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:12.107289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.112436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.113270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.114204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.114826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.115421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.371470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:12.385379 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f7a3c6a9-c53d-4a64-bf32-10390bd56b8d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.304068 Aug 27 03:46:12.386681 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3219/6156] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:12 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:12.387942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:12.416376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce0957f8-3428-478f-b2b5-dbc7ed4b5aff tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.815817 Aug 27 03:46:12.419614 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2938/6157] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:11 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:12.543166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:12.544886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:12.560530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.562574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.563388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.565251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.565983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.567323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.028355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:13.049935 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab568da2-6b9c-451f-91e5-ba39592e0cd2 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1313 microversion: 2.1 time: 0.511167 Aug 27 03:46:13.050623 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3220/6158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:12 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:13.099078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:13.099729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:13.125636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:13.132058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.139195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.144066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.145110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.145613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.146289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.341022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-68c6793f-5cf3-4803-a597-08cc40caf730 req-efeb6119-7916-4ac3-b158-5855e7820e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513cbac8-0e95-4747-b946-893cf9f7fd28", "tag": "c9f46ba3-3505-4f92-b581-024410fd964a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:13.361036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-68c6793f-5cf3-4803-a597-08cc40caf730 req-efeb6119-7916-4ac3-b158-5855e7820e2a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.361363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-68c6793f-5cf3-4803-a597-08cc40caf730 req-efeb6119-7916-4ac3-b158-5855e7820e2a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.361862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-68c6793f-5cf3-4803-a597-08cc40caf730 req-efeb6119-7916-4ac3-b158-5855e7820e2a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.427461 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-68c6793f-5cf3-4803-a597-08cc40caf730 req-efeb6119-7916-4ac3-b158-5855e7820e2a service nova] Creating event network-changed:c9f46ba3-3505-4f92-b581-024410fd964a for instance 513cbac8-0e95-4747-b946-893cf9f7fd28 on n-h1-852086-5 Aug 27 03:46:13.444263 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-68c6793f-5cf3-4803-a597-08cc40caf730 req-efeb6119-7916-4ac3-b158-5855e7820e2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112592 Aug 27 03:46:13.445340 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3221/6159] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:13.463238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:13.464146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:13.483025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.483657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.484111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.484866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.485323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.491023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.723958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:13.739509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1caf4b4-0fb1-4de7-91ae-2ae9c3e2792c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.644441 Aug 27 03:46:13.752433 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2939/6160] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:13 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:13.771673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:13.780845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:13.788198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.788726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.789189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.793602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.794125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.794631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.969435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:13.978841 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac306d0c-88ab-4ce0-b64a-f5b53c21f0bd tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.532244 Aug 27 03:46:13.985556 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3222/6161] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:13 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:14.072359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:14.073236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:14.087416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:14.090701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:14.091429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:14.094539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:14.095891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:14.099110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:14.489420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:14.509031 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af039a26-4dd0-4c88-a401-59a62c4a3816 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.753526 Aug 27 03:46:14.517394 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2940/6162] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:13 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:14.663127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:14.676750 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-144a2560-453d-4a98-a8db-f725fba7db9a tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1495 microversion: 2.1 time: 0.608825 Aug 27 03:46:14.677524 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3223/6163] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:14 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1495 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:14.774626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:14.775245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:14.790937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:14.791678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:14.793354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:14.794359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:14.794857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:14.795312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:14.976372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:14.990818 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97b687b7-3136-4fd9-92b9-416d54a0e217 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.221544 Aug 27 03:46:14.992467 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2941/6164] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:14 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:15.015584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:15.016219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:15.022003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:15.023953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.024661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.025295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:15.026304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.027416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.028743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:15.546393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:15.547097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:15.563213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.564342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.564814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:15.565576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.570517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.571084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:16.041036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:16.063383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-624ca199-535a-4d62-b93f-a2ea1301e0f4 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.526841 Aug 27 03:46:16.076531 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2942/6165] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:15 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:16.095952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:16.099300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:16.107237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:16.115866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10c26bff-347f-46a9-bb01-d9b82d8e7720 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 1.107820 Aug 27 03:46:16.119552 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3224/6166] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:15 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:16.133740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:16.136926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:16.139444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:16.140240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:16.140733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:16.144315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:16.316974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:16.335671 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35738d01-5490-49f8-896d-da81313719db tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.263776 Aug 27 03:46:16.336451 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2943/6167] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:16 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:16.791418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f83f5d8c-1ce0-4d4d-8c90-95de97ceb571 req-316cc03d-74be-4a92-a603-ace0a7c6923a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8057fa-429d-4c51-9e50-957aa22b8362", "name": "network-vif-plugged", "status": "completed", "tag": "dd6a0d46-b0a4-4a39-b94b-6ebc3bf26655"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:16.799638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:16.806972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f83f5d8c-1ce0-4d4d-8c90-95de97ceb571 req-316cc03d-74be-4a92-a603-ace0a7c6923a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:16.807902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f83f5d8c-1ce0-4d4d-8c90-95de97ceb571 req-316cc03d-74be-4a92-a603-ace0a7c6923a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:16.808577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f83f5d8c-1ce0-4d4d-8c90-95de97ceb571 req-316cc03d-74be-4a92-a603-ace0a7c6923a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:16.822373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f83f5d8c-1ce0-4d4d-8c90-95de97ceb571 req-316cc03d-74be-4a92-a603-ace0a7c6923a service nova] Creating event network-vif-plugged:dd6a0d46-b0a4-4a39-b94b-6ebc3bf26655 for instance fd8057fa-429d-4c51-9e50-957aa22b8362 on n-h2-852086-5 Aug 27 03:46:16.830829 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f83f5d8c-1ce0-4d4d-8c90-95de97ceb571 req-316cc03d-74be-4a92-a603-ace0a7c6923a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042251 Aug 27 03:46:16.832154 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3225/6168] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:17.094137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:17.094902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:17.103611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.104554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.106432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.107954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.108724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.109663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.138740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:17.140114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:17.164964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.165652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.165787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.166568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.167395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.168084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.336964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=10 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:17.374516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:17.389016 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-859682d9-6ce6-45e6-9fa8-d36edfcfb6bb tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.255660 Aug 27 03:46:17.390278 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3226/6169] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:17 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:17.399310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:17.401034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:17.409305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.410119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.410814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.411707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:17.412334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:17.413092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.580858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:17.591233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd97d5f4-12c4-4dbc-9a00-a5a3ebd3f6c5 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1298 microversion: 2.1 time: 0.199539 Aug 27 03:46:17.612124 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3227/6170] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:17 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1298 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:17.626107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:17.636665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5f79ad3-0098-4a6e-9611-c3da4ed760eb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.547682 Aug 27 03:46:17.650296 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2944/6171] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:17 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:18.411414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:18.412206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:18.428760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.429677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.430394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.431356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.432046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.432850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.613839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:18.615076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:18.628975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.630839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.633452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.634504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.637332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.641769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.774207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:18.784523 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a0d1035-69ba-49e2-8e0b-a55b5af89eb0 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.376553 Aug 27 03:46:18.785880 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3228/6172] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:18 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:18.791499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:18.793032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:18.801326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.802172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.802918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.804237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.804939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.805745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.963352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:18.978627 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c55fdcf-5740-4591-8eb9-a4379de8be30 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1471 microversion: 2.1 time: 0.369780 Aug 27 03:46:18.979470 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2945/6173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:18 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:18.986560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-58b5cd0c-ab96-48ee-b0d3-7efa0ef39910 req-6cfb55d7-9fe9-4bdf-b0be-4f794739a0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251c38b0-5397-4030-82d8-d356b01c13e4", "name": "network-vif-plugged", "status": "completed", "tag": "dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:19.018707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-58b5cd0c-ab96-48ee-b0d3-7efa0ef39910 req-6cfb55d7-9fe9-4bdf-b0be-4f794739a0ae service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.019610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-58b5cd0c-ab96-48ee-b0d3-7efa0ef39910 req-6cfb55d7-9fe9-4bdf-b0be-4f794739a0ae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.020274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-58b5cd0c-ab96-48ee-b0d3-7efa0ef39910 req-6cfb55d7-9fe9-4bdf-b0be-4f794739a0ae service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.034384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:19.046230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8845dfeb-0cde-4a2d-b9c5-df21499808de tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.257482 Aug 27 03:46:19.047034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3229/6174] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:18 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:19.052269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.053078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.054335 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-58b5cd0c-ab96-48ee-b0d3-7efa0ef39910 req-6cfb55d7-9fe9-4bdf-b0be-4f794739a0ae service nova] Creating event network-vif-plugged:dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f for instance 251c38b0-5397-4030-82d8-d356b01c13e4 on n-h2-852086-5 Aug 27 03:46:19.062744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.063422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.067222 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-58b5cd0c-ab96-48ee-b0d3-7efa0ef39910 req-6cfb55d7-9fe9-4bdf-b0be-4f794739a0ae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085459 Aug 27 03:46:19.067792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.068402 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2946/6175] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:19.068593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.069078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.069602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.201520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.202221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.211919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.212614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.213261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.214638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.215408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.216012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.235137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:19.249592 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-13e3fe27-228c-41c5-aa74-ffaeaca0d693 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1471 microversion: 2.1 time: 0.201164 Aug 27 03:46:19.264389 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3230/6176] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:19 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:19.264872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:46:19.276187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.277440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.287580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.291454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.293018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.299516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.300308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.306073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.373954 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb4629a4-3629-433e-9712-05a98dec8a76 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "DELETE /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 204 len: 0 microversion: 2.1 time: 0.175634 Aug 27 03:46:19.375550 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2947/6177] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:46:19 2022] DELETE /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:46:19.391640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.392769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.400256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.404123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.404866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.406444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.408149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.408921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.473323 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f5fc20a2-6804-4de7-b890-d7df586c3386 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1622 microversion: 2.1 time: 0.201309 Aug 27 03:46:19.476425 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3231/6178] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:19 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1622 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:19.508064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.509040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.525954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.527547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.528351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.529684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.530535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.531246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.784152 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b036e452-3ce0-41b8-aec6-f944b094e086 tempest-TestSecurityGroupsBasicOps-343343035 tempest-TestSecurityGroupsBasicOps-343343035-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1913 microversion: 2.1 time: 0.281317 Aug 27 03:46:19.785427 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3232/6179] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:19 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1913 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:19.818396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.819059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.834552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.839290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.839667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.844458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.845354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.846000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.879510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:19.899015 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2aeb42c0-771b-4762-8b34-7c8f6452d476 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1501 microversion: 2.1 time: 0.513188 Aug 27 03:46:19.902142 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2948/6180] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:19 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1501 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:19.929646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.930404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.955600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.956421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.957105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.958445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.959645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.960769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.012857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:46:20.101596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:20.111299 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e299b83b-9a11-4d2b-a60f-7e4df2f1d791 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.305737 Aug 27 03:46:20.112474 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3233/6181] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:19 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:20.120905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:20.122238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:20.128091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:20.132396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.133890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.134619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.135624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.136955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.137611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.168166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=100 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:20.195752 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7fa48306-e299-42fc-ae83-f4346e7f8484 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 204 len: 0 microversion: 2.1 time: 0.269981 Aug 27 03:46:20.198247 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2949/6182] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:46:19 2022] DELETE /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:46:20.218695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:20.219816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:20.255088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.255677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.256150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.256917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.257394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.257840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.393656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:20.404897 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ffc006b8-0d9e-414f-bf0e-12c5a9f3d5ec tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.290655 Aug 27 03:46:20.405870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3234/6183] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:20 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:20.484517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:20.502588 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08a98019-e1d5-4f12-ac58-5033a42049c2 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1477 microversion: 2.1 time: 0.298244 Aug 27 03:46:20.512853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2950/6184] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:20 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1477 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:20.933945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:20.934743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:20.946664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.947643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.949506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.951078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.951746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.952347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.134126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:21.134924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:21.155734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.156254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.156719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.157468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.157949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.158451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.369712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:21.382149 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8615583a-f976-4ada-986b-d2ad9ff0f0ff tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1501 microversion: 2.1 time: 0.452745 Aug 27 03:46:21.382930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3235/6185] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:20 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1501 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:21.431474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:21.432759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:21.465777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.475865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.477115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.481517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.484203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.486869 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.965649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:21.987540 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0846922e-7581-4b1e-883b-d435ce788955 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.857747 Aug 27 03:46:21.990887 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2951/6186] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:21 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:22.005462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:22.006090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:22.022596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.023569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.027204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.029606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.037179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.038300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.306684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:22.370490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6efc10b-7b1c-41eb-b3a9-b297746c63f7 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1266 microversion: 2.1 time: 0.945549 Aug 27 03:46:22.387773 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3236/6187] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:21 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1266 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:22.393807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0610b35c-71da-4b53-9dc1-232414cc115e req-d22d908f-622c-403b-9d5a-0c0862dd35f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341ba319-c23f-4a14-b2f9-ae4d4d4969b5", "name": "network-vif-deleted", "tag": "49972f63-f934-459b-9714-c96af82f02dc"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:22.439250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:22.445188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0610b35c-71da-4b53-9dc1-232414cc115e req-d22d908f-622c-403b-9d5a-0c0862dd35f8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.445693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0610b35c-71da-4b53-9dc1-232414cc115e req-d22d908f-622c-403b-9d5a-0c0862dd35f8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.446290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0610b35c-71da-4b53-9dc1-232414cc115e req-d22d908f-622c-403b-9d5a-0c0862dd35f8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.452737 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46e86220-1bd6-4aa1-80fd-b2a3a0f3702c tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1477 microversion: 2.1 time: 0.458406 Aug 27 03:46:22.467201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2952/6188] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:21 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1477 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:22.474016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:22.475832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:22.478329 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0610b35c-71da-4b53-9dc1-232414cc115e req-d22d908f-622c-403b-9d5a-0c0862dd35f8 service nova] Creating event network-vif-deleted:49972f63-f934-459b-9714-c96af82f02dc for instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 on n-h1-852086-5 Aug 27 03:46:22.484674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.486479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.487154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.488076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.491165 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.492901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.493504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0610b35c-71da-4b53-9dc1-232414cc115e req-d22d908f-622c-403b-9d5a-0c0862dd35f8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102368 Aug 27 03:46:22.494853 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3237/6189] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:22.511210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b0833b70-618b-46cc-bad0-e9f476792403 req-8392f771-4255-4afc-b326-1bfac4022989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513cbac8-0e95-4747-b946-893cf9f7fd28", "name": "network-vif-plugged", "status": "completed", "tag": "c9f46ba3-3505-4f92-b581-024410fd964a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:22.534626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0833b70-618b-46cc-bad0-e9f476792403 req-8392f771-4255-4afc-b326-1bfac4022989 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.535771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0833b70-618b-46cc-bad0-e9f476792403 req-8392f771-4255-4afc-b326-1bfac4022989 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.538039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b0833b70-618b-46cc-bad0-e9f476792403 req-8392f771-4255-4afc-b326-1bfac4022989 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.580834 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b0833b70-618b-46cc-bad0-e9f476792403 req-8392f771-4255-4afc-b326-1bfac4022989 service nova] Creating event network-vif-plugged:c9f46ba3-3505-4f92-b581-024410fd964a for instance 513cbac8-0e95-4747-b946-893cf9f7fd28 on n-h1-852086-5 Aug 27 03:46:22.585313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:22.585936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:22.586434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.586912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lazy-loading 'fault' on Instance uuid 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:22.594764 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b0833b70-618b-46cc-bad0-e9f476792403 req-8392f771-4255-4afc-b326-1bfac4022989 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096774 Aug 27 03:46:22.597276 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3238/6190] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:22.759146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1208dc0446451ca3a7bbef33de7b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695ba835bad34da19f4f0a2c84fd9c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:22.777029 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-616ee6ea-6317-4990-a88f-cbfce6e914bc tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 200 len: 1303 microversion: 2.1 time: 0.307627 Aug 27 03:46:22.780987 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2953/6191] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:22 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 1303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:23.021142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:23.023937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:23.036656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.037151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.037838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.039022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.039663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.040268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.410064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:23.411348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:23.445416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.446019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.446416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.451177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.451998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.458189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.534087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:23.559078 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed263afa-4c68-4265-9d06-e4d201f587ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1314 microversion: 2.1 time: 0.549573 Aug 27 03:46:23.561115 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3239/6192] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:23 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:23.566852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:23.567761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:23.575599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.576625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.577286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.578283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.578994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.579601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.654871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.655624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.656230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.656864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lazy-loading 'fault' on Instance uuid fd8057fa-429d-4c51-9e50-957aa22b8362 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:23.719892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:23.732079 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5557347-5b64-4c14-b5fb-c5e2cdb87653 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1452 microversion: 2.1 time: 0.326890 Aug 27 03:46:23.742522 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2954/6193] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:23 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1452 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:23.767958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:23.774775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:23.775505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:23.780311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-22c87ba2-c311-4453-882b-90dc04cba021 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 200 len: 1330 microversion: 2.1 time: 0.217898 Aug 27 03:46:23.781416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3240/6194] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:23 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 1330 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:23.784053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.785359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.786546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.788628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.789502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.790413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.809479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:23.810327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] [instance: 341ba319-c23f-4a14-b2f9-ae4d4d4969b5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:23.819384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.820063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.820840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.821887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.823612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.824210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.844395 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] HTTP exception thrown: Instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 could not be found. Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Request method failure captured: Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 HTTP/1.1 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZNm2QbrmCOujmYZKVXGMKAGz51ItLluEAsmPTne4mAjC9lNLHjyqGFi0npLKy9Lt5G2WRqq9P3-X5IVjmeUT_zjG1VAkwA54JZtt9smd6qHy8gXrzt2a3ptr3o21TgAIZDtWKsPzEnjl2g__o9BLUJaCM2ui5JhWd8STrIakXoXBZg Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 695ba835bad34da19f4f0a2c84fd9c7c Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesActionsTest-1143024887 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/695ba835bad34da19f4f0a2c84fd9c7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/695ba835bad34da19f4f0a2c84fd9c7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_695ba835bad34da19f4f0a2c84fd9c7c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/695ba835bad34da19f4f0a2c84fd9c7c"}]}] Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesActionsTest-1143024887 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 695ba835bad34da19f4f0a2c84fd9c7c Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesActionsTest-1143024887 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesActionsTest-1143024887-project Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 3e1208dc0446451ca3a7bbef33de7b39 Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesActionsTest-1143024887-project Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 could not be found. Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '341ba319-c23f-4a14-b2f9-ae4d4d4969b5'} Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 could not be found. Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 could not be found. Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:23.846477 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 could not be found. Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] Returning 404 to user: Instance 341ba319-c23f-4a14-b2f9-ae4d4d4969b5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64987f7c-e619-4f8d-a675-a65c48310199 tempest-VolumesActionsTest-1143024887 tempest-VolumesActionsTest-1143024887-project] 10.222.0.69 "GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5" status: 404 len: 111 microversion: 2.1 time: 0.049834 Aug 27 03:46:23.853574 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3241/6195] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:23 2022] GET /compute/v2.1/servers/341ba319-c23f-4a14-b2f9-ae4d4d4969b5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:24.026350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:24.039711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-871d5e4e-516d-4134-b697-62cfae8d6dfb tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1452 microversion: 2.1 time: 0.288474 Aug 27 03:46:24.041065 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2955/6196] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:23 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1452 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:24.529338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-635a1894-4ba3-4570-8ee9-1def19e4cc58 req-aa478ee3-b281-459f-b8da-d66fe2b5cc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8057fa-429d-4c51-9e50-957aa22b8362", "name": "network-vif-deleted", "tag": "dd6a0d46-b0a4-4a39-b94b-6ebc3bf26655"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:24.546873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-635a1894-4ba3-4570-8ee9-1def19e4cc58 req-aa478ee3-b281-459f-b8da-d66fe2b5cc57 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:24.547748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-635a1894-4ba3-4570-8ee9-1def19e4cc58 req-aa478ee3-b281-459f-b8da-d66fe2b5cc57 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:24.547937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-635a1894-4ba3-4570-8ee9-1def19e4cc58 req-aa478ee3-b281-459f-b8da-d66fe2b5cc57 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:24.564789 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-635a1894-4ba3-4570-8ee9-1def19e4cc58 req-aa478ee3-b281-459f-b8da-d66fe2b5cc57 service nova] Creating event network-vif-deleted:dd6a0d46-b0a4-4a39-b94b-6ebc3bf26655 for instance fd8057fa-429d-4c51-9e50-957aa22b8362 on n-h2-852086-5 Aug 27 03:46:24.568264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-635a1894-4ba3-4570-8ee9-1def19e4cc58 req-aa478ee3-b281-459f-b8da-d66fe2b5cc57 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042840 Aug 27 03:46:24.568901 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3242/6197] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:24.595069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:24.595717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:24.603540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:24.604302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:24.605456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:24.606904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:24.607778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:24.608396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:24.812542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:24.813261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: fd8057fa-429d-4c51-9e50-957aa22b8362] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:24.814109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:24.829046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:24.830204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:24.832055 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b77bf85c-bd18-4857-93ae-25c8c4e33316 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1499 microversion: 2.1 time: 0.240796 Aug 27 03:46:24.832493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:24.832973 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2956/6198] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:24 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1499 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:24.833439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:24.834656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:24.836974 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:24.861400 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] HTTP exception thrown: Instance fd8057fa-429d-4c51-9e50-957aa22b8362 could not be found. Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Request method failure captured: Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 HTTP/1.1 Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZMPzZ0lVjNb2hItCuQuF7QapkrZBlKnhXnKPIfzKeAYMLOMbl7PqoImyhEXMtttjv0re894-fSCJY4MAoLxDdDAfhkrsjeaV8BUxsmJHPJw20VO_ohgP190aL806kFB6gwLTI4fl7R4145UPnNTG-_X8XAb-GeBP6uLyhrHvf3TPIw Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 68b24ee21d014b1c80af4e05263b269b Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1956916499 Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/68b24ee21d014b1c80af4e05263b269b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/68b24ee21d014b1c80af4e05263b269b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_68b24ee21d014b1c80af4e05263b269b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/68b24ee21d014b1c80af4e05263b269b"}]}] Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1956916499 Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 68b24ee21d014b1c80af4e05263b269b Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1956916499 Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestSecurityGroupsBasicOps-1956916499-project Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 005288c5b485480fac0f3885151d7b6d Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1956916499-project Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance fd8057fa-429d-4c51-9e50-957aa22b8362 could not be found. Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'fd8057fa-429d-4c51-9e50-957aa22b8362'} Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8057fa-429d-4c51-9e50-957aa22b8362 could not be found. Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8057fa-429d-4c51-9e50-957aa22b8362 could not be found. Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:24.864010 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8057fa-429d-4c51-9e50-957aa22b8362 could not be found. Aug 27 03:46:24.867612 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:24.869189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Returning 404 to user: Instance fd8057fa-429d-4c51-9e50-957aa22b8362 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:24.870742 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bd23824f-fd44-4ee6-90bd-59dcef85b73f tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362" status: 404 len: 111 microversion: 2.1 time: 0.063154 Aug 27 03:46:24.875419 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3243/6199] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:24 2022] GET /compute/v2.1/servers/fd8057fa-429d-4c51-9e50-957aa22b8362 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:46:25.633321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:25.634519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:25.646497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:25.647284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:25.660931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:25.662105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:25.662954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:25.663728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:25.742983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:46:25.964552 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3778ae92-2e58-4a28-978b-3f942f2ab3ff tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "DELETE /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 204 len: 0 microversion: 2.1 time: 0.337095 Aug 27 03:46:25.965820 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2957/6200] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:46:25 2022] DELETE /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:46:25.974460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:25.974460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:25.985178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:25.985673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:25.986107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:25.986841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:25.987290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:25.987713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:26.418072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:26.431884 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49ce7a77-567d-404b-a27d-a13750c9c5ce tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1505 microversion: 2.1 time: 0.461700 Aug 27 03:46:26.469366 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3244/6201] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:25 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:27.456282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:27.457118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:27.470662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:27.471420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:27.472040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:27.473146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:27.473961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:27.474974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:28.567892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:28.585241 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57c9bfc7-778a-43b0-a4c3-6e275f39bb47 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1505 microversion: 2.1 time: 1.133146 Aug 27 03:46:28.589671 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2958/6202] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:27 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1505 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:28.837641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b2805da9-9045-4b0d-8150-1e1e257f4e56 req-c3936e42-0260-4785-afdb-6f44aea38569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251c38b0-5397-4030-82d8-d356b01c13e4", "tag": "dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:28.866118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2805da9-9045-4b0d-8150-1e1e257f4e56 req-c3936e42-0260-4785-afdb-6f44aea38569 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:28.868252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2805da9-9045-4b0d-8150-1e1e257f4e56 req-c3936e42-0260-4785-afdb-6f44aea38569 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:28.869640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2805da9-9045-4b0d-8150-1e1e257f4e56 req-c3936e42-0260-4785-afdb-6f44aea38569 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:28.912918 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b2805da9-9045-4b0d-8150-1e1e257f4e56 req-c3936e42-0260-4785-afdb-6f44aea38569 service nova] Creating event network-changed:dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f for instance 251c38b0-5397-4030-82d8-d356b01c13e4 on n-h2-852086-5 Aug 27 03:46:28.939537 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b2805da9-9045-4b0d-8150-1e1e257f4e56 req-c3936e42-0260-4785-afdb-6f44aea38569 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.442218 Aug 27 03:46:28.947409 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3245/6203] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:29.614467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:29.615122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:29.645529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:29.645996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:29.646603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:29.647615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:29.648534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:29.649132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:30.259816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:30.270990 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99cd7f1f-7baf-4b50-9967-e1a280454e2e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1505 microversion: 2.1 time: 0.663684 Aug 27 03:46:30.282381 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2959/6204] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:29 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1505 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:30.581507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0bec4de1-0dd8-413e-917b-e02277bd46e4 req-10a3fa97-5a32-42f4-b9a1-d047269d140c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513cbac8-0e95-4747-b946-893cf9f7fd28", "name": "network-vif-deleted", "tag": "c9f46ba3-3505-4f92-b581-024410fd964a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:30.649256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0bec4de1-0dd8-413e-917b-e02277bd46e4 req-10a3fa97-5a32-42f4-b9a1-d047269d140c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:30.651632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0bec4de1-0dd8-413e-917b-e02277bd46e4 req-10a3fa97-5a32-42f4-b9a1-d047269d140c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:30.656931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0bec4de1-0dd8-413e-917b-e02277bd46e4 req-10a3fa97-5a32-42f4-b9a1-d047269d140c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:30.710300 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0bec4de1-0dd8-413e-917b-e02277bd46e4 req-10a3fa97-5a32-42f4-b9a1-d047269d140c service nova] Creating event network-vif-deleted:c9f46ba3-3505-4f92-b581-024410fd964a for instance 513cbac8-0e95-4747-b946-893cf9f7fd28 on n-h1-852086-5 Aug 27 03:46:30.724937 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0bec4de1-0dd8-413e-917b-e02277bd46e4 req-10a3fa97-5a32-42f4-b9a1-d047269d140c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146108 Aug 27 03:46:30.727905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3246/6205] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:31.306483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:31.307271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:31.321536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:31.324243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:31.324760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:31.326029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:31.326555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:31.329584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:31.486588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:31.487923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:31.502664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:31.503390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lazy-loading 'fault' on Instance uuid 513cbac8-0e95-4747-b946-893cf9f7fd28 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:31.726232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:31.735371 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9212580-5bcc-456b-a1c7-1a70a14d2d73 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 200 len: 1304 microversion: 2.1 time: 0.434619 Aug 27 03:46:31.740272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2960/6206] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:31 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 1304 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:32.766826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:32.767591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 513cbac8-0e95-4747-b946-893cf9f7fd28] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:32.801169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:32.801169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:32.801169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:32.804571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:32.805142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:32.805600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:32.846807 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] HTTP exception thrown: Instance 513cbac8-0e95-4747-b946-893cf9f7fd28 could not be found. Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Request method failure captured: Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 HTTP/1.1 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZN43LPEzmFMxYxJWiWtqVBgHOd4sAl__9j9uapBOmZCXrrLyRhxi5e_ESkMbPstQWyzPG4P3PC3L4hRxO0K5oaX614mPEv7QYzoXMvGGTX6lLa-cRhkXnBS2mqZuUY2rEnzJii1JnMC1hDsYWdzqydRC2ZAJLu6wftEEw8dYTvx_8M Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: dc41d85ceb9f48daa8b69ab73061ee54 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesActionsTest-1494655463 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dc41d85ceb9f48daa8b69ab73061ee54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dc41d85ceb9f48daa8b69ab73061ee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dc41d85ceb9f48daa8b69ab73061ee54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dc41d85ceb9f48daa8b69ab73061ee54"}]}] Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesActionsTest-1494655463 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: dc41d85ceb9f48daa8b69ab73061ee54 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesActionsTest-1494655463 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesActionsTest-1494655463-project Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90176e8b65e3418684f95a4ae06d53a0 Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesActionsTest-1494655463-project Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 513cbac8-0e95-4747-b946-893cf9f7fd28 could not be found. Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '513cbac8-0e95-4747-b946-893cf9f7fd28'} Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513cbac8-0e95-4747-b946-893cf9f7fd28 could not be found. Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513cbac8-0e95-4747-b946-893cf9f7fd28 could not be found. Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:32.850503 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:32.856541 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:32.856541 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:32.856541 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:32.856541 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:32.856541 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:32.856541 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513cbac8-0e95-4747-b946-893cf9f7fd28 could not be found. Aug 27 03:46:32.856541 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:46:32.859146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Returning 404 to user: Instance 513cbac8-0e95-4747-b946-893cf9f7fd28 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:32.860504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32392596-b14a-449d-af1c-8e47e1830035 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28" status: 404 len: 111 microversion: 2.1 time: 0.098615 Aug 27 03:46:32.861848 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3247/6207] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:32 2022] GET /compute/v2.1/servers/513cbac8-0e95-4747-b946-893cf9f7fd28 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:32.964034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1144544440", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "7fc2ac56-a737-4221-8680-f0cdb83840a1"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:33.049571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] validate_networks() for [('7fc2ac56-a737-4221-8680-f0cdb83840a1', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:46:34.529804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:46:34.530459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:46:34.532910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:46:34.533392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:46:34.533885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:46:34.552336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:34.554994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:34.555811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:34.556992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:34.559537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:34.560639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:34.592444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Getting quotas for project dc41d85ceb9f48daa8b69ab73061ee54. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:46:34.601700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Getting quotas for user 90176e8b65e3418684f95a4ae06d53a0 and project dc41d85ceb9f48daa8b69ab73061ee54. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:46:34.640032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:46:34.642639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:46:34.732766 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5b3c170-758c-4356-ac07-1298df108374 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772484 Aug 27 03:46:34.741527 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2961/6208] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:46:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:46:34.745942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ede72e27-8fe2-4850-9c51-1bb0d83fcb2b tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:34.746677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ede72e27-8fe2-4850-9c51-1bb0d83fcb2b tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:34.915765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ede72e27-8fe2-4850-9c51-1bb0d83fcb2b tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:34.925636 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ede72e27-8fe2-4850-9c51-1bb0d83fcb2b tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1214 microversion: 2.1 time: 0.184107 Aug 27 03:46:34.928658 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3248/6209] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:34 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:35.738284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:35.738802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:35.777069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:35.778395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:35.781795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:35.785131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:35.787469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:35.790640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:35.858701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f4975052-c969-4274-8436-a2b75203f5a1 req-21b0a2e2-ce5e-4f3e-b266-18d15bd79cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8e0267-dcfa-45ca-b8ac-dad339a896ab", "tag": "30acbdaa-903e-4d10-a0db-c3f69ed35fd5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:35.893439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f4975052-c969-4274-8436-a2b75203f5a1 req-21b0a2e2-ce5e-4f3e-b266-18d15bd79cdf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:35.895752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f4975052-c969-4274-8436-a2b75203f5a1 req-21b0a2e2-ce5e-4f3e-b266-18d15bd79cdf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:35.896728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:46:35.899073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f4975052-c969-4274-8436-a2b75203f5a1 req-21b0a2e2-ce5e-4f3e-b266-18d15bd79cdf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:35.947295 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f4975052-c969-4274-8436-a2b75203f5a1 req-21b0a2e2-ce5e-4f3e-b266-18d15bd79cdf service nova] Creating event network-changed:30acbdaa-903e-4d10-a0db-c3f69ed35fd5 for instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab on n-h1-852086-5 Aug 27 03:46:35.954988 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f4975052-c969-4274-8436-a2b75203f5a1 req-21b0a2e2-ce5e-4f3e-b266-18d15bd79cdf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102283 Aug 27 03:46:35.955746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3249/6210] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:46:35.961042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:35.961950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:35.970856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:35.971529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:35.972134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:35.973202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:35.974093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:35.975261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:36.161160 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc7f8bbf-eded-47e4-ac5a-248248b85456 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 204 len: 0 microversion: 2.1 time: 0.419534 Aug 27 03:46:36.162346 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2962/6211] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:46:35 2022] DELETE /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:46:36.171414 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:36.178995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:36.191209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:36.191999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:36.192615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:36.193530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:36.194338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:36.194933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:36.196719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:36.200616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:36.217657 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c431684a-5a8c-4f26-b0d6-01389cc86b2c tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1210 microversion: 2.1 time: 0.260361 Aug 27 03:46:36.223373 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3250/6212] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:35 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1210 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:36.529478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:36.542284 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d996d45-4fe4-450e-bd77-da7594de0998 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1768 microversion: 2.1 time: 0.374619 Aug 27 03:46:36.543680 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2963/6213] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:36 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1768 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:37.240955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:37.242379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:37.250373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:37.251071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:37.251929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:37.252799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:37.253403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:37.254351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:37.358705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:37.375331 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90b9f1d2-1572-4dfc-b462-879cf4e82580 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1266 microversion: 2.1 time: 0.138138 Aug 27 03:46:37.389930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3251/6214] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:37 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:37.578031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:37.580387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:37.590310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:37.590918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:37.591329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:37.592088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:37.592570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:37.593019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:38.293000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:38.311432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f25b9b3-d776-4d5b-a6b3-3d7a9198ebf0 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1768 microversion: 2.1 time: 0.739995 Aug 27 03:46:38.328813 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2964/6215] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:37 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1768 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:38.396233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:38.396990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:38.408446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:38.408928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:38.409409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:38.410204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:38.410663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:38.411094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:38.619358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:38.656349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c2395a3f-6b32-496a-abca-593f287e912e tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1272 microversion: 2.1 time: 0.258896 Aug 27 03:46:38.659830 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3252/6216] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:38 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:39.340672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:39.341488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:39.355526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:39.356217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:39.356822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:39.357996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:39.358668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:39.359713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:39.527659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:39.547659 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b10ee2b9-009b-4d7c-a2f2-f19d9fe2e331 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1530 microversion: 2.1 time: 0.209806 Aug 27 03:46:39.548497 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2965/6217] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:39 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1530 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:39.682908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:39.684359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:39.697262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:39.701591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:39.704030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:39.709088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:39.709978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:39.711501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:39.727871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f3972a99-7e76-4591-b49c-d5cdb062cd17 req-03e1f073-f246-4a25-aa33-9c0f57d30f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8e0267-dcfa-45ca-b8ac-dad339a896ab", "name": "network-vif-deleted", "tag": "30acbdaa-903e-4d10-a0db-c3f69ed35fd5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:39.770803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f3972a99-7e76-4591-b49c-d5cdb062cd17 req-03e1f073-f246-4a25-aa33-9c0f57d30f8b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:39.772205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f3972a99-7e76-4591-b49c-d5cdb062cd17 req-03e1f073-f246-4a25-aa33-9c0f57d30f8b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:39.779563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f3972a99-7e76-4591-b49c-d5cdb062cd17 req-03e1f073-f246-4a25-aa33-9c0f57d30f8b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:39.827546 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f3972a99-7e76-4591-b49c-d5cdb062cd17 req-03e1f073-f246-4a25-aa33-9c0f57d30f8b service nova] Creating event network-vif-deleted:30acbdaa-903e-4d10-a0db-c3f69ed35fd5 for instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab on n-h1-852086-5 Aug 27 03:46:39.844296 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f3972a99-7e76-4591-b49c-d5cdb062cd17 req-03e1f073-f246-4a25-aa33-9c0f57d30f8b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120474 Aug 27 03:46:39.849122 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2966/6218] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:39.923130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:39.961455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-885a7680-6ae9-4be2-a140-bdd46b099e71 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1272 microversion: 2.1 time: 0.283208 Aug 27 03:46:39.970606 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3253/6219] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:39 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:40.613681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:40.619720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:40.670700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:40.672062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:40.672667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:40.673374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:40.685923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:40.689948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:40.917458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:40.953201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:40.953828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:40.954336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:40.954828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lazy-loading 'fault' on Instance uuid 2f8e0267-dcfa-45ca-b8ac-dad339a896ab {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:40.991785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:40.992426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:41.008507 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:41.009314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:41.012751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:41.023384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:41.027666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:41.032780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:41.206641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005288c5b485480fac0f3885151d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b24ee21d014b1c80af4e05263b269b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:41.232438 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d93c0e5-5bb3-48cd-8ac2-4be0cfa9c6e1 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 200 len: 1385 microversion: 2.1 time: 0.659104 Aug 27 03:46:41.237193 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2967/6220] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:40 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 1385 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:41.874742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:41.889367 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-67111656-dfae-4fef-abf9-16b2cdc012bc tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1314 microversion: 2.1 time: 0.902556 Aug 27 03:46:41.892211 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3254/6221] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:40 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:42.263758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:42.264405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] [instance: 2f8e0267-dcfa-45ca-b8ac-dad339a896ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:42.290258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:42.290799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:42.297473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:42.298190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:42.298680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:42.299166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:42.383779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] HTTP exception thrown: Instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab could not be found. Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Request method failure captured: Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab HTTP/1.1 Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZMPzZ0lVjNb2hItCuQuF7QapkrZBlKnhXnKPIfzKeAYMLOMbl7PqoImyhEXMtttjv0re894-fSCJY4MAoLxDdDAfhkrsjeaV8BUxsmJHPJw20VO_ohgP190aL806kFB6gwLTI4fl7R4145UPnNTG-_X8XAb-GeBP6uLyhrHvf3TPIw Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 68b24ee21d014b1c80af4e05263b269b Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1956916499 Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/68b24ee21d014b1c80af4e05263b269b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/68b24ee21d014b1c80af4e05263b269b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_68b24ee21d014b1c80af4e05263b269b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/68b24ee21d014b1c80af4e05263b269b"}]}] Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1956916499 Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 68b24ee21d014b1c80af4e05263b269b Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1956916499 Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestSecurityGroupsBasicOps-1956916499-project Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 005288c5b485480fac0f3885151d7b6d Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1956916499-project Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab could not be found. Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '2f8e0267-dcfa-45ca-b8ac-dad339a896ab'} Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab could not be found. Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab could not be found. Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:42.386477 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab could not be found. Aug 27 03:46:42.390276 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:42.392357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Returning 404 to user: Instance 2f8e0267-dcfa-45ca-b8ac-dad339a896ab could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:42.398771 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29114f6a-5edc-4c97-975e-e2b1a19412ef tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab" status: 404 len: 111 microversion: 2.1 time: 0.136121 Aug 27 03:46:42.399413 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2968/6222] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:42 2022] GET /compute/v2.1/servers/2f8e0267-dcfa-45ca-b8ac-dad339a896ab => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:46:42.623849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b18423c3-54df-4275-a9b6-113c49044cfc req-2d2828f7-e68e-4e30-8275-8a11d545bfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b1a9fb-c222-48f1-894c-03dd278b6231", "tag": "27c13974-7f30-4faf-bcb8-d5e256c625c3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:42.650102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b18423c3-54df-4275-a9b6-113c49044cfc req-2d2828f7-e68e-4e30-8275-8a11d545bfe8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:42.652900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b18423c3-54df-4275-a9b6-113c49044cfc req-2d2828f7-e68e-4e30-8275-8a11d545bfe8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:42.653524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b18423c3-54df-4275-a9b6-113c49044cfc req-2d2828f7-e68e-4e30-8275-8a11d545bfe8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:42.691302 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b18423c3-54df-4275-a9b6-113c49044cfc req-2d2828f7-e68e-4e30-8275-8a11d545bfe8 service nova] Creating event network-changed:27c13974-7f30-4faf-bcb8-d5e256c625c3 for instance 00b1a9fb-c222-48f1-894c-03dd278b6231 on n-h1-852086-5 Aug 27 03:46:42.711452 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b18423c3-54df-4275-a9b6-113c49044cfc req-2d2828f7-e68e-4e30-8275-8a11d545bfe8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112407 Aug 27 03:46:42.713055 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3255/6223] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:42.912882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:42.913717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:42.932247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:42.932776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:42.933231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:42.934535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:42.935666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:42.936262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:43.394580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:43.410296 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2cc7e98e-c55d-4f33-a441-ae4a26840969 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1314 microversion: 2.1 time: 0.500995 Aug 27 03:46:43.411241 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2969/6224] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:42 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:44.435150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:44.436509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:44.451079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:44.452717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:44.457079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:44.458139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:44.459136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:44.461332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:44.927476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:44.993225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:45.002901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee27d3dc-ca9a-4375-bd20-277436314a49 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1314 microversion: 2.1 time: 0.572909 Aug 27 03:46:45.018588 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3256/6225] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:44 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:46.033040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:46.034006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:46.036364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:46.037552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:46.056405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:46.062461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:46.064968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:46.066343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:46.067467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:46.067467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:46.652725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:46.667993 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ec512a0-9f85-41cf-8b69-3685ff8fce68 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1314 microversion: 2.1 time: 0.639696 Aug 27 03:46:46.672426 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2970/6226] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:46 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:47.693850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:47.695599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:47.713769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=70 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:47.715619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:47.716395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:47.717029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:47.717937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:47.718581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:47.719164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:48.090283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:48.107838 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-82c09b5c-9b26-481f-a20e-833dfd913fcf tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1314 microversion: 2.1 time: 0.418619 Aug 27 03:46:48.109518 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3257/6227] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:47 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:49.132565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:49.134009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:49.147826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:49.149351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:49.151601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:49.154438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:49.155219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:49.155950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:49.692808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:49.706276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd77ef8e-342f-47a6-9a41-c38a725ef1f5 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1314 microversion: 2.1 time: 0.577598 Aug 27 03:46:49.718240 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2971/6228] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:49 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:49.837395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-361478e3-c092-4090-8fb1-23ad1c7d899d req-ea53f57d-e3ca-40d7-948f-d197fab76402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b1a9fb-c222-48f1-894c-03dd278b6231", "name": "network-vif-plugged", "status": "completed", "tag": "27c13974-7f30-4faf-bcb8-d5e256c625c3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:49.877296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-361478e3-c092-4090-8fb1-23ad1c7d899d req-ea53f57d-e3ca-40d7-948f-d197fab76402 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:49.879675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-361478e3-c092-4090-8fb1-23ad1c7d899d req-ea53f57d-e3ca-40d7-948f-d197fab76402 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:49.881998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-361478e3-c092-4090-8fb1-23ad1c7d899d req-ea53f57d-e3ca-40d7-948f-d197fab76402 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:49.964926 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-361478e3-c092-4090-8fb1-23ad1c7d899d req-ea53f57d-e3ca-40d7-948f-d197fab76402 service nova] Creating event network-vif-plugged:27c13974-7f30-4faf-bcb8-d5e256c625c3 for instance 00b1a9fb-c222-48f1-894c-03dd278b6231 on n-h1-852086-5 Aug 27 03:46:50.008989 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-361478e3-c092-4090-8fb1-23ad1c7d899d req-ea53f57d-e3ca-40d7-948f-d197fab76402 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158078 Aug 27 03:46:50.015596 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3258/6229] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:50.751208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:50.751843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:50.779986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:50.780459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:50.780930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:50.781716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:50.782249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:50.782707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:51.127074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:51.140412 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e530018b-834f-4b16-b045-5254a28664c3 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1314 microversion: 2.1 time: 0.403100 Aug 27 03:46:51.146788 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2972/6230] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:50 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:51.600069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2dfae610-c1d4-4140-8391-7267daef8a19 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] Calling method '.version_select at 0x7fe457b5d550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:51.632881 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2dfae610-c1d4-4140-8391-7267daef8a19 tempest-TestSecurityGroupsBasicOps-1956916499 tempest-TestSecurityGroupsBasicOps-1956916499-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1262522443" status: 202 len: 0 microversion: 2.1 time: 0.050861 Aug 27 03:46:51.634340 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3259/6231] 10.222.0.69 () {58 vars in 1278 bytes} [Sat Aug 27 03:46:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1262522443 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:46:52.174762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:52.174762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:52.189922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:52.190740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:52.191424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:52.192181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:52.192693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:52.193127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:52.459343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:52.470326 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8c65e1b-c6ac-4ccf-9eb9-2e0b0f488ed2 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1499 microversion: 2.1 time: 0.303242 Aug 27 03:46:52.471321 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2973/6232] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:52 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1499 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:53.308349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:53.309655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:53.334614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:53.337578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:53.338854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:53.339812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:53.343292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:53.343980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:53.363749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:53.408274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:46:53.601991 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a81be63-10da-4897-9e70-550a3b9d0104 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 204 len: 0 microversion: 2.1 time: 0.299674 Aug 27 03:46:53.603080 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3260/6233] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:46:53 2022] DELETE /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:46:53.613981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:53.614668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:53.628251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:53.629754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:53.630193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:53.632437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:53.635138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:53.635612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:53.805355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:53.814843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e24cf4d-e7de-49d9-a472-d5c6259bfc96 tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1505 microversion: 2.1 time: 0.206194 Aug 27 03:46:53.827251 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2974/6234] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:53 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:54.850614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:54.863324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:54.877922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:54.886071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:54.888072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:54.888992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:54.891081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:54.891744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:55.350716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:55.364019 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-57c67593-fba8-4308-b729-1d5cdbf577db tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1505 microversion: 2.1 time: 0.530974 Aug 27 03:46:55.369505 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3261/6235] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:54 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:56.147775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ec0058c8-6f16-45cc-af72-6b530be34949 req-99750840-5437-49b9-8301-979a8dac5ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b1a9fb-c222-48f1-894c-03dd278b6231", "name": "network-vif-deleted", "tag": "27c13974-7f30-4faf-bcb8-d5e256c625c3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:56.199495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec0058c8-6f16-45cc-af72-6b530be34949 req-99750840-5437-49b9-8301-979a8dac5ac7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:56.202487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec0058c8-6f16-45cc-af72-6b530be34949 req-99750840-5437-49b9-8301-979a8dac5ac7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:56.203910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec0058c8-6f16-45cc-af72-6b530be34949 req-99750840-5437-49b9-8301-979a8dac5ac7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:56.251697 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ec0058c8-6f16-45cc-af72-6b530be34949 req-99750840-5437-49b9-8301-979a8dac5ac7 service nova] Creating event network-vif-deleted:27c13974-7f30-4faf-bcb8-d5e256c625c3 for instance 00b1a9fb-c222-48f1-894c-03dd278b6231 on n-h1-852086-5 Aug 27 03:46:56.277350 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ec0058c8-6f16-45cc-af72-6b530be34949 req-99750840-5437-49b9-8301-979a8dac5ac7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130281 Aug 27 03:46:56.280476 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2975/6236] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:56.394783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:56.396177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:56.409739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:56.410284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:56.418106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:56.421934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:56.423230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:56.425689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:56.568687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:56.569656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:56.570607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:56.578431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lazy-loading 'fault' on Instance uuid 00b1a9fb-c222-48f1-894c-03dd278b6231 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:46:56.700516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90176e8b65e3418684f95a4ae06d53a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc41d85ceb9f48daa8b69ab73061ee54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:56.719021 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4db9b0b3-63f3-49f3-90d6-59db899cb71d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 200 len: 1304 microversion: 2.1 time: 0.327156 Aug 27 03:46:56.721426 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3262/6237] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:56 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 1304 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:57.749045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:57.749780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] [instance: 00b1a9fb-c222-48f1-894c-03dd278b6231] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:57.770323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:57.777166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:57.777953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:57.779941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:57.780445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:57.782095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:57.820993 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] HTTP exception thrown: Instance 00b1a9fb-c222-48f1-894c-03dd278b6231 could not be found. Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Request method failure captured: Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 HTTP/1.1 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZN43LPEzmFMxYxJWiWtqVBgHOd4sAl__9j9uapBOmZCXrrLyRhxi5e_ESkMbPstQWyzPG4P3PC3L4hRxO0K5oaX614mPEv7QYzoXMvGGTX6lLa-cRhkXnBS2mqZuUY2rEnzJii1JnMC1hDsYWdzqydRC2ZAJLu6wftEEw8dYTvx_8M Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: dc41d85ceb9f48daa8b69ab73061ee54 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesActionsTest-1494655463 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dc41d85ceb9f48daa8b69ab73061ee54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dc41d85ceb9f48daa8b69ab73061ee54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dc41d85ceb9f48daa8b69ab73061ee54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dc41d85ceb9f48daa8b69ab73061ee54"}]}] Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesActionsTest-1494655463 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: dc41d85ceb9f48daa8b69ab73061ee54 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesActionsTest-1494655463 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-VolumesActionsTest-1494655463-project Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90176e8b65e3418684f95a4ae06d53a0 Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesActionsTest-1494655463-project Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 00b1a9fb-c222-48f1-894c-03dd278b6231 could not be found. Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '00b1a9fb-c222-48f1-894c-03dd278b6231'} Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b1a9fb-c222-48f1-894c-03dd278b6231 could not be found. Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b1a9fb-c222-48f1-894c-03dd278b6231 could not be found. Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:46:57.825746 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b1a9fb-c222-48f1-894c-03dd278b6231 could not be found. Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] Returning 404 to user: Instance 00b1a9fb-c222-48f1-894c-03dd278b6231 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:46:57.830629 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a727571b-6d40-42df-9c6d-fb4e6853d16d tempest-VolumesActionsTest-1494655463 tempest-VolumesActionsTest-1494655463-project] 10.222.0.69 "GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231" status: 404 len: 111 microversion: 2.1 time: 0.083915 Aug 27 03:46:57.835861 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2976/6238] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:57 2022] GET /compute/v2.1/servers/00b1a9fb-c222-48f1-894c-03dd278b6231 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:47:55.015092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-456600711", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:55.022509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:55.023334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:55.291272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] validate_networks() for None {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:47:55.497195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:47:55.497614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:47:55.498085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:47:55.498518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:47:55.498927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:47:55.513409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:55.514018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:55.514676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:55.515613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:55.516077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:55.516704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:55.539182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Getting quotas for project 5a7b4c1901bb402cba47de49a00d6268. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:47:55.546235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Getting quotas for user 8731e637ab004bffbee12b5b4250689c and project 5a7b4c1901bb402cba47de49a00d6268. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:47:55.561184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:47:55.563919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:47:55.618771 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd29d679-b3c3-497b-88b8-30ed15d885ca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609229 Aug 27 03:47:55.620203 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3263/6239] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:47:55.630759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6fc00418-8b8c-4d17-8b8d-ef696b7a536b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:55.631401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6fc00418-8b8c-4d17-8b8d-ef696b7a536b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:55.645324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=19 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:55.647283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=68 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:55.966652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6fc00418-8b8c-4d17-8b8d-ef696b7a536b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:55.986627 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6fc00418-8b8c-4d17-8b8d-ef696b7a536b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1213 microversion: 2.1 time: 0.352883 Aug 27 03:47:55.986627 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2977/6240] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:55 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1213 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:57.010542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:57.012029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:57.042526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:57.043039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:57.043560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:57.047835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:57.048981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:57.049679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:57.128100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:57.136628 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9ffc6643-d8d0-49ba-b452-0441ca38dfa5 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1265 microversion: 2.1 time: 0.133076 Aug 27 03:47:57.137226 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3264/6241] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:57 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:58.156861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:58.157504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:58.170922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:58.171462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:58.171911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:58.172654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:58.173137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:58.173581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:58.540040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:58.549678 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-949a4c2f-b156-457b-b50d-476aefe6dd88 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1313 microversion: 2.1 time: 0.396596 Aug 27 03:47:58.556928 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2978/6242] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:58 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:59.382240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8993b985-6d3b-4f05-8607-e3d0305640c0 req-a4d2eba8-688c-4aae-8dfe-d8627388ec77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268606c1-91e8-4556-a01f-793666644fc1", "tag": "19fb2a7a-e93d-46b6-93bb-b479f43d4614"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:59.417384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8993b985-6d3b-4f05-8607-e3d0305640c0 req-a4d2eba8-688c-4aae-8dfe-d8627388ec77 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:59.431159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8993b985-6d3b-4f05-8607-e3d0305640c0 req-a4d2eba8-688c-4aae-8dfe-d8627388ec77 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:59.435252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8993b985-6d3b-4f05-8607-e3d0305640c0 req-a4d2eba8-688c-4aae-8dfe-d8627388ec77 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:59.479547 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8993b985-6d3b-4f05-8607-e3d0305640c0 req-a4d2eba8-688c-4aae-8dfe-d8627388ec77 service nova] Creating event network-changed:19fb2a7a-e93d-46b6-93bb-b479f43d4614 for instance 268606c1-91e8-4556-a01f-793666644fc1 on n-h1-852086-5 Aug 27 03:47:59.501627 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8993b985-6d3b-4f05-8607-e3d0305640c0 req-a4d2eba8-688c-4aae-8dfe-d8627388ec77 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123684 Aug 27 03:47:59.502291 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3265/6243] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:59.575268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:59.575922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:59.593576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:59.594108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:59.594665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:59.595403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:59.595892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:59.599681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:59.903594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:59.949316 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a4c2d16-af53-45e0-ac99-1a4aad006c30 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1313 microversion: 2.1 time: 0.380793 Aug 27 03:47:59.957587 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2979/6244] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:59 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:00.980514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:00.981548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:00.988927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:00.989423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:00.989858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:00.990604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:00.991063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:00.991491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:01.144741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:01.152822 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ffb5d465-db56-40c5-8b3a-8a137fd9cec2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1313 microversion: 2.1 time: 0.178856 Aug 27 03:48:01.153325 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3266/6245] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:00 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:02.178227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:02.184211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:02.200216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:02.201178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:02.206850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:02.207801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:02.209660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:02.209660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:02.439017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:02.455366 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff44b00a-7dc4-4aaa-95a2-4b0bbfedba48 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1313 microversion: 2.1 time: 0.285516 Aug 27 03:48:02.465890 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2980/6246] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:02 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:03.482251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:03.483409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:03.492523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:03.493899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:03.494622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:03.495905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:03.496800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:03.497522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:03.751973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:03.761443 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6d8d40a-ad2a-4e3b-803b-5fff3e68916e tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1313 microversion: 2.1 time: 0.285654 Aug 27 03:48:03.762499 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3267/6247] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:03 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:04.789605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:04.790981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:04.799933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:04.800606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:04.801195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:04.802088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:04.802736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:04.803430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:05.009945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:05.020061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4aea6c79-b7ff-4985-91ea-654b0310e4a2 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1313 microversion: 2.1 time: 0.234554 Aug 27 03:48:05.020392 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2981/6248] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:04 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:05.572952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8ac8644a-5acb-40da-acdf-1f05b1ea85d0 req-d8c09006-7a39-4b82-bb44-fc1edc2fa253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268606c1-91e8-4556-a01f-793666644fc1", "name": "network-vif-plugged", "status": "completed", "tag": "19fb2a7a-e93d-46b6-93bb-b479f43d4614"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:05.584513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:05.586068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:05.589203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8ac8644a-5acb-40da-acdf-1f05b1ea85d0 req-d8c09006-7a39-4b82-bb44-fc1edc2fa253 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:05.589984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8ac8644a-5acb-40da-acdf-1f05b1ea85d0 req-d8c09006-7a39-4b82-bb44-fc1edc2fa253 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:05.593103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8ac8644a-5acb-40da-acdf-1f05b1ea85d0 req-d8c09006-7a39-4b82-bb44-fc1edc2fa253 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:05.608264 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8ac8644a-5acb-40da-acdf-1f05b1ea85d0 req-d8c09006-7a39-4b82-bb44-fc1edc2fa253 service nova] Creating event network-vif-plugged:19fb2a7a-e93d-46b6-93bb-b479f43d4614 for instance 268606c1-91e8-4556-a01f-793666644fc1 on n-h1-852086-5 Aug 27 03:48:05.622005 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8ac8644a-5acb-40da-acdf-1f05b1ea85d0 req-d8c09006-7a39-4b82-bb44-fc1edc2fa253 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054617 Aug 27 03:48:05.623748 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3268/6249] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:06.041713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:06.043169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:06.058551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:06.064496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:06.065283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:06.065931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:06.066793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:06.067436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:06.068098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:06.233568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:06.243616 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b94b448-1400-4ba5-b0b5-973126420339 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1313 microversion: 2.1 time: 0.206511 Aug 27 03:48:06.244742 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2982/6250] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:06 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:07.267031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:07.272157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:07.286036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:07.288986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:07.288986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:07.288986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:07.288986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:07.288986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:07.574570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:07.587553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0d93c07-9e14-4de1-98bd-dba712eacc95 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1462 microversion: 2.1 time: 0.324595 Aug 27 03:48:07.589189 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3269/6251] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:07 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1462 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:07.609229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d45fc5a4-abcd-400b-bcf1-ac65a86aa7f4", "device": "/dev/sdb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:07.612791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:07.623122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:07.624309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:07.625014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:07.625993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:07.626759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:07.627506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:07.946798 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fb9981f-d595-488d-9736-51a532e9e39b tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "POST /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339764 Aug 27 03:48:07.968183 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2983/6252] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:48:07 2022] POST /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:12.852295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:12.852881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:12.856741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-993a1162-f324-4922-95af-79b5abae1bb9 req-7fe294d2-0886-4c4f-88be-d614c731b4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251c38b0-5397-4030-82d8-d356b01c13e4", "tag": "dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:12.871033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:12.871894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:12.872505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:12.875548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:12.876233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:12.876891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:12.882678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-993a1162-f324-4922-95af-79b5abae1bb9 req-7fe294d2-0886-4c4f-88be-d614c731b4bc service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:12.883535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-993a1162-f324-4922-95af-79b5abae1bb9 req-7fe294d2-0886-4c4f-88be-d614c731b4bc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:12.887458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-993a1162-f324-4922-95af-79b5abae1bb9 req-7fe294d2-0886-4c4f-88be-d614c731b4bc service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:12.910280 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-993a1162-f324-4922-95af-79b5abae1bb9 req-7fe294d2-0886-4c4f-88be-d614c731b4bc service nova] Creating event network-changed:dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f for instance 251c38b0-5397-4030-82d8-d356b01c13e4 on n-h2-852086-5 Aug 27 03:48:12.924425 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-993a1162-f324-4922-95af-79b5abae1bb9 req-7fe294d2-0886-4c4f-88be-d614c731b4bc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079415 Aug 27 03:48:12.925385 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2984/6253] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:12.928226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:48:13.060311 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-31490492-a08f-42ad-bec1-7a26da25c10f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 204 len: 0 microversion: 2.1 time: 0.218870 Aug 27 03:48:13.061115 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3270/6254] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:48:12 2022] DELETE /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:48:13.069984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:13.071791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:13.085770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:13.086362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:13.087204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:13.088148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:13.092466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:13.093141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:13.337880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:13.347641 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71cdbab8-6c5f-4ec4-b6ec-af97949514a1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1576 microversion: 2.1 time: 0.281816 Aug 27 03:48:13.348907 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2985/6255] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:13 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1576 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:14.372281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:14.373072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:14.390441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:14.395295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:14.395956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:14.396905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:14.399042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:14.400073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:14.705296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:14.714670 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f4f9afd-1e40-4ca9-a938-28f33a87350a tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1576 microversion: 2.1 time: 0.346813 Aug 27 03:48:14.716792 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3271/6256] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:14 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1576 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:15.556486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1c563484-fe58-4fa3-841b-7a19d0ab1c20 req-a7931421-2749-416c-8c82-863cd67ba445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251c38b0-5397-4030-82d8-d356b01c13e4", "name": "network-vif-deleted", "tag": "dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:15.592041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1c563484-fe58-4fa3-841b-7a19d0ab1c20 req-a7931421-2749-416c-8c82-863cd67ba445 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:15.592632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1c563484-fe58-4fa3-841b-7a19d0ab1c20 req-a7931421-2749-416c-8c82-863cd67ba445 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:15.593133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1c563484-fe58-4fa3-841b-7a19d0ab1c20 req-a7931421-2749-416c-8c82-863cd67ba445 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:15.623157 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1c563484-fe58-4fa3-841b-7a19d0ab1c20 req-a7931421-2749-416c-8c82-863cd67ba445 service nova] Creating event network-vif-deleted:dafb0a3e-43ca-4ed8-b552-ecfc7dc7407f for instance 251c38b0-5397-4030-82d8-d356b01c13e4 on n-h2-852086-5 Aug 27 03:48:15.634902 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1c563484-fe58-4fa3-841b-7a19d0ab1c20 req-a7931421-2749-416c-8c82-863cd67ba445 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085408 Aug 27 03:48:15.650261 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2986/6257] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:15.738596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:15.741353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:15.754755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:15.755637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:15.756451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:15.757714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:15.759030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:15.759411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:15.840339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:15.851169 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ddcbc137-ac38-4e2a-9491-43c3ee90e192 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1225 microversion: 2.1 time: 0.116381 Aug 27 03:48:15.853296 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3272/6258] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:15 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:16.881401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:16.885193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:16.897223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:16.898831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:16.900347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:16.902018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:16.902699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:16.903912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:17.004700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:17.013976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8183c398-210a-4adb-8329-7c4c40cb9692 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1225 microversion: 2.1 time: 0.142854 Aug 27 03:48:17.015145 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2987/6259] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:16 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:18.036446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:18.037051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:18.052649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:18.053146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:18.053586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:18.055235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:18.055793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:18.056225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:18.152287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:18.160698 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c758f5b6-7b8d-4fb1-8f06-2ceab1d84d4f tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1225 microversion: 2.1 time: 0.128720 Aug 27 03:48:18.161539 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3273/6260] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:18 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:19.183047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:19.184282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:19.201751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:19.202295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:19.202800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:19.203468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:19.203937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:19.204389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:19.330445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:19.354436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5187e96-f5d8-41ca-a148-e75f7c933282 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1225 microversion: 2.1 time: 0.176026 Aug 27 03:48:19.356703 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2988/6261] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:19 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:20.380588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:20.382137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:20.399534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:20.400520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:20.401138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:20.402863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:20.403602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:20.404192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:20.598187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:20.610234 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-260b8a76-48b6-4650-95b9-194802443c38 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1225 microversion: 2.1 time: 0.234690 Aug 27 03:48:20.611362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3274/6262] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:20 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1225 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:21.634538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:21.640784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:21.661853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:21.662423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:21.662887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:21.663633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:21.664650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:21.665190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:21.802425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:21.813324 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c35f60c9-1638-438a-8c46-7394a4cb4dda tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1225 microversion: 2.1 time: 0.185879 Aug 27 03:48:21.829034 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2989/6263] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:21 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1225 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:22.838640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:22.839367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:22.855983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:22.856577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:22.857024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:22.857753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:22.858239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:22.858677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:22.960435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:22.977452 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b39266cd-692d-4177-93b5-d8da451988fc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1225 microversion: 2.1 time: 0.142954 Aug 27 03:48:22.978375 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3275/6264] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:22 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:23.999687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:24.000725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:24.011781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:24.012308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:24.012760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:24.013528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:24.014230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:24.014706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:24.091498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:24.093404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:24.095244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:24.096105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lazy-loading 'fault' on Instance uuid 251c38b0-5397-4030-82d8-d356b01c13e4 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:48:24.677808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:24.699743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a452c1d4-abd2-400a-8577-04b997d925c1 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 200 len: 1184 microversion: 2.1 time: 0.703848 Aug 27 03:48:24.701932 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2990/6265] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:23 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 1184 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:25.723884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:25.724502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 251c38b0-5397-4030-82d8-d356b01c13e4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:25.727746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:25.748473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:25.749686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:25.750513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:25.752209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:25.752487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:25.753786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:25.760546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:25.777995 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 251c38b0-5397-4030-82d8-d356b01c13e4 could not be found. Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 HTTP/1.1 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 251c38b0-5397-4030-82d8-d356b01c13e4 could not be found. Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '251c38b0-5397-4030-82d8-d356b01c13e4'} Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251c38b0-5397-4030-82d8-d356b01c13e4 could not be found. Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251c38b0-5397-4030-82d8-d356b01c13e4 could not be found. Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:25.780180 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:25.783927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:25.783927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:25.783927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:25.783927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:48:25.783927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:48:25.783927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251c38b0-5397-4030-82d8-d356b01c13e4 could not be found. Aug 27 03:48:25.783927 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:25.786440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 251c38b0-5397-4030-82d8-d356b01c13e4 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:48:25.787757 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6bc706bc-23f4-4782-9367-a95bb3d4a058 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4" status: 404 len: 111 microversion: 2.1 time: 0.067807 Aug 27 03:48:25.788974 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3276/6266] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:25 2022] GET /compute/v2.1/servers/251c38b0-5397-4030-82d8-d356b01c13e4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:48:36.434331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-18df5e56-0f10-49bb-8b6b-34bb087fe279 req-6deebc9e-0b8c-4e44-8d97-398d755b83fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744be0ab-3af2-45d4-89a0-b0a2d15eb0b2", "tag": "dfa97205-e8ed-40ef-892c-c2007fc91a5b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:36.437764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:36.444509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:36.447116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:36.453316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:36.459923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:36.467078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-18df5e56-0f10-49bb-8b6b-34bb087fe279 req-6deebc9e-0b8c-4e44-8d97-398d755b83fe service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:36.467848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-18df5e56-0f10-49bb-8b6b-34bb087fe279 req-6deebc9e-0b8c-4e44-8d97-398d755b83fe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:36.468267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-18df5e56-0f10-49bb-8b6b-34bb087fe279 req-6deebc9e-0b8c-4e44-8d97-398d755b83fe service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:36.472101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:36.473392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:36.480589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:36.481502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:36.482478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:36.497677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:36.504892 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-18df5e56-0f10-49bb-8b6b-34bb087fe279 req-6deebc9e-0b8c-4e44-8d97-398d755b83fe service nova] Creating event network-changed:dfa97205-e8ed-40ef-892c-c2007fc91a5b for instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 on n-h2-852086-5 Aug 27 03:48:36.517944 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-18df5e56-0f10-49bb-8b6b-34bb087fe279 req-6deebc9e-0b8c-4e44-8d97-398d755b83fe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090415 Aug 27 03:48:36.518841 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3277/6267] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:48:36.649443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:48:36.893141 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c5f0d30-9b53-40c8-9b04-1082303db2af tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 204 len: 0 microversion: 2.1 time: 0.476418 Aug 27 03:48:36.894032 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2991/6268] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:48:36 2022] DELETE /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:48:36.925434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:36.932285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:36.973929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:36.974804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:36.988998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:36.989827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:36.992287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:36.993053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:37.323580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:37.334659 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c374688c-c8ca-4328-94ff-921a731cea08 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1578 microversion: 2.1 time: 0.431574 Aug 27 03:48:37.336169 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3278/6269] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:36 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1578 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:38.408941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:38.412421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:38.443781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:38.444325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:38.446011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:38.446816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:38.447296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:38.447746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:38.857202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:38.865879 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-993b2cca-03b0-4d59-816c-9244c61d159d tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1578 microversion: 2.1 time: 0.461947 Aug 27 03:48:38.882186 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2992/6270] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:38 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1578 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:39.255536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-12164faf-e8df-4e05-9e70-cef47a8ede7c req-970665b0-d4d1-4c60-acb1-77fe1b179c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744be0ab-3af2-45d4-89a0-b0a2d15eb0b2", "name": "network-vif-deleted", "tag": "dfa97205-e8ed-40ef-892c-c2007fc91a5b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:39.275950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-12164faf-e8df-4e05-9e70-cef47a8ede7c req-970665b0-d4d1-4c60-acb1-77fe1b179c50 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:39.276813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-12164faf-e8df-4e05-9e70-cef47a8ede7c req-970665b0-d4d1-4c60-acb1-77fe1b179c50 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:39.277485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-12164faf-e8df-4e05-9e70-cef47a8ede7c req-970665b0-d4d1-4c60-acb1-77fe1b179c50 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:39.295015 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-12164faf-e8df-4e05-9e70-cef47a8ede7c req-970665b0-d4d1-4c60-acb1-77fe1b179c50 service nova] Creating event network-vif-deleted:dfa97205-e8ed-40ef-892c-c2007fc91a5b for instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 on n-h2-852086-5 Aug 27 03:48:39.301292 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-12164faf-e8df-4e05-9e70-cef47a8ede7c req-970665b0-d4d1-4c60-acb1-77fe1b179c50 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049971 Aug 27 03:48:39.306779 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3279/6271] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:39.897727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:39.899431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:39.916553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:39.920248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:39.920912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:39.921832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:39.922898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:39.924669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:40.106810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:40.117952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d77c239-3ec4-4ed3-a5b2-7fbd667f551c tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1226 microversion: 2.1 time: 0.224792 Aug 27 03:48:40.120909 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2993/6272] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:39 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:41.140380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:41.141094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:41.169409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:41.170780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:41.171325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:41.183761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:41.183761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:41.183761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:41.433745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:41.445641 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-258ef0b4-5585-4aea-baaa-e293fff882e9 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1226 microversion: 2.1 time: 0.310079 Aug 27 03:48:41.446458 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3280/6273] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:41 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:42.472009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:42.472648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:42.496364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:42.498261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:42.498938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:42.503180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:42.503767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:42.506265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:42.608368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:42.623668 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25546cca-c4d4-4943-bc7e-168cb4f7d5cd tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1226 microversion: 2.1 time: 0.157162 Aug 27 03:48:42.624316 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2994/6274] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:42 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:43.685194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:43.686132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:43.692734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:43.693225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:43.693724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:43.694485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:43.694958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:43.698634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:43.800639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:43.809117 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-478eaf8f-2477-42c9-8895-b93288df66bc tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1226 microversion: 2.1 time: 0.161599 Aug 27 03:48:43.823360 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3281/6275] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:43 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1226 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:44.831672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:44.836049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:44.856506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:44.858458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:44.859107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:44.862265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:44.863180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:44.863818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:45.055745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc63a76e5f94f06afefd6e61fc3f123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b410c14c58534c78a33eaef79c7b60e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:45.071139 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd61b7da-e05a-4d78-817a-67771508d052 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 200 len: 1226 microversion: 2.1 time: 0.243038 Aug 27 03:48:45.072323 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2995/6276] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:44 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:46.103928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:46.105198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:46.112908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.113743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.114441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.115360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.116724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.118009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.135695 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 could not be found. Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 HTTP/1.1 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 could not be found. Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '744be0ab-3af2-45d4-89a0-b0a2d15eb0b2'} Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 could not be found. Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 could not be found. Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:46.137774 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.141411 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.141411 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:46.141411 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:46.141411 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:48:46.141411 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:48:46.141411 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 could not be found. Aug 27 03:48:46.141411 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.144022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance 744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:48:46.145087 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df31eb7d-8194-4cbc-b0be-cc5f6550a81b tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2" status: 404 len: 111 microversion: 2.1 time: 0.054717 Aug 27 03:48:46.149574 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3282/6277] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:46 2022] GET /compute/v2.1/servers/744be0ab-3af2-45d4-89a0-b0a2d15eb0b2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:48:46.802579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:46.803684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:46.811149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.811663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.812121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.812842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.813486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.813937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.830095 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 HTTP/1.1 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'ac73f172-0385-4669-a0a4-028ad9c648b7'} Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:48:46.831929 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:48:46.835642 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7279d4b5-0e33-4b27-90a4-37a1434148a5 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 404 len: 111 microversion: 2.1 time: 0.034916 Aug 27 03:48:46.842327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:46.842956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] [instance: ac73f172-0385-4669-a0a4-028ad9c648b7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:46.846283 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2996/6278] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:48:46 2022] DELETE /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:48:46.849601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.850899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.851360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.852097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.852547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.852979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.876735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] HTTP exception thrown: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Request method failure captured: Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 HTTP/1.1 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZAkjrHHQ8bERaoVjOa-7OgV8-U7_9MTj4O4ByYz7H8YFmAR72ygsHpw3_JAdTjqlGBIOCNcQ0_b9R2RHPVYs93w3QL2g_5Rt0VhUzC0JYYCx7tK_ukxX3L4Ja9zQ2SVIHeQpQ4nU7JSP4ERjtDIE9qnx-M8sSB-xjpelw4Mo0Q7PGk Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b410c14c58534c78a33eaef79c7b60e3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b410c14c58534c78a33eaef79c7b60e3"}]}] Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: b410c14c58534c78a33eaef79c7b60e3 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1993791353 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2bc63a76e5f94f06afefd6e61fc3f123 Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestVolumeBootPattern-1993791353-project Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'ac73f172-0385-4669-a0a4-028ad9c648b7'} Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:46.878556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.883613 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:46.883613 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:46.883613 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:46.883613 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:48:46.883613 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:48:46.883613 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. Aug 27 03:48:46.883613 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:48:46.885491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Returning 404 to user: Instance ac73f172-0385-4669-a0a4-028ad9c648b7 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:48:46.886828 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0d02ea02-aa74-4823-9e21-be45b81cf825 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7" status: 404 len: 111 microversion: 2.1 time: 0.048361 Aug 27 03:48:46.887299 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3283/6279] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:46 2022] GET /compute/v2.1/servers/ac73f172-0385-4669-a0a4-028ad9c648b7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:48:52.838496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-217fe7ea-d825-4a37-8650-c3e991d436d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] Calling method '.version_select at 0x7fe4601acdc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:52.899679 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-217fe7ea-d825-4a37-8650-c3e991d436d6 tempest-TestVolumeBootPattern-1993791353 tempest-TestVolumeBootPattern-1993791353-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1842421952" status: 202 len: 0 microversion: 2.1 time: 0.065554 Aug 27 03:48:52.900670 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2997/6280] 10.222.0.69 () {58 vars in 1263 bytes} [Sat Aug 27 03:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1842421952 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:49:14.229655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1212379167", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "69a77e7a-eec6-4c6d-8c53-65159e53e14c"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:14.248770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=14 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:14.249479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=27 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:14.307759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] validate_networks() for [('69a77e7a-eec6-4c6d-8c53-65159e53e14c', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:49:14.792467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:49:14.792861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:49:14.793269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:49:14.793753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:49:14.794082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:49:14.809556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:14.810056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:14.810543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:14.811306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:14.811781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:14.812218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:14.834898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Getting quotas for project fb2cc6956f1d46f6a89ec3866efa70a3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:49:14.842463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Getting quotas for user 9ecae80ab8da498f87e148995ea67231 and project fb2cc6956f1d46f6a89ec3866efa70a3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:49:14.858610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:49:14.860991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:49:14.923065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f91f97d-c991-4f35-86b6-9ec4c25b3f56 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697847 Aug 27 03:49:14.933900 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3284/6281] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:49:14.936841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1292d8f4-a43a-42ca-a8a5-e77ab9ee4b4d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:14.938493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1292d8f4-a43a-42ca-a8a5-e77ab9ee4b4d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:14.948593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:14.951351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:15.027545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1292d8f4-a43a-42ca-a8a5-e77ab9ee4b4d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:15.036060 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1292d8f4-a43a-42ca-a8a5-e77ab9ee4b4d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1219 microversion: 2.1 time: 0.104291 Aug 27 03:49:15.037222 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2998/6282] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:14 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:16.070571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:16.071907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:16.090746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:16.092251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:16.093141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:16.094713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:16.096299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:16.098039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:16.240203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:16.256980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7727d39b-e1f4-4128-9141-176e547b7453 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1271 microversion: 2.1 time: 0.199167 Aug 27 03:49:16.277255 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3285/6283] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:16 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:17.279761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:17.280526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:17.293004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:17.293530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:17.294007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:17.300298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:17.314789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:17.315311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:17.521018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:17.539701 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb0245fe-2f7f-43be-a538-78a2da7b7283 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1277 microversion: 2.1 time: 0.265160 Aug 27 03:49:17.540839 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2999/6284] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:17 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:18.589831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:18.591993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:18.610229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:18.611280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:18.612319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:18.616070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:18.618105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:18.618765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:18.838997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:18.852301 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6ac27019-4edd-4306-9c0c-bd58346a2fa3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1319 microversion: 2.1 time: 0.271628 Aug 27 03:49:18.854209 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3286/6285] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:18 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:19.351612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1cbc4fec-9781-4e43-a329-18afe190d7d9 req-3e9fdb13-b310-41d6-903f-163a82d6a611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4d0648-8635-44dd-8cf5-50cbc07b7fd1", "tag": "a85401af-21f0-4342-865e-27f188b95b41"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:19.375374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1cbc4fec-9781-4e43-a329-18afe190d7d9 req-3e9fdb13-b310-41d6-903f-163a82d6a611 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:19.376242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1cbc4fec-9781-4e43-a329-18afe190d7d9 req-3e9fdb13-b310-41d6-903f-163a82d6a611 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:19.377092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1cbc4fec-9781-4e43-a329-18afe190d7d9 req-3e9fdb13-b310-41d6-903f-163a82d6a611 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:19.391582 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1cbc4fec-9781-4e43-a329-18afe190d7d9 req-3e9fdb13-b310-41d6-903f-163a82d6a611 service nova] Creating event network-changed:a85401af-21f0-4342-865e-27f188b95b41 for instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 on n-h2-852086-5 Aug 27 03:49:19.403248 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1cbc4fec-9781-4e43-a329-18afe190d7d9 req-3e9fdb13-b310-41d6-903f-163a82d6a611 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057536 Aug 27 03:49:19.405020 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3000/6286] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:19.884910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:19.885652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:19.899674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:19.903715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:19.904443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:19.905610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:19.907950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:19.908477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:20.132943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:20.141337 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e2c5b83-90f8-4e4f-a394-bca7279396d1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1319 microversion: 2.1 time: 0.261642 Aug 27 03:49:20.154832 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3287/6287] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:19 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:21.180303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:21.180303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:21.208011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:21.208541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:21.209004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:21.226040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:21.228150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:21.229423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:21.896373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:21.907588 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d8c09c4-70d1-41bc-992b-9d48509c4bb0 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1319 microversion: 2.1 time: 0.747504 Aug 27 03:49:21.909839 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3001/6288] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:21 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:49:22.931422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:22.932656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:22.947251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:22.947982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:22.948609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:22.949509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:22.950758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:22.951359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:23.230802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:23.242186 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e43b91f-6db8-4f11-b731-35fc7ab26631 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1319 microversion: 2.1 time: 0.316108 Aug 27 03:49:23.242836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3288/6289] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:22 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:24.265158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:24.266044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:24.280834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:24.281441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:24.286213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:24.287000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:24.287516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:24.290552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:24.473041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:24.483076 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-978b2935-d32d-48d3-bf96-f6f693fa639b tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1319 microversion: 2.1 time: 0.221679 Aug 27 03:49:24.484024 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3002/6290] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:24 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:24.880138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:24.885246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:25.121417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-58bcdcd2-db48-4bbd-9e7c-b6f7d08018b8 req-46e8d88d-f377-488b-bc04-bb1e6d71304e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4d0648-8635-44dd-8cf5-50cbc07b7fd1", "name": "network-vif-plugged", "status": "completed", "tag": "a85401af-21f0-4342-865e-27f188b95b41"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:25.131995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-58bcdcd2-db48-4bbd-9e7c-b6f7d08018b8 req-46e8d88d-f377-488b-bc04-bb1e6d71304e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:25.132763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-58bcdcd2-db48-4bbd-9e7c-b6f7d08018b8 req-46e8d88d-f377-488b-bc04-bb1e6d71304e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:25.133209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-58bcdcd2-db48-4bbd-9e7c-b6f7d08018b8 req-46e8d88d-f377-488b-bc04-bb1e6d71304e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:25.149998 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-58bcdcd2-db48-4bbd-9e7c-b6f7d08018b8 req-46e8d88d-f377-488b-bc04-bb1e6d71304e service nova] Creating event network-vif-plugged:a85401af-21f0-4342-865e-27f188b95b41 for instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 on n-h2-852086-5 Aug 27 03:49:25.158208 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-58bcdcd2-db48-4bbd-9e7c-b6f7d08018b8 req-46e8d88d-f377-488b-bc04-bb1e6d71304e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297240 Aug 27 03:49:25.165476 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3289/6291] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:49:25.506580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:25.508420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:25.517375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:25.525500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:25.526666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:25.527300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:25.528551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:25.529175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:25.529760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:25.756553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:25.765339 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe8a3aed-dd71-4cf2-b271-e906bc704222 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1319 microversion: 2.1 time: 0.265059 Aug 27 03:49:25.785915 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3003/6292] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:25 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:26.807826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:26.808647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:26.829163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:26.830581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:26.834926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:26.836243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:26.838661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:26.839098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:27.066813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:27.077062 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eb7b3932-bc30-4216-b09b-482a0c1fc1bd tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1507 microversion: 2.1 time: 0.274698 Aug 27 03:49:27.077653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3290/6293] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:26 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:49:49.613503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:49.615078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:49.617970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:49.620668 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:49.621799 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 03:49:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1/os-volume_attachments/d45fc5a4-abcd-400b-bcf1-ac65a86aa7f4 (ip 10.222.0.69) !!! Aug 27 03:49:49.625595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=26 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:49.660681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:49.661211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:49.661680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:49.665483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:49.665704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:49.666195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:49.787168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lazy-loading 'services' on Instance uuid 268606c1-91e8-4556-a01f-793666644fc1 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:49:49.947269 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-feeae84e-f4e8-4776-bbfe-b317088444a9 tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "DELETE /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1/os-volume_attachments/d45fc5a4-abcd-400b-bcf1-ac65a86aa7f4" status: 202 len: 0 microversion: 2.1 time: 0.338262 Aug 27 03:49:49.947902 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3004/6294] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:49:49 2022] DELETE /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1/os-volume_attachments/d45fc5a4-abcd-400b-bcf1-ac65a86aa7f4 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:49:53.000341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5cd56f-65ac-48cb-b25c-dd0a8b03fb96", "device": "/dev/sdb"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:53.004135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:53.012611 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:49:53.012955 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 03:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1/os-volume_attachments (ip 10.222.0.69) !!! Aug 27 03:49:53.014247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:53.015141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=34 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:53.017027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:53.017973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:53.019217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:53.020336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:53.021031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:53.022705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:53.926687 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7abe72ed-598d-49b2-bf1b-1e3d292864c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "POST /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930311 Aug 27 03:49:53.936523 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3291/6295] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:49:52 2022] POST /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:56.440336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:56.440949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:56.457500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:56.458097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:56.458714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:56.461498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:56.461956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:56.462709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:56.503428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:49:56.638833 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5dab8d56-beda-4d56-bcc9-b9c4e0b6ed9a tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "DELETE /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 204 len: 0 microversion: 2.1 time: 0.201734 Aug 27 03:49:56.639974 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3005/6296] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:49:56 2022] DELETE /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:49:56.651551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:56.653278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:56.661970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:56.662661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:56.663095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:56.663805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:56.664413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:56.664845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:56.872450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:56.881092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8b6eca0c-1bbc-4ba9-9e92-ae1e34ba92ea tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1468 microversion: 2.1 time: 0.236079 Aug 27 03:49:56.882216 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3292/6297] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:56 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1468 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:57.904258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:57.905982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:57.915979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:57.916939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:57.917565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:57.918531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:57.919192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:57.919801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:58.126835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:58.152526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a546c096-8433-4207-a68b-25e2cbb4deca tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1468 microversion: 2.1 time: 0.252852 Aug 27 03:49:58.162227 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3006/6298] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:57 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1468 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:49:59.174393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:59.175711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:59.195228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:59.196002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:59.198836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:59.199766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:59.200412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:59.210975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:59.281664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4f7d2aea-71db-4110-9348-6ead15b63d5b req-34790d22-d05d-4947-b725-b815628ad923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268606c1-91e8-4556-a01f-793666644fc1", "name": "network-vif-deleted", "tag": "19fb2a7a-e93d-46b6-93bb-b479f43d4614"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:59.297828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:59.299676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:59.299822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4f7d2aea-71db-4110-9348-6ead15b63d5b req-34790d22-d05d-4947-b725-b815628ad923 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:59.300278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4f7d2aea-71db-4110-9348-6ead15b63d5b req-34790d22-d05d-4947-b725-b815628ad923 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:59.300709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4f7d2aea-71db-4110-9348-6ead15b63d5b req-34790d22-d05d-4947-b725-b815628ad923 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:59.301135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:59.301853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lazy-loading 'fault' on Instance uuid 268606c1-91e8-4556-a01f-793666644fc1 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:49:59.323341 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4f7d2aea-71db-4110-9348-6ead15b63d5b req-34790d22-d05d-4947-b725-b815628ad923 service nova] Creating event network-vif-deleted:19fb2a7a-e93d-46b6-93bb-b479f43d4614 for instance 268606c1-91e8-4556-a01f-793666644fc1 on n-h1-852086-5 Aug 27 03:49:59.352075 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4f7d2aea-71db-4110-9348-6ead15b63d5b req-34790d22-d05d-4947-b725-b815628ad923 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312536 Aug 27 03:49:59.357435 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3293/6299] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:59.364728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731e637ab004bffbee12b5b4250689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7b4c1901bb402cba47de49a00d6268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:59.403331 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72db16a7-2e9f-44ab-b208-b512af97161c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 200 len: 1303 microversion: 2.1 time: 0.232565 Aug 27 03:49:59.404433 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3007/6300] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:59 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 1303 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:00.426306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:00.428206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] [instance: 268606c1-91e8-4556-a01f-793666644fc1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:00.454871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:00.458907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:00.459428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:00.460445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:00.460985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:00.461486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:00.492139 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] HTTP exception thrown: Instance 268606c1-91e8-4556-a01f-793666644fc1 could not be found. Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Request method failure captured: Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 HTTP/1.1 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZPo5SrxnRDPTHN_Ejbsj2YR2v8dKv5PypTMM6xz9U23JnL6a9eEusLJ_HwsJBUi830KstVHphucKbnVVYNITA4XOcP4clxlVyXzvxYiP17o77tSOMyyuMh8HbgZj1w6RYs0q3DrjZfilmx-8Sc1fKOyZ-LhT8PjWOdSxH3pRSQ6p_0 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 5a7b4c1901bb402cba47de49a00d6268 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesBackupsTest-316135850 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5a7b4c1901bb402cba47de49a00d6268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5a7b4c1901bb402cba47de49a00d6268"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5a7b4c1901bb402cba47de49a00d6268", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5a7b4c1901bb402cba47de49a00d6268"}]}] Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesBackupsTest-316135850 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 5a7b4c1901bb402cba47de49a00d6268 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesBackupsTest-316135850 Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesBackupsTest-316135850-project Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 8731e637ab004bffbee12b5b4250689c Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesBackupsTest-316135850-project Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 268606c1-91e8-4556-a01f-793666644fc1 could not be found. Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '268606c1-91e8-4556-a01f-793666644fc1'} Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268606c1-91e8-4556-a01f-793666644fc1 could not be found. Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268606c1-91e8-4556-a01f-793666644fc1 could not be found. Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:50:00.495058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:00.499633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:00.499633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:50:00.499633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:50:00.499633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:50:00.499633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:50:00.499633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268606c1-91e8-4556-a01f-793666644fc1 could not be found. Aug 27 03:50:00.499633 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:00.500416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] Returning 404 to user: Instance 268606c1-91e8-4556-a01f-793666644fc1 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:50:00.516658 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4b41049-3690-41e5-829a-4a1ac9aadc2c tempest-VolumesBackupsTest-316135850 tempest-VolumesBackupsTest-316135850-project] 10.222.0.69 "GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1" status: 404 len: 111 microversion: 2.1 time: 0.095413 Aug 27 03:50:00.522384 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3294/6301] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:00 2022] GET /compute/v2.1/servers/268606c1-91e8-4556-a01f-793666644fc1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:50:22.709781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:22.710946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:22.713160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:22.713844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:22.722520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:22.723797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:22.725399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:22.726719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:22.727370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:22.728020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:22.850103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lazy-loading 'services' on Instance uuid fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:50:22.937514 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1954683b-a20a-47dd-8074-e26e404dae93 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1/os-volume_attachments/0c5cd56f-65ac-48cb-b25c-dd0a8b03fb96" status: 202 len: 0 microversion: 2.1 time: 0.231357 Aug 27 03:50:22.939996 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3008/6302] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:50:22 2022] DELETE /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1/os-volume_attachments/0c5cd56f-65ac-48cb-b25c-dd0a8b03fb96 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:50:32.151133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:32.152204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:32.164927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:32.168141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:32.171193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:32.172230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:32.173060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:32.174256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:32.174972 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:32.175677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:32.248256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:50:32.414463 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae23b647-e751-4684-99ff-b4f19689a91d tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 204 len: 0 microversion: 2.1 time: 0.272273 Aug 27 03:50:32.418955 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3295/6303] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:50:32 2022] DELETE /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:50:32.436326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:32.445311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:32.455967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:32.457314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:32.458702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:32.462309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:32.463053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:32.463861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:32.752547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:32.770447 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21ca0d77-5969-43e5-ac69-417f00a89e77 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1513 microversion: 2.1 time: 0.349423 Aug 27 03:50:32.773173 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3009/6304] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:32 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:33.797597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:33.798460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:33.809054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:33.812607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:33.813174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:33.819171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:33.819777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:33.820302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:34.071790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:34.087096 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f5946f7-6318-4e35-8632-ccc44629f643 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1513 microversion: 2.1 time: 0.293681 Aug 27 03:50:34.087963 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3296/6305] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:33 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:35.115827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:35.117506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:35.136360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:35.138179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:35.138949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:35.150477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:35.151331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:35.152023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:35.544487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:35.560937 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a856a5da-5fae-42b9-b612-2bf73426d1b1 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1513 microversion: 2.1 time: 0.450528 Aug 27 03:50:35.575692 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3010/6306] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:35 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1513 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:35.847042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f341e7fa-3bf0-4d59-928e-8b521eafaf37 req-11efe6cb-0f70-4fbf-807c-8923a487b8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4d0648-8635-44dd-8cf5-50cbc07b7fd1", "name": "network-vif-deleted", "tag": "a85401af-21f0-4342-865e-27f188b95b41"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:35.905715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f341e7fa-3bf0-4d59-928e-8b521eafaf37 req-11efe6cb-0f70-4fbf-807c-8923a487b8e6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:35.917945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f341e7fa-3bf0-4d59-928e-8b521eafaf37 req-11efe6cb-0f70-4fbf-807c-8923a487b8e6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:35.918813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f341e7fa-3bf0-4d59-928e-8b521eafaf37 req-11efe6cb-0f70-4fbf-807c-8923a487b8e6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:35.973141 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f341e7fa-3bf0-4d59-928e-8b521eafaf37 req-11efe6cb-0f70-4fbf-807c-8923a487b8e6 service nova] Creating event network-vif-deleted:a85401af-21f0-4342-865e-27f188b95b41 for instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 on n-h2-852086-5 Aug 27 03:50:35.985095 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f341e7fa-3bf0-4d59-928e-8b521eafaf37 req-11efe6cb-0f70-4fbf-807c-8923a487b8e6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141433 Aug 27 03:50:35.990012 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3297/6307] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:36.586699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:36.587981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:36.604149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:36.605077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:36.606867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:36.616962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:36.621004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:36.621740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:36.724350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:36.725098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:36.725558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:36.726059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lazy-loading 'fault' on Instance uuid fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:50:36.864190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:36.873729 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7d0365d-174e-47a0-8152-4b5cb0906608 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 200 len: 1309 microversion: 2.1 time: 0.291065 Aug 27 03:50:36.874354 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3011/6308] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:36 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 1309 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:37.900650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:37.901568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: fb4d0648-8635-44dd-8cf5-50cbc07b7fd1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:37.911464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:37.917676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:37.918422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:37.919363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:37.919817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:37.922099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:37.961559 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] HTTP exception thrown: Instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 could not be found. Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Request method failure captured: Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 HTTP/1.1 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZPoRRqMVqKD-eOcw0XIfnEq7Q20Alk7_rbmRiDTOiXHE560EPDgf_F2TIGOaUacDSex_Zehk0Ma4Cv9c-xC5wvkchu2OEF0z7t4l_yCTDJdvebbM7RCkkhGAgh7R6oOZxGI7-ktFrpS0Lr1LCURdSFJBB0ACW1teYJ4KG2nu87vA7Y Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: fb2cc6956f1d46f6a89ec3866efa70a3 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1113363674 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fb2cc6956f1d46f6a89ec3866efa70a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb2cc6956f1d46f6a89ec3866efa70a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fb2cc6956f1d46f6a89ec3866efa70a3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb2cc6956f1d46f6a89ec3866efa70a3"}]}] Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesSnapshotTestJSON-1113363674 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: fb2cc6956f1d46f6a89ec3866efa70a3 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1113363674 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesSnapshotTestJSON-1113363674-project Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 9ecae80ab8da498f87e148995ea67231 Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesSnapshotTestJSON-1113363674-project Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 could not be found. Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'fb4d0648-8635-44dd-8cf5-50cbc07b7fd1'} Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 could not be found. Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 could not be found. Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:50:37.975433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:37.980153 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:37.980153 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:50:37.980153 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:50:37.980153 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:50:37.980153 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:50:37.980153 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 could not be found. Aug 27 03:50:37.980153 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:50:37.985178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Returning 404 to user: Instance fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:50:37.987160 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f47a8d5-5ae3-4c8a-b7b2-d2c78db48b3c tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1" status: 404 len: 111 microversion: 2.1 time: 0.091408 Aug 27 03:50:37.991432 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3298/6309] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:37 2022] GET /compute/v2.1/servers/fb4d0648-8635-44dd-8cf5-50cbc07b7fd1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:50:40.172350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-257840a4-30ce-4925-88e6-c55417b098bb tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1786386242", "availability_zone": "foo_zone"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:40.177766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-257840a4-30ce-4925-88e6-c55417b098bb tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Generated uuid eb5b243b-23fd-4581-96a0-d7006e66dbee for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:50:40.256190 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-257840a4-30ce-4925-88e6-c55417b098bb tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.317043 Aug 27 03:50:40.257681 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3012/6310] 10.222.0.69 () {60 vars in 1164 bytes} [Sat Aug 27 03:50:39 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:40.268148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2a22c49-0ed4-4ee7-a87f-2528701afb12 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:40.334664 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2a22c49-0ed4-4ee7-a87f-2528701afb12 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.070086 Aug 27 03:50:40.336536 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3299/6311] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:50:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:40.348084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:40.355619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:40.359816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:40.362290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:40.363561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:40.369451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:40.370204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:40.438761 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9065d43a-934e-45d1-aa38-f39f8dfaeef7 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094512 Aug 27 03:50:40.447866 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3013/6312] 10.222.0.69 () {58 vars in 1176 bytes} [Sat Aug 27 03:50:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:40.451795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5bb19792-1767-4b05-9a4e-984c563614ea tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:40.469213 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5bb19792-1767-4b05-9a4e-984c563614ea tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.021260 Aug 27 03:50:40.470407 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3300/6313] 10.222.0.69 () {58 vars in 1143 bytes} [Sat Aug 27 03:50:40 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:40.487299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-533884d0-b4e8-4b63-92fc-97d1630510f1 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852086-5"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:40.508861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533884d0-b4e8-4b63-92fc-97d1630510f1 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:40.509782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533884d0-b4e8-4b63-92fc-97d1630510f1 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:40.510508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533884d0-b4e8-4b63-92fc-97d1630510f1 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:41.182539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-533884d0-b4e8-4b63-92fc-97d1630510f1 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.700976 Aug 27 03:50:41.183944 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3014/6314] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:50:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.201504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aa95740e-1ff2-45bd-99b0-084b21a4e26c tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:41.214194 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aa95740e-1ff2-45bd-99b0-084b21a4e26c tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.022927 Aug 27 03:50:41.215655 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3301/6315] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:50:41 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.229078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0668f56a-5dd3-4b54-ace1-58a185237d10 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-596520267", "availability_zone": "foo_zone"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:41.313018 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0668f56a-5dd3-4b54-ace1-58a185237d10 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.089969 Aug 27 03:50:41.322372 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3015/6316] 10.222.0.69 () {60 vars in 1173 bytes} [Sat Aug 27 03:50:41 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.327465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e963a75-98cd-463c-bbf6-b432eeb7c506 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:41.371822 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e963a75-98cd-463c-bbf6-b432eeb7c506 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.047844 Aug 27 03:50:41.378897 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3302/6317] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:50:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.384443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-510c5430-1f64-4f23-94b2-02800266d58d tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:41.405123 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-510c5430-1f64-4f23-94b2-02800266d58d tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.025025 Aug 27 03:50:41.405819 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3016/6318] 10.222.0.69 () {58 vars in 1152 bytes} [Sat Aug 27 03:50:41 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.417641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5639c7cf-c36f-4099-a9ea-fe4bca180186 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852086-5"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:41.452944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5639c7cf-c36f-4099-a9ea-fe4bca180186 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:41.455459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5639c7cf-c36f-4099-a9ea-fe4bca180186 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:41.456099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5639c7cf-c36f-4099-a9ea-fe4bca180186 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:41.816277 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5639c7cf-c36f-4099-a9ea-fe4bca180186 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.402477 Aug 27 03:50:41.819392 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3303/6319] 10.222.0.69 () {60 vars in 1194 bytes} [Sat Aug 27 03:50:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.834798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e184b428-8d20-4e20-9cdc-e11a1b9881e8 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:41.892911 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e184b428-8d20-4e20-9cdc-e11a1b9881e8 tempest-TestAggregatesBasicOps-1897094276 tempest-TestAggregatesBasicOps-1897094276-project-admin] 10.222.0.69 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.067216 Aug 27 03:50:41.894224 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3017/6320] 10.222.0.69 () {58 vars in 1155 bytes} [Sat Aug 27 03:50:41 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 03:50:48.882231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2025155389", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "69a77e7a-eec6-4c6d-8c53-65159e53e14c"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:48.974933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] validate_networks() for [('69a77e7a-eec6-4c6d-8c53-65159e53e14c', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:50:49.796734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:50:49.797166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:50:49.797643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:50:49.798058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:50:49.798502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:50:49.828801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:49.831430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:49.832338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:49.836214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:49.836753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:49.839811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:49.872694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Getting quotas for project fb2cc6956f1d46f6a89ec3866efa70a3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:50:49.880259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Getting quotas for user 9ecae80ab8da498f87e148995ea67231 and project fb2cc6956f1d46f6a89ec3866efa70a3. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:50:49.896634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:50:49.899806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:50:49.979898 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2c004c77-5461-43df-83e6-f8a5dd9152e3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103726 Aug 27 03:50:49.987311 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3304/6321] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:50:49.992390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30c44c7b-5852-46c5-98e8-b7261ee59d23 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:49.993098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30c44c7b-5852-46c5-98e8-b7261ee59d23 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:50.165506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30c44c7b-5852-46c5-98e8-b7261ee59d23 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:50.175075 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30c44c7b-5852-46c5-98e8-b7261ee59d23 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1219 microversion: 2.1 time: 0.186787 Aug 27 03:50:50.176258 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3018/6322] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:49 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1219 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:50:51.197729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d42eb450-fe1a-42f2-8edd-5ba591eada60 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:51.198540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d42eb450-fe1a-42f2-8edd-5ba591eada60 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:51.740512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d42eb450-fe1a-42f2-8edd-5ba591eada60 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:51.755981 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d42eb450-fe1a-42f2-8edd-5ba591eada60 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1219 microversion: 2.1 time: 0.554740 Aug 27 03:50:51.757518 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3305/6323] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:51 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1219 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:52.783216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:52.783879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:52.785960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:52.787015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:52.788512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:52.803206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:52.803649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:52.804289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:52.805040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:52.805513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:52.806247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:53.061631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:53.073308 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6babfc15-c00f-4a1a-af03-cff9f3f2feca tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1277 microversion: 2.1 time: 0.295979 Aug 27 03:50:53.078235 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3019/6324] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:52 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:54.104675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:54.105920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:54.150478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:54.151333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:54.151969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:54.152928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:54.153733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:54.154402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:54.308961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:54.317835 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-075274cd-2cae-47f9-b229-8451c1b8cfae tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1277 microversion: 2.1 time: 0.222449 Aug 27 03:50:54.321498 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3306/6325] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:54 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:55.347606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:55.349599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:55.362748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:55.366112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:55.366852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:55.368823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:55.369509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:55.372117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:56.610388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:56.631304 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d24a2f3-d61a-4fec-808f-07172ceffff3 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1319 microversion: 2.1 time: 1.292973 Aug 27 03:50:56.631861 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3020/6326] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:55 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1319 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:57.254107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d45ec655-7a8f-47fc-be19-1942a91d1aea req-bd946723-84a6-46eb-b417-eb84fccba3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7112b364-0db2-4819-b935-7b748475ee43", "tag": "08600b95-1df2-4ccb-9d21-68edcffa549b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:57.284946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d45ec655-7a8f-47fc-be19-1942a91d1aea req-bd946723-84a6-46eb-b417-eb84fccba3e2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.288696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d45ec655-7a8f-47fc-be19-1942a91d1aea req-bd946723-84a6-46eb-b417-eb84fccba3e2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.290352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d45ec655-7a8f-47fc-be19-1942a91d1aea req-bd946723-84a6-46eb-b417-eb84fccba3e2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:57.340349 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d45ec655-7a8f-47fc-be19-1942a91d1aea req-bd946723-84a6-46eb-b417-eb84fccba3e2 service nova] Creating event network-changed:08600b95-1df2-4ccb-9d21-68edcffa549b for instance 7112b364-0db2-4819-b935-7b748475ee43 on n-h2-852086-5 Aug 27 03:50:57.351870 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d45ec655-7a8f-47fc-be19-1942a91d1aea req-bd946723-84a6-46eb-b417-eb84fccba3e2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101224 Aug 27 03:50:57.352659 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3307/6327] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:57.654443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:57.655029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:57.666098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.666949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.669198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:57.670686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.671578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.672310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:58.198297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:58.207213 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-259389d2-fa5d-4519-aeb4-536942bdb92f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1319 microversion: 2.1 time: 0.557880 Aug 27 03:50:58.209979 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3021/6328] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:57 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:59.232082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:59.233561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:59.248871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:59.256639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:59.257545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:59.258671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:59.259362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:59.259945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:59.526743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:59.541206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-18dd7dd6-54ea-41df-8c3a-d5f30e9ef6a8 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1319 microversion: 2.1 time: 0.314427 Aug 27 03:50:59.548450 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3308/6329] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:59 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:59.987944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30be0fa9-cda6-4ec7-9f45-c6647ea57738 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Action: 'create', calling method: .version_select at 0x7fe4577a5550>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2407346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1AA6tohmZETeJDromUQWkP0WrrvKsxv1UefSLz0vpf1vnV2laUw+3leZPcvAb0V7X2yLF6gCHejNYHeTUUqtC7E0SIA+ctB1mvo+LvBGLYOcEbYoGEfWa97Ccso7E3hA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:00.007085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-30be0fa9-cda6-4ec7-9f45-c6647ea57738 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Getting quotas for project 8e2052a4ffb546fc8d9e25f4b6d6fbc6. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:51:00.015178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-30be0fa9-cda6-4ec7-9f45-c6647ea57738 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Getting quotas for user 2424c7d0ce8c47c3b9e6f3d4edac6d8e and project 8e2052a4ffb546fc8d9e25f4b6d6fbc6. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:51:00.059232 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30be0fa9-cda6-4ec7-9f45-c6647ea57738 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.362483 Aug 27 03:51:00.059232 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3022/6330] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:50:59 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:00.565232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:00.565905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:00.568673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:00.584619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:00.585620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:00.586426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:00.587336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:00.587984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:00.588604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:00.830451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:00.843735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a2686f4-6574-48a2-ac52-91e4ef3d3913 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1319 microversion: 2.1 time: 0.280727 Aug 27 03:51:00.844689 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3309/6331] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:00 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:01.000827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d01d381-27dc-4682-9234-bbcfe127ab7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: .version_select at 0x7fe46037ae50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-195871638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXk5W5sgUaj0elVfHwGN9JVR+oOt8TIctGV7uN10ay9/Gdmd6w6lGuw1XfMk1hnzWkLjvG0ouRPygcD6LkHR1RbPqPTvea6WXAqU9cc0n0QADTNenm24Z1YutNs68KsLw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:01.030051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7d01d381-27dc-4682-9234-bbcfe127ab7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:51:01.060035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7d01d381-27dc-4682-9234-bbcfe127ab7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:51:01.104020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d01d381-27dc-4682-9234-bbcfe127ab7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.438977 Aug 27 03:51:01.106233 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3023/6332] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:51:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:51:01.742558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-349615002", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2407346", "security_groups": [{"name": "tempest-secgroup-smoke-66155945"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "59310396-30f5-469c-a481-7f686e525a6f"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:01.762008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:01.867175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:01.868604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:01.876492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:01.877380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:01.879030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:01.880887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:01.882848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:01.884260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:01.954673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] validate_networks() for [('59310396-30f5-469c-a481-7f686e525a6f', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:51:02.169264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:02.187668 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4dfd121-2f4b-4da7-a96b-ea6607e00c81 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1319 microversion: 2.1 time: 0.322418 Aug 27 03:51:02.189211 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3024/6333] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:01 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:02.243577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:02.713123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Getting quotas for project 8e2052a4ffb546fc8d9e25f4b6d6fbc6. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:51:02.727041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Getting quotas for user 2424c7d0ce8c47c3b9e6f3d4edac6d8e and project 8e2052a4ffb546fc8d9e25f4b6d6fbc6. Resources: dict_keys(['metadata_items']) {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:51:02.747867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:51:02.749163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:51:02.749818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:51:02.751138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:51:02.752043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:51:02.763985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:02.764773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:02.765531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:02.766493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:02.767113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:02.767704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:02.780586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:02.796085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Getting quotas for project 8e2052a4ffb546fc8d9e25f4b6d6fbc6. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:51:02.804033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Getting quotas for user 2424c7d0ce8c47c3b9e6f3d4edac6d8e and project 8e2052a4ffb546fc8d9e25f4b6d6fbc6. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:51:02.823482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:51:02.826467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:51:02.906423 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-100092dd-bae8-499f-8c1c-94da12b62776 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.168626 Aug 27 03:51:02.914319 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3310/6334] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:51:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:51:02.926687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb94a79b-a30a-476f-8a84-2aa13884aa75 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:02.933808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb94a79b-a30a-476f-8a84-2aa13884aa75 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:03.027748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb94a79b-a30a-476f-8a84-2aa13884aa75 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:03.040068 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb94a79b-a30a-476f-8a84-2aa13884aa75 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1299 microversion: 2.1 time: 0.125477 Aug 27 03:51:03.041805 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3025/6335] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:02 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:03.212674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:03.213490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:03.244569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.245301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.245744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.246496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.246983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.247442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.561239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:03.596023 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7e524e53-25f8-41c8-84e2-b3989c87c7c9 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1319 microversion: 2.1 time: 0.388339 Aug 27 03:51:03.611557 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3311/6336] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:03 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:03.877334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2c54ad59-c017-4891-bed0-ada59a6f944f req-477c3622-ce92-4c9a-8c1c-f7ede8ce0d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7112b364-0db2-4819-b935-7b748475ee43", "name": "network-vif-plugged", "status": "completed", "tag": "08600b95-1df2-4ccb-9d21-68edcffa549b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:03.900766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2c54ad59-c017-4891-bed0-ada59a6f944f req-477c3622-ce92-4c9a-8c1c-f7ede8ce0d65 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.901758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2c54ad59-c017-4891-bed0-ada59a6f944f req-477c3622-ce92-4c9a-8c1c-f7ede8ce0d65 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.902420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2c54ad59-c017-4891-bed0-ada59a6f944f req-477c3622-ce92-4c9a-8c1c-f7ede8ce0d65 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.929080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2c54ad59-c017-4891-bed0-ada59a6f944f req-477c3622-ce92-4c9a-8c1c-f7ede8ce0d65 service nova] Creating event network-vif-plugged:08600b95-1df2-4ccb-9d21-68edcffa549b for instance 7112b364-0db2-4819-b935-7b748475ee43 on n-h2-852086-5 Aug 27 03:51:03.935820 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2c54ad59-c017-4891-bed0-ada59a6f944f req-477c3622-ce92-4c9a-8c1c-f7ede8ce0d65 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063307 Aug 27 03:51:03.937085 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3026/6337] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:04.061960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:04.062649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:04.069577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.076651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.077113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:04.080405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.080649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.081086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:04.196334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:04.205938 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f2697ba-40af-41c6-875b-36885f979c3d tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1295 microversion: 2.1 time: 0.147763 Aug 27 03:51:04.207930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3312/6338] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:04 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1295 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:04.625860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:04.626960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:04.637617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.638448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.638977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:04.639903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:04.640730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:04.641582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:05.229800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:05.230534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:05.241542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:05.242137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:05.243263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:05.244462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:05.245169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:05.245811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:05.356398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:05.372866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-22db44b9-88ec-4f5a-abdd-4d59dd7721e5 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1357 microversion: 2.1 time: 0.147150 Aug 27 03:51:05.373383 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3313/6339] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:05 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:05.437163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:05.448783 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff1ab3d7-1dd8-424e-bf7b-a6dd0606a904 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1319 microversion: 2.1 time: 0.829222 Aug 27 03:51:05.449637 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3027/6340] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:04 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1319 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:06.394899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:06.396870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:06.409757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:06.410497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:06.414294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:06.415236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:06.422736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:06.423292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:06.471022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:06.471669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:06.485109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:06.485622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:06.501268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:06.502688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:06.503206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:06.503661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:06.771461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:06.781175 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e40dba9d-6ff0-42f7-8e47-0f7ced02df90 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.390992 Aug 27 03:51:06.782419 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3314/6341] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:06 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:06.939230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:06.952696 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3091d48-10d6-4a88-bc39-53ed7a93254a tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1507 microversion: 2.1 time: 0.485224 Aug 27 03:51:06.954065 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3028/6342] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:06 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:06.975241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a25ef147-4b86-4099-aa99-afc0c46a548f", "device": "/dev/sdb"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:06.978294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:06.985094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:06.985586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:06.986023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:06.986847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:06.988283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:06.989534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.387799 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37091853-0e2d-4386-aa97-6fbb53303036 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "POST /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417033 Aug 27 03:51:07.401462 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3315/6343] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 03:51:06 2022] POST /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:07.806781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:07.808177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:07.817886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8d20c0df-c32d-49f7-a6d5-df0af7077b7f req-0990dc70-0139-410e-b7ca-097bc82334ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a", "tag": "cd5c6996-92c5-4fd4-85b2-fbbf59c49341"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:07.834592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:07.853179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8d20c0df-c32d-49f7-a6d5-df0af7077b7f req-0990dc70-0139-410e-b7ca-097bc82334ea service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:07.854240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:07.854940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.855898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:07.856569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:07.857522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.862877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8d20c0df-c32d-49f7-a6d5-df0af7077b7f req-0990dc70-0139-410e-b7ca-097bc82334ea service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:07.864487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8d20c0df-c32d-49f7-a6d5-df0af7077b7f req-0990dc70-0139-410e-b7ca-097bc82334ea service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:07.900659 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8d20c0df-c32d-49f7-a6d5-df0af7077b7f req-0990dc70-0139-410e-b7ca-097bc82334ea service nova] Creating event network-changed:cd5c6996-92c5-4fd4-85b2-fbbf59c49341 for instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a on n-h1-852086-5 Aug 27 03:51:07.928204 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8d20c0df-c32d-49f7-a6d5-df0af7077b7f req-0990dc70-0139-410e-b7ca-097bc82334ea service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116916 Aug 27 03:51:07.933243 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3316/6344] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:08.537264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:08.564529 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7175a326-c7b4-49d2-b442-811b00cd9a7f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.762059 Aug 27 03:51:08.567933 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3029/6345] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:07 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:09.586709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:09.594187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:09.609430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:09.613942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:09.614714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:09.617619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:09.618395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:09.622273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:10.050308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:10.068824 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e6c6137-861b-4860-9992-74f585fae9b6 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.487032 Aug 27 03:51:10.069434 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3317/6346] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:09 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:11.090517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:11.091190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:11.116812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:11.118037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:11.118520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:11.124593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:11.133398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:11.136488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:11.439659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:11.450558 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3c4f174-4d7a-4720-a6ad-7ed6559c048f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.364148 Aug 27 03:51:11.451776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3030/6347] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:11 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:11.792571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1225348285", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "b2111828-83b2-443d-8baa-c2908d61ba88"}], "key_name": "tempest-TestNetworkAdvancedServerOps-195871638", "security_groups": [{"name": "tempest-secgroup-smoke-1241410031"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:12.025935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] validate_networks() for [('b2111828-83b2-443d-8baa-c2908d61ba88', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:51:12.472440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:12.474925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:12.482998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:12.484086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:12.485168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:12.486385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:12.487021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:12.487628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:12.742056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:12.753226 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-731c83e1-5d34-451a-9d06-ca7896be8dac tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.282767 Aug 27 03:51:12.757241 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3031/6348] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:12 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:12.781589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:12.798585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:51:12.799764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:51:12.800817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:51:12.801611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:51:12.802693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:51:12.829336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:12.830288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:12.830918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:12.831888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:12.833114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:12.833891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:12.856916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:51:12.865640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:51:12.883070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:51:12.885826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:51:12.993267 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e44bf42-dbb3-4a2e-a620-c76a5a6990f5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.207387 Aug 27 03:51:12.994817 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3318/6349] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:51:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:51:13.008248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbcc9db9-1487-4bb8-bc56-442f67ca486a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:13.009076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbcc9db9-1487-4bb8-bc56-442f67ca486a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:13.058312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:13.143714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbcc9db9-1487-4bb8-bc56-442f67ca486a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:13.156518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbcc9db9-1487-4bb8-bc56-442f67ca486a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1266 microversion: 2.1 time: 0.152528 Aug 27 03:51:13.157407 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3032/6350] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:13 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:13.778537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:13.779162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:13.804165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:13.809597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:13.810329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:13.812306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:13.815263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:13.815855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:14.006552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:14.017538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad67bc40-2488-4d92-8bb2-5078f0c27cf0 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.243565 Aug 27 03:51:14.018344 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3319/6351] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:13 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:14.184912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:14.185484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:14.232907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:14.233717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:14.236775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:14.240579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:14.241664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:14.242403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:14.401864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:14.414937 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9bb48fd-f6f6-4886-be38-e1bf4be249ca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1318 microversion: 2.1 time: 0.235335 Aug 27 03:51:14.415761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3033/6352] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:14 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:14.763737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b2834c39-9d8e-4f20-aee0-9fe9f47f9e64 req-360f710f-d4f6-4f3e-a28a-cabdee5a14bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a", "name": "network-vif-plugged", "status": "completed", "tag": "cd5c6996-92c5-4fd4-85b2-fbbf59c49341"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:14.802924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2834c39-9d8e-4f20-aee0-9fe9f47f9e64 req-360f710f-d4f6-4f3e-a28a-cabdee5a14bb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:14.806730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2834c39-9d8e-4f20-aee0-9fe9f47f9e64 req-360f710f-d4f6-4f3e-a28a-cabdee5a14bb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:14.812877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b2834c39-9d8e-4f20-aee0-9fe9f47f9e64 req-360f710f-d4f6-4f3e-a28a-cabdee5a14bb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:14.846536 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b2834c39-9d8e-4f20-aee0-9fe9f47f9e64 req-360f710f-d4f6-4f3e-a28a-cabdee5a14bb service nova] Creating event network-vif-plugged:cd5c6996-92c5-4fd4-85b2-fbbf59c49341 for instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a on n-h1-852086-5 Aug 27 03:51:14.856090 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b2834c39-9d8e-4f20-aee0-9fe9f47f9e64 req-360f710f-d4f6-4f3e-a28a-cabdee5a14bb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104400 Aug 27 03:51:14.856903 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3320/6353] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:15.039059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:15.039955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:15.053036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:15.053917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:15.058072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:15.059150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:15.059810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:15.060425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:15.446091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:15.446864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:15.456461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:15.462694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:15.463399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:15.463851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:15.464629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:15.465088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:15.465706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:15.467587 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2f06b0e-70f5-46b5-af2a-53a2090f33d4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.432673 Aug 27 03:51:15.473600 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3034/6354] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:15 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:15.580385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:15.596065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b7ed6828-1c10-496d-8d7f-29230b796c61 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1324 microversion: 2.1 time: 0.156987 Aug 27 03:51:15.597722 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3321/6355] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:15 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:16.503938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:16.506582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:16.514584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:16.515397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:16.516582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:16.517503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:16.518135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:16.518764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:16.620656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:16.622485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:16.630945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:16.631827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:16.632444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:16.633426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:16.634044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:16.635409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:16.786332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:16.807657 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04fd41f9-53de-4caa-9e9e-f907e84835ed tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1423 microversion: 2.1 time: 0.312047 Aug 27 03:51:16.823376 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3035/6356] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:16 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1423 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:16.867944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:16.876532 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45a8537b-e4c7-4d03-8bc1-4ae4fc4d2c95 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1392 microversion: 2.1 time: 0.262997 Aug 27 03:51:16.877129 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3322/6357] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:16 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:17.500431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2e3606b3-8803-4bc7-9f0c-0904186ccf93 req-72a67dff-f10f-4604-b7e6-03cb6d32ca54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:17.561733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2e3606b3-8803-4bc7-9f0c-0904186ccf93 req-72a67dff-f10f-4604-b7e6-03cb6d32ca54 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:17.571368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2e3606b3-8803-4bc7-9f0c-0904186ccf93 req-72a67dff-f10f-4604-b7e6-03cb6d32ca54 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:17.572195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2e3606b3-8803-4bc7-9f0c-0904186ccf93 req-72a67dff-f10f-4604-b7e6-03cb6d32ca54 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:17.597495 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2e3606b3-8803-4bc7-9f0c-0904186ccf93 req-72a67dff-f10f-4604-b7e6-03cb6d32ca54 service nova] Creating event network-changed:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h2-852086-5 Aug 27 03:51:17.603616 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2e3606b3-8803-4bc7-9f0c-0904186ccf93 req-72a67dff-f10f-4604-b7e6-03cb6d32ca54 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107219 Aug 27 03:51:17.604755 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3036/6358] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:17.839964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:17.840614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:17.853894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:17.854666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:17.855279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:17.856205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:17.856900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:17.857556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:17.899463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:17.900658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:17.908363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:17.909847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:17.911273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:17.912129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:17.912692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:17.913358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:18.021426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:18.033505 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8ea82450-8ce3-4904-86b1-7c546e3977a1 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1603 microversion: 2.1 time: 0.204253 Aug 27 03:51:18.044428 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3323/6359] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:17 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:18.055257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:18.056387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:18.062668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:18.063482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:18.064160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:18.065014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:18.065623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:18.066223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:18.134800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:18.144303 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab8a5602-6ad8-4391-9c3a-abf551c2f501 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1392 microversion: 2.1 time: 0.249460 Aug 27 03:51:18.145909 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3037/6360] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:17 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:18.227499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:18.237438 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d098436-10b8-4c91-8651-fac61bf34e3f tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1603 microversion: 2.1 time: 0.187037 Aug 27 03:51:18.238009 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3324/6361] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:18 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1603 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:18.257499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:18.258131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:18.264535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:18.265036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:18.265481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:18.266277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:18.266755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:18.267198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:18.441265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:18.450137 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0debeeb0-d6ad-4c9b-bb2f-b465e233647a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1603 microversion: 2.1 time: 0.196776 Aug 27 03:51:18.450995 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3038/6362] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:18 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1603 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:19.167645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:19.168248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:19.176259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:19.177299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:19.177299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:19.178039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:19.178859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:19.179495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:19.339521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:19.347567 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0014dd5-efa2-4866-bc35-05f1b01d4018 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1392 microversion: 2.1 time: 0.184340 Aug 27 03:51:19.348923 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3325/6363] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:19 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:20.372589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:20.373232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:20.380804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:20.381318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:20.381803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:20.383074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:20.383311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:20.383983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:20.719637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:20.729418 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f63b045d-0a43-403a-a08b-0f38c0b78208 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1392 microversion: 2.1 time: 0.363023 Aug 27 03:51:20.730140 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3039/6364] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:20 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1392 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:21.453341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4494cca9-ceb6-4304-a6b9-77eb50339521 req-823ad216-2010-44cd-9cdd-84db32addd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a", "tag": "cd5c6996-92c5-4fd4-85b2-fbbf59c49341"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:21.471556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4494cca9-ceb6-4304-a6b9-77eb50339521 req-823ad216-2010-44cd-9cdd-84db32addd50 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:21.472719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4494cca9-ceb6-4304-a6b9-77eb50339521 req-823ad216-2010-44cd-9cdd-84db32addd50 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:21.474378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4494cca9-ceb6-4304-a6b9-77eb50339521 req-823ad216-2010-44cd-9cdd-84db32addd50 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:21.502641 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4494cca9-ceb6-4304-a6b9-77eb50339521 req-823ad216-2010-44cd-9cdd-84db32addd50 service nova] Creating event network-changed:cd5c6996-92c5-4fd4-85b2-fbbf59c49341 for instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a on n-h1-852086-5 Aug 27 03:51:21.518627 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4494cca9-ceb6-4304-a6b9-77eb50339521 req-823ad216-2010-44cd-9cdd-84db32addd50 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063292 Aug 27 03:51:21.520892 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3326/6365] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:21.752571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:21.755013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:21.766278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:21.768015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:21.768724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:21.771320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:21.772177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:21.772961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:22.129884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:22.136938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:22.151990 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48465737-5056-415e-ae11-6adb060df45a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1392 microversion: 2.1 time: 0.404469 Aug 27 03:51:22.160463 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3040/6366] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:21 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1392 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:23.177608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:23.178366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:23.181858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:23.183003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=16 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:23.190428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:23.190927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:23.191367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:23.193206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:23.193459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:23.194076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:23.366113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:23.377728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9453412-9445-4421-901b-cdd49f570df3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1392 microversion: 2.1 time: 0.204849 Aug 27 03:51:23.378342 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3327/6367] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:23 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1392 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:23.633272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0a9a59cc-8dfb-4341-a56d-ce0bf15a4f23 req-bcda2001-d7f0-423c-8b3f-8fea65247f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "name": "network-vif-plugged", "status": "completed", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:23.649332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:23.650989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:23.654108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0a9a59cc-8dfb-4341-a56d-ce0bf15a4f23 req-bcda2001-d7f0-423c-8b3f-8fea65247f7d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:23.654937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0a9a59cc-8dfb-4341-a56d-ce0bf15a4f23 req-bcda2001-d7f0-423c-8b3f-8fea65247f7d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:23.655657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0a9a59cc-8dfb-4341-a56d-ce0bf15a4f23 req-bcda2001-d7f0-423c-8b3f-8fea65247f7d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:23.671620 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0a9a59cc-8dfb-4341-a56d-ce0bf15a4f23 req-bcda2001-d7f0-423c-8b3f-8fea65247f7d service nova] Creating event network-vif-plugged:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h2-852086-5 Aug 27 03:51:23.678844 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0a9a59cc-8dfb-4341-a56d-ce0bf15a4f23 req-bcda2001-d7f0-423c-8b3f-8fea65247f7d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050761 Aug 27 03:51:23.680271 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3041/6368] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:24.401284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:24.402270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:24.410213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:24.411575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:24.412138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:24.413005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:24.413632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:24.414136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:24.568906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:24.575226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:24.580528 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-76793fd8-101b-4eee-b42e-4aa57780cfd4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1392 microversion: 2.1 time: 0.183182 Aug 27 03:51:24.582806 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3328/6369] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:24 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:25.611848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:25.613046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:25.624273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:25.625140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:25.625892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:25.626940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:25.627616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:25.628264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:25.821377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:25.830146 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e056e138-aa79-4ec7-9541-eda79166d9a9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1565 microversion: 2.1 time: 0.228474 Aug 27 03:51:25.830756 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3042/6370] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:25 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1565 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:25.850953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:25.851973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:25.861267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:25.861952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:25.862514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:25.863845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:25.864517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:25.865098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:26.038863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:26.047257 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-228c5ef4-46d6-4d91-9421-e4bb856a86c1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1565 microversion: 2.1 time: 0.200434 Aug 27 03:51:26.058217 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3329/6371] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:25 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:28.413334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:28.414536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:28.417275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c2054e87-d45b-44b6-9920-b4eb35c62cd1 req-517f74b9-d853-4996-865b-afdc1b155494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:28.429494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:28.430408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:28.431123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:28.432494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:28.433235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:28.433535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c2054e87-d45b-44b6-9920-b4eb35c62cd1 req-517f74b9-d853-4996-865b-afdc1b155494 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:28.434019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c2054e87-d45b-44b6-9920-b4eb35c62cd1 req-517f74b9-d853-4996-865b-afdc1b155494 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:28.434443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:28.455451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c2054e87-d45b-44b6-9920-b4eb35c62cd1 req-517f74b9-d853-4996-865b-afdc1b155494 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:28.491506 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c2054e87-d45b-44b6-9920-b4eb35c62cd1 req-517f74b9-d853-4996-865b-afdc1b155494 service nova] Creating event network-changed:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h2-852086-5 Aug 27 03:51:28.496740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c2054e87-d45b-44b6-9920-b4eb35c62cd1 req-517f74b9-d853-4996-865b-afdc1b155494 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083848 Aug 27 03:51:28.497678 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3330/6372] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:28.686426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:28.700761 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89e0aa58-5ffb-4bae-b811-e98e0496c44e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1565 microversion: 2.1 time: 0.295144 Aug 27 03:51:28.701724 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3043/6373] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:28 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1565 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:34.324454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:34.325022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:34.328352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:34.333647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:34.334112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:34.334579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:34.335277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:34.335728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:34.336148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:34.423629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lazy-loading 'services' on Instance uuid 7112b364-0db2-4819-b935-7b748475ee43 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:51:34.505553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5627698e-c6b9-4910-86f0-59f5e2c5af89 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43/os-volume_attachments/a25ef147-4b86-4099-aa99-afc0c46a548f" status: 202 len: 0 microversion: 2.1 time: 0.186481 Aug 27 03:51:34.506370 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3331/6374] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 03:51:34 2022] DELETE /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43/os-volume_attachments/a25ef147-4b86-4099-aa99-afc0c46a548f => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:51:39.935248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:39.935840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:39.939611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:39.940512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:39.952238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:39.952749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:39.953207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:39.953942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:39.954434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:39.954875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:39.984205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:51:40.076646 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9bf9f06-d7ae-446e-9555-e15a5cc79695 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 204 len: 0 microversion: 2.1 time: 0.145058 Aug 27 03:51:40.077671 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3044/6375] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:51:39 2022] DELETE /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:51:40.087945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:40.089256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:40.098790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:40.099461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:40.099896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:40.100598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:40.101072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:40.101474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:40.259276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:40.267309 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bbbe504a-86ae-4228-852d-fdf0108f571f tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1513 microversion: 2.1 time: 0.184299 Aug 27 03:51:40.267893 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3332/6376] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:40 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:51:41.294317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:41.296469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:41.308463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:41.309172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:41.309908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:41.311206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:41.311981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:41.312680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:41.469085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:41.478557 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cbf73a44-729e-4278-85ae-d2b84282ef31 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1513 microversion: 2.1 time: 0.191886 Aug 27 03:51:41.479164 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3045/6377] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:41 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:42.499791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-38e4c943-09c3-4ada-827d-eaab8f06522b req-9884c9be-0a8b-46e0-bc18-182482647b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7112b364-0db2-4819-b935-7b748475ee43", "name": "network-vif-deleted", "tag": "08600b95-1df2-4ccb-9d21-68edcffa549b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:42.501002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:42.501892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:42.509816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.510351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.511050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:42.511816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.512299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.512763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:42.551447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38e4c943-09c3-4ada-827d-eaab8f06522b req-9884c9be-0a8b-46e0-bc18-182482647b02 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.552006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38e4c943-09c3-4ada-827d-eaab8f06522b req-9884c9be-0a8b-46e0-bc18-182482647b02 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.552716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38e4c943-09c3-4ada-827d-eaab8f06522b req-9884c9be-0a8b-46e0-bc18-182482647b02 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:42.592957 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-38e4c943-09c3-4ada-827d-eaab8f06522b req-9884c9be-0a8b-46e0-bc18-182482647b02 service nova] Creating event network-vif-deleted:08600b95-1df2-4ccb-9d21-68edcffa549b for instance 7112b364-0db2-4819-b935-7b748475ee43 on n-h2-852086-5 Aug 27 03:51:42.603934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecae80ab8da498f87e148995ea67231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2cc6956f1d46f6a89ec3866efa70a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:42.610430 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-38e4c943-09c3-4ada-827d-eaab8f06522b req-9884c9be-0a8b-46e0-bc18-182482647b02 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114174 Aug 27 03:51:42.611896 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3333/6378] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:51:42.621110 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21185c16-c85c-4c45-b39b-8b676eaa6e61 tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 200 len: 1471 microversion: 2.1 time: 0.124268 Aug 27 03:51:42.621805 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3046/6379] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:42 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 1471 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:43.648371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:43.649240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] [instance: 7112b364-0db2-4819-b935-7b748475ee43] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:43.656490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:43.656978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:43.657412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:43.658115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:43.658591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:43.659017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:43.673317 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] HTTP exception thrown: Instance 7112b364-0db2-4819-b935-7b748475ee43 could not be found. Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Request method failure captured: Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 HTTP/1.1 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZPoRRqMVqKD-eOcw0XIfnEq7Q20Alk7_rbmRiDTOiXHE560EPDgf_F2TIGOaUacDSex_Zehk0Ma4Cv9c-xC5wvkchu2OEF0z7t4l_yCTDJdvebbM7RCkkhGAgh7R6oOZxGI7-ktFrpS0Lr1LCURdSFJBB0ACW1teYJ4KG2nu87vA7Y Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: fb2cc6956f1d46f6a89ec3866efa70a3 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1113363674 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fb2cc6956f1d46f6a89ec3866efa70a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb2cc6956f1d46f6a89ec3866efa70a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fb2cc6956f1d46f6a89ec3866efa70a3", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fb2cc6956f1d46f6a89ec3866efa70a3"}]}] Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-VolumesSnapshotTestJSON-1113363674 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: fb2cc6956f1d46f6a89ec3866efa70a3 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1113363674 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-VolumesSnapshotTestJSON-1113363674-project Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 9ecae80ab8da498f87e148995ea67231 Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-VolumesSnapshotTestJSON-1113363674-project Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7112b364-0db2-4819-b935-7b748475ee43 could not be found. Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7112b364-0db2-4819-b935-7b748475ee43'} Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7112b364-0db2-4819-b935-7b748475ee43 could not be found. Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7112b364-0db2-4819-b935-7b748475ee43 could not be found. Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:51:43.675079 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7112b364-0db2-4819-b935-7b748475ee43 could not be found. Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] Returning 404 to user: Instance 7112b364-0db2-4819-b935-7b748475ee43 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-acac1fc1-df2d-431a-af53-bdc91b193dcf tempest-VolumesSnapshotTestJSON-1113363674 tempest-VolumesSnapshotTestJSON-1113363674-project] 10.222.0.69 "GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43" status: 404 len: 111 microversion: 2.1 time: 0.036016 Aug 27 03:51:43.679959 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3334/6380] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:43 2022] GET /compute/v2.1/servers/7112b364-0db2-4819-b935-7b748475ee43 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:51:53.643022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:53.649497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:53.666483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:53.667981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:53.670561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:53.671495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:53.672162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:53.673114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:53.673825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:53.674507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:53.746264 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-743d1cd3-c6f6-4e18-8163-5b6b67675c5a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action" status: 200 len: 24573 microversion: 2.1 time: 0.111651 Aug 27 03:51:53.753625 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3047/6381] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:51:53 2022] POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action => generated 24573 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:52:00.440039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:00.440772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:00.443384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:00.444605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:00.458870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:00.459655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:00.460286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:00.461188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:00.461915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:00.462530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:00.493113 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c05c394c-de18-4bcb-996f-d893d76ecb2b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.057385 Aug 27 03:52:00.494178 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3335/6382] 10.222.0.69 () {58 vars in 1293 bytes} [Sat Aug 27 03:52:00 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a/os-server-password => generated 116 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:52:04.856183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:04.856957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:04.860253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:04.860933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:04.868749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:04.869259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:04.869724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:04.870549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:04.871110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:04.871433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.145574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46e17dda-e2b6-4a44-b28a-3ec42c8a17de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1834 microversion: 2.1 time: 0.292955 Aug 27 03:52:05.146064 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3048/6383] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:04 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1834 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:05.167878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:05.170928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:05.183340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.184396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.185065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.186056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.186890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.187521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.359968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:05.370617 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d888bb7c-44a6-4a97-88fa-b97e08d98b3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1683 microversion: 2.1 time: 0.207337 Aug 27 03:52:05.378270 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3336/6384] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:05 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1683 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:05.484265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:05.487514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:05.496621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.497707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.498602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.499402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.500047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.500492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.560934 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0d53002-2021-4447-8555-cc0deea225af tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action" status: 200 len: 32648 microversion: 2.1 time: 0.080752 Aug 27 03:52:05.564311 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3049/6385] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:52:05 2022] POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action => generated 32648 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:52:05.700251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:05.701054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:05.708487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.709410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.709917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.710772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.711628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.711779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.756667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'adb688159d5f414ebdc5e2d650ed34f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6671c98dd80e4dc28f06c7eb85243447', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:05.757384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] flavor_id is None. Assuming migration. {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:52:05.757915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:52:05.933557 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e0c73cd2-0d28-4b32-984f-800a2020abf6 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action" status: 202 len: 0 microversion: 2.1 time: 0.237216 Aug 27 03:52:05.934532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3337/6386] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:52:05 2022] POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:52:05.945109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:05.946125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:05.956294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.957889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.958637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:05.959792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:05.960655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:05.961293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:06.217840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:06.230002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ec4bf47-de60-45f4-850e-5d376b859ae2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1692 microversion: 2.1 time: 0.288903 Aug 27 03:52:06.230875 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3050/6387] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:05 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1692 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:07.258557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:07.260047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:07.266785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:07.267778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:07.268701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:07.270228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:07.270932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:07.271943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:07.501980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:07.511642 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d256e6f4-51f1-447c-9d35-97fa6c08a9fe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1692 microversion: 2.1 time: 0.259332 Aug 27 03:52:07.512788 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3338/6388] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:07 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1692 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:08.554122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:08.555393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:08.564815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:08.565523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:08.566941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:08.568714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:08.569836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:08.570492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:08.736408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:08.747636 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8c84f9e-b38f-476f-92ec-f4d011a02d18 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1692 microversion: 2.1 time: 0.217203 Aug 27 03:52:08.748591 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3051/6389] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:08 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:09.821881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:09.989819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:09.997886 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3a2304d-851b-4295-9305-66643439aa56 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.230269 Aug 27 03:52:09.998505 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3339/6390] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:09 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:11.019696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:11.020410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:11.027364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:11.027874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:11.028327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:11.029058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:11.029566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:11.030020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:11.204680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:11.231122 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9381217-533b-46ce-8219-12689aff173d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.215508 Aug 27 03:52:11.232652 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3052/6391] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:11 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:12.257915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:12.259286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:12.267555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:12.268325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:12.269076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:12.270029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:12.270737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:12.271395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:12.445094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:12.457875 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eba1c3e6-012d-40f8-8a69-ff7ee2e6e863 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.204561 Aug 27 03:52:12.458782 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3340/6392] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:12 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:13.497215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:13.497757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:13.506430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:13.506930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:13.507456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:13.508244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:13.508574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:13.509018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:13.700920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:13.710520 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d99ae97-1e3d-476f-be23-81468d0d5d8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.217927 Aug 27 03:52:13.711715 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3053/6393] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:13 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:14.733552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:14.734179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:14.742930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:14.743420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:14.743852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:14.745620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:14.745620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:14.745620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:14.964669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:14.977450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc553929-0672-4544-8735-871868281f3a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.248204 Aug 27 03:52:14.978220 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3341/6394] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:14 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:16.001413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:16.002058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:16.014795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:16.015305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:16.015764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:16.017841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:16.019036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:16.019714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:16.202191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:16.213054 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee7fb915-39ca-43ea-8573-39794d2af21f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.216684 Aug 27 03:52:16.213611 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3054/6395] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:15 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:17.236608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:17.237233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:17.244933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:17.245425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:17.245866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:17.246615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:17.247068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:17.247494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:17.405784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:17.415300 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-29c1634f-e9eb-4caf-85db-dee8e5be0b4e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.182672 Aug 27 03:52:17.415984 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3342/6396] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:17 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:18.437213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:18.438070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:18.446074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:18.446703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:18.447227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:18.448030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:18.448579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:18.449097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:18.607711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:18.616845 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d66e0701-c13d-4c12-b9be-c443eb9b2b76 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.183557 Aug 27 03:52:18.617608 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3055/6397] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:18 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:19.640021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:19.641044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:19.648976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.649472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.649907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.651037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.651512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.652146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.868612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:19.877215 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cdb979bd-5e28-47ee-a48a-e25b7bc44dfd tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.241093 Aug 27 03:52:19.878601 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3343/6398] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:19 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:52:20.903806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:20.904607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:20.913255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:20.913749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:20.914240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:20.914977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:20.915450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:20.915899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:21.077772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:21.087260 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4007a82c-901c-4132-9d4d-bee8094ebf7e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.188344 Aug 27 03:52:21.088038 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3056/6399] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:20 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:52:22.110186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:22.110939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:22.119387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:22.119675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:22.120337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:22.121067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:22.121578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:22.121952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:22.277995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:22.288500 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d121870d-d61e-4452-9aa4-af00b13c492e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.182291 Aug 27 03:52:22.293523 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3344/6400] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:22 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:23.312275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:23.313313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:23.320644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:23.321151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:23.321604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:23.322361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:23.322864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:23.323309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:23.516233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:23.525732 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fec6c2a0-06af-4cfb-87b2-2761f1fa021f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.218899 Aug 27 03:52:23.536379 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3057/6401] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:23 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:24.559111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:24.560308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:24.569090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:24.572551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:24.573599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:24.575572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:24.576325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:24.577024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:24.808533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:24.818685 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-151ee1f8-1942-460d-9032-f8b4951273ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.264085 Aug 27 03:52:24.819476 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3345/6402] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:24 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:25.842608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:25.843380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:25.851365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:25.852186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:25.852734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:25.853521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:25.854060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:25.854593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.019642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:26.029086 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44ce685e-ef24-4c2d-80bf-cfbaafc5821a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1697 microversion: 2.1 time: 0.190709 Aug 27 03:52:26.029831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3058/6403] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:25 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:26.820018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c63dca56-4525-4e13-a7ee-579ec30267aa req-a3d6f2b0-8b16-4773-ac90-4418cbd245cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:26.833515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c63dca56-4525-4e13-a7ee-579ec30267aa req-a3d6f2b0-8b16-4773-ac90-4418cbd245cb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.835375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c63dca56-4525-4e13-a7ee-579ec30267aa req-a3d6f2b0-8b16-4773-ac90-4418cbd245cb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.835998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c63dca56-4525-4e13-a7ee-579ec30267aa req-a3d6f2b0-8b16-4773-ac90-4418cbd245cb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.851265 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c63dca56-4525-4e13-a7ee-579ec30267aa req-a3d6f2b0-8b16-4773-ac90-4418cbd245cb service nova] Creating event network-vif-unplugged:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h1-852086-5 Aug 27 03:52:26.857474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-c63dca56-4525-4e13-a7ee-579ec30267aa req-a3d6f2b0-8b16-4773-ac90-4418cbd245cb service nova] Instance d8461624-61dd-4661-af98-c2b8423bd0e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:52:26.871400 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c63dca56-4525-4e13-a7ee-579ec30267aa req-a3d6f2b0-8b16-4773-ac90-4418cbd245cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055941 Aug 27 03:52:26.873020 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3346/6404] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:27.055462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:27.056769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:27.065132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:27.066865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:27.067569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:27.068541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:27.069224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:27.069896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:27.265199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:27.279455 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bcf63801-d4a2-44ca-ae6b-3516f4097df6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1696 microversion: 2.1 time: 0.228141 Aug 27 03:52:27.280661 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3059/6405] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:27 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1696 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:28.305388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:28.306232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:28.313671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:28.314202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:28.314775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:28.316258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:28.316732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:28.317286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:28.467353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:28.476494 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd5eb332-b377-4ea0-a243-9142c47f1550 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1694 microversion: 2.1 time: 0.177836 Aug 27 03:52:28.477206 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3347/6406] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:28 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:28.896727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ab6f3520-21a4-4db8-91d7-5d0c1c773060 req-0a7fa54c-9224-4041-9ea0-b973fcd5c167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:28.907374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab6f3520-21a4-4db8-91d7-5d0c1c773060 req-0a7fa54c-9224-4041-9ea0-b973fcd5c167 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:28.907801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab6f3520-21a4-4db8-91d7-5d0c1c773060 req-0a7fa54c-9224-4041-9ea0-b973fcd5c167 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:28.908252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab6f3520-21a4-4db8-91d7-5d0c1c773060 req-0a7fa54c-9224-4041-9ea0-b973fcd5c167 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:28.921701 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ab6f3520-21a4-4db8-91d7-5d0c1c773060 req-0a7fa54c-9224-4041-9ea0-b973fcd5c167 service nova] Creating event network-changed:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h1-852086-5 Aug 27 03:52:28.927810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-ab6f3520-21a4-4db8-91d7-5d0c1c773060 req-0a7fa54c-9224-4041-9ea0-b973fcd5c167 service nova] Instance d8461624-61dd-4661-af98-c2b8423bd0e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:52:28.939490 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ab6f3520-21a4-4db8-91d7-5d0c1c773060 req-0a7fa54c-9224-4041-9ea0-b973fcd5c167 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047138 Aug 27 03:52:28.940272 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3060/6407] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:29.502859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:29.505176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:29.517744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:29.519533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:29.520327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:29.521584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:29.522971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:29.523626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:29.777518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:29.789058 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cb713c26-2b05-468c-8ab5-f755dc875d84 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1694 microversion: 2.1 time: 0.292729 Aug 27 03:52:29.791160 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3348/6408] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:29 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1694 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:30.812565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:30.813214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:30.823645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:30.824182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:30.824693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:30.826186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:30.826730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:30.827150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:30.990133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:30.998404 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d21565fe-e346-410c-ab0c-a3542348e731 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1691 microversion: 2.1 time: 0.191145 Aug 27 03:52:30.999782 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3061/6409] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:30 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:31.020463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:31.021590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:31.028701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=31 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:31.030599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:31.031267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:31.031891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:31.032809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:31.033426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:31.034224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:31.039981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:31.116483 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5a7b2aa4-42ed-41da-9b51-47ee9ca58538 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action" status: 204 len: 0 microversion: 2.1 time: 0.099765 Aug 27 03:52:31.121517 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3349/6410] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:52:31 2022] POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:52:31.126883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:31.129155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:31.146421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:31.147333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:31.148306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:31.149235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:31.149740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:31.150225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:31.434732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:31.446139 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-029edc8c-7d18-4325-adbb-558a1006c9be tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1691 microversion: 2.1 time: 0.324027 Aug 27 03:52:31.448393 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3062/6411] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:31 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1691 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:32.471799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:32.473025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:32.484057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:32.484057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:32.484057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:32.484057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:32.484057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:32.484599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:32.714466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:32.724539 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d544f0eb-956c-4ed1-ab51-fdaabc879667 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1691 microversion: 2.1 time: 0.258495 Aug 27 03:52:32.725111 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3350/6412] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:32 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:52:33.098959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a57ac2ce-afeb-471d-b2c8-6d949fa3849a req-eb3517a1-0f6b-4bb4-8b2e-62ab0bc72b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "name": "network-vif-plugged", "status": "completed", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:33.116156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a57ac2ce-afeb-471d-b2c8-6d949fa3849a req-eb3517a1-0f6b-4bb4-8b2e-62ab0bc72b9b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:33.117332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a57ac2ce-afeb-471d-b2c8-6d949fa3849a req-eb3517a1-0f6b-4bb4-8b2e-62ab0bc72b9b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:33.117983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a57ac2ce-afeb-471d-b2c8-6d949fa3849a req-eb3517a1-0f6b-4bb4-8b2e-62ab0bc72b9b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:33.135363 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a57ac2ce-afeb-471d-b2c8-6d949fa3849a req-eb3517a1-0f6b-4bb4-8b2e-62ab0bc72b9b service nova] Creating event network-vif-plugged:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h1-852086-5 Aug 27 03:52:33.146431 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a57ac2ce-afeb-471d-b2c8-6d949fa3849a req-eb3517a1-0f6b-4bb4-8b2e-62ab0bc72b9b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052471 Aug 27 03:52:33.151939 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3063/6413] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:33.752159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:33.753642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:33.765743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:33.766283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:33.766785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:33.767459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:33.767938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:33.769003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:33.960342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:33.969422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1a28b0c2-bc89-48cf-bbc6-a811683e1894 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1683 microversion: 2.1 time: 0.225168 Aug 27 03:52:33.970532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3351/6414] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:33 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:58.223028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:58.224070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=88 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:58.228964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:58.231283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:58.238966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:58.239585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:58.240033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:58.240747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:58.241210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:58.241648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:58.294976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cfaf6ff-dc6a-47c9-8cb4-7add27a67219 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action" status: 200 len: 24556 microversion: 2.1 time: 0.074138 Aug 27 03:52:58.302531 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3064/6415] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:52:58 2022] POST /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7/action => generated 24556 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:53:09.421044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:09.421811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:09.424625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=5 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:09.425368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:09.433592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:09.434083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:09.434542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:09.435246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:09.435914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:09.436081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:09.785382 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd019ef9-3e72-4b41-bf59-fc52a9de4c38 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1834 microversion: 2.1 time: 0.368386 Aug 27 03:53:09.785992 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3352/6416] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:09 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1834 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:10.693189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:10.697889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:10.705986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:10.706950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:10.710182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:10.710960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:10.711648 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:10.712581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:10.713249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:10.713960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:10.752102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:53:10.792427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3b81b370-82ba-45b0-b6e7-23be0181d5c5 req-69b7f2cd-b9a7-494a-be3f-eaef17c51115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:10.805344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3b81b370-82ba-45b0-b6e7-23be0181d5c5 req-69b7f2cd-b9a7-494a-be3f-eaef17c51115 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:10.806294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3b81b370-82ba-45b0-b6e7-23be0181d5c5 req-69b7f2cd-b9a7-494a-be3f-eaef17c51115 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:10.807020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3b81b370-82ba-45b0-b6e7-23be0181d5c5 req-69b7f2cd-b9a7-494a-be3f-eaef17c51115 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:10.819953 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3b81b370-82ba-45b0-b6e7-23be0181d5c5 req-69b7f2cd-b9a7-494a-be3f-eaef17c51115 service nova] Creating event network-changed:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h1-852086-5 Aug 27 03:53:10.826703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3b81b370-82ba-45b0-b6e7-23be0181d5c5 req-69b7f2cd-b9a7-494a-be3f-eaef17c51115 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139352 Aug 27 03:53:10.827481 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3353/6417] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:10.861402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ecaf9c6-6d90-4d5f-947b-9a29a6e8c736 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 204 len: 0 microversion: 2.1 time: 0.176739 Aug 27 03:53:10.862588 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3065/6418] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:53:10 2022] DELETE /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:53:10.872930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:10.873911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:10.903318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:10.904080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:10.904851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:10.905747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:10.906394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:10.907013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:11.065051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:11.080855 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b1f7e7d-a527-48d9-8d23-9a312368e8b2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1689 microversion: 2.1 time: 0.213295 Aug 27 03:53:11.081781 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3354/6419] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:10 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:12.111799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:12.114108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:12.133727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:12.140444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:12.153083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:12.154433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:12.155182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:12.155895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:12.485513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:12.498718 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0db83749-51cb-4471-9a9b-32d95c946b8a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1689 microversion: 2.1 time: 0.398777 Aug 27 03:53:12.499347 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3066/6420] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:12 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1689 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:12.936469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d5a136c6-3715-4c2e-b572-2ae15a60f8bb req-fd79192d-f187-4db4-bd3d-087b31fbe45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8461624-61dd-4661-af98-c2b8423bd0e7", "name": "network-vif-deleted", "tag": "a415634f-a2e5-4e8f-8b1f-05ba13fe4714"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:12.955180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5a136c6-3715-4c2e-b572-2ae15a60f8bb req-fd79192d-f187-4db4-bd3d-087b31fbe45d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:12.956364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5a136c6-3715-4c2e-b572-2ae15a60f8bb req-fd79192d-f187-4db4-bd3d-087b31fbe45d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:12.958634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d5a136c6-3715-4c2e-b572-2ae15a60f8bb req-fd79192d-f187-4db4-bd3d-087b31fbe45d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:12.976097 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d5a136c6-3715-4c2e-b572-2ae15a60f8bb req-fd79192d-f187-4db4-bd3d-087b31fbe45d service nova] Creating event network-vif-deleted:a415634f-a2e5-4e8f-8b1f-05ba13fe4714 for instance d8461624-61dd-4661-af98-c2b8423bd0e7 on n-h1-852086-5 Aug 27 03:53:12.982767 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d5a136c6-3715-4c2e-b572-2ae15a60f8bb req-fd79192d-f187-4db4-bd3d-087b31fbe45d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050670 Aug 27 03:53:12.983787 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3355/6421] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:13.527086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:13.528384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:13.537247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:13.537849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:13.540424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:13.541224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:13.541713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:13.542686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:13.580047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:13.580551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:13.581281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:13.581814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lazy-loading 'fault' on Instance uuid d8461624-61dd-4661-af98-c2b8423bd0e7 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:53:13.627281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:13.634863 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28b0708d-0a5a-4f2e-b505-da54ade0b5f6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 200 len: 1356 microversion: 2.1 time: 0.112268 Aug 27 03:53:13.635835 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3067/6422] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:13 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:14.657191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:14.657866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: d8461624-61dd-4661-af98-c2b8423bd0e7] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:14.662542 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:53:14.662705 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 03:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 (ip 10.222.0.69) !!! Aug 27 03:53:14.674229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:14.674717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:14.675152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:14.675855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:14.676337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:14.677069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:14.691407 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] HTTP exception thrown: Instance d8461624-61dd-4661-af98-c2b8423bd0e7 could not be found. Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Request method failure captured: Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 HTTP/1.1 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZSj7HFO2PaNzyPbSA7cTP-KIbMXatuskAYCPhYxud_jxcSMxl_Q6ae_gUMlmk6imBa7B5VqLQbCfFECNSOxptHSzbymSfoCmI3GvPSmrDgYOmpB9haOnmwV1YgaLuTK8tHRWP0PkcW2CcI14O2muT_9eUWhYFs7LVJntcr2Qw-VdJ4 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0d3f5f3257024419926319c6013d4d56", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}] Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: cd7171be5b3d4238acfe83058f78413c Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d8461624-61dd-4661-af98-c2b8423bd0e7 could not be found. Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd8461624-61dd-4661-af98-c2b8423bd0e7'} Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8461624-61dd-4661-af98-c2b8423bd0e7 could not be found. Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8461624-61dd-4661-af98-c2b8423bd0e7 could not be found. Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:53:14.693059 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8461624-61dd-4661-af98-c2b8423bd0e7 could not be found. Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Returning 404 to user: Instance d8461624-61dd-4661-af98-c2b8423bd0e7 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:53:14.697877 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d9a8ef79-0506-4984-a6e6-ea3b5572e6db tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7" status: 404 len: 111 microversion: 2.1 time: 0.041512 Aug 27 03:53:14.707093 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3356/6423] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:14 2022] GET /compute/v2.1/servers/d8461624-61dd-4661-af98-c2b8423bd0e7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:53:18.267128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e693a3d3-073f-4c1c-8529-8f3f47c125c5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '.version_select at 0x7fe4572cc310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:18.272675 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e693a3d3-073f-4c1c-8529-8f3f47c125c5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [e9270f90-f029-452a-ae03-543005b9fa7d] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:53:19.281227 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [None req-e693a3d3-073f-4c1c-8529-8f3f47c125c5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [e9270f90-f029-452a-ae03-543005b9fa7d] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 33524. Aug 27 03:53:19.302977 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e693a3d3-073f-4c1c-8529-8f3f47c125c5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-195871638" status: 202 len: 0 microversion: 2.1 time: 1.039896 Aug 27 03:53:19.303723 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3068/6424] 10.222.0.69 () {58 vars in 1281 bytes} [Sat Aug 27 03:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-195871638 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:53:19.334368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7127cbd-1779-46f3-bfc9-e4b0c7ab2b49 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: .version_select at 0x7fe4602fe790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1938604949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1A63puLTdeXCEcHfnvloNAich83NAvzTGqvL1O160mNm4ttMfDBP6656wY15mSeZkNFV27mV4h/7g7G3PdDfpCpxX6VOgZNQffD1PArHrEOW1FDTdF7PPRzwX8WGxuOQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:19.351340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d7127cbd-1779-46f3-bfc9-e4b0c7ab2b49 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:53:19.357702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-d7127cbd-1779-46f3-bfc9-e4b0c7ab2b49 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:53:19.393970 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7127cbd-1779-46f3-bfc9-e4b0c7ab2b49 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063663 Aug 27 03:53:19.394889 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3357/6425] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:53:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:25.709939 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:53:25.710528 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 03:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.69) !!! Aug 27 03:53:25.717872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:25.724924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1710661274", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "1aacff10-220a-42f8-ae40-a9848d57bfef"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1938604949", "security_groups": [{"name": "tempest-secgroup-smoke-1166904618"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:25.888893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] validate_networks() for [('1aacff10-220a-42f8-ae40-a9848d57bfef', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:53:26.447129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:53:26.448040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:53:26.448772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:53:26.449436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:53:26.450090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:53:26.465051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:26.465667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:26.466257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:26.467113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:26.467818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:26.468332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:26.498125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:53:26.511123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:53:26.533299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:53:26.536334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:53:26.607526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d1845a7-4600-4917-a6a6-56904d635446 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.899626 Aug 27 03:53:26.608794 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3069/6426] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:53:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:53:26.622290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b46f1e3f-0af9-4255-860a-d8fbeac814ad tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:26.623625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b46f1e3f-0af9-4255-860a-d8fbeac814ad tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:26.627771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=18 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:26.707190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b46f1e3f-0af9-4255-860a-d8fbeac814ad tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:26.716538 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b46f1e3f-0af9-4255-860a-d8fbeac814ad tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1267 microversion: 2.1 time: 0.099341 Aug 27 03:53:26.717447 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3358/6427] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:26 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:27.740562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:27.742588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:27.750960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:27.751515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:27.751975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:27.752862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:27.753445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:27.754091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:27.838868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:27.851014 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-128d792a-f412-4314-84b9-0be9017032a6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1319 microversion: 2.1 time: 0.115282 Aug 27 03:53:27.863044 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3070/6428] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:27 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1319 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:28.871856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:28.873202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:28.889273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:28.890025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:28.890747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:28.891664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:28.892290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:28.893087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:28.986737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:29.007669 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7f8bb638-bd70-40e3-8bcf-39c3e3dd503f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1325 microversion: 2.1 time: 0.139500 Aug 27 03:53:29.011172 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3359/6429] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:28 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1325 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:30.031444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:30.032634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:30.041775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:30.042175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:30.042744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:30.043834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:30.044312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:30.044764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:30.082017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0bc36108-db79-4934-9273-70cbe686f619 req-5ded5be5-e74e-4af9-8f1f-ac250db87a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:30.103712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0bc36108-db79-4934-9273-70cbe686f619 req-5ded5be5-e74e-4af9-8f1f-ac250db87a16 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:30.104501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0bc36108-db79-4934-9273-70cbe686f619 req-5ded5be5-e74e-4af9-8f1f-ac250db87a16 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:30.105095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0bc36108-db79-4934-9273-70cbe686f619 req-5ded5be5-e74e-4af9-8f1f-ac250db87a16 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:30.118551 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0bc36108-db79-4934-9273-70cbe686f619 req-5ded5be5-e74e-4af9-8f1f-ac250db87a16 service nova] Creating event network-changed:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:53:30.124303 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0bc36108-db79-4934-9273-70cbe686f619 req-5ded5be5-e74e-4af9-8f1f-ac250db87a16 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046227 Aug 27 03:53:30.126830 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3360/6430] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:53:30.356737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:30.368755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5144b404-7184-45a5-a624-c5888c5310d4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1393 microversion: 2.1 time: 0.341182 Aug 27 03:53:30.369734 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3071/6431] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:30 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1393 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:31.392163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:31.392984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:31.399497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:31.399995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:31.400436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:31.401160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:31.401613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:31.402051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:31.565359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:31.575811 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b7bc216-e37e-458a-8029-369913151a19 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1393 microversion: 2.1 time: 0.188569 Aug 27 03:53:31.576863 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3361/6432] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:31 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:32.597526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:32.598121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:32.606037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:32.606630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:32.607081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:32.607801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:32.608268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:32.608758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:32.756800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:32.765238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f14fb8b0-cd1b-49ae-9f99-124fef655a3c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1393 microversion: 2.1 time: 0.172025 Aug 27 03:53:32.766263 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3072/6433] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:32 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:33.788142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:33.788758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:33.795611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:33.796097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:33.796536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:33.797231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:33.797689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:33.798114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:33.943534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:33.951671 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1cfc6318-980f-4aa3-bf08-c4f7fb4e193f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1393 microversion: 2.1 time: 0.168350 Aug 27 03:53:33.952585 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3362/6434] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:33 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:34.974628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:34.975209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:34.990417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:34.991244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:34.991706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:34.992814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:34.992994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:34.993449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:35.180247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:35.193281 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8fd51f8-0f82-429d-990e-8aab482a194e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1393 microversion: 2.1 time: 0.222769 Aug 27 03:53:35.195853 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3073/6435] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:34 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1393 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:36.188099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6fddd7e4-40a0-4816-9021-5126287124e1 req-50c87d2a-59f3-4411-844f-1e5d89bb952b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "name": "network-vif-plugged", "status": "completed", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:36.200946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6fddd7e4-40a0-4816-9021-5126287124e1 req-50c87d2a-59f3-4411-844f-1e5d89bb952b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:36.201841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6fddd7e4-40a0-4816-9021-5126287124e1 req-50c87d2a-59f3-4411-844f-1e5d89bb952b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:36.202255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6fddd7e4-40a0-4816-9021-5126287124e1 req-50c87d2a-59f3-4411-844f-1e5d89bb952b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:36.217505 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6fddd7e4-40a0-4816-9021-5126287124e1 req-50c87d2a-59f3-4411-844f-1e5d89bb952b service nova] Creating event network-vif-plugged:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:53:36.219536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:36.220243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:36.223882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6fddd7e4-40a0-4816-9021-5126287124e1 req-50c87d2a-59f3-4411-844f-1e5d89bb952b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039019 Aug 27 03:53:36.224747 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3363/6436] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:36.233916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:36.234468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:36.234930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:36.235679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:36.236157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:36.236603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:36.453421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:36.462864 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-106123d5-e978-487c-b30b-3ae796993201 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1393 microversion: 2.1 time: 0.248416 Aug 27 03:53:36.463741 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3074/6437] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:36 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:37.484854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:37.492107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:37.492826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:37.500087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:37.500629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:37.501124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:37.501876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:37.502358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:37.502784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:37.666876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:37.680065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dcfe081e-c2ce-4757-ab03-02f6502b1fb1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1393 microversion: 2.1 time: 0.196584 Aug 27 03:53:37.681035 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3364/6438] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:37 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1393 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:38.701844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:38.702506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:38.704471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:38.705284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:38.712676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:38.713223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:38.713673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:38.714431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:38.714901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:38.715341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:38.863327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:38.874477 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0fd01c88-d3ee-4cb8-ad79-4b4dd1f9b3e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1565 microversion: 2.1 time: 0.176286 Aug 27 03:53:38.875092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3075/6439] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:38 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:38.895037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:38.895695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:38.902453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:38.902940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:38.903398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:38.904088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:38.904548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:38.904980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:39.051845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:39.060345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf9329a1-1ce2-4e93-a1a9-78895b0b1b2a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1565 microversion: 2.1 time: 0.169201 Aug 27 03:53:39.061043 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3365/6440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:38 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:40.991917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:40.992797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:40.997598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f0b461ad-3939-4776-acb4-841952ceca3f req-7c7bd8ae-b210-4f36-81aa-856154f52d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:41.005661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:41.007144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:41.014424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:41.014933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:41.019295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f0b461ad-3939-4776-acb4-841952ceca3f req-7c7bd8ae-b210-4f36-81aa-856154f52d6b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:41.019780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f0b461ad-3939-4776-acb4-841952ceca3f req-7c7bd8ae-b210-4f36-81aa-856154f52d6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:41.020485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f0b461ad-3939-4776-acb4-841952ceca3f req-7c7bd8ae-b210-4f36-81aa-856154f52d6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:41.025372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:41.026266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:41.026942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:41.027401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:41.041389 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f0b461ad-3939-4776-acb4-841952ceca3f req-7c7bd8ae-b210-4f36-81aa-856154f52d6b service nova] Creating event network-changed:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:53:41.048011 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f0b461ad-3939-4776-acb4-841952ceca3f req-7c7bd8ae-b210-4f36-81aa-856154f52d6b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053926 Aug 27 03:53:41.049286 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3366/6441] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:53:41.281021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:41.305470 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13f2eb67-be52-4e6d-a5d6-d8ff16cbcc79 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1565 microversion: 2.1 time: 0.315490 Aug 27 03:53:41.307480 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3076/6442] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:40 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1565 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:04.575692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=36 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:04.576448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:04.581169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:04.583743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:04.593518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:04.594016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:04.594476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:04.595199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:04.595656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:04.596336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:04.649968 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7fda9fb0-2ce0-4df7-b91d-d1bd37a36dba tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action" status: 200 len: 24558 microversion: 2.1 time: 0.076196 Aug 27 03:54:04.650726 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3367/6443] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:04 2022] POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action => generated 24558 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:54:15.708855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:15.709885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=44 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:15.714078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:15.714634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:15.721930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:15.722465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:15.723713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:15.724415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:15.725084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:15.725537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:15.871218 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-338256b1-b148-440e-9d3e-af445627276d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1835 microversion: 2.1 time: 0.164243 Aug 27 03:54:15.872898 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3077/6444] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:15 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1835 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:15.899344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:15.900204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:15.905624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:15.906689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:15.916602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:15.917408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:15.918137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:15.919348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:15.920133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:15.920853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:16.081046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:16.089686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39cc4d11-22dd-4613-aa43-b669039ca03d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1684 microversion: 2.1 time: 0.196917 Aug 27 03:54:16.090297 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3368/6445] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:15 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1684 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:16.188976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:16.192181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:16.199139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:16.199652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:16.200108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:16.200912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:16.201307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:16.201750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:16.257464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46f38296-e984-400d-aa10-ef4dd8815570 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action" status: 200 len: 32633 microversion: 2.1 time: 0.072277 Aug 27 03:54:16.258147 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3078/6446] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:16 2022] POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action => generated 32633 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:54:16.380588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:16.381083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:16.387608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:16.388095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:16.388531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:16.389227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:16.389681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:16.390105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:16.420938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'adb688159d5f414ebdc5e2d650ed34f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6671c98dd80e4dc28f06c7eb85243447', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:16.421519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: 66f25817-50e3-4c0f-a434-332529d01176] flavor_id is None. Assuming migration. {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:54:16.421963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:54:16.537723 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ae41cef-9f2e-49e1-8fdc-fe601cd882d3 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action" status: 202 len: 0 microversion: 2.1 time: 0.161460 Aug 27 03:54:16.541359 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3369/6447] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:16 2022] POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:54:16.547459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:16.548318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:16.556577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:16.556959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:16.557429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:16.558508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:16.558934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:16.559384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:16.708137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:16.716161 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19eda514-3db4-402c-82a1-15737a2ac696 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1693 microversion: 2.1 time: 0.173010 Aug 27 03:54:16.716827 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3079/6448] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:16 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:17.739700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:17.740347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:17.747455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:17.747890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:17.748332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:17.749037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:17.749502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:17.749954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:17.893477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:17.903591 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59b5f2fd-530a-4ebb-bde7-19b767cf70a7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1693 microversion: 2.1 time: 0.169358 Aug 27 03:54:17.904186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3370/6449] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:17 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:18.927312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:18.927973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:18.935579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:18.936090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:18.936551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:18.937289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:18.937765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:18.938244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:19.085101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:19.093755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2afcdd1-8226-4928-b212-3d151a3f5594 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.172087 Aug 27 03:54:19.094841 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3080/6450] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:18 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:20.116873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:20.117497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:20.124349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:20.124829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:20.125259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:20.125946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:20.126429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:20.126853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:20.262035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:20.269894 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c50db73-b9b9-4dfe-9792-2be1be7ff9fa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.157710 Aug 27 03:54:20.270509 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3371/6451] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:20 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:21.292590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:21.293750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:21.301645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:21.302282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:21.302943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:21.303680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:21.304321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:21.304762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:21.442298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:21.451445 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2373eabf-dbd6-445a-969f-fc81e6ea041f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.163008 Aug 27 03:54:21.452032 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3081/6452] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:21 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:22.473661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:22.474498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:22.481211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:22.481709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:22.482139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:22.482887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:22.483346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:22.483767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:22.627611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:22.635854 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fe97cd9b-7972-4982-8bc8-3e0244c74b1e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.166914 Aug 27 03:54:22.636433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3372/6453] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:22 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:23.659004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:23.661437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:23.680141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:23.680976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:23.681669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:23.682654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:23.683732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:23.690470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:23.870822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:23.878846 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30edce44-1ddd-4ff0-95c0-a60206f3574a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.223791 Aug 27 03:54:23.879973 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3082/6454] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:23 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:24.901908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:24.903279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:24.911219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:24.911219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:24.911219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:24.911835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:24.912299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:24.912762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:25.074440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:25.082680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f2ccc36-e14d-40dd-befd-2ca6d54f9f74 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.185412 Aug 27 03:54:25.084618 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3373/6455] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:24 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:26.105229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:26.105870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:26.113260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:26.113784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:26.114276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:26.115017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:26.115490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:26.115946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:26.276834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:26.287678 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77a0908d-8064-4061-a363-3f2ebdff4fca tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.185222 Aug 27 03:54:26.288454 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3083/6456] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:26 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:27.309585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:27.310302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:27.318808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:27.319539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:27.319981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:27.320784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:27.321242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:27.321858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:27.468931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:27.477472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02f91c56-951d-44d3-a5dc-47bb92facdc6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.172030 Aug 27 03:54:27.478054 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3374/6457] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:27 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:28.499440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:28.500227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:28.507091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:28.507597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:28.508054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:28.508782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:28.509258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:28.509702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:28.650460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:28.658546 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfcf970e-cee1-46e1-8dc7-63d49fcf9a9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.163027 Aug 27 03:54:28.659050 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3084/6458] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:28 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:29.681870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:29.682677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:29.690435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:29.691058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:29.691572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:29.693248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:29.693943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:29.694455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:29.845032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:29.854253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-40fa3ea8-cf88-40b8-bf7c-8e01e5023bfe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.177387 Aug 27 03:54:29.855252 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3375/6459] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:29 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:30.877614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:30.878873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:30.886921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:30.887429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:30.887884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:30.888608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:30.889084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:30.889529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:31.040576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:31.052276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82c58b9f-ba42-4ace-841b-ce7b4f06a135 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.178612 Aug 27 03:54:31.053061 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3085/6460] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:30 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:54:32.075564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:32.076231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:32.083870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:32.084508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:32.085244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:32.086727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:32.087198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:32.087630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:32.240649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:32.250001 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fa79a1c3-420e-4689-882b-2f34e135ba02 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.178352 Aug 27 03:54:32.250930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3376/6461] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:32 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:33.274317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:33.276013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:33.287482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:33.288018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:33.288697 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:33.289745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:33.290272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:33.290917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:33.430481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:33.438857 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a51d8d42-e625-433c-9354-ec4bf770c7c9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.170011 Aug 27 03:54:33.439461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3086/6462] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:33 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:34.461106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:34.461727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:34.468905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:34.469393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:34.469827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:34.470559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:34.471009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:34.471434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:34.637673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:34.650383 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d52fe6cb-528c-42d6-a863-d59f57d079b1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.192874 Aug 27 03:54:34.651705 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3377/6463] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:34 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:35.674484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:35.675123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:35.682824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:35.683334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:35.684045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:35.684781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:35.685264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:35.685709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:35.885275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:35.893797 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c0c48e7-dcc1-4337-9ebb-2ef415172573 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1698 microversion: 2.1 time: 0.223378 Aug 27 03:54:35.894424 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3087/6464] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:35 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1698 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:36.604629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5483f26a-ef68-4a92-a4db-732455df4b92 req-57e188db-9ae6-4154-ab50-c1fc0e74ff5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "name": "network-vif-unplugged", "status": "completed", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:36.616866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5483f26a-ef68-4a92-a4db-732455df4b92 req-57e188db-9ae6-4154-ab50-c1fc0e74ff5d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:36.617571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5483f26a-ef68-4a92-a4db-732455df4b92 req-57e188db-9ae6-4154-ab50-c1fc0e74ff5d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:36.618251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5483f26a-ef68-4a92-a4db-732455df4b92 req-57e188db-9ae6-4154-ab50-c1fc0e74ff5d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:36.632392 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5483f26a-ef68-4a92-a4db-732455df4b92 req-57e188db-9ae6-4154-ab50-c1fc0e74ff5d service nova] Creating event network-vif-unplugged:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h1-852086-5 Aug 27 03:54:36.638052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-5483f26a-ef68-4a92-a4db-732455df4b92 req-57e188db-9ae6-4154-ab50-c1fc0e74ff5d service nova] Instance 66f25817-50e3-4c0f-a434-332529d01176 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:54:36.649069 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5483f26a-ef68-4a92-a4db-732455df4b92 req-57e188db-9ae6-4154-ab50-c1fc0e74ff5d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048150 Aug 27 03:54:36.649994 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3378/6465] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:36.916198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:36.916937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:36.925138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:36.925928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:36.926461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:36.928253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:36.928674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:36.928970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:37.103859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:37.113771 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a302f55-f946-44d8-8efe-5128809719da tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1697 microversion: 2.1 time: 0.202422 Aug 27 03:54:37.115136 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3088/6466] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:36 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:38.138466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:38.139179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:38.147051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:38.147724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:38.148247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:38.148996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:38.149464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:38.149942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:38.292669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:38.301059 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fca1cc70-1f9b-442a-b772-6159c4edc19a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1695 microversion: 2.1 time: 0.167983 Aug 27 03:54:38.302688 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3379/6467] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:38 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:38.673528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-686448cc-df57-4f0f-b602-d14797fa04f6 req-6aab29ed-eb7d-48f2-b44c-560caf3617a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:38.684644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-686448cc-df57-4f0f-b602-d14797fa04f6 req-6aab29ed-eb7d-48f2-b44c-560caf3617a6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:38.685140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-686448cc-df57-4f0f-b602-d14797fa04f6 req-6aab29ed-eb7d-48f2-b44c-560caf3617a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:38.685587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-686448cc-df57-4f0f-b602-d14797fa04f6 req-6aab29ed-eb7d-48f2-b44c-560caf3617a6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:38.697429 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-686448cc-df57-4f0f-b602-d14797fa04f6 req-6aab29ed-eb7d-48f2-b44c-560caf3617a6 service nova] Creating event network-changed:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h1-852086-5 Aug 27 03:54:38.702905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-686448cc-df57-4f0f-b602-d14797fa04f6 req-6aab29ed-eb7d-48f2-b44c-560caf3617a6 service nova] Instance 66f25817-50e3-4c0f-a434-332529d01176 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:54:38.715114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-686448cc-df57-4f0f-b602-d14797fa04f6 req-6aab29ed-eb7d-48f2-b44c-560caf3617a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045194 Aug 27 03:54:38.716075 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3089/6468] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:39.325001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:39.325938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:39.333267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:39.334196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:39.335142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:39.337036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:39.337750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:39.338442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:39.530713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:39.539576 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49cbc65f-7159-4430-8c9b-4920e1d93c57 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1695 microversion: 2.1 time: 0.218507 Aug 27 03:54:39.540710 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3380/6469] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:39 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:40.576561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:40.577975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:40.587692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.588218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.588821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:40.589797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.590476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.590924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:40.744198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:40.756198 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c62a85e8-3d93-493e-b4e8-39d4dfe4acd1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1692 microversion: 2.1 time: 0.196728 Aug 27 03:54:40.756977 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3090/6470] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:40 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1692 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:40.779759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:40.781136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:40.791213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.793211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.793747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:40.795179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.795179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.795532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:40.908003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:40.936046 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbddfec1-c3b1-4024-b7c7-9f56b09d87f1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action" status: 202 len: 0 microversion: 2.1 time: 0.160474 Aug 27 03:54:40.936768 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3381/6471] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:54:40 2022] POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:54:40.952429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:40.953073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:40.961117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.961710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.962319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:40.963139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:40.963854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:40.964369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:41.134808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:41.145034 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1dc21c12-ef54-457d-b0fa-be4f15a763cf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1691 microversion: 2.1 time: 0.203733 Aug 27 03:54:41.159265 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3091/6472] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:40 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1691 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:42.168808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:42.169515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:42.177756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:42.178277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:42.178712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:42.179432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:42.179883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:42.180922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:42.351801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:42.362677 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7285153f-e22c-4c0d-966f-a1cd64cd2afe tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1691 microversion: 2.1 time: 0.197995 Aug 27 03:54:42.363653 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3382/6473] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:42 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:43.385931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:43.386739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:43.394530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:43.396326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:43.396326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:43.397319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:43.397867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:43.398615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:43.572824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:43.596238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-520b8374-8545-489d-bb9a-befe294748fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1691 microversion: 2.1 time: 0.214306 Aug 27 03:54:43.596866 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3092/6474] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:43 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:43.809248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8725c6e4-951f-49ed-9501-4a0dfd0e5bf4 req-00888d48-92a1-46dd-ae30-d6995542b786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "name": "network-vif-plugged", "status": "completed", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:43.819764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8725c6e4-951f-49ed-9501-4a0dfd0e5bf4 req-00888d48-92a1-46dd-ae30-d6995542b786 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:43.820393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8725c6e4-951f-49ed-9501-4a0dfd0e5bf4 req-00888d48-92a1-46dd-ae30-d6995542b786 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:43.820918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8725c6e4-951f-49ed-9501-4a0dfd0e5bf4 req-00888d48-92a1-46dd-ae30-d6995542b786 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:43.834136 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8725c6e4-951f-49ed-9501-4a0dfd0e5bf4 req-00888d48-92a1-46dd-ae30-d6995542b786 service nova] Creating event network-vif-plugged:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:54:43.840496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-8725c6e4-951f-49ed-9501-4a0dfd0e5bf4 req-00888d48-92a1-46dd-ae30-d6995542b786 service nova] Instance 66f25817-50e3-4c0f-a434-332529d01176 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:54:43.853230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8725c6e4-951f-49ed-9501-4a0dfd0e5bf4 req-00888d48-92a1-46dd-ae30-d6995542b786 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328321 Aug 27 03:54:43.854039 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3383/6475] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:44.481986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-801ec85d-5df4-4f3a-a889-7e6ecbd45af2 req-a3820d99-da55-4ed3-ada0-3df0133edb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "name": "network-vif-unplugged", "status": "completed", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:44.495300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-801ec85d-5df4-4f3a-a889-7e6ecbd45af2 req-a3820d99-da55-4ed3-ada0-3df0133edb25 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:44.495886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-801ec85d-5df4-4f3a-a889-7e6ecbd45af2 req-a3820d99-da55-4ed3-ada0-3df0133edb25 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:44.496371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-801ec85d-5df4-4f3a-a889-7e6ecbd45af2 req-a3820d99-da55-4ed3-ada0-3df0133edb25 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:44.517080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-801ec85d-5df4-4f3a-a889-7e6ecbd45af2 req-a3820d99-da55-4ed3-ada0-3df0133edb25 service nova] Creating event network-vif-unplugged:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:54:44.526138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-801ec85d-5df4-4f3a-a889-7e6ecbd45af2 req-a3820d99-da55-4ed3-ada0-3df0133edb25 service nova] Instance 66f25817-50e3-4c0f-a434-332529d01176 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:54:44.547374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-801ec85d-5df4-4f3a-a889-7e6ecbd45af2 req-a3820d99-da55-4ed3-ada0-3df0133edb25 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071472 Aug 27 03:54:44.548401 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3093/6476] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:54:44.620457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:44.621285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:44.627955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:44.628546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:44.629052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:44.631927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:44.632737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:44.633297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:44.778305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:44.786450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4353c22c-8737-4985-a13e-4ee9248627de tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1691 microversion: 2.1 time: 0.171216 Aug 27 03:54:44.787038 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3384/6477] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:44 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:45.809766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:45.810708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:45.813682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:45.819749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:45.820279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:45.820743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:45.821700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:45.822192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:45.822679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:45.825907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:45.972641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:45.981935 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7249e106-9f53-42ab-9f70-0d311bfe0453 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1691 microversion: 2.1 time: 0.176630 Aug 27 03:54:45.996207 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3094/6478] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:45 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:46.586345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0cb52e4a-807b-4227-ab60-7a4693e01c01 req-d3192817-a2ec-46f9-877e-01185bf50b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:46.592232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=41 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:46.598112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0cb52e4a-807b-4227-ab60-7a4693e01c01 req-d3192817-a2ec-46f9-877e-01185bf50b68 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:46.598948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0cb52e4a-807b-4227-ab60-7a4693e01c01 req-d3192817-a2ec-46f9-877e-01185bf50b68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:46.599477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0cb52e4a-807b-4227-ab60-7a4693e01c01 req-d3192817-a2ec-46f9-877e-01185bf50b68 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:46.612225 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0cb52e4a-807b-4227-ab60-7a4693e01c01 req-d3192817-a2ec-46f9-877e-01185bf50b68 service nova] Creating event network-changed:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:54:46.620812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-0cb52e4a-807b-4227-ab60-7a4693e01c01 req-d3192817-a2ec-46f9-877e-01185bf50b68 service nova] Instance 66f25817-50e3-4c0f-a434-332529d01176 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:54:46.633247 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0cb52e4a-807b-4227-ab60-7a4693e01c01 req-d3192817-a2ec-46f9-877e-01185bf50b68 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051456 Aug 27 03:54:46.634047 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3385/6479] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:47.011591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:47.014370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:47.033892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:47.035191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:47.036631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:47.041348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:47.043324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:47.044125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:47.309652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:47.327455 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bcef06ba-2a83-4eb9-b70a-fb4e49aaad8f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1691 microversion: 2.1 time: 0.322317 Aug 27 03:54:47.328468 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3095/6480] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:46 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1691 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:48.353610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:48.355201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:48.362823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:48.363316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:48.363749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:48.365446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:48.366290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:48.367007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:48.556513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:48.568738 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-217e747c-21a2-431c-a3a9-9027410b62c0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1684 microversion: 2.1 time: 0.221070 Aug 27 03:54:48.570001 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3386/6481] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:48 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1684 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:50.503222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-229ab379-e438-4efb-860b-5884636881ee req-f8818427-788c-424c-b9f4-7aee0f24d4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "name": "network-vif-plugged", "status": "completed", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:50.517167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-229ab379-e438-4efb-860b-5884636881ee req-f8818427-788c-424c-b9f4-7aee0f24d4b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:50.517971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-229ab379-e438-4efb-860b-5884636881ee req-f8818427-788c-424c-b9f4-7aee0f24d4b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:50.518596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-229ab379-e438-4efb-860b-5884636881ee req-f8818427-788c-424c-b9f4-7aee0f24d4b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:50.543154 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-229ab379-e438-4efb-860b-5884636881ee req-f8818427-788c-424c-b9f4-7aee0f24d4b8 service nova] Creating event network-vif-plugged:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:54:50.549156 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-229ab379-e438-4efb-860b-5884636881ee req-f8818427-788c-424c-b9f4-7aee0f24d4b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050440 Aug 27 03:54:50.550044 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3096/6482] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:14.813070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:14.815209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:14.819689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:14.820380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:14.829789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:14.830116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:14.830590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:14.831308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:14.831768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:14.832272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:14.895911 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-684c46f7-885f-4e8e-93c6-909ed37eaa52 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action" status: 200 len: 63038 microversion: 2.1 time: 0.086313 Aug 27 03:55:14.896683 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3387/6483] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:55:14 2022] POST /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176/action => generated 63038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:55:21.145619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:21.147126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=13 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:21.152086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:21.152821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:21.160423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:21.161502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:21.161974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:21.162843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:21.163323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:21.163771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:21.320361 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b7b54fb-2a0b-40a2-b4c7-3b795678b74a tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1835 microversion: 2.1 time: 0.176618 Aug 27 03:55:21.321473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3097/6484] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:21 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1835 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:22.400055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:22.401349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:22.412382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:22.413320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:22.414067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:22.415008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:22.416410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:22.417198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:22.455235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:55:22.595608 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1a35b75-ec4b-4305-9adc-01dc4bf572d9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 204 len: 0 microversion: 2.1 time: 0.201271 Aug 27 03:55:22.596677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3388/6485] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:55:22 2022] DELETE /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:55:22.603350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-db214d7a-8438-42cd-b3a4-81a801586fda req-a420aeba-893f-4157-b560-967a6049fcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:22.616156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:22.617000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db214d7a-8438-42cd-b3a4-81a801586fda req-a420aeba-893f-4157-b560-967a6049fcba service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:22.617911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db214d7a-8438-42cd-b3a4-81a801586fda req-a420aeba-893f-4157-b560-967a6049fcba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:22.618293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:22.619088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db214d7a-8438-42cd-b3a4-81a801586fda req-a420aeba-893f-4157-b560-967a6049fcba service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:22.626431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:22.627140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:22.627660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:22.628555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:22.629098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:22.629634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:22.634760 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-db214d7a-8438-42cd-b3a4-81a801586fda req-a420aeba-893f-4157-b560-967a6049fcba service nova] Creating event network-changed:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:55:22.640724 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-db214d7a-8438-42cd-b3a4-81a801586fda req-a420aeba-893f-4157-b560-967a6049fcba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246547 Aug 27 03:55:22.641333 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3098/6486] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:55:22.834129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:22.842803 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02b8979f-6b0d-4223-a985-281c17fd21e5 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1690 microversion: 2.1 time: 0.235448 Aug 27 03:55:22.843531 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3389/6487] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:22 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1690 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:23.867356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:23.869050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:23.877144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:23.878393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:23.879080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:23.880683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:23.881173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:23.881617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:24.076313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:24.086949 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8afefaed-ca39-411c-879a-ee8465094d0f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1690 microversion: 2.1 time: 0.225701 Aug 27 03:55:24.087623 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3099/6488] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:23 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:25.013606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-a9a1053f-fbce-423c-8d4d-dd3bc145585f req-146ab2d8-a151-41a8-98e0-4f335d0407b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f25817-50e3-4c0f-a434-332529d01176", "name": "network-vif-deleted", "tag": "8ddd9662-abad-46db-aa3e-cb820627830c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:25.029821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9a1053f-fbce-423c-8d4d-dd3bc145585f req-146ab2d8-a151-41a8-98e0-4f335d0407b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.030445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9a1053f-fbce-423c-8d4d-dd3bc145585f req-146ab2d8-a151-41a8-98e0-4f335d0407b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.030955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a9a1053f-fbce-423c-8d4d-dd3bc145585f req-146ab2d8-a151-41a8-98e0-4f335d0407b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:25.047787 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-a9a1053f-fbce-423c-8d4d-dd3bc145585f req-146ab2d8-a151-41a8-98e0-4f335d0407b8 service nova] Creating event network-vif-deleted:8ddd9662-abad-46db-aa3e-cb820627830c for instance 66f25817-50e3-4c0f-a434-332529d01176 on n-h2-852086-5 Aug 27 03:55:25.054381 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-a9a1053f-fbce-423c-8d4d-dd3bc145585f req-146ab2d8-a151-41a8-98e0-4f335d0407b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043984 Aug 27 03:55:25.055011 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3390/6489] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:55:25.109112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:25.109882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:25.119003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.119542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.119998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:25.120750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.121219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.121680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:25.157752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:25.158292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:25.158929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:25.159626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lazy-loading 'fault' on Instance uuid 66f25817-50e3-4c0f-a434-332529d01176 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:55:25.211864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:25.222037 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e6252ce-64dd-4e84-9208-3e8eb2885486 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 200 len: 1357 microversion: 2.1 time: 0.116917 Aug 27 03:55:25.222663 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3100/6490] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:25 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 1357 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:26.244848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:26.245632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 66f25817-50e3-4c0f-a434-332529d01176] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:26.252442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:26.253152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:26.253606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:26.254348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:26.254816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:26.255247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:26.268784 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] HTTP exception thrown: Instance 66f25817-50e3-4c0f-a434-332529d01176 could not be found. Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Request method failure captured: Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 HTTP/1.1 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZSj7HFO2PaNzyPbSA7cTP-KIbMXatuskAYCPhYxud_jxcSMxl_Q6ae_gUMlmk6imBa7B5VqLQbCfFECNSOxptHSzbymSfoCmI3GvPSmrDgYOmpB9haOnmwV1YgaLuTK8tHRWP0PkcW2CcI14O2muT_9eUWhYFs7LVJntcr2Qw-VdJ4 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0d3f5f3257024419926319c6013d4d56", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}] Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: cd7171be5b3d4238acfe83058f78413c Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 66f25817-50e3-4c0f-a434-332529d01176 could not be found. Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '66f25817-50e3-4c0f-a434-332529d01176'} Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f25817-50e3-4c0f-a434-332529d01176 could not be found. Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f25817-50e3-4c0f-a434-332529d01176 could not be found. Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:55:26.270482 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f25817-50e3-4c0f-a434-332529d01176 could not be found. Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Returning 404 to user: Instance 66f25817-50e3-4c0f-a434-332529d01176 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7af9700f-d1df-40fc-a2d7-6f2ce06ceb82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176" status: 404 len: 111 microversion: 2.1 time: 0.032295 Aug 27 03:55:26.276310 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3391/6491] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:26 2022] GET /compute/v2.1/servers/66f25817-50e3-4c0f-a434-332529d01176 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:55:32.430152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ed129b0-51a1-49ff-a175-5b9f7121b544 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '.version_select at 0x7fe4602848b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:32.453509 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7ed129b0-51a1-49ff-a175-5b9f7121b544 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1938604949" status: 202 len: 0 microversion: 2.1 time: 0.027468 Aug 27 03:55:32.454567 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3101/6492] 10.222.0.69 () {58 vars in 1284 bytes} [Sat Aug 27 03:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1938604949 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:55:32.495754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4928750-5545-4dbc-aa80-b23fbd56a349 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: .version_select at 0x7fe457a251f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1392709135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZx2jmO/NF+bjGaHrdAcKn/D9QPrv2UR+hSCye0WpTp0Um8cCRrc7tOH9WVlNYeqTaJknoSvqswzMg+XxGKduirhd4CBxJSt7/BZpc6pHojzPn8ImrVYvr/WYnXQlJFdA=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:32.515333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e4928750-5545-4dbc-aa80-b23fbd56a349 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:55:32.523268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e4928750-5545-4dbc-aa80-b23fbd56a349 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:55:32.578460 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4928750-5545-4dbc-aa80-b23fbd56a349 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.086875 Aug 27 03:55:32.580333 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3392/6493] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:55:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:34.371484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d6358533-93a4-4f13-aeef-62dced15d6d4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'create', calling method: .version_select at 0x7fe457d7e9d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1097607745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0fWZaCfrizpNIGlJjRMIXyG0M0G4EUKV6Kd39hVQU/toXEJ/i9ntwtCyh7bgI2E5/ttlAOx9kCcizT7KDdmNMI9Jbnkts/fhnuNYLKeltK+x/iE2Y/sYNSBrXDPkCDVQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:34.389868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d6358533-93a4-4f13-aeef-62dced15d6d4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for project c037d852b1074d47a19377735a5ff519. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:55:34.396348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-d6358533-93a4-4f13-aeef-62dced15d6d4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for user 553f4b1db7eb4c53981c18ac5ed0b352 and project c037d852b1074d47a19377735a5ff519. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:55:34.425041 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d6358533-93a4-4f13-aeef-62dced15d6d4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.058572 Aug 27 03:55:34.431311 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3102/6494] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:55:34 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:36.326676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:36.332608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1677020385", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "df3fb603-efdb-4f69-a74c-95f8a37daa46"}], "key_name": "tempest-TestNetworkBasicOps-1097607745", "security_groups": [{"name": "tempest-secgroup-smoke-58830128"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:36.460720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] validate_networks() for [('df3fb603-efdb-4f69-a74c-95f8a37daa46', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:55:36.886385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:55:36.887281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:55:36.887827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:55:36.888310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:55:36.888796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:55:36.909592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:36.910098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:36.910561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:36.911732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:36.911847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:36.912202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:36.941220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for project c037d852b1074d47a19377735a5ff519. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:55:36.948298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for user 553f4b1db7eb4c53981c18ac5ed0b352 and project c037d852b1074d47a19377735a5ff519. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:55:36.963716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:55:36.966273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:55:37.032728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91b8dacc-8948-44df-a825-83bdb3a165fd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.707681 Aug 27 03:55:37.034597 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3393/6495] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:55:36 2022] POST /compute/v2.1/servers => generated 404 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:55:37.047036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdc0b76b-abb2-4411-bb33-51c4b51ad32d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:37.048022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdc0b76b-abb2-4411-bb33-51c4b51ad32d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:37.051148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=22 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:37.162738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdc0b76b-abb2-4411-bb33-51c4b51ad32d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:37.183971 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdc0b76b-abb2-4411-bb33-51c4b51ad32d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1249 microversion: 2.1 time: 0.142257 Aug 27 03:55:37.198124 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3103/6496] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:37 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1249 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:55:38.207947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:38.210127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:38.217839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:38.218840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:38.219389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:38.221271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:38.222047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:38.222990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:38.312502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:38.326202 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-416a6c67-c4fb-4955-9335-0de9ec0a3d9d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1301 microversion: 2.1 time: 0.122895 Aug 27 03:55:38.327547 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3394/6497] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:38 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1301 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:39.354611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:39.356348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:39.368602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:39.369436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:39.370066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:39.371613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:39.372573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:39.373581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:39.524246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:39.538694 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48b3dd2c-9702-4996-b078-62f8334d5345 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1307 microversion: 2.1 time: 0.192956 Aug 27 03:55:39.543268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3104/6498] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:39 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:55:40.565361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:40.566745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:40.576509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:40.577589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:40.578518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:40.579348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:40.580034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:40.580703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:40.674987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-05241d5c-6f29-4d3a-9bc6-69337430e1b6 req-7479d836-8587-48a4-86eb-c572114d068f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "672822a0-a63f-4927-8863-02b2e46c3ac6", "tag": "1e25c900-58c2-4356-ba27-7bd28062cf1d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:40.691284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-05241d5c-6f29-4d3a-9bc6-69337430e1b6 req-7479d836-8587-48a4-86eb-c572114d068f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:40.692088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-05241d5c-6f29-4d3a-9bc6-69337430e1b6 req-7479d836-8587-48a4-86eb-c572114d068f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:40.693374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-05241d5c-6f29-4d3a-9bc6-69337430e1b6 req-7479d836-8587-48a4-86eb-c572114d068f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:40.706196 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-05241d5c-6f29-4d3a-9bc6-69337430e1b6 req-7479d836-8587-48a4-86eb-c572114d068f service nova] Creating event network-changed:1e25c900-58c2-4356-ba27-7bd28062cf1d for instance 672822a0-a63f-4927-8863-02b2e46c3ac6 on n-h2-852086-5 Aug 27 03:55:40.713231 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-05241d5c-6f29-4d3a-9bc6-69337430e1b6 req-7479d836-8587-48a4-86eb-c572114d068f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043375 Aug 27 03:55:40.714063 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3105/6499] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:55:40.856861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:40.870460 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b2a8f88-c698-4295-9f59-ec3ab6c1081b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1373 microversion: 2.1 time: 0.309121 Aug 27 03:55:40.886140 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3395/6500] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:40 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1373 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:41.179655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-416095585", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "36b45c24-1df2-401c-96e2-11c0d3d38dc8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1392709135", "security_groups": [{"name": "tempest-secgroup-smoke-450016067"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:41.330857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] validate_networks() for [('36b45c24-1df2-401c-96e2-11c0d3d38dc8', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:55:41.752201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:55:41.752973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:55:41.753119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:55:41.753554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:55:41.754011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:55:41.763385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:41.763892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:41.764350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:41.765116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:41.765595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:41.766039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:41.788270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:55:41.793675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:55:41.807898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:55:41.810668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:55:41.862440 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abbafe36-3bc7-4955-a297-c3935bfd992d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688066 Aug 27 03:55:41.869769 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3106/6501] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:55:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:55:41.876799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-782eecb0-e8af-4b26-9e42-015f89ae90ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:41.878713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-782eecb0-e8af-4b26-9e42-015f89ae90ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:41.902370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:41.903253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:41.911673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:41.912616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:41.913296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:41.914269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:41.916303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:41.917032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:41.950868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-782eecb0-e8af-4b26-9e42-015f89ae90ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:41.964862 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-782eecb0-e8af-4b26-9e42-015f89ae90ae tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1266 microversion: 2.1 time: 0.092924 Aug 27 03:55:41.982905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3396/6502] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:41 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:42.096529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:42.105443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a0a0c2c-b3e7-448d-9693-7e71b99a9c04 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1373 microversion: 2.1 time: 0.214461 Aug 27 03:55:42.106549 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3107/6503] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:41 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:42.993420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:42.994260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:43.002104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:43.002718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:43.003235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:43.004081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:43.004734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:43.005993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:43.071646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:43.080065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b1bce23-31ee-4b2e-ae45-9d0b755eb5c4 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1318 microversion: 2.1 time: 0.091256 Aug 27 03:55:43.105862 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3397/6504] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:42 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:43.128191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:43.128791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:43.138665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:43.139292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:43.139986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:43.142100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:43.142100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:43.142100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:43.344275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:43.358083 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c9da698-be35-45f4-a471-1617c27c9a7f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1373 microversion: 2.1 time: 0.234775 Aug 27 03:55:43.359024 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3108/6505] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:43 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1373 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:44.102364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:44.103094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:44.112195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:44.112890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:44.113513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:44.115042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:44.116382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:44.117027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:44.379286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:44.380372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:44.381006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:44.391714 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e52e62c4-4210-4dbd-898e-adccacf801c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1391 microversion: 2.1 time: 0.294612 Aug 27 03:55:44.392445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:44.392658 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3398/6506] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:44 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:44.393120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:44.393653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:44.394515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:44.395068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:44.396192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:44.670403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-c15daa99-791c-447e-9547-23dd7e507b8e req-b9255ed1-0334-4751-9def-04c46e34b4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672822a0-a63f-4927-8863-02b2e46c3ac6", "name": "network-vif-plugged", "status": "completed", "tag": "1e25c900-58c2-4356-ba27-7bd28062cf1d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:44.687965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c15daa99-791c-447e-9547-23dd7e507b8e req-b9255ed1-0334-4751-9def-04c46e34b4d2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:44.688908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c15daa99-791c-447e-9547-23dd7e507b8e req-b9255ed1-0334-4751-9def-04c46e34b4d2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:44.689663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-c15daa99-791c-447e-9547-23dd7e507b8e req-b9255ed1-0334-4751-9def-04c46e34b4d2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:44.705583 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-c15daa99-791c-447e-9547-23dd7e507b8e req-b9255ed1-0334-4751-9def-04c46e34b4d2 service nova] Creating event network-vif-plugged:1e25c900-58c2-4356-ba27-7bd28062cf1d for instance 672822a0-a63f-4927-8863-02b2e46c3ac6 on n-h2-852086-5 Aug 27 03:55:44.717254 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-c15daa99-791c-447e-9547-23dd7e507b8e req-b9255ed1-0334-4751-9def-04c46e34b4d2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055807 Aug 27 03:55:44.717905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3399/6507] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:44.888020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:44.898457 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecb87bda-0823-4643-ad22-7d1d91fd55f8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1373 microversion: 2.1 time: 0.523259 Aug 27 03:55:44.899185 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3109/6508] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:44 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1373 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:55:44.919385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b862fb91-2cd1-4ee7-8457-1864c5221572 req-12ee6f43-ba41-4c8a-b265-977d2c30283c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5998634-656c-464b-9e44-74609f284072", "tag": "e50aae7b-dccd-416b-9a0f-97a7638b964c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:44.936080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:44.939713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b862fb91-2cd1-4ee7-8457-1864c5221572 req-12ee6f43-ba41-4c8a-b265-977d2c30283c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:44.940674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b862fb91-2cd1-4ee7-8457-1864c5221572 req-12ee6f43-ba41-4c8a-b265-977d2c30283c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:44.941314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b862fb91-2cd1-4ee7-8457-1864c5221572 req-12ee6f43-ba41-4c8a-b265-977d2c30283c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:44.957621 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b862fb91-2cd1-4ee7-8457-1864c5221572 req-12ee6f43-ba41-4c8a-b265-977d2c30283c service nova] Creating event network-changed:e50aae7b-dccd-416b-9a0f-97a7638b964c for instance c5998634-656c-464b-9e44-74609f284072 on n-h1-852086-5 Aug 27 03:55:44.965613 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b862fb91-2cd1-4ee7-8457-1864c5221572 req-12ee6f43-ba41-4c8a-b265-977d2c30283c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058247 Aug 27 03:55:44.966870 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3400/6509] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:55:45.417266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:45.418708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:45.429468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:45.430113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:45.430669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:45.431669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:45.432249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:45.432770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:45.588955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:45.597186 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59cddb3d-59a4-4d6a-b227-33b33bd98957 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1391 microversion: 2.1 time: 0.187911 Aug 27 03:55:45.597986 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3110/6510] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:45 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:45.925666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:45.926422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:45.934688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:45.935174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:45.935604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:45.936313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:45.936766 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:45.937194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:46.082099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:46.092952 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1362cb64-bc3b-4e87-8e09-cfe825c882d8 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1373 microversion: 2.1 time: 0.174679 Aug 27 03:55:46.093540 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3401/6511] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:45 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:46.619617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:46.620259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:46.626797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:46.627303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:46.627783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:46.628495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:46.628962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:46.629400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:46.765343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:46.773404 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2c6b752-280d-4c7d-b95b-7d7721c5b12c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1391 microversion: 2.1 time: 0.158845 Aug 27 03:55:46.773979 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3111/6512] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:46 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:47.115486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:47.116096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:47.118396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:47.124173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:47.124659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:47.125123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:47.125849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:47.126337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:47.126761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:47.270254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:47.278868 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eb5c449a-a102-449b-9734-4972ebeb688d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1545 microversion: 2.1 time: 0.167937 Aug 27 03:55:47.279470 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3402/6513] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:47 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:47.299590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:47.300221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:47.306422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:47.306925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:47.307373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:47.308082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:47.308551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:47.308990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:47.442504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:47.450447 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fbb0560-411e-4c6d-8227-0b3f64d11244 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1545 microversion: 2.1 time: 0.154835 Aug 27 03:55:47.451026 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3112/6514] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:47 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:47.794252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:47.795109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:47.800901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:47.801403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:47.801880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:47.802640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:47.803345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:47.803908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:48.255746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:48.264245 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d59776fa-d5e6-4821-bb2d-41e6c2198715 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1391 microversion: 2.1 time: 0.473804 Aug 27 03:55:48.265135 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3403/6515] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:47 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1391 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:49.287837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:49.288623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:49.295566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:49.296076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:49.296915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:49.297289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:49.297766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:49.298233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:49.436615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:49.444694 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-563f097c-18e1-4ffb-977e-35730e52e549 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1391 microversion: 2.1 time: 0.161354 Aug 27 03:55:49.445273 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3113/6516] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:49 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:49.650061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-73ffffd0-d6bb-49ba-8ab1-d104eedab815 req-93d10ceb-79c0-4288-a4c1-456aaf39d99c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "672822a0-a63f-4927-8863-02b2e46c3ac6", "tag": "1e25c900-58c2-4356-ba27-7bd28062cf1d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:49.663218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-73ffffd0-d6bb-49ba-8ab1-d104eedab815 req-93d10ceb-79c0-4288-a4c1-456aaf39d99c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:49.663875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-73ffffd0-d6bb-49ba-8ab1-d104eedab815 req-93d10ceb-79c0-4288-a4c1-456aaf39d99c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:49.664503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-73ffffd0-d6bb-49ba-8ab1-d104eedab815 req-93d10ceb-79c0-4288-a4c1-456aaf39d99c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:49.677003 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-73ffffd0-d6bb-49ba-8ab1-d104eedab815 req-93d10ceb-79c0-4288-a4c1-456aaf39d99c service nova] Creating event network-changed:1e25c900-58c2-4356-ba27-7bd28062cf1d for instance 672822a0-a63f-4927-8863-02b2e46c3ac6 on n-h2-852086-5 Aug 27 03:55:49.683905 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-73ffffd0-d6bb-49ba-8ab1-d104eedab815 req-93d10ceb-79c0-4288-a4c1-456aaf39d99c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038254 Aug 27 03:55:49.683905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3404/6517] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:49.891016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-be7d3806-34a8-41ae-9c6e-00d30178a7c6 req-69900da5-4108-4ac1-8319-d43a8059f85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5998634-656c-464b-9e44-74609f284072", "name": "network-vif-plugged", "status": "completed", "tag": "e50aae7b-dccd-416b-9a0f-97a7638b964c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:49.906663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-be7d3806-34a8-41ae-9c6e-00d30178a7c6 req-69900da5-4108-4ac1-8319-d43a8059f85d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:49.908991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-be7d3806-34a8-41ae-9c6e-00d30178a7c6 req-69900da5-4108-4ac1-8319-d43a8059f85d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:49.909779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-be7d3806-34a8-41ae-9c6e-00d30178a7c6 req-69900da5-4108-4ac1-8319-d43a8059f85d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:49.930223 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-be7d3806-34a8-41ae-9c6e-00d30178a7c6 req-69900da5-4108-4ac1-8319-d43a8059f85d service nova] Creating event network-vif-plugged:e50aae7b-dccd-416b-9a0f-97a7638b964c for instance c5998634-656c-464b-9e44-74609f284072 on n-h1-852086-5 Aug 27 03:55:49.939225 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-be7d3806-34a8-41ae-9c6e-00d30178a7c6 req-69900da5-4108-4ac1-8319-d43a8059f85d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052776 Aug 27 03:55:49.940986 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3114/6518] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:50.465821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:50.466468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:50.472788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:50.473279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:50.474616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:50.475336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:50.475854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:50.476287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:50.634877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:50.642749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1fa661da-9b01-4022-bbf5-4dc98b0be2e2 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1391 microversion: 2.1 time: 0.181389 Aug 27 03:55:50.643332 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3405/6519] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:50 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:51.667546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:51.668267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:51.670350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:51.676298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:51.677457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:51.677911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:51.678656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:51.679125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:51.679563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:51.781233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:51.801862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:51.835634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:51.843468 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5642a61c-9199-4340-85ab-0d716538485b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1563 microversion: 2.1 time: 0.181369 Aug 27 03:55:51.844048 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3115/6520] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:51 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:51.865733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:51.866434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:51.873206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:51.873693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:51.874125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:51.874839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:51.875292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:51.875712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:51.963647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:55:52.013232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:52.021740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eda5afbd-1300-4df4-919e-50b87d32f7e6 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1563 microversion: 2.1 time: 0.160318 Aug 27 03:55:52.022362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3406/6521] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:51 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:53.681323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:53.682670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:55:53.683680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-363dacf7-5acf-479a-81cb-d958a9700d9b req-031d7889-9a57-4456-a923-58ab83a0dd8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5998634-656c-464b-9e44-74609f284072", "tag": "e50aae7b-dccd-416b-9a0f-97a7638b964c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:53.690387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:53.691192 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:53.691876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:53.692885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:53.693584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:53.694404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:53.695749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-363dacf7-5acf-479a-81cb-d958a9700d9b req-031d7889-9a57-4456-a923-58ab83a0dd8d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:55:53.695979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-363dacf7-5acf-479a-81cb-d958a9700d9b req-031d7889-9a57-4456-a923-58ab83a0dd8d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:55:53.696610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-363dacf7-5acf-479a-81cb-d958a9700d9b req-031d7889-9a57-4456-a923-58ab83a0dd8d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:55:53.716896 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-363dacf7-5acf-479a-81cb-d958a9700d9b req-031d7889-9a57-4456-a923-58ab83a0dd8d service nova] Creating event network-changed:e50aae7b-dccd-416b-9a0f-97a7638b964c for instance c5998634-656c-464b-9e44-74609f284072 on n-h1-852086-5 Aug 27 03:55:53.722039 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-363dacf7-5acf-479a-81cb-d958a9700d9b req-031d7889-9a57-4456-a923-58ab83a0dd8d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042351 Aug 27 03:55:53.722997 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3407/6522] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:53.841630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:55:53.851603 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93073987-4652-4712-97c1-3746c0e41ddf tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1563 microversion: 2.1 time: 0.174243 Aug 27 03:55:53.852512 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3116/6523] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:55:53 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:04.154176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=15 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:04.154857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=64 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:04.338117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:04.338748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:04.345015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:04.345505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:04.345944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:04.346703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:04.347169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:04.347602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:04.374246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:56:04.453539 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-79d8b18b-d6ef-435f-a0f4-17afbb52c01a tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 204 len: 0 microversion: 2.1 time: 0.301124 Aug 27 03:56:04.454222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3408/6524] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:56:04 2022] DELETE /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:56:04.463365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:04.464120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:04.467497 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:04.468176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=66 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:04.474334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:04.474855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:04.475304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:04.476034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:04.476515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:04.476964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:04.618302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:04.626401 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee472155-4da5-428d-954b-c16f0f1b5d04 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1727 microversion: 2.1 time: 0.167133 Aug 27 03:56:04.626980 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3117/6525] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:04 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:05.650221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:05.650938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:05.658387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:05.658863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:05.659351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:05.660123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:05.661151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:05.661768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:05.802349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:05.811015 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17593396-8ea5-44db-8958-0888bdb7e5a3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1727 microversion: 2.1 time: 0.165694 Aug 27 03:56:05.811608 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3409/6526] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:05 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:06.842643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:06.843303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:06.852043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:06.852587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:06.853037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:06.853943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:06.854544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:06.855485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:06.928108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2424c7d0ce8c47c3b9e6f3d4edac6d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2052a4ffb546fc8d9e25f4b6d6fbc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:06.936548 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24c65290-8b77-4118-9934-ebe4aa9b14b4 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 200 len: 1661 microversion: 2.1 time: 0.098805 Aug 27 03:56:06.937440 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3118/6527] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:06 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 1661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:07.089253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-190e5445-649a-4b94-8e46-5f7558825a4e req-1e221df7-e913-41a3-b029-6a8753c75fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a", "name": "network-vif-deleted", "tag": "cd5c6996-92c5-4fd4-85b2-fbbf59c49341"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:07.101877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-190e5445-649a-4b94-8e46-5f7558825a4e req-1e221df7-e913-41a3-b029-6a8753c75fca service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:07.102399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-190e5445-649a-4b94-8e46-5f7558825a4e req-1e221df7-e913-41a3-b029-6a8753c75fca service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:07.102901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-190e5445-649a-4b94-8e46-5f7558825a4e req-1e221df7-e913-41a3-b029-6a8753c75fca service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:07.122528 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-190e5445-649a-4b94-8e46-5f7558825a4e req-1e221df7-e913-41a3-b029-6a8753c75fca service nova] Creating event network-vif-deleted:cd5c6996-92c5-4fd4-85b2-fbbf59c49341 for instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a on n-h1-852086-5 Aug 27 03:56:07.128267 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-190e5445-649a-4b94-8e46-5f7558825a4e req-1e221df7-e913-41a3-b029-6a8753c75fca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043176 Aug 27 03:56:07.129008 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3410/6528] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:07.958970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:07.959739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:07.967734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:07.968249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:07.968724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:07.969431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:07.970102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:07.970577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:07.985743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] HTTP exception thrown: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Request method failure captured: Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a HTTP/1.1 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZSY-qPE2mA3lbvosgxtu3RIki5gjYN89z5X_o6tZKyrvWThT1NX7fYHKmjFPXdRTL4wgTWpZW3j7IPF8duEY2K5NED1LoowHsI3kUszu12UO5ochRN3DBIffXpWRDyibcY5mjGwl0574WGYkfPkRggpcvCD5kJrCCZCd6uuDGpjH2I Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8e2052a4ffb546fc8d9e25f4b6d6fbc6 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8e2052a4ffb546fc8d9e25f4b6d6fbc6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}] Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8e2052a4ffb546fc8d9e25f4b6d6fbc6 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestServerBasicOps-1237331827-project Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2424c7d0ce8c47c3b9e6f3d4edac6d8e Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestServerBasicOps-1237331827-project Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a'} Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:07.987505 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Returning 404 to user: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-401e6668-e5fb-4011-a99b-3a7921c8f653 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 404 len: 111 microversion: 2.1 time: 0.034176 Aug 27 03:56:07.997035 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3119/6529] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:07 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:56:08.462849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:08.463435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:08.469648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:08.470132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:08.470590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:08.471281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:08.471733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:08.472163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:08.486377 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] HTTP exception thrown: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Request method failure captured: Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a HTTP/1.1 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZSY-qPE2mA3lbvosgxtu3RIki5gjYN89z5X_o6tZKyrvWThT1NX7fYHKmjFPXdRTL4wgTWpZW3j7IPF8duEY2K5NED1LoowHsI3kUszu12UO5ochRN3DBIffXpWRDyibcY5mjGwl0574WGYkfPkRggpcvCD5kJrCCZCd6uuDGpjH2I Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8e2052a4ffb546fc8d9e25f4b6d6fbc6 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8e2052a4ffb546fc8d9e25f4b6d6fbc6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}] Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8e2052a4ffb546fc8d9e25f4b6d6fbc6 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestServerBasicOps-1237331827-project Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 2424c7d0ce8c47c3b9e6f3d4edac6d8e Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestServerBasicOps-1237331827-project Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a'} Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:56:08.488035 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Returning 404 to user: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-71269529-8941-49e7-92d6-32f9d3b47830 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 404 len: 111 microversion: 2.1 time: 0.033333 Aug 27 03:56:08.493813 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3411/6530] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:56:08 2022] DELETE /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:56:08.499342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:08.500017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] [instance: 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:08.507322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:08.507825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:08.508279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:08.509000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:08.509469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:08.509913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:08.524053 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] HTTP exception thrown: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Request method failure captured: Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a HTTP/1.1 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZSY-qPE2mA3lbvosgxtu3RIki5gjYN89z5X_o6tZKyrvWThT1NX7fYHKmjFPXdRTL4wgTWpZW3j7IPF8duEY2K5NED1LoowHsI3kUszu12UO5ochRN3DBIffXpWRDyibcY5mjGwl0574WGYkfPkRggpcvCD5kJrCCZCd6uuDGpjH2I Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8e2052a4ffb546fc8d9e25f4b6d6fbc6 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8e2052a4ffb546fc8d9e25f4b6d6fbc6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8e2052a4ffb546fc8d9e25f4b6d6fbc6"}]}] Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8e2052a4ffb546fc8d9e25f4b6d6fbc6 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestServerBasicOps-1237331827 Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestServerBasicOps-1237331827-project Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 2424c7d0ce8c47c3b9e6f3d4edac6d8e Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestServerBasicOps-1237331827-project Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a'} Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:08.525656 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Returning 404 to user: Instance 6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c14bfbd7-5d11-4898-843b-5497aca6e3f3 tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a" status: 404 len: 111 microversion: 2.1 time: 0.031725 Aug 27 03:56:08.533876 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3120/6531] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:08 2022] GET /compute/v2.1/servers/6a9c3bb6-36d1-4a69-8d17-2c9f86e35d9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:56:08.699508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc95b32a-a574-4b99-9390-e655b7117f8b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] Calling method '.version_select at 0x7fe4569e8d30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:08.722432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc95b32a-a574-4b99-9390-e655b7117f8b tempest-TestServerBasicOps-1237331827 tempest-TestServerBasicOps-1237331827-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2407346" status: 202 len: 0 microversion: 2.1 time: 0.026703 Aug 27 03:56:08.724034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3412/6532] 10.222.0.69 () {58 vars in 1245 bytes} [Sat Aug 27 03:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2407346 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:56:12.891756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:12.894213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:12.902892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:12.903416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:12.903887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:12.904620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:12.905094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:12.905539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:12.962953 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d747071b-2528-4a7b-8c99-f72f660efd07 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6/action" status: 200 len: 24572 microversion: 2.1 time: 0.074995 Aug 27 03:56:12.970747 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3121/6533] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:12 2022] POST /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:21.150480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:21.151449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:21.425878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:21.429032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:21.436788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:21.437285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:21.437743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:21.438774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:21.439325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:21.439757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:21.503651 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e689c0da-c3dd-4eb8-9452-44f44a56e304 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action" status: 200 len: 24570 microversion: 2.1 time: 0.359664 Aug 27 03:56:21.512712 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3413/6534] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:21 2022] POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action => generated 24570 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:27.745631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:27.746428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=20 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:27.922361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:27.924446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:27.925309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:27.926307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:27.927398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:27.928072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:27.929826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:27.966834 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fbe54767-5411-406b-b705-7f4995d3f05f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.228848 Aug 27 03:56:27.967725 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3122/6535] 10.222.0.69 () {58 vars in 1185 bytes} [Sat Aug 27 03:56:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:28.092954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1042710974", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "availability_zone": "nova:n-h1-852086-5", "networks": [{"uuid": "dfad5ed0-1065-4776-831e-2158b327c543"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:28.160525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] validate_networks() for [('dfad5ed0-1065-4776-831e-2158b327c543', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:56:28.635477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33a5ff96-17a2-47a8-9df6-3f5a125724c3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'create', calling method: .version_select at 0x7fe4603c7e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-629412444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB8fi2fo60emi8IEHzlZ3DES/k57a3ARGzpRtik13DNpUIGcLAsUndTZgqbpL9x1WnU855L4c5/LrklElKAxx60bFr3djRYNY7EYkHHiF+k1756uQHLr75fZ+iOHWRJrw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:28.653181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-33a5ff96-17a2-47a8-9df6-3f5a125724c3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for project c037d852b1074d47a19377735a5ff519. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:56:28.659874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-33a5ff96-17a2-47a8-9df6-3f5a125724c3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for user 553f4b1db7eb4c53981c18ac5ed0b352 and project c037d852b1074d47a19377735a5ff519. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:56:28.711742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:56:28.712164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:56:28.712635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:56:28.713045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:56:28.713456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:56:28.715057 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33a5ff96-17a2-47a8-9df6-3f5a125724c3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.076262 Aug 27 03:56:28.716130 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3123/6536] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:56:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:28.730395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:28.731123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:28.732034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:28.733383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:28.734082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:28.734539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:28.757212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Getting quotas for project 0af67211e7c44b60a5569e15799c84ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:56:28.762941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Getting quotas for user 9943b84d12d6498f866188a6d083e636 and project 0af67211e7c44b60a5569e15799c84ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:56:28.775965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:56:28.778588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:56:28.850009 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-80111e5a-7dd2-4c68-8fba-baa99d62e8e6 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760657 Aug 27 03:56:28.855916 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3414/6537] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:56:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:56:28.864185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b610a3f5-c78e-46d7-8c48-a699030652d5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:28.866090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b610a3f5-c78e-46d7-8c48-a699030652d5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:28.995014 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b610a3f5-c78e-46d7-8c48-a699030652d5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1329 microversion: 2.1 time: 0.136491 Aug 27 03:56:28.996027 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3124/6538] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:28 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1329 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:30.020177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:30.020921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:30.041952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:30.042959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:30.043412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:30.044181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:30.044880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:30.045477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:30.127607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-478344244", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "1495bda2-9e27-43d5-8651-73ca9ea22b08"}], "key_name": "tempest-TestNetworkBasicOps-629412444", "security_groups": [{"name": "tempest-secgroup-smoke-1486586663"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:30.156145 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f1e4a77-67d5-49ce-a8d4-c4b0ccb5a46f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1416 microversion: 2.1 time: 0.141761 Aug 27 03:56:30.170891 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3415/6539] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:30 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:30.292101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] validate_networks() for [('1495bda2-9e27-43d5-8651-73ca9ea22b08', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:56:30.786488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:56:30.787031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:56:30.787966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:56:30.788478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:56:30.789014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:56:30.802854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:30.803502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:30.804247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:30.805454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:30.806152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:30.806667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:30.841150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for project c037d852b1074d47a19377735a5ff519. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:56:30.850742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for user 553f4b1db7eb4c53981c18ac5ed0b352 and project c037d852b1074d47a19377735a5ff519. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:56:30.875934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:56:30.878512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:56:30.948998 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4704fd57-c41f-4af3-9432-fa9775479be6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829584 Aug 27 03:56:30.956174 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3125/6540] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:56:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:56:30.961832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8fed1f3-74ca-4a11-a640-58793a830f6d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:30.962481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8fed1f3-74ca-4a11-a640-58793a830f6d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:31.047789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c8fed1f3-74ca-4a11-a640-58793a830f6d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:31.058572 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8fed1f3-74ca-4a11-a640-58793a830f6d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1247 microversion: 2.1 time: 0.101156 Aug 27 03:56:31.060129 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3416/6541] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:30 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1247 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:31.179002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:31.179643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:31.189048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:31.190056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:31.190920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:31.193025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:31.193965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:31.194884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:31.409408 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c061fda3-d5f8-4752-9a60-c6f6c091f4a0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1464 microversion: 2.1 time: 0.232953 Aug 27 03:56:31.412201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3126/6542] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:31 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1464 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:32.083015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:32.083653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:32.105678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.113446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.119682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.120735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.122311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.125370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.296244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:32.306147 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b72b13e-6cd3-4fbf-94db-bb426c273736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1299 microversion: 2.1 time: 0.228407 Aug 27 03:56:32.307340 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3417/6543] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:32 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:32.358106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-35db1e00-7cb1-48a0-8fc1-79c0acda6a31 req-24028576-c0a5-435f-975a-d4e0225b5297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec00b94-77de-40e7-9c84-619f41298324", "tag": "8e43a0ef-e258-4c62-ace2-2bf12a0163f8"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:32.375443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-35db1e00-7cb1-48a0-8fc1-79c0acda6a31 req-24028576-c0a5-435f-975a-d4e0225b5297 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.376981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-35db1e00-7cb1-48a0-8fc1-79c0acda6a31 req-24028576-c0a5-435f-975a-d4e0225b5297 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.377691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-35db1e00-7cb1-48a0-8fc1-79c0acda6a31 req-24028576-c0a5-435f-975a-d4e0225b5297 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.402664 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-35db1e00-7cb1-48a0-8fc1-79c0acda6a31 req-24028576-c0a5-435f-975a-d4e0225b5297 service nova] Creating event network-changed:8e43a0ef-e258-4c62-ace2-2bf12a0163f8 for instance eec00b94-77de-40e7-9c84-619f41298324 on n-h1-852086-5 Aug 27 03:56:32.408947 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-35db1e00-7cb1-48a0-8fc1-79c0acda6a31 req-24028576-c0a5-435f-975a-d4e0225b5297 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054833 Aug 27 03:56:32.410316 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3127/6544] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:32.439502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:32.440494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:32.450804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.451640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.452286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.453561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.454297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.455164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.580941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:32.587423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:32.609528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.610494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.611142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.612101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.614664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.615591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.749286 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2b5f45a-721d-4b08-a6ba-683cb527b214 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1464 microversion: 2.1 time: 0.317073 Aug 27 03:56:32.750105 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3418/6545] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:32 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1464 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:32.909107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:32.920133 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c47268f0-c0e3-4719-985d-ebef203c0e63 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1682 microversion: 2.1 time: 0.347616 Aug 27 03:56:32.930848 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3128/6546] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:32 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1682 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:33.080356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:33.083440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:33.091937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.093137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.093938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.095066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.095381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.095821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.329423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:33.330046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:33.338542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.339065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.339676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.341338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.341834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.342456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.443181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:33.458670 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33054dd0-ae71-4ff7-b91f-8eb5089a6797 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1305 microversion: 2.1 time: 0.133272 Aug 27 03:56:33.459265 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3129/6547] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:33 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:33.781185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:33.782021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:33.792561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.794137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.794871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.798266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.798991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.799772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.987018 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6470b313-0583-4a93-98d4-97c5151ffa85 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action" status: 200 len: 32644 microversion: 2.1 time: 0.910852 Aug 27 03:56:33.990617 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3419/6548] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:33 2022] POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action => generated 32644 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:34.071030 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a4db64e-0a38-4478-83cb-2fc49ca883fc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1464 microversion: 2.1 time: 0.303875 Aug 27 03:56:34.082282 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3130/6549] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:33 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:34.297866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:34.298906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:34.306492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.307140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.307759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.308858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.309402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.310246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.480679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:34.482185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:34.489653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.490090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.490571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.491487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.492113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.492571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.540338 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ae3334d-317c-4744-bc2d-13c42d16860d tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1833 microversion: 2.1 time: 0.373767 Aug 27 03:56:34.555899 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3420/6550] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:34 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1833 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:34.576735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:34.579347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:34.586426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.587151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.587589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.588411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.588737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.589354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.622546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lazy-loading 'flavor' on Instance uuid c5998634-656c-464b-9e44-74609f284072 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:56:34.637225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: c5998634-656c-464b-9e44-74609f284072] Going to try to live migrate instance to another host {{(pid=122407) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:56:34.771379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:34.781115 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-707c49d7-5d42-43bb-ab76-eeec0c5b55a7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1373 microversion: 2.1 time: 0.304620 Aug 27 03:56:34.781848 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3131/6551] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:34 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1373 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:34.800472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4401d6f1-3b4a-4547-99cc-0f74039c8934 req-0ba3e2c7-38a7-494b-997d-8a31f9385119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfdcea-b640-4a69-a8c5-e21ac807699b", "tag": "e56d3c84-f9b7-4fad-ac9c-520d28a5bffc"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:34.813248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4401d6f1-3b4a-4547-99cc-0f74039c8934 req-0ba3e2c7-38a7-494b-997d-8a31f9385119 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.813760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4401d6f1-3b4a-4547-99cc-0f74039c8934 req-0ba3e2c7-38a7-494b-997d-8a31f9385119 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.814221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4401d6f1-3b4a-4547-99cc-0f74039c8934 req-0ba3e2c7-38a7-494b-997d-8a31f9385119 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.829365 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4401d6f1-3b4a-4547-99cc-0f74039c8934 req-0ba3e2c7-38a7-494b-997d-8a31f9385119 service nova] Creating event network-changed:e56d3c84-f9b7-4fad-ac9c-520d28a5bffc for instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b on n-h2-852086-5 Aug 27 03:56:34.834689 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4401d6f1-3b4a-4547-99cc-0f74039c8934 req-0ba3e2c7-38a7-494b-997d-8a31f9385119 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038468 Aug 27 03:56:34.835758 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3132/6552] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:35.093686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:35.094593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:35.103618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:35.104663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:35.105299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:35.106281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:35.118618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:35.119401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:35.318980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e86ceeb9-823e-4280-9deb-a224c1a4943d tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1464 microversion: 2.1 time: 0.229830 Aug 27 03:56:35.319570 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3133/6553] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:35 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1464 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:35.807528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:35.808168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:35.815719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:35.816311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:35.816773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:35.817694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:35.818229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:35.818808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:36.278112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:36.287878 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6fdfcb48-c7d4-4231-b2fc-efd4fb9032b6 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1373 microversion: 2.1 time: 0.484362 Aug 27 03:56:36.290201 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3134/6554] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:35 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1373 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:36.340402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:36.340951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:36.347245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.348377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.348822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:36.349560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.350027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.350506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:36.615062 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24592346-b04d-4e2c-82da-99677de25144 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1464 microversion: 2.1 time: 0.276625 Aug 27 03:56:36.630699 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3135/6555] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:36 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1464 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:36.654789 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-abf12545-b6c7-4118-97a2-beca6d0a07de tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action" status: 202 len: 0 microversion: 2.1 time: 2.082177 Aug 27 03:56:36.659310 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3421/6556] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:34 2022] POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action => generated 0 bytes in 2088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:56:36.671289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:36.671954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:36.679773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.680511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.680971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:36.682391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.682876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.683326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.081441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:37.094734 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0181435d-3a2d-47cb-8d94-3186f4ce8c97 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.430709 Aug 27 03:56:37.095343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3136/6557] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:36 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:37.310141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:37.311037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:37.322013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:37.322531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:37.323201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.324111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:37.324577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:37.325007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.513393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:37.525861 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1573ebfc-093a-4fff-adf9-c428edcbf7ba tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1373 microversion: 2.1 time: 0.220018 Aug 27 03:56:37.527241 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3422/6558] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:37 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1373 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:37.639630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:37.640274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:37.647230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:37.647746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:37.648197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.648927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:37.649406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:37.649847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.895706 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4061ba44-2389-49a6-8975-b64cc97b43e7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1464 microversion: 2.1 time: 0.259762 Aug 27 03:56:37.896308 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3137/6559] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:37 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1464 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:38.122381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:38.123883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:38.133162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0554f2f8-a4f0-4d69-bbef-c51647d73d9e req-ef5949ce-ebe7-40f4-a79e-0d41e7bc03ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5998634-656c-464b-9e44-74609f284072", "name": "network-vif-unplugged", "status": "completed", "tag": "e50aae7b-dccd-416b-9a0f-97a7638b964c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:38.144878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.146727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.148283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.149026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.149491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.149925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.153558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0554f2f8-a4f0-4d69-bbef-c51647d73d9e req-ef5949ce-ebe7-40f4-a79e-0d41e7bc03ff service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.154346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0554f2f8-a4f0-4d69-bbef-c51647d73d9e req-ef5949ce-ebe7-40f4-a79e-0d41e7bc03ff service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.155109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0554f2f8-a4f0-4d69-bbef-c51647d73d9e req-ef5949ce-ebe7-40f4-a79e-0d41e7bc03ff service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.176741 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0554f2f8-a4f0-4d69-bbef-c51647d73d9e req-ef5949ce-ebe7-40f4-a79e-0d41e7bc03ff service nova] Creating event network-vif-unplugged:e50aae7b-dccd-416b-9a0f-97a7638b964c for instance c5998634-656c-464b-9e44-74609f284072 on n-h1-852086-5 Aug 27 03:56:38.193017 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0554f2f8-a4f0-4d69-bbef-c51647d73d9e req-ef5949ce-ebe7-40f4-a79e-0d41e7bc03ff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065031 Aug 27 03:56:38.193830 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3138/6560] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:38.198786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-aae90a99-2ef7-49e3-bfd2-51a715b3c4ec req-181cd2e9-ab15-4063-95e6-901179936f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec00b94-77de-40e7-9c84-619f41298324", "name": "network-vif-plugged", "status": "completed", "tag": "8e43a0ef-e258-4c62-ace2-2bf12a0163f8"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:38.210787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-aae90a99-2ef7-49e3-bfd2-51a715b3c4ec req-181cd2e9-ab15-4063-95e6-901179936f38 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.211359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-aae90a99-2ef7-49e3-bfd2-51a715b3c4ec req-181cd2e9-ab15-4063-95e6-901179936f38 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.211820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-aae90a99-2ef7-49e3-bfd2-51a715b3c4ec req-181cd2e9-ab15-4063-95e6-901179936f38 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.224361 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-aae90a99-2ef7-49e3-bfd2-51a715b3c4ec req-181cd2e9-ab15-4063-95e6-901179936f38 service nova] Creating event network-vif-plugged:8e43a0ef-e258-4c62-ace2-2bf12a0163f8 for instance eec00b94-77de-40e7-9c84-619f41298324 on n-h1-852086-5 Aug 27 03:56:38.230045 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-aae90a99-2ef7-49e3-bfd2-51a715b3c4ec req-181cd2e9-ab15-4063-95e6-901179936f38 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Aug 27 03:56:38.231249 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3139/6561] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:38.371222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:38.380044 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-05b15a40-e289-4811-ad08-f486b6d57a7d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.262893 Aug 27 03:56:38.380640 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3423/6562] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:38 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:38.553746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:38.554531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:38.561573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.562076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.562554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.563275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.563744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.564184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.715599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:38.725004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ef5d0f8-c054-4df9-8605-149f20b5b067 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1373 microversion: 2.1 time: 0.176786 Aug 27 03:56:38.725884 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3140/6563] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:38 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:38.919830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:38.920593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:38.925189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:38.931284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.931907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.932455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.933356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.933987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.934558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.077850 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b0df718c-374a-4685-9c25-d1bfd453166b tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1464 microversion: 2.1 time: 0.163590 Aug 27 03:56:39.078584 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3424/6564] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:38 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:39.401447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:39.402081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:39.409133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.409636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.410800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.411539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.412014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.412490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.573402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:39.581989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d8fc75f-b68b-4fba-875a-319ec1507f8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.184484 Aug 27 03:56:39.582644 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3141/6565] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:39 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:39.747215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:39.747945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:39.757179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.758188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.758943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.760332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.761252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.761981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.917644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:39.927611 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0cb69a70-0b48-42b1-991a-d3d01bfa41c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1373 microversion: 2.1 time: 0.184496 Aug 27 03:56:39.928211 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3425/6566] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:39 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:40.099770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:40.100397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:40.106492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.106998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.107449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.108162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.108635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.109085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.215611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-882310e1-889a-44ec-b0bd-764ffee9734d req-e37844a9-a4d9-4e76-8908-f0f323e7cf98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5998634-656c-464b-9e44-74609f284072", "tag": "e50aae7b-dccd-416b-9a0f-97a7638b964c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:40.228300 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-882310e1-889a-44ec-b0bd-764ffee9734d req-e37844a9-a4d9-4e76-8908-f0f323e7cf98 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.228786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-882310e1-889a-44ec-b0bd-764ffee9734d req-e37844a9-a4d9-4e76-8908-f0f323e7cf98 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.229213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-882310e1-889a-44ec-b0bd-764ffee9734d req-e37844a9-a4d9-4e76-8908-f0f323e7cf98 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.241405 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-882310e1-889a-44ec-b0bd-764ffee9734d req-e37844a9-a4d9-4e76-8908-f0f323e7cf98 service nova] Creating event network-changed:e50aae7b-dccd-416b-9a0f-97a7638b964c for instance c5998634-656c-464b-9e44-74609f284072 on n-h1-852086-5 Aug 27 03:56:40.246588 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-882310e1-889a-44ec-b0bd-764ffee9734d req-e37844a9-a4d9-4e76-8908-f0f323e7cf98 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034696 Aug 27 03:56:40.247196 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3426/6567] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:56:40.249027 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b588751-312e-43fb-90d2-e7ee43b1e3d7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1648 microversion: 2.1 time: 0.153857 Aug 27 03:56:40.252258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-dae79006-29dc-493f-9716-33e43dd92b61 req-6e27d4c6-50b7-4b3d-b4d9-389eb9008629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfdcea-b640-4a69-a8c5-e21ac807699b", "name": "network-vif-plugged", "status": "completed", "tag": "e56d3c84-f9b7-4fad-ac9c-520d28a5bffc"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:40.254572 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3142/6568] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:40 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1648 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:40.261842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dae79006-29dc-493f-9716-33e43dd92b61 req-6e27d4c6-50b7-4b3d-b4d9-389eb9008629 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.262381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dae79006-29dc-493f-9716-33e43dd92b61 req-6e27d4c6-50b7-4b3d-b4d9-389eb9008629 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.262878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-dae79006-29dc-493f-9716-33e43dd92b61 req-6e27d4c6-50b7-4b3d-b4d9-389eb9008629 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.269605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:40.270639 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:40.274368 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-dae79006-29dc-493f-9716-33e43dd92b61 req-6e27d4c6-50b7-4b3d-b4d9-389eb9008629 service nova] Creating event network-vif-plugged:e56d3c84-f9b7-4fad-ac9c-520d28a5bffc for instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b on n-h2-852086-5 Aug 27 03:56:40.277019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.277644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.278241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.279191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.279537 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-dae79006-29dc-493f-9716-33e43dd92b61 req-6e27d4c6-50b7-4b3d-b4d9-389eb9008629 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Aug 27 03:56:40.279883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.280313 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3427/6569] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:40.280859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.490842 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9b6f918-678c-49a7-9a53-c5c9ec24a1f2 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1648 microversion: 2.1 time: 0.224769 Aug 27 03:56:40.491644 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3143/6570] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:40 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1648 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:40.524617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:40.525488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:40.532408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.532908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.533348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.534077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.537952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.537952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.607087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:40.607087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:40.618557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.620549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.622459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.624446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.625185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.626189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.652607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:40.784957 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d43ac95b-4c49-4ee3-bef9-7fc934478f28 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1648 microversion: 2.1 time: 0.266932 Aug 27 03:56:40.786195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3428/6571] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:40 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1648 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:40.803117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:40.819692 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eaba9968-5a15-4ec7-89f5-481b0d72c529 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.219255 Aug 27 03:56:40.820844 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3144/6572] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:40 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:40.867027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-789623543", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "availability_zone": "nova:n-h2-852086-5", "networks": [{"uuid": "dfad5ed0-1065-4776-831e-2158b327c543"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:40.955864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:40.956727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:40.963843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:40.967405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:40.967742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] validate_networks() for [('dfad5ed0-1065-4776-831e-2158b327c543', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:56:40.987533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.989112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.990457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.993250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.994606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.996706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.057736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:41.242564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:41.255945 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a810cbc-85f7-4e27-9247-d69395c1e640 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1373 microversion: 2.1 time: 0.308391 Aug 27 03:56:41.256973 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3145/6573] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:40 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1373 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:41.802002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:56:41.802768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:56:41.803031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:56:41.803711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:56:41.804200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:56:41.816439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:41.817308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:41.818155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.819622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:41.820527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:41.821330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.841897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Getting quotas for project 0af67211e7c44b60a5569e15799c84ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:56:41.848609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Getting quotas for user 9943b84d12d6498f866188a6d083e636 and project 0af67211e7c44b60a5569e15799c84ff. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:56:41.855779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:41.856577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:41.865411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:56:41.866315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:41.867252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:41.868035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:56:41.868220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.869583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:41.870577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:41.871533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.926132 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c756dd60-331a-47c6-9141-fc56db88d7cc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062616 Aug 27 03:56:41.927501 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3429/6574] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:56:41.945495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5bcff38d-61ea-4de7-aff3-7818f2ff2426 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:41.946151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5bcff38d-61ea-4de7-aff3-7818f2ff2426 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:42.029266 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5bcff38d-61ea-4de7-aff3-7818f2ff2426 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1328 microversion: 2.1 time: 0.089488 Aug 27 03:56:42.030110 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3430/6575] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:41 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:42.122492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:42.140206 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-533f3785-c38c-4887-85bf-16cea31c4bce tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.290842 Aug 27 03:56:42.141540 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3146/6576] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:41 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:42.290137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:42.291229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:42.300076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.301365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.301868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:42.302897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.303467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.304156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:42.510868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:42.520365 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff2db0ce-eb7f-4b0b-9dc4-abbdcdac11a0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1546 microversion: 2.1 time: 0.237780 Aug 27 03:56:42.521398 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3431/6577] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:42 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:42.543637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:42.544277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:42.551583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.552104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.552562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:42.553314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.553789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.554488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:42.732622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:42.743368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-266991b4-c7d3-4684-80af-76d3ee8a52fc tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1546 microversion: 2.1 time: 0.203785 Aug 27 03:56:42.744058 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3147/6578] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:42 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:43.051893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:43.052575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:43.059063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.059558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.060262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.060982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.061446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.061878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.141107 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bb5f4ff1-0398-4df4-bb40-0dada821cc65 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1415 microversion: 2.1 time: 0.093965 Aug 27 03:56:43.141706 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3432/6579] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:43 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1415 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:43.178211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:43.178896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:43.186586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.187093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.187795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.188533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.189004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.189445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.338634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:43.347729 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b781a7a-17c9-435f-9caf-718ffde9dafa tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.174665 Aug 27 03:56:43.349217 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3148/6580] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:43 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:44.162957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:44.164238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:44.171924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:44.172712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:44.173336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:44.174359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:44.175000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:44.175803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:44.180274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:44.369830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:44.370576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:44.378051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:44.378928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:44.380036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:44.381405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:44.382422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:44.383474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:44.501108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-55a5e0a2-c853-4263-a9cf-013370ce2685 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1463 microversion: 2.1 time: 0.342401 Aug 27 03:56:44.501745 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3433/6581] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:44 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1463 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:44.629836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:44.637966 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5cae8edc-9528-46bc-a2d1-9d9af5c11383 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.272001 Aug 27 03:56:44.639635 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3149/6582] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:44 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:44.789205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0231ab3f-0bbb-4adb-b490-f3d9ebc3d394 req-5fe7881d-0afc-4165-ba58-e859c4d370df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d8af9b-77ec-4e48-9978-2968274805f9", "tag": "ce77afeb-16a4-4d6c-a21b-4f80b9c6bc5e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:44.815287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0231ab3f-0bbb-4adb-b490-f3d9ebc3d394 req-5fe7881d-0afc-4165-ba58-e859c4d370df service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:44.816175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0231ab3f-0bbb-4adb-b490-f3d9ebc3d394 req-5fe7881d-0afc-4165-ba58-e859c4d370df service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:44.816952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0231ab3f-0bbb-4adb-b490-f3d9ebc3d394 req-5fe7881d-0afc-4165-ba58-e859c4d370df service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:44.829552 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0231ab3f-0bbb-4adb-b490-f3d9ebc3d394 req-5fe7881d-0afc-4165-ba58-e859c4d370df service nova] Creating event network-changed:ce77afeb-16a4-4d6c-a21b-4f80b9c6bc5e for instance 59d8af9b-77ec-4e48-9978-2968274805f9 on n-h2-852086-5 Aug 27 03:56:44.835148 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0231ab3f-0bbb-4adb-b490-f3d9ebc3d394 req-5fe7881d-0afc-4165-ba58-e859c4d370df service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052777 Aug 27 03:56:44.836034 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3434/6583] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:56:45.523700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:45.524454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:45.536035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.536818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.537726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.539028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.540105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.541035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.667612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:45.668922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:45.694460 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bde0f193-ef4e-44c6-85f3-151dabd1ae4f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1463 microversion: 2.1 time: 0.175923 Aug 27 03:56:45.695499 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3150/6584] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:45 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1463 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:45.701969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.702531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.703252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.704790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.705497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.706142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.957552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:45.965724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1827bc6e-cb2e-49c0-9c91-ae99d3ffc281 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.307567 Aug 27 03:56:45.966440 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3435/6585] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:45 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:46.716997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:46.718478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:46.731109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:46.731961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:46.732661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:46.733789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:46.734565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:46.735232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:46.991578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:46.993779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:47.006484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:47.007058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:47.008500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:47.009535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:47.010604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:47.011786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:47.136826 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-001ed77c-7ed7-4640-8abc-482eb844ffa0 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1463 microversion: 2.1 time: 0.424006 Aug 27 03:56:47.154185 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3151/6586] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:46 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1463 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:47.213791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:47.224941 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9cc007ca-25b4-4e4d-9f32-4c064386dbff tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1692 microversion: 2.1 time: 0.239543 Aug 27 03:56:47.239999 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3436/6587] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:46 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1692 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:48.162107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:48.163522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:48.171717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.172124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.172800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.173643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.174617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.174617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.249367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:48.250060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:48.260725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.263059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.264160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.265762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.266491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.267141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.349802 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6fa158b-baac-4cef-b9cd-fa540b1a81de tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1463 microversion: 2.1 time: 0.191787 Aug 27 03:56:48.350427 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3152/6588] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:48 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1463 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:48.440827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:48.448851 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-76a3cbc1-3cf8-4923-9dc8-2a4d2b4fe642 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1682 microversion: 2.1 time: 0.204771 Aug 27 03:56:48.449434 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3437/6589] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:48 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:48.469800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:48.470551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:48.477879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.478314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.478766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.479482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.479948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.480385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.662874 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13e7466c-389b-4c4b-84ef-371d09960a24 tempest-TestNetworkAdvancedServerOps-859494458 tempest-TestNetworkAdvancedServerOps-859494458-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1833 microversion: 2.1 time: 0.196698 Aug 27 03:56:48.663643 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3153/6590] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:48 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1833 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:48.690842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:48.692965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:48.699587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.700081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.700520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.701231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:48.701687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:48.702115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:48.849570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:48.857959 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-63c35a5e-dbd9-4cb0-81e3-f62e8dca2512 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1682 microversion: 2.1 time: 0.175586 Aug 27 03:56:48.858632 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3438/6591] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:48 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:49.095778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b4e6c228-309f-4681-bec6-67064408e3f4 req-99303d36-27ae-460e-a71d-0bf98fce46a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d8af9b-77ec-4e48-9978-2968274805f9", "name": "network-vif-plugged", "status": "completed", "tag": "ce77afeb-16a4-4d6c-a21b-4f80b9c6bc5e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:49.106256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b4e6c228-309f-4681-bec6-67064408e3f4 req-99303d36-27ae-460e-a71d-0bf98fce46a4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:49.106994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b4e6c228-309f-4681-bec6-67064408e3f4 req-99303d36-27ae-460e-a71d-0bf98fce46a4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:49.107445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b4e6c228-309f-4681-bec6-67064408e3f4 req-99303d36-27ae-460e-a71d-0bf98fce46a4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:49.120219 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b4e6c228-309f-4681-bec6-67064408e3f4 req-99303d36-27ae-460e-a71d-0bf98fce46a4 service nova] Creating event network-vif-plugged:ce77afeb-16a4-4d6c-a21b-4f80b9c6bc5e for instance 59d8af9b-77ec-4e48-9978-2968274805f9 on n-h2-852086-5 Aug 27 03:56:49.126928 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b4e6c228-309f-4681-bec6-67064408e3f4 req-99303d36-27ae-460e-a71d-0bf98fce46a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035622 Aug 27 03:56:49.127990 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3154/6592] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:49.373185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:49.373920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:49.381895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:49.382415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:49.382857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:49.383591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:49.384055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:49.384485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:49.526681 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87f23d5e-d15a-4724-a740-d334aa47b87f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1463 microversion: 2.1 time: 0.157524 Aug 27 03:56:49.527284 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3439/6593] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:49 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:50.548846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:50.549562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:50.557851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.558393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.558844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:50.559555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.560277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.560713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:50.703717 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e144a120-dd88-49be-9821-57bcb351b80f tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1647 microversion: 2.1 time: 0.159997 Aug 27 03:56:50.704303 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3155/6594] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:50 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1647 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:50.724933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:50.725550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:50.732374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.732854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.733286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:50.733967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.734454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.734874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:50.870017 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9869f1b-65e6-49dd-8392-bb8e1784af21 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1647 microversion: 2.1 time: 0.149594 Aug 27 03:56:50.870638 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3440/6595] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:50 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1647 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:50.891329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:50.891971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:50.896521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:50.900663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.901173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.901631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:50.902390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.902876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.903326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:50.972219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:50.974960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:50.980993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.981491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.982086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:50.982836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:50.983303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:50.983735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:51.042475 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5fbade0e-138a-4520-b9b6-6469d1b94240 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action" status: 200 len: 38647 microversion: 2.1 time: 0.074180 Aug 27 03:56:51.042808 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0b5d397-fc39-4f46-962d-b481133433be tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1647 microversion: 2.1 time: 0.155109 Aug 27 03:56:51.043557 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3441/6596] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:50 2022] POST /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072/action => generated 38647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:56:51.043722 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3156/6597] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:50 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1647 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:51.065056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:51.065581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:51.072863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:51.073346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:51.073778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:51.074510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:51.074967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:51.075390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:51.101484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:56:51.183180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:51.219868 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-52ea87ae-596e-438e-b9c3-96e98fed5bcb tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "DELETE /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 204 len: 0 microversion: 2.1 time: 0.159353 Aug 27 03:56:51.221561 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3442/6598] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:56:51 2022] DELETE /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:56:51.234490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:51.235447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:51.245284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:51.246952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:51.247675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:51.249179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:51.249964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:51.251664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:51.423508 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bd65495-1f86-4005-b598-9a3ac5a492dc tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1653 microversion: 2.1 time: 0.195767 Aug 27 03:56:51.424204 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3157/6599] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:51 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1653 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:52.446534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:52.447301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:52.451213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:52.452508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:52.464784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:52.465687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:52.466556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:52.468190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:52.468651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:52.469702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:52.478706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:52.480304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:52.490461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:52.491228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:52.491899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:52.493049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:52.494132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:52.496636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:52.533198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:56:52.653268 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f86ecffc-8c56-45c5-9fcc-d0c4079d86fb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 204 len: 0 microversion: 2.1 time: 0.178694 Aug 27 03:56:52.654641 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3158/6600] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:56:52 2022] DELETE /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:56:52.662623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c7606843-1377-4104-b64a-d2d1d74b8eb5 req-a71b09e7-dfab-4463-b874-dfa29a3351e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5998634-656c-464b-9e44-74609f284072", "tag": "e50aae7b-dccd-416b-9a0f-97a7638b964c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:52.678952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7606843-1377-4104-b64a-d2d1d74b8eb5 req-a71b09e7-dfab-4463-b874-dfa29a3351e9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:52.679934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7606843-1377-4104-b64a-d2d1d74b8eb5 req-a71b09e7-dfab-4463-b874-dfa29a3351e9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:52.680387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7606843-1377-4104-b64a-d2d1d74b8eb5 req-a71b09e7-dfab-4463-b874-dfa29a3351e9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:52.694721 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c29c055a-258d-465e-a57d-121ef3931d71 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1653 microversion: 2.1 time: 0.252784 Aug 27 03:56:52.695058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c7606843-1377-4104-b64a-d2d1d74b8eb5 req-a71b09e7-dfab-4463-b874-dfa29a3351e9 service nova] Creating event network-changed:e50aae7b-dccd-416b-9a0f-97a7638b964c for instance c5998634-656c-464b-9e44-74609f284072 on n-h2-852086-5 Aug 27 03:56:52.696664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3443/6601] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:52 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1653 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:52.706749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:52.708163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:52.717176 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c7606843-1377-4104-b64a-d2d1d74b8eb5 req-a71b09e7-dfab-4463-b874-dfa29a3351e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060454 Aug 27 03:56:52.717837 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3159/6602] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:52.720834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:52.723131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:52.724443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:52.726301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:52.727149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:52.727935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:52.889299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:52.897139 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c48ea7f5-b877-4028-a08c-10f4aaea9197 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1688 microversion: 2.1 time: 0.198730 Aug 27 03:56:52.897801 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3444/6603] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:52 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:53.719641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:53.724895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:53.731484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:53.731979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:53.736168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:53.737159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:53.737640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:53.738954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:53.925996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:53.939591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:53.949756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:53.950462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:53.951326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:53.956592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:53.957741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:53.958953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:54.045991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:54.055738 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90141c75-cba6-45a1-bc3c-8ea97906a880 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 200 len: 1351 microversion: 2.1 time: 0.138706 Aug 27 03:56:54.069893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:54.071810 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3445/6604] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:53 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 1351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:54.077374 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6efe45d-f27a-4754-9a4d-38cddcc1d4c7 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 200 len: 1653 microversion: 2.1 time: 0.362048 Aug 27 03:56:54.078493 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3160/6605] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:53 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 1653 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:54.194589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-06704a21-4407-46a6-ad22-e6a07b00266a req-f70898bc-e3e8-4873-9012-5ece2d68163a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d8af9b-77ec-4e48-9978-2968274805f9", "name": "network-vif-deleted", "tag": "ce77afeb-16a4-4d6c-a21b-4f80b9c6bc5e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:54.224172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06704a21-4407-46a6-ad22-e6a07b00266a req-f70898bc-e3e8-4873-9012-5ece2d68163a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:54.228435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06704a21-4407-46a6-ad22-e6a07b00266a req-f70898bc-e3e8-4873-9012-5ece2d68163a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:54.229373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06704a21-4407-46a6-ad22-e6a07b00266a req-f70898bc-e3e8-4873-9012-5ece2d68163a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:54.265679 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-06704a21-4407-46a6-ad22-e6a07b00266a req-f70898bc-e3e8-4873-9012-5ece2d68163a service nova] Creating event network-vif-deleted:ce77afeb-16a4-4d6c-a21b-4f80b9c6bc5e for instance 59d8af9b-77ec-4e48-9978-2968274805f9 on n-h2-852086-5 Aug 27 03:56:54.279393 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-06704a21-4407-46a6-ad22-e6a07b00266a req-f70898bc-e3e8-4873-9012-5ece2d68163a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089018 Aug 27 03:56:54.282501 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3446/6606] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:54.736390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7c9f753b-7185-4a9d-b108-0dbc2715ec0a req-ef042777-df77-41d9-bba3-3112eb146e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5998634-656c-464b-9e44-74609f284072", "name": "network-vif-deleted", "tag": "e50aae7b-dccd-416b-9a0f-97a7638b964c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:54.749350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c9f753b-7185-4a9d-b108-0dbc2715ec0a req-ef042777-df77-41d9-bba3-3112eb146e90 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:54.749808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c9f753b-7185-4a9d-b108-0dbc2715ec0a req-ef042777-df77-41d9-bba3-3112eb146e90 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:54.750286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c9f753b-7185-4a9d-b108-0dbc2715ec0a req-ef042777-df77-41d9-bba3-3112eb146e90 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:54.766487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7c9f753b-7185-4a9d-b108-0dbc2715ec0a req-ef042777-df77-41d9-bba3-3112eb146e90 service nova] Creating event network-vif-deleted:e50aae7b-dccd-416b-9a0f-97a7638b964c for instance c5998634-656c-464b-9e44-74609f284072 on n-h2-852086-5 Aug 27 03:56:54.772354 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7c9f753b-7185-4a9d-b108-0dbc2715ec0a req-ef042777-df77-41d9-bba3-3112eb146e90 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040009 Aug 27 03:56:54.773200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3161/6607] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:55.078435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:55.079119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: c5998634-656c-464b-9e44-74609f284072] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:55.089446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.090364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.091184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.092372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.092842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.093276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.100991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:55.101714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: 59d8af9b-77ec-4e48-9978-2968274805f9] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:55.107932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.108242 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] HTTP exception thrown: Instance c5998634-656c-464b-9e44-74609f284072 could not be found. Aug 27 03:56:55.108434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.108884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.109609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Request method failure captured: Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 HTTP/1.1 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZSj7HFO2PaNzyPbSA7cTP-KIbMXatuskAYCPhYxud_jxcSMxl_Q6ae_gUMlmk6imBa7B5VqLQbCfFECNSOxptHSzbymSfoCmI3GvPSmrDgYOmpB9haOnmwV1YgaLuTK8tHRWP0PkcW2CcI14O2muT_9eUWhYFs7LVJntcr2Qw-VdJ4 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0d3f5f3257024419926319c6013d4d56", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}] Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: cd7171be5b3d4238acfe83058f78413c Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance c5998634-656c-464b-9e44-74609f284072 could not be found. Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'c5998634-656c-464b-9e44-74609f284072'} Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5998634-656c-464b-9e44-74609f284072 could not be found. Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5998634-656c-464b-9e44-74609f284072 could not be found. Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.109892 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5998634-656c-464b-9e44-74609f284072 could not be found. Aug 27 03:56:55.115171 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.115956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.116062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Returning 404 to user: Instance c5998634-656c-464b-9e44-74609f284072 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:56:55.116167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.116265 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6c51773-2091-42e4-9488-1efa2fb47e22 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072" status: 404 len: 111 microversion: 2.1 time: 0.037232 Aug 27 03:56:55.116265 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3447/6608] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:55 2022] GET /compute/v2.1/servers/c5998634-656c-464b-9e44-74609f284072 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:56:55.126898 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] HTTP exception thrown: Instance 59d8af9b-77ec-4e48-9978-2968274805f9 could not be found. Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Request method failure captured: Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 HTTP/1.1 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZXrIjhNnKlk0Wzwcd-Lo82xKT3iyYdlnR5pc7chyQSnG8DmHZjjq2-m4Bte5auUnZvhvp4NzZBj6NbRXwusP6rvmAUH3Sx5FHpdXgm_3Z6j6MK_gVPllMQT-ycO5tptnjDdjIZSyC5svgJ3IRvSJ8v5rWQSLQCwKwXlCUj5ifWTWMw Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0af67211e7c44b60a5569e15799c84ff Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestServerMultinode-426308525 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0af67211e7c44b60a5569e15799c84ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0af67211e7c44b60a5569e15799c84ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0af67211e7c44b60a5569e15799c84ff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0af67211e7c44b60a5569e15799c84ff"}]}] Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestServerMultinode-426308525 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0af67211e7c44b60a5569e15799c84ff Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestServerMultinode-426308525 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestServerMultinode-426308525-project-admin Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 9943b84d12d6498f866188a6d083e636 Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestServerMultinode-426308525-project-admin Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 59d8af9b-77ec-4e48-9978-2968274805f9 could not be found. Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '59d8af9b-77ec-4e48-9978-2968274805f9'} Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d8af9b-77ec-4e48-9978-2968274805f9 could not be found. Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d8af9b-77ec-4e48-9978-2968274805f9 could not be found. Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:55.128590 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d8af9b-77ec-4e48-9978-2968274805f9 could not be found. Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Returning 404 to user: Instance 59d8af9b-77ec-4e48-9978-2968274805f9 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c650ded-c15f-401b-900a-fc8f7da88333 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9" status: 404 len: 111 microversion: 2.1 time: 0.033952 Aug 27 03:56:55.134574 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3162/6609] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:55 2022] GET /compute/v2.1/servers/59d8af9b-77ec-4e48-9978-2968274805f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:56:55.139379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:55.139879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:55.146816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.147310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.147785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.148499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.148954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.149381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.178413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:56:55.231029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:55.261846 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95f9623d-aa52-4685-b4df-daea57aa02e5 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "DELETE /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 204 len: 0 microversion: 2.1 time: 0.126158 Aug 27 03:56:55.266286 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3448/6610] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:56:55 2022] DELETE /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:56:55.271329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:55.271970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:55.278708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.279510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.279976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.280734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:55.281243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:55.281693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:55.432170 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-54bd8804-5025-442f-ae4c-0118f13c5194 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1654 microversion: 2.1 time: 0.165147 Aug 27 03:56:55.432758 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3163/6611] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:55 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:56.455378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:56.456228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:56.463361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:56.463948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:56.464396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:56.465115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:56.465573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:56.466004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:56.693297 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ccfabd5f-e5ea-4dec-9341-e39e1186c5ff tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1654 microversion: 2.1 time: 0.242413 Aug 27 03:56:56.694209 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3449/6612] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:56 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1654 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:57.715858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:57.717979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:57.730312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:57.730975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:57.731613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:57.732394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:57.733055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:57.733671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:57.861989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87197269-0e29-416d-b08e-3d7a859fa104 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 200 len: 1612 microversion: 2.1 time: 0.149851 Aug 27 03:56:57.863351 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3164/6613] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:57 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 1612 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:57.868585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4dbb0047-68a6-456e-a6b4-c32490415fc3 req-8919d651-f82a-4a43-b490-90e0ce24b29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec00b94-77de-40e7-9c84-619f41298324", "name": "network-vif-deleted", "tag": "8e43a0ef-e258-4c62-ace2-2bf12a0163f8"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:57.903184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4dbb0047-68a6-456e-a6b4-c32490415fc3 req-8919d651-f82a-4a43-b490-90e0ce24b29b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:57.903860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4dbb0047-68a6-456e-a6b4-c32490415fc3 req-8919d651-f82a-4a43-b490-90e0ce24b29b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:57.904796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4dbb0047-68a6-456e-a6b4-c32490415fc3 req-8919d651-f82a-4a43-b490-90e0ce24b29b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:57.936351 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4dbb0047-68a6-456e-a6b4-c32490415fc3 req-8919d651-f82a-4a43-b490-90e0ce24b29b service nova] Creating event network-vif-deleted:8e43a0ef-e258-4c62-ace2-2bf12a0163f8 for instance eec00b94-77de-40e7-9c84-619f41298324 on n-h1-852086-5 Aug 27 03:56:57.947849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4dbb0047-68a6-456e-a6b4-c32490415fc3 req-8919d651-f82a-4a43-b490-90e0ce24b29b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087368 Aug 27 03:56:57.949156 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3450/6614] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:58.884557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:58.885135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] [instance: eec00b94-77de-40e7-9c84-619f41298324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:58.898575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:58.899091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:58.899551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:58.900282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:58.900750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:58.901606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:58.916401 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] HTTP exception thrown: Instance eec00b94-77de-40e7-9c84-619f41298324 could not be found. Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Request method failure captured: Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 HTTP/1.1 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZXrIjhNnKlk0Wzwcd-Lo82xKT3iyYdlnR5pc7chyQSnG8DmHZjjq2-m4Bte5auUnZvhvp4NzZBj6NbRXwusP6rvmAUH3Sx5FHpdXgm_3Z6j6MK_gVPllMQT-ycO5tptnjDdjIZSyC5svgJ3IRvSJ8v5rWQSLQCwKwXlCUj5ifWTWMw Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0af67211e7c44b60a5569e15799c84ff Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestServerMultinode-426308525 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0af67211e7c44b60a5569e15799c84ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0af67211e7c44b60a5569e15799c84ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0af67211e7c44b60a5569e15799c84ff", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0af67211e7c44b60a5569e15799c84ff"}]}] Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestServerMultinode-426308525 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0af67211e7c44b60a5569e15799c84ff Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestServerMultinode-426308525 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestServerMultinode-426308525-project-admin Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 9943b84d12d6498f866188a6d083e636 Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestServerMultinode-426308525-project-admin Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance eec00b94-77de-40e7-9c84-619f41298324 could not be found. Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'eec00b94-77de-40e7-9c84-619f41298324'} Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec00b94-77de-40e7-9c84-619f41298324 could not be found. Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec00b94-77de-40e7-9c84-619f41298324 could not be found. Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:56:58.918299 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec00b94-77de-40e7-9c84-619f41298324 could not be found. Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] Returning 404 to user: Instance eec00b94-77de-40e7-9c84-619f41298324 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02b9eb19-188c-4641-a46e-a34117157bb8 tempest-TestServerMultinode-426308525 tempest-TestServerMultinode-426308525-project-admin] 10.222.0.69 "GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324" status: 404 len: 111 microversion: 2.1 time: 0.040556 Aug 27 03:56:58.924019 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3165/6615] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:58 2022] GET /compute/v2.1/servers/eec00b94-77de-40e7-9c84-619f41298324 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:56:59.183977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6c84d9fc-e1aa-484f-822e-4b972831ce6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '.version_select at 0x7fe457026040>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:59.215373 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6c84d9fc-e1aa-484f-822e-4b972831ce6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1392709135" status: 202 len: 0 microversion: 2.1 time: 0.036018 Aug 27 03:56:59.216357 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3451/6616] 10.222.0.69 () {58 vars in 1284 bytes} [Sat Aug 27 03:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1392709135 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:56:59.247310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69177270-0b37-4dfb-91eb-fa782d6f8e53 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: .version_select at 0x7fe45c83d8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1557170116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaJ+NIlSHfDvFmpv7FLxLxxn/it/DxbYgDEgLGxjdmqJgro//y1Xpl+VkTSgeO7zmne64iwnZu1Bvvijd1cR8q0+58pVuiOX2y7BDTPHJHN9O1PX7QOBTeN/jVbgqvuPQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:59.278323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-69177270-0b37-4dfb-91eb-fa782d6f8e53 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:56:59.284817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-69177270-0b37-4dfb-91eb-fa782d6f8e53 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:56:59.311089 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69177270-0b37-4dfb-91eb-fa782d6f8e53 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.067662 Aug 27 03:56:59.311440 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3166/6617] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:56:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:09.425797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:09.427669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:09.432120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-147826494", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "311da0c1-a3e4-4820-89e4-6fb86ec1ac83"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1557170116", "security_groups": [{"name": "tempest-secgroup-smoke-1717814206"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:09.580714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] validate_networks() for [('311da0c1-a3e4-4820-89e4-6fb86ec1ac83', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:57:10.080805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:57:10.081767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:57:10.082220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:57:10.084151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:57:10.084854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:57:10.095376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:10.095881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:10.096349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:10.097126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:10.097651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:10.098245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:10.117896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:57:10.123860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Getting quotas for user cd7171be5b3d4238acfe83058f78413c and project 0d3f5f3257024419926319c6013d4d56. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:57:10.139251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:57:10.142143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:57:10.198211 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-938ac98a-6038-4268-ad63-841d47db3562 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774187 Aug 27 03:57:10.199573 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3452/6618] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:57:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:57:10.210245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=18 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:10.211042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:10.211723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:10.215974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-599c730a-c581-40a8-a166-f48033b57864 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:10.216618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-599c730a-c581-40a8-a166-f48033b57864 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:10.282725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-599c730a-c581-40a8-a166-f48033b57864 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:10.292834 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-599c730a-c581-40a8-a166-f48033b57864 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1266 microversion: 2.1 time: 0.086319 Aug 27 03:57:10.293616 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3167/6619] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:10 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:11.316282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:11.317933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:11.327091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:11.327750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:11.328848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:11.330104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:11.330950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:11.331867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:11.422981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:11.441313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-93fabe84-9d9c-45e0-88df-668bc38bf7e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1318 microversion: 2.1 time: 0.130151 Aug 27 03:57:11.442553 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3453/6620] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:11 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:12.464212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:12.464965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:12.474405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:12.485491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:12.485984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:12.487052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:12.487936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:12.489369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:12.832496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:12.857576 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aebc785b-41d3-4786-b6a4-0d039565ded9 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1392 microversion: 2.1 time: 0.397331 Aug 27 03:57:12.858237 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3168/6621] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:12 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1392 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:13.434810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-9834940a-d72b-47a1-9eda-82d8144aeabb req-cc6c4ddd-697d-416d-8f85-03784d01f327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829af0c4-b95b-48a5-b5eb-06d7b06b48d2", "tag": "e69eb617-7d62-4c98-b960-25e6842632e6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:13.461959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9834940a-d72b-47a1-9eda-82d8144aeabb req-cc6c4ddd-697d-416d-8f85-03784d01f327 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:13.462467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9834940a-d72b-47a1-9eda-82d8144aeabb req-cc6c4ddd-697d-416d-8f85-03784d01f327 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:13.467343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9834940a-d72b-47a1-9eda-82d8144aeabb req-cc6c4ddd-697d-416d-8f85-03784d01f327 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:13.504358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-9834940a-d72b-47a1-9eda-82d8144aeabb req-cc6c4ddd-697d-416d-8f85-03784d01f327 service nova] Creating event network-changed:e69eb617-7d62-4c98-b960-25e6842632e6 for instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 on n-h1-852086-5 Aug 27 03:57:13.516151 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-9834940a-d72b-47a1-9eda-82d8144aeabb req-cc6c4ddd-697d-416d-8f85-03784d01f327 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085495 Aug 27 03:57:13.523945 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3454/6622] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:13.879260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:13.880629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:13.889343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:13.889851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:13.890551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:13.891671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:13.892322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:13.892936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:14.327363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:14.327960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:14.335031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:14.335863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:14.336543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:14.337340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:14.337859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:14.338540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:14.353088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:14.361733 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6c2a176-a66d-424a-acce-27e880b37166 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1392 microversion: 2.1 time: 0.487276 Aug 27 03:57:14.363540 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3169/6623] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:13 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1392 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:57:14.365810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:57:14.452890 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39841069-067d-4d7f-80b0-54ed6a9a91cb tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 204 len: 0 microversion: 2.1 time: 0.128643 Aug 27 03:57:14.453677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3455/6624] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:57:14 2022] DELETE /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:57:14.463373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:14.464775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:14.471176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:14.471762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:14.472304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:14.473637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:14.474480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:14.475124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:14.636851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:14.645461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e61a38af-7dd6-4a1a-bc3f-48ab9bbb4b5f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1552 microversion: 2.1 time: 0.186332 Aug 27 03:57:14.646127 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3170/6625] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:14 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:15.384025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:15.384810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:15.397604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:15.398843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:15.399570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:15.400489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:15.401050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:15.401906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:15.624560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:15.634908 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fa0666c-bae8-4dfe-aa1e-7d0d7a697d82 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1392 microversion: 2.1 time: 0.255567 Aug 27 03:57:15.642214 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3456/6626] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:15 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1392 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:15.669473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:15.670570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:15.680392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:15.681404 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:15.681997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:15.683133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:15.683894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:15.686439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:15.875243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:15.883967 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ff8604d-df4f-4a03-917a-ddfb45e064dd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1552 microversion: 2.1 time: 0.219463 Aug 27 03:57:15.884645 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3171/6627] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:15 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1552 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:57:16.509495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-37c61e7c-ff40-4e3f-b31a-4388129239d2 req-bb5224e3-7183-4013-b486-180672de0edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfdcea-b640-4a69-a8c5-e21ac807699b", "name": "network-vif-deleted", "tag": "e56d3c84-f9b7-4fad-ac9c-520d28a5bffc"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:16.525100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-37c61e7c-ff40-4e3f-b31a-4388129239d2 req-bb5224e3-7183-4013-b486-180672de0edd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:16.525672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-37c61e7c-ff40-4e3f-b31a-4388129239d2 req-bb5224e3-7183-4013-b486-180672de0edd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:16.526188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-37c61e7c-ff40-4e3f-b31a-4388129239d2 req-bb5224e3-7183-4013-b486-180672de0edd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:16.539490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-37c61e7c-ff40-4e3f-b31a-4388129239d2 req-bb5224e3-7183-4013-b486-180672de0edd service nova] Creating event network-vif-deleted:e56d3c84-f9b7-4fad-ac9c-520d28a5bffc for instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b on n-h2-852086-5 Aug 27 03:57:16.544870 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-37c61e7c-ff40-4e3f-b31a-4388129239d2 req-bb5224e3-7183-4013-b486-180672de0edd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039253 Aug 27 03:57:16.545501 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3457/6628] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:16.663428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:16.664169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:16.671566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:16.672239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:16.673744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:16.674718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:16.675382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:16.675840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:16.834005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:16.843273 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e1da735-2a35-4d5b-be02-510e6868bf0a tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1392 microversion: 2.1 time: 0.191749 Aug 27 03:57:16.843816 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3172/6629] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:16 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:16.909363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:16.910076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:16.916961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:16.919078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:16.919503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:16.920108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:16.920823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:16.921270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:16.958516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:16.959020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:16.959461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:16.959921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lazy-loading 'fault' on Instance uuid 5ecfdcea-b640-4a69-a8c5-e21ac807699b {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:57:17.011090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:17.019424 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2d11e05-42f5-4616-9973-2d9c90c56f55 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 200 len: 1337 microversion: 2.1 time: 0.114409 Aug 27 03:57:17.020987 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3458/6630] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:16 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 1337 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:17.865381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:17.866016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:17.873054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:17.873555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:17.874010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:17.874761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:17.875248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:17.875694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.010256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:18.018060 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e520c52d-afce-4c06-8a35-5941499f19d7 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1392 microversion: 2.1 time: 0.157681 Aug 27 03:57:18.018665 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3173/6631] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:17 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:18.040911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:18.041530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 5ecfdcea-b640-4a69-a8c5-e21ac807699b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:18.048951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:18.049440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:18.049880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.050610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:18.051072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:18.051505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.065731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] HTTP exception thrown: Instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b could not be found. Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Request method failure captured: Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b HTTP/1.1 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZWtW7NAm0GaTRctev_oAlrcQdCxPthvanlLgW5bWvt0kvES1YHZfQq196O3n2iYU0jl9-deutPR_sH3Hwvqdz0FboMXo2qX6dbz1lWQqHhFNFrPJtrmPjqIosiaIqjjjT6qmcssJNmDGJhnFpiWHtDDbAMmzC3WgplcijFj-gMOCGM Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c037d852b1074d47a19377735a5ff519 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c037d852b1074d47a19377735a5ff519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c037d852b1074d47a19377735a5ff519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c037d852b1074d47a19377735a5ff519", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c037d852b1074d47a19377735a5ff519"}]}] Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c037d852b1074d47a19377735a5ff519 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkBasicOps-1992731955-project Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 553f4b1db7eb4c53981c18ac5ed0b352 Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkBasicOps-1992731955-project Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b could not be found. Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5ecfdcea-b640-4a69-a8c5-e21ac807699b'} Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b could not be found. Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b could not be found. Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:57:18.068022 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b could not be found. Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Returning 404 to user: Instance 5ecfdcea-b640-4a69-a8c5-e21ac807699b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d72aa7a-4167-4a44-9df8-55e2d0e75cbe tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b" status: 404 len: 111 microversion: 2.1 time: 0.032424 Aug 27 03:57:18.073542 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3459/6632] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:18 2022] GET /compute/v2.1/servers/5ecfdcea-b640-4a69-a8c5-e21ac807699b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:57:18.240787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3124d43c-4f5e-4a84-b3c8-fcf46b7c390d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '.version_select at 0x7fe45c725310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:18.265773 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3124d43c-4f5e-4a84-b3c8-fcf46b7c390d tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-629412444" status: 202 len: 0 microversion: 2.1 time: 0.030238 Aug 27 03:57:18.266798 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3174/6633] 10.222.0.69 () {58 vars in 1254 bytes} [Sat Aug 27 03:57:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-629412444 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:57:18.345112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-22523f00-47f6-4372-8865-b12189d39bde req-f7445cf2-7477-4ea0-8c44-c5938b7e78cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829af0c4-b95b-48a5-b5eb-06d7b06b48d2", "name": "network-vif-plugged", "status": "completed", "tag": "e69eb617-7d62-4c98-b960-25e6842632e6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:18.358295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-22523f00-47f6-4372-8865-b12189d39bde req-f7445cf2-7477-4ea0-8c44-c5938b7e78cd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:18.359062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-22523f00-47f6-4372-8865-b12189d39bde req-f7445cf2-7477-4ea0-8c44-c5938b7e78cd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:18.359499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-22523f00-47f6-4372-8865-b12189d39bde req-f7445cf2-7477-4ea0-8c44-c5938b7e78cd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:18.372129 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-22523f00-47f6-4372-8865-b12189d39bde req-f7445cf2-7477-4ea0-8c44-c5938b7e78cd service nova] Creating event network-vif-plugged:e69eb617-7d62-4c98-b960-25e6842632e6 for instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 on n-h1-852086-5 Aug 27 03:57:18.377941 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-22523f00-47f6-4372-8865-b12189d39bde req-f7445cf2-7477-4ea0-8c44-c5938b7e78cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036800 Aug 27 03:57:18.379005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3460/6634] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:19.043610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:19.044794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:19.052909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:19.053694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:19.054177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:19.054920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:19.055399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:19.056111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:19.225262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:19.237936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74bff12c-128f-4105-9959-e0b9279a67c8 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1392 microversion: 2.1 time: 0.202048 Aug 27 03:57:19.240844 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3175/6635] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:19 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1392 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:20.259139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:20.259566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:20.264792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:20.265508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:20.274579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.275073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.275530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.276237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.276721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.277141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.471611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:20.472167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:20.475565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:20.482338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.483133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.483594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.484401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.484877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.485316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.501287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:20.509849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-517ce216-ff7d-425b-a5e8-0c151e71f221 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1564 microversion: 2.1 time: 0.252818 Aug 27 03:57:20.510456 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3461/6636] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:20 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:20.514696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:57:20.515429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4543eca4-dc90-4039-9b0d-d303684a0a0b req-25b56be9-9534-4ee2-9f36-fdfc90f33e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "672822a0-a63f-4927-8863-02b2e46c3ac6", "tag": "1e25c900-58c2-4356-ba27-7bd28062cf1d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:20.524913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4543eca4-dc90-4039-9b0d-d303684a0a0b req-25b56be9-9534-4ee2-9f36-fdfc90f33e6b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.525657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4543eca4-dc90-4039-9b0d-d303684a0a0b req-25b56be9-9534-4ee2-9f36-fdfc90f33e6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.526095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4543eca4-dc90-4039-9b0d-d303684a0a0b req-25b56be9-9534-4ee2-9f36-fdfc90f33e6b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.542087 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4543eca4-dc90-4039-9b0d-d303684a0a0b req-25b56be9-9534-4ee2-9f36-fdfc90f33e6b service nova] Creating event network-changed:1e25c900-58c2-4356-ba27-7bd28062cf1d for instance 672822a0-a63f-4927-8863-02b2e46c3ac6 on n-h2-852086-5 Aug 27 03:57:20.548022 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4543eca4-dc90-4039-9b0d-d303684a0a0b req-25b56be9-9534-4ee2-9f36-fdfc90f33e6b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036194 Aug 27 03:57:20.549869 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3462/6637] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:20.557763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:20.558962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:20.567599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.568458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.569154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.570126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.570937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.571578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.639216 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6d33af8-5b0d-4701-b6fb-e86f70441eaf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "DELETE /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 204 len: 0 microversion: 2.1 time: 0.171441 Aug 27 03:57:20.640123 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3176/6638] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:57:20 2022] DELETE /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:57:20.653383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:20.654384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:20.661588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.662100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.662904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.663707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:20.664191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:20.664630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:20.791570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:20.800357 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-821c641a-17d0-43e2-adbe-9bdfdd7f2075 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1564 microversion: 2.1 time: 0.248846 Aug 27 03:57:20.801679 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3463/6639] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:20 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:20.864172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:20.877156 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20c3a895-14cb-451b-9ef6-fe66f3bcb6d2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1670 microversion: 2.1 time: 0.229984 Aug 27 03:57:20.877973 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3177/6640] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:20 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:21.903059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:21.904153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:21.912552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:21.913109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:21.913904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:21.915233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:21.915717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:21.916376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:22.064474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:22.073248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-49dfe2e3-4194-4cf5-851e-7159c44b5e63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1670 microversion: 2.1 time: 0.176470 Aug 27 03:57:22.073842 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3464/6641] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:21 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:23.096533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:23.097279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:23.105164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:23.105710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:23.106236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:23.106984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:23.107457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:23.107906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:23.552471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6923b907-ab31-474a-bfa4-c022b049b238 req-f1a6fd6e-b602-4ebb-93d5-84a2af1671a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672822a0-a63f-4927-8863-02b2e46c3ac6", "name": "network-vif-deleted", "tag": "1e25c900-58c2-4356-ba27-7bd28062cf1d"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:23.556719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:23.569897 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-148c3c2e-77e8-4e29-9d80-7dae386ed736 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 200 len: 1485 microversion: 2.1 time: 0.476195 Aug 27 03:57:23.571414 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3178/6642] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:23 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 1485 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:23.578669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6923b907-ab31-474a-bfa4-c022b049b238 req-f1a6fd6e-b602-4ebb-93d5-84a2af1671a3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:23.579441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6923b907-ab31-474a-bfa4-c022b049b238 req-f1a6fd6e-b602-4ebb-93d5-84a2af1671a3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:23.580314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6923b907-ab31-474a-bfa4-c022b049b238 req-f1a6fd6e-b602-4ebb-93d5-84a2af1671a3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:23.597969 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6923b907-ab31-474a-bfa4-c022b049b238 req-f1a6fd6e-b602-4ebb-93d5-84a2af1671a3 service nova] Creating event network-vif-deleted:1e25c900-58c2-4356-ba27-7bd28062cf1d for instance 672822a0-a63f-4927-8863-02b2e46c3ac6 on n-h2-852086-5 Aug 27 03:57:23.609902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6923b907-ab31-474a-bfa4-c022b049b238 req-f1a6fd6e-b602-4ebb-93d5-84a2af1671a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061616 Aug 27 03:57:23.611293 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3465/6643] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:23.670936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:23.672037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:23.679389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:23.680272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:23.680902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:23.681706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:23.682469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:23.682924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:23.835773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:23.846011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-877face9-318e-4174-82db-d3f0ca0ab8cb tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1564 microversion: 2.1 time: 0.184140 Aug 27 03:57:23.846865 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3179/6644] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:23 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:24.596639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:24.598657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 672822a0-a63f-4927-8863-02b2e46c3ac6] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:24.605301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:24.605779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:24.606241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:24.606959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:24.607418 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:24.607847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:24.622891 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] HTTP exception thrown: Instance 672822a0-a63f-4927-8863-02b2e46c3ac6 could not be found. Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Request method failure captured: Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 HTTP/1.1 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZWtW7NAm0GaTRctev_oAlrcQdCxPthvanlLgW5bWvt0kvES1YHZfQq196O3n2iYU0jl9-deutPR_sH3Hwvqdz0FboMXo2qX6dbz1lWQqHhFNFrPJtrmPjqIosiaIqjjjT6qmcssJNmDGJhnFpiWHtDDbAMmzC3WgplcijFj-gMOCGM Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c037d852b1074d47a19377735a5ff519 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c037d852b1074d47a19377735a5ff519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c037d852b1074d47a19377735a5ff519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c037d852b1074d47a19377735a5ff519", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c037d852b1074d47a19377735a5ff519"}]}] Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c037d852b1074d47a19377735a5ff519 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkBasicOps-1992731955-project Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 553f4b1db7eb4c53981c18ac5ed0b352 Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkBasicOps-1992731955-project Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 672822a0-a63f-4927-8863-02b2e46c3ac6 could not be found. Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '672822a0-a63f-4927-8863-02b2e46c3ac6'} Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672822a0-a63f-4927-8863-02b2e46c3ac6 could not be found. Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672822a0-a63f-4927-8863-02b2e46c3ac6 could not be found. Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:57:24.624515 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672822a0-a63f-4927-8863-02b2e46c3ac6 could not be found. Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Returning 404 to user: Instance 672822a0-a63f-4927-8863-02b2e46c3ac6 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34ddb310-3460-47db-b8e8-a4d6eee8b169 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6" status: 404 len: 111 microversion: 2.1 time: 0.035606 Aug 27 03:57:24.630108 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3466/6645] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:24 2022] GET /compute/v2.1/servers/672822a0-a63f-4927-8863-02b2e46c3ac6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:57:24.802053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0636ad7a-5944-46c3-81e3-ba89a41f71cf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '.version_select at 0x7fe457644d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:24.824716 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0636ad7a-5944-46c3-81e3-ba89a41f71cf tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1097607745" status: 202 len: 0 microversion: 2.1 time: 0.027073 Aug 27 03:57:24.825313 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3180/6646] 10.222.0.69 () {58 vars in 1257 bytes} [Sat Aug 27 03:57:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1097607745 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:57:25.638391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-bc29a484-e274-4af2-b6df-3e3761cce5f8 req-ea624301-717d-4d6e-afc3-ac491297a608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829af0c4-b95b-48a5-b5eb-06d7b06b48d2", "tag": "e69eb617-7d62-4c98-b960-25e6842632e6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:25.650963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bc29a484-e274-4af2-b6df-3e3761cce5f8 req-ea624301-717d-4d6e-afc3-ac491297a608 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:25.652017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bc29a484-e274-4af2-b6df-3e3761cce5f8 req-ea624301-717d-4d6e-afc3-ac491297a608 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:25.652839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bc29a484-e274-4af2-b6df-3e3761cce5f8 req-ea624301-717d-4d6e-afc3-ac491297a608 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:25.664970 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-bc29a484-e274-4af2-b6df-3e3761cce5f8 req-ea624301-717d-4d6e-afc3-ac491297a608 service nova] Creating event network-changed:e69eb617-7d62-4c98-b960-25e6842632e6 for instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 on n-h1-852086-5 Aug 27 03:57:25.671542 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-bc29a484-e274-4af2-b6df-3e3761cce5f8 req-ea624301-717d-4d6e-afc3-ac491297a608 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036512 Aug 27 03:57:25.672222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3467/6647] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:57:32.935772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ea121d5-514a-450e-b458-3f5beee001c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'create', calling method: .version_select at 0x7fe457d4d820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-612163978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlVkKmtkHo7F+juBmQkrCHFjvMkL9gZXERg/GzlyPV2u6AiLUcM1VpgbSK0c7TD2qaPLSPxSzLlzIneU0aqPSqizbizjsrvxuRkGgtbmtMzpTelPupm+GBNs2jeFRybQA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:32.954720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6ea121d5-514a-450e-b458-3f5beee001c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for project c037d852b1074d47a19377735a5ff519. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:57:32.960253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6ea121d5-514a-450e-b458-3f5beee001c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for user 553f4b1db7eb4c53981c18ac5ed0b352 and project c037d852b1074d47a19377735a5ff519. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:57:32.984627 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ea121d5-514a-450e-b458-3f5beee001c2 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052975 Aug 27 03:57:32.985245 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3181/6648] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 03:57:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:34.095866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-647635698", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "61d5af91-f338-4507-a5a4-c2a406ce8707"}], "key_name": "tempest-TestNetworkBasicOps-612163978", "security_groups": [{"name": "tempest-secgroup-smoke-1706180136"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:34.221311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] validate_networks() for [('61d5af91-f338-4507-a5a4-c2a406ce8707', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:57:34.635426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:57:34.635983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:57:34.636528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:57:34.637144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:57:34.637756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:57:34.648369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:34.648856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:34.649319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:34.650083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:34.650585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:34.651014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:34.669821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for project c037d852b1074d47a19377735a5ff519. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:57:34.677055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Getting quotas for user 553f4b1db7eb4c53981c18ac5ed0b352 and project c037d852b1074d47a19377735a5ff519. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:57:34.690629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:57:34.693214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:57:34.742825 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b461c811-eb50-4106-9afa-296b63b99447 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.651328 Aug 27 03:57:34.743834 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3468/6649] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 03:57:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:57:34.751825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:34.757790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e08e124-38d8-4b94-91bc-110178e05264 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:34.758466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e08e124-38d8-4b94-91bc-110178e05264 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:34.819615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e08e124-38d8-4b94-91bc-110178e05264 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:34.827437 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e08e124-38d8-4b94-91bc-110178e05264 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1247 microversion: 2.1 time: 0.076422 Aug 27 03:57:34.828346 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3182/6650] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:34 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:35.851906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:35.852516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:35.860157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:35.861029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:35.861682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:35.862515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:35.863018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:35.864053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:35.928553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:35.937344 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4df73821-cade-4284-aa83-4c2c0f1013b7 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1307 microversion: 2.1 time: 0.090344 Aug 27 03:57:35.937958 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3469/6651] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:35 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:36.959841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:36.960428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:36.968493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:36.969006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:36.969464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:36.970218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:36.970714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:36.971280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:37.354713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:37.362600 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98ccb279-7f6f-452c-87e3-e2323620a3c0 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1373 microversion: 2.1 time: 0.407359 Aug 27 03:57:37.363204 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3183/6652] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:36 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1373 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:37.683220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ed743a53-f454-4710-817e-2cb516efdf8e req-81f93a58-e46c-4d51-9d91-919bf5dd7646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029f5c18-9e38-498f-9861-1ed0f12cf11a", "tag": "ef63a30b-dc34-47b7-a533-15f639bb410f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:37.695743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ed743a53-f454-4710-817e-2cb516efdf8e req-81f93a58-e46c-4d51-9d91-919bf5dd7646 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:37.696565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ed743a53-f454-4710-817e-2cb516efdf8e req-81f93a58-e46c-4d51-9d91-919bf5dd7646 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:37.697002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ed743a53-f454-4710-817e-2cb516efdf8e req-81f93a58-e46c-4d51-9d91-919bf5dd7646 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:37.713664 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ed743a53-f454-4710-817e-2cb516efdf8e req-81f93a58-e46c-4d51-9d91-919bf5dd7646 service nova] Creating event network-changed:ef63a30b-dc34-47b7-a533-15f639bb410f for instance 029f5c18-9e38-498f-9861-1ed0f12cf11a on n-h2-852086-5 Aug 27 03:57:37.719699 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ed743a53-f454-4710-817e-2cb516efdf8e req-81f93a58-e46c-4d51-9d91-919bf5dd7646 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040476 Aug 27 03:57:37.720331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3470/6653] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:38.385154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:38.385717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:38.392668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:38.393177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:38.393631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:38.394394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:38.395423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:38.395867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:38.555021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:38.563870 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a72a0ab-a019-424e-9b17-90bc86c7181f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1373 microversion: 2.1 time: 0.182495 Aug 27 03:57:38.564724 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3184/6654] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:38 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:39.586506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:39.587203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:39.589117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:39.594970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:39.595457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:39.595890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:39.596586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:39.597037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:39.597494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:39.602057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:39.744010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:39.751669 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac968b3f-67b3-4213-9ee4-050463ae2d5c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1373 microversion: 2.1 time: 0.171004 Aug 27 03:57:39.752260 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3471/6655] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:39 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:40.773244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:40.773873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:40.776618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:40.782002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:40.782532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:40.782988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:40.783756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:40.784182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:40.784630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:40.921543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:40.929505 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7f3b00b-fd7f-4070-a14b-02c2b0586f63 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1373 microversion: 2.1 time: 0.160875 Aug 27 03:57:40.930080 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3185/6656] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:40 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:41.951043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:41.951631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:41.958495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.958979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.959408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:41.960103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:41.960555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:41.960977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:42.105510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:42.113369 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-57d74533-27fd-4395-8a60-96bbc8dfc803 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1373 microversion: 2.1 time: 0.166302 Aug 27 03:57:42.113956 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3472/6657] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:41 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:43.135477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:43.136118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:43.143265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:43.143776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:43.144237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:43.144976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:43.145453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:43.145902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:43.284307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:43.292612 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-733820cb-8fc1-4853-8588-19106cd39a1b tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1373 microversion: 2.1 time: 0.161935 Aug 27 03:57:43.293210 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3186/6658] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:43 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:43.301137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0065dae1-b651-4e7c-8e29-3a0d8416b1e6 req-3c03b77f-a4e8-4efa-a5f4-85da563c1844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029f5c18-9e38-498f-9861-1ed0f12cf11a", "name": "network-vif-plugged", "status": "completed", "tag": "ef63a30b-dc34-47b7-a533-15f639bb410f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:43.315826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0065dae1-b651-4e7c-8e29-3a0d8416b1e6 req-3c03b77f-a4e8-4efa-a5f4-85da563c1844 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:43.316612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0065dae1-b651-4e7c-8e29-3a0d8416b1e6 req-3c03b77f-a4e8-4efa-a5f4-85da563c1844 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:43.317045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0065dae1-b651-4e7c-8e29-3a0d8416b1e6 req-3c03b77f-a4e8-4efa-a5f4-85da563c1844 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:43.329873 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0065dae1-b651-4e7c-8e29-3a0d8416b1e6 req-3c03b77f-a4e8-4efa-a5f4-85da563c1844 service nova] Creating event network-vif-plugged:ef63a30b-dc34-47b7-a533-15f639bb410f for instance 029f5c18-9e38-498f-9861-1ed0f12cf11a on n-h2-852086-5 Aug 27 03:57:43.336201 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0065dae1-b651-4e7c-8e29-3a0d8416b1e6 req-3c03b77f-a4e8-4efa-a5f4-85da563c1844 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040491 Aug 27 03:57:43.336858 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3473/6659] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:57:44.313974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:44.314641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:44.322278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:44.322789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:44.323243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:44.323961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:44.324424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:44.324858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:44.484344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:44.492471 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45738363-74e2-4999-96c3-600a6d1dbbbd tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1373 microversion: 2.1 time: 0.182758 Aug 27 03:57:44.493075 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3187/6660] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:44 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:45.513561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:45.514184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:45.516973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:45.517636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:45.524872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:45.525428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:45.525786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:45.526989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:45.526989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:45.527504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:45.666519 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:45.675528 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a8c63006-624f-4625-b255-80ac3d2a4d56 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1546 microversion: 2.1 time: 0.166294 Aug 27 03:57:45.676114 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3474/6661] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:45 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:45.696416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:45.697062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:45.699009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:45.705052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:45.705566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:45.706024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:45.706783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:45.707270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:45.707727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:45.844027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:45.852539 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3b2aca0-1edd-4a26-a195-fe6f99998955 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1546 microversion: 2.1 time: 0.160084 Aug 27 03:57:45.853155 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3188/6662] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:45 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:47.478205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-9120e7a4-ea0e-48e8-ad11-a5c0a21f1936 req-976413a1-30ef-4652-a92d-d375d010bd63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029f5c18-9e38-498f-9861-1ed0f12cf11a", "tag": "ef63a30b-dc34-47b7-a533-15f639bb410f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:47.488921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9120e7a4-ea0e-48e8-ad11-a5c0a21f1936 req-976413a1-30ef-4652-a92d-d375d010bd63 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:47.489425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9120e7a4-ea0e-48e8-ad11-a5c0a21f1936 req-976413a1-30ef-4652-a92d-d375d010bd63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:47.489874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-9120e7a4-ea0e-48e8-ad11-a5c0a21f1936 req-976413a1-30ef-4652-a92d-d375d010bd63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:47.501868 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-9120e7a4-ea0e-48e8-ad11-a5c0a21f1936 req-976413a1-30ef-4652-a92d-d375d010bd63 service nova] Creating event network-changed:ef63a30b-dc34-47b7-a533-15f639bb410f for instance 029f5c18-9e38-498f-9861-1ed0f12cf11a on n-h2-852086-5 Aug 27 03:57:47.508544 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-9120e7a4-ea0e-48e8-ad11-a5c0a21f1936 req-976413a1-30ef-4652-a92d-d375d010bd63 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040334 Aug 27 03:57:47.509595 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3475/6663] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:49.113500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:49.116374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:49.123436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:49.123937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:49.124392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:49.125107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:49.125576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:49.126016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:49.182194 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63e5fb75-72c5-4872-b3a2-14878f846688 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2/action" status: 200 len: 24570 microversion: 2.1 time: 0.072428 Aug 27 03:57:49.182865 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3189/6664] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:57:49 2022] POST /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:58:00.266658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=9 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:00.267351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=21 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:00.272934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:00.275835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:00.283577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.284072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.284516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.285230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.285692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.286124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.368123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:58:00.368544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:58:00.369020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:58:00.369429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:58:00.369840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:58:00.431602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:00.437785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.438303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.438748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.439467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.439936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.440366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.473900 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cdca133b-5248-44b9-aba8-13e268b68a16 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2/action" status: 202 len: 1137 microversion: 2.1 time: 0.209627 Aug 27 03:58:00.482509 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3476/6665] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:58:00 2022] POST /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2/action => generated 1137 bytes in 211 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:58:00.494722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:00.495554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:00.498782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:00.499527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:00.505505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.506033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.507246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.507988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.508456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.508897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.659279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:00.667666 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03037fd2-ea85-44fa-b1a3-ca3f4e045aa3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.177791 Aug 27 03:58:00.668238 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3190/6666] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:00 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:01.689206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:01.689801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:01.697068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:01.697561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:01.697999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:01.698741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:01.699198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:01.699631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:01.839760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:01.848155 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-008ceac5-27b8-4cb8-b7bc-4b6f1c237a30 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.163085 Aug 27 03:58:01.848746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3477/6667] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:01 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:02.876252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:02.876832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:02.884304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:02.884801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:02.885249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:02.885964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:02.886465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:02.887003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:03.024516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:03.033175 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37816ada-453c-4982-a79c-b30fb857ae6c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.161144 Aug 27 03:58:03.033755 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3191/6668] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:02 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:04.055719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:04.056328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:04.063813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:04.064304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:04.064747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:04.065454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:04.065918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:04.066381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:04.198689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:04.206488 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d282904-440f-4a40-b085-30a52d36159e tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.155501 Aug 27 03:58:04.207068 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3478/6669] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:04 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:05.228916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:05.229547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:05.236721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:05.237231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:05.237681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:05.238445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:05.238917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:05.239361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:05.385683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:05.393837 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f531688d-8a47-4fa7-917d-0f1421a7b2d0 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.169661 Aug 27 03:58:05.394472 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3192/6670] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:05 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:06.415958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:06.416965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:06.424942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:06.425438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:06.425879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:06.427009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:06.429230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:06.429230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:06.573254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:06.581324 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b581425-41fc-4276-ada1-c4f725e9e51b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.169957 Aug 27 03:58:06.581910 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3479/6671] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:06 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:07.603152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:07.603848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:07.611145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:07.611710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:07.612133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:07.612869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:07.613485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:07.613930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:07.757564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:07.766058 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-535e09d7-ed60-4f78-82ae-4e83d51f7f9c tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.166960 Aug 27 03:58:07.766759 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3193/6672] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:07 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:08.788317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:08.789786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:08.796873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:08.797366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:08.797801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:08.798590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:08.799050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:08.799484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:09.129224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:09.137339 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c2e88dd-7094-432c-83ac-56aab3d073d1 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.352887 Aug 27 03:58:09.140055 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3480/6673] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:08 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:09.799622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:09.801787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:09.808857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:09.809362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:09.809847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:09.810908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:09.811382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:09.811825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:09.868090 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-079d2f23-b9b3-484a-8b32-d48e80b0ddb4 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a/action" status: 200 len: 24575 microversion: 2.1 time: 0.072371 Aug 27 03:58:09.869059 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3194/6674] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:58:09 2022] POST /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a/action => generated 24575 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:58:10.160684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:10.161363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:10.169352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:10.169866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:10.170396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:10.171106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:10.171600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:10.172034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:10.312866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:10.321609 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83edc966-d274-4faa-9c72-37237cc6e617 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.165770 Aug 27 03:58:10.322212 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3481/6675] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:10 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:11.344070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:11.344887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:11.353167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:11.353713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:11.354186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:11.354940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:11.355512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:11.355963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:11.575888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:11.588099 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9243db8-3c04-4037-bb32-e005c3145607 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1692 microversion: 2.1 time: 0.248579 Aug 27 03:58:11.588697 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3195/6676] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:11 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1692 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:12.610014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:12.610669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:12.619883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:12.620439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:12.620890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:12.621613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:12.622079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:12.622543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:12.774497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:12.784300 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f27bce5-7e36-404e-a5c8-743e65f9ef9f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1698 microversion: 2.1 time: 0.178113 Aug 27 03:58:12.784930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3482/6677] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:12 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:13.807592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:13.808193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:13.815381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:13.815883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:13.816336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:13.817048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:13.817530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:13.817971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:13.954477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:13.962572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dba2f0b6-29c5-4a7f-9036-5e69c9c20cec tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1698 microversion: 2.1 time: 0.159562 Aug 27 03:58:13.963236 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3196/6678] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:13 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:14.984189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:14.985269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:15.002960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:15.003871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:15.004639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:15.005917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:15.006758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:15.007546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:15.160995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:15.172183 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-26e95663-a7e6-432f-a158-0add23f7ba8b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1683 microversion: 2.1 time: 0.191982 Aug 27 03:58:15.172809 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3483/6679] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:14 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:16.675754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e5682785-6164-42c7-8d02-0885e26adf86 req-f4f19b37-708b-4fd0-9816-f5a8ad37e723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829af0c4-b95b-48a5-b5eb-06d7b06b48d2", "name": "network-vif-unplugged", "status": "completed", "tag": "e69eb617-7d62-4c98-b960-25e6842632e6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:16.688361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e5682785-6164-42c7-8d02-0885e26adf86 req-f4f19b37-708b-4fd0-9816-f5a8ad37e723 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:16.688798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e5682785-6164-42c7-8d02-0885e26adf86 req-f4f19b37-708b-4fd0-9816-f5a8ad37e723 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:16.689321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e5682785-6164-42c7-8d02-0885e26adf86 req-f4f19b37-708b-4fd0-9816-f5a8ad37e723 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:16.702465 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e5682785-6164-42c7-8d02-0885e26adf86 req-f4f19b37-708b-4fd0-9816-f5a8ad37e723 service nova] Creating event network-vif-unplugged:e69eb617-7d62-4c98-b960-25e6842632e6 for instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 on n-h1-852086-5 Aug 27 03:58:16.708637 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e5682785-6164-42c7-8d02-0885e26adf86 req-f4f19b37-708b-4fd0-9816-f5a8ad37e723 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037103 Aug 27 03:58:16.709796 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3197/6680] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:18.731827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-1b5192c6-be70-4941-8547-7a84ae663ac0 req-d3036d45-ed12-402e-b61f-790bb0d39b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829af0c4-b95b-48a5-b5eb-06d7b06b48d2", "name": "network-vif-plugged", "status": "completed", "tag": "e69eb617-7d62-4c98-b960-25e6842632e6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:18.741658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-1b5192c6-be70-4941-8547-7a84ae663ac0 req-d3036d45-ed12-402e-b61f-790bb0d39b8f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:18.742183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-1b5192c6-be70-4941-8547-7a84ae663ac0 req-d3036d45-ed12-402e-b61f-790bb0d39b8f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:18.742621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-1b5192c6-be70-4941-8547-7a84ae663ac0 req-d3036d45-ed12-402e-b61f-790bb0d39b8f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:18.754462 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-1b5192c6-be70-4941-8547-7a84ae663ac0 req-d3036d45-ed12-402e-b61f-790bb0d39b8f service nova] Creating event network-vif-plugged:e69eb617-7d62-4c98-b960-25e6842632e6 for instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 on n-h1-852086-5 Aug 27 03:58:18.759398 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-1b5192c6-be70-4941-8547-7a84ae663ac0 req-d3036d45-ed12-402e-b61f-790bb0d39b8f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031692 Aug 27 03:58:18.760005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3484/6681] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:21.048318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:21.050647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:21.058042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:21.058671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:21.059123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:21.059849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:21.060327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:21.061038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:21.113119 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d09f858-c24a-49f0-99b7-5bf64fe5b052 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "POST /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a/action" status: 200 len: 32639 microversion: 2.1 time: 0.068865 Aug 27 03:58:21.113792 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3198/6682] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:58:21 2022] POST /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a/action => generated 32639 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:58:22.467853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:22.468588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:22.475292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:22.475775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:22.476204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:22.476899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:22.477588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:22.478089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:22.505217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:58:22.546320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6da84493-1298-4646-a22a-9d096d732047 req-d772b51b-fb77-4c05-967f-a2ca045bad63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029f5c18-9e38-498f-9861-1ed0f12cf11a", "tag": "ef63a30b-dc34-47b7-a533-15f639bb410f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:22.560486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6da84493-1298-4646-a22a-9d096d732047 req-d772b51b-fb77-4c05-967f-a2ca045bad63 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:22.561267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6da84493-1298-4646-a22a-9d096d732047 req-d772b51b-fb77-4c05-967f-a2ca045bad63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:22.561791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6da84493-1298-4646-a22a-9d096d732047 req-d772b51b-fb77-4c05-967f-a2ca045bad63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:22.573786 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6da84493-1298-4646-a22a-9d096d732047 req-d772b51b-fb77-4c05-967f-a2ca045bad63 service nova] Creating event network-changed:ef63a30b-dc34-47b7-a533-15f639bb410f for instance 029f5c18-9e38-498f-9861-1ed0f12cf11a on n-h2-852086-5 Aug 27 03:58:22.596055 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6da84493-1298-4646-a22a-9d096d732047 req-d772b51b-fb77-4c05-967f-a2ca045bad63 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131239 Aug 27 03:58:22.600035 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3199/6683] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:22.604237 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ffd4df94-9083-4f02-aa28-ab192af0b638 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "DELETE /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 204 len: 0 microversion: 2.1 time: 0.142403 Aug 27 03:58:22.610644 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3485/6684] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:58:22 2022] DELETE /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:58:22.614752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:22.615777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:22.623302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:22.624183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:22.624906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:22.625945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:22.626593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:22.627319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:22.780555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:22.788768 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a1e5816-8a87-4504-b679-0c72d816fcd1 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1670 microversion: 2.1 time: 0.178384 Aug 27 03:58:22.789365 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3200/6685] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:22 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:58:23.811384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:23.812129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:23.820036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:23.820557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:23.823184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:23.823184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:23.823184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:23.823500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:23.975477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:23.983378 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bda8125d-f2c0-4db6-bb28-6b5d20a131b3 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1670 microversion: 2.1 time: 0.176607 Aug 27 03:58:23.984166 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3486/6686] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:23 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:25.003873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:25.004714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:25.012057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:25.012650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:25.013217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:25.014345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:25.014721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:25.015247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:25.036843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0d103a38-d08b-48de-81cf-ee630c124984 req-e7dd3473-c21e-4edc-af64-136d2cff7857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029f5c18-9e38-498f-9861-1ed0f12cf11a", "name": "network-vif-deleted", "tag": "ef63a30b-dc34-47b7-a533-15f639bb410f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:25.050319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0d103a38-d08b-48de-81cf-ee630c124984 req-e7dd3473-c21e-4edc-af64-136d2cff7857 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:25.051259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0d103a38-d08b-48de-81cf-ee630c124984 req-e7dd3473-c21e-4edc-af64-136d2cff7857 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:25.052340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0d103a38-d08b-48de-81cf-ee630c124984 req-e7dd3473-c21e-4edc-af64-136d2cff7857 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:25.067218 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0d103a38-d08b-48de-81cf-ee630c124984 req-e7dd3473-c21e-4edc-af64-136d2cff7857 service nova] Creating event network-vif-deleted:ef63a30b-dc34-47b7-a533-15f639bb410f for instance 029f5c18-9e38-498f-9861-1ed0f12cf11a on n-h2-852086-5 Aug 27 03:58:25.072411 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0d103a38-d08b-48de-81cf-ee630c124984 req-e7dd3473-c21e-4edc-af64-136d2cff7857 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039342 Aug 27 03:58:25.073036 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3487/6687] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:58:25.094698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '553f4b1db7eb4c53981c18ac5ed0b352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037d852b1074d47a19377735a5ff519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:25.105786 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1bc6672-77ef-493d-b44b-1bf9f553e692 tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 200 len: 1484 microversion: 2.1 time: 0.105112 Aug 27 03:58:25.105786 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3201/6688] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:24 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 1484 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:26.127561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:26.128259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] [instance: 029f5c18-9e38-498f-9861-1ed0f12cf11a] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:26.135093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:26.135576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:26.136009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:26.136697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:26.137149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:26.137569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:26.151453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] HTTP exception thrown: Instance 029f5c18-9e38-498f-9861-1ed0f12cf11a could not be found. Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Request method failure captured: Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a HTTP/1.1 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZWtW7NAm0GaTRctev_oAlrcQdCxPthvanlLgW5bWvt0kvES1YHZfQq196O3n2iYU0jl9-deutPR_sH3Hwvqdz0FboMXo2qX6dbz1lWQqHhFNFrPJtrmPjqIosiaIqjjjT6qmcssJNmDGJhnFpiWHtDDbAMmzC3WgplcijFj-gMOCGM Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: c037d852b1074d47a19377735a5ff519 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c037d852b1074d47a19377735a5ff519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c037d852b1074d47a19377735a5ff519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c037d852b1074d47a19377735a5ff519", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c037d852b1074d47a19377735a5ff519"}]}] Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: c037d852b1074d47a19377735a5ff519 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkBasicOps-1992731955 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkBasicOps-1992731955-project Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 553f4b1db7eb4c53981c18ac5ed0b352 Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkBasicOps-1992731955-project Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 029f5c18-9e38-498f-9861-1ed0f12cf11a could not be found. Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '029f5c18-9e38-498f-9861-1ed0f12cf11a'} Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029f5c18-9e38-498f-9861-1ed0f12cf11a could not be found. Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029f5c18-9e38-498f-9861-1ed0f12cf11a could not be found. Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:26.153040 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029f5c18-9e38-498f-9861-1ed0f12cf11a could not be found. Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Returning 404 to user: Instance 029f5c18-9e38-498f-9861-1ed0f12cf11a could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1b0cdc59-17a7-4826-8cc1-5810d306f05c tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a" status: 404 len: 111 microversion: 2.1 time: 0.031961 Aug 27 03:58:26.158478 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3488/6689] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:26 2022] GET /compute/v2.1/servers/029f5c18-9e38-498f-9861-1ed0f12cf11a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:58:26.311685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-051334e1-818c-4f06-8633-30fd6fc1231f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] Calling method '.version_select at 0x7fe457500c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:26.333396 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-051334e1-818c-4f06-8633-30fd6fc1231f tempest-TestNetworkBasicOps-1992731955 tempest-TestNetworkBasicOps-1992731955-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-612163978" status: 202 len: 0 microversion: 2.1 time: 0.025385 Aug 27 03:58:26.334105 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3202/6690] 10.222.0.69 () {58 vars in 1254 bytes} [Sat Aug 27 03:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-612163978 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:58:43.402503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:43.405629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:43.413891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:43.414592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:43.417458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:43.417920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:43.418394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:43.419128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:43.419589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:43.420025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:43.502849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-401ca104-1497-4d64-9d2d-00e2f1437d7f tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "POST /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2/action" status: 200 len: 24571 microversion: 2.1 time: 0.104649 Aug 27 03:58:43.510467 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3489/6691] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 03:58:43 2022] POST /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2/action => generated 24571 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:58:55.626804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:55.627384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:55.636082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b7656b95-47df-45f4-9824-b83a4cbe793f req-5a584a4f-7d22-46dc-a000-c1b4e6104306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829af0c4-b95b-48a5-b5eb-06d7b06b48d2", "tag": "e69eb617-7d62-4c98-b960-25e6842632e6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:55.641737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=60 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:55.643085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:55.654199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:55.655146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:55.657291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b7656b95-47df-45f4-9824-b83a4cbe793f req-5a584a4f-7d22-46dc-a000-c1b4e6104306 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:55.658922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:55.659647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b7656b95-47df-45f4-9824-b83a4cbe793f req-5a584a4f-7d22-46dc-a000-c1b4e6104306 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:55.660266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b7656b95-47df-45f4-9824-b83a4cbe793f req-5a584a4f-7d22-46dc-a000-c1b4e6104306 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:55.660940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:55.667175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:55.668238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:55.668904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:55.669548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:55.691924 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b7656b95-47df-45f4-9824-b83a4cbe793f req-5a584a4f-7d22-46dc-a000-c1b4e6104306 service nova] Creating event network-changed:e69eb617-7d62-4c98-b960-25e6842632e6 for instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 on n-h1-852086-5 Aug 27 03:58:55.701836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b7656b95-47df-45f4-9824-b83a4cbe793f req-5a584a4f-7d22-46dc-a000-c1b4e6104306 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069844 Aug 27 03:58:55.703553 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3490/6692] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:55.703996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:58:55.813141 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3127688-addc-4e4f-9d40-aa632d3ea32d tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 204 len: 0 microversion: 2.1 time: 0.189485 Aug 27 03:58:55.820638 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3203/6693] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 03:58:55 2022] DELETE /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:58:55.828390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:55.829091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:55.838906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:55.839846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:55.840285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:55.841016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:55.841520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:55.841948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:55.999698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:56.008724 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-51106691-352e-4b7d-8228-260cfb62459b tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1689 microversion: 2.1 time: 0.185310 Aug 27 03:58:56.019702 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3491/6694] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:55 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:57.031788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:57.032513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:57.039259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:57.039769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:57.040225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:57.041219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:57.041464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:57.041906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:57.180989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:57.191989 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6fbd9ff4-e455-43be-a83c-c1f26aa4f5fc tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1689 microversion: 2.1 time: 0.164325 Aug 27 03:58:57.192800 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3204/6695] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:57 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:57.849525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-850c685c-a93f-4f9b-9894-afbf09d0f8dd req-420c14b7-f39b-4ea0-9a55-d3b7f364b947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829af0c4-b95b-48a5-b5eb-06d7b06b48d2", "name": "network-vif-deleted", "tag": "e69eb617-7d62-4c98-b960-25e6842632e6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:57.862939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-850c685c-a93f-4f9b-9894-afbf09d0f8dd req-420c14b7-f39b-4ea0-9a55-d3b7f364b947 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:57.863427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-850c685c-a93f-4f9b-9894-afbf09d0f8dd req-420c14b7-f39b-4ea0-9a55-d3b7f364b947 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:57.863857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-850c685c-a93f-4f9b-9894-afbf09d0f8dd req-420c14b7-f39b-4ea0-9a55-d3b7f364b947 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:57.876720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-850c685c-a93f-4f9b-9894-afbf09d0f8dd req-420c14b7-f39b-4ea0-9a55-d3b7f364b947 service nova] Creating event network-vif-deleted:e69eb617-7d62-4c98-b960-25e6842632e6 for instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 on n-h1-852086-5 Aug 27 03:58:57.882661 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-850c685c-a93f-4f9b-9894-afbf09d0f8dd req-420c14b7-f39b-4ea0-9a55-d3b7f364b947 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036884 Aug 27 03:58:57.883475 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3492/6696] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:58.215696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:58.216336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:58.223644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:58.224407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:58.225054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:58.225987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:58.226493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:58.226935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:58.265424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:58.265928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:58.266474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:58.266943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lazy-loading 'fault' on Instance uuid 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:58:58.314087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7171be5b3d4238acfe83058f78413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f5f3257024419926319c6013d4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:58.322899 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5fd77fc-02e6-4f99-82ad-996818535e81 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 200 len: 1356 microversion: 2.1 time: 0.111547 Aug 27 03:58:58.323808 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3205/6697] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:58 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:59.346029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:59.346758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] [instance: 829af0c4-b95b-48a5-b5eb-06d7b06b48d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:59.354219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:59.354711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:59.355154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:59.355870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:59.356333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:59.356767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:59.370882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] HTTP exception thrown: Instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 could not be found. Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Request method failure captured: Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 HTTP/1.1 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZSj7HFO2PaNzyPbSA7cTP-KIbMXatuskAYCPhYxud_jxcSMxl_Q6ae_gUMlmk6imBa7B5VqLQbCfFECNSOxptHSzbymSfoCmI3GvPSmrDgYOmpB9haOnmwV1YgaLuTK8tHRWP0PkcW2CcI14O2muT_9eUWhYFs7LVJntcr2Qw-VdJ4 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0d3f5f3257024419926319c6013d4d56", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0d3f5f3257024419926319c6013d4d56"}]}] Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 0d3f5f3257024419926319c6013d4d56 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-248261926 Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: cd7171be5b3d4238acfe83058f78413c Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-248261926-project Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 could not be found. Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '829af0c4-b95b-48a5-b5eb-06d7b06b48d2'} Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 could not be found. Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 could not be found. Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:59.372527 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 could not be found. Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Returning 404 to user: Instance 829af0c4-b95b-48a5-b5eb-06d7b06b48d2 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2fa79e01-3b4a-4e11-971e-5d03040eb8e3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2" status: 404 len: 111 microversion: 2.1 time: 0.032176 Aug 27 03:58:59.381129 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3493/6698] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:59 2022] GET /compute/v2.1/servers/829af0c4-b95b-48a5-b5eb-06d7b06b48d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:59:02.942589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35fc69c2-8f84-4067-98de-0f7678ce77b3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] Calling method '.version_select at 0x7fe457500b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:03.006104 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35fc69c2-8f84-4067-98de-0f7678ce77b3 tempest-TestNetworkAdvancedServerOps-248261926 tempest-TestNetworkAdvancedServerOps-248261926-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1557170116" status: 202 len: 0 microversion: 2.1 time: 0.070231 Aug 27 03:59:03.008215 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3206/6699] 10.222.0.69 () {58 vars in 1284 bytes} [Sat Aug 27 03:59:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1557170116 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:00:31.812907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:31.813657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:31.814545 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:31.814692 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.69) !!! Aug 27 04:00:31.815761 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:31.815947 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.69) !!! Aug 27 04:00:31.821796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85c424aa-56ff-482e-b900-abea7b6cd040 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Action: 'create', calling method: .version_select at 0x7fe456a12d30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1729280903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA/V0C1ASll3HxcnlZvtdkDfY5oBfNtXNSRN9LWujXowfQVQgvyMAsFwQ6ZYMKhgTeKXuJOrzx9LsIrrBBOlhYd+p9qyytnaiWcXSQ74cSGIBCwL7DKjZUMvubMla8FSw=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:31.842820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-85c424aa-56ff-482e-b900-abea7b6cd040 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Getting quotas for project 865a493961694d77b60ba33be0a43867. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:00:31.847903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-85c424aa-56ff-482e-b900-abea7b6cd040 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Getting quotas for user 093a2b5db3b64e01b4b2f891246fc64c and project 865a493961694d77b60ba33be0a43867. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:00:31.875556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85c424aa-56ff-482e-b900-abea7b6cd040 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.066538 Aug 27 04:00:31.876151 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3494/6700] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:00:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:00:32.846433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:32.847227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:32.851346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-306042528", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "747bd3b4-c8dd-4623-901e-2adc2167f29e", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1729280903", "security_groups": [{"name": "tempest-secgroup-smoke-760580439"}], "networks": [{"uuid": "7d6f21b9-efcb-4e2c-b60f-301c317f07b3"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:32.969562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] validate_networks() for [('7d6f21b9-efcb-4e2c-b60f-301c317f07b3', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:00:33.462556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:00:33.463034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:00:33.463528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:00:33.463954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:00:33.464378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:00:33.473422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:33.473919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:33.474406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:33.475153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:33.475636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:33.476081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:33.493280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Getting quotas for project 865a493961694d77b60ba33be0a43867. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:00:33.498537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Getting quotas for user 093a2b5db3b64e01b4b2f891246fc64c and project 865a493961694d77b60ba33be0a43867. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:00:33.559062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:00:33.561229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='747bd3b4-c8dd-4623-901e-2adc2167f29e',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:00:33.692390 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e5b14a6-78dc-410e-b886-c21f0ce234d5 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.847829 Aug 27 04:00:33.693104 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3207/6701] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:00:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:00:33.706956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95e0d6be-f1e7-4d2d-bfc1-ba83667583fd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:33.707579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95e0d6be-f1e7-4d2d-bfc1-ba83667583fd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:33.762154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95e0d6be-f1e7-4d2d-bfc1-ba83667583fd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:33.769102 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95e0d6be-f1e7-4d2d-bfc1-ba83667583fd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1098 microversion: 2.1 time: 0.067715 Aug 27 04:00:33.769666 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3495/6702] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:33 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1098 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:34.792088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecffd01a-fd88-4385-bd55-1862ddc3c4aa tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:34.792780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecffd01a-fd88-4385-bd55-1862ddc3c4aa tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:34.846842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecffd01a-fd88-4385-bd55-1862ddc3c4aa tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:34.854663 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecffd01a-fd88-4385-bd55-1862ddc3c4aa tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1098 microversion: 2.1 time: 0.068371 Aug 27 04:00:34.855243 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3208/6703] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:34 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1098 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:35.875856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:35.876469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:35.884089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:35.884644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:35.885136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:35.885858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:35.886346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:35.886776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:35.949022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:35.956775 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-76de20df-0b85-49c5-b831-3026f792d4bd tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1148 microversion: 2.1 time: 0.084795 Aug 27 04:00:35.957353 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3496/6704] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:35 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1148 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:36.977785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:36.978727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:36.988658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:36.989515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:36.990258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:36.991205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:36.992033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:36.992561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:37.069022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:37.079019 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2c6103f-e12d-431a-9fb9-8a11af5058a0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1214 microversion: 2.1 time: 0.105315 Aug 27 04:00:37.079634 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3209/6705] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:36 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:38.101541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:38.102408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:38.111188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:38.111982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:38.112667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:38.113840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:38.114535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:38.115181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:38.293011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:38.302317 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-08e1e36b-bcb2-487a-9ee8-56bfcf67f3da tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1281 microversion: 2.1 time: 0.205175 Aug 27 04:00:38.316638 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3497/6706] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:38 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:38.413760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-356a7e9a-a9bf-4781-b29e-382c4bc95358 req-01e13688-553a-45c8-8e04-d2ccfd823762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e51918-b41c-4c2c-a5f2-6ade73df29d2", "tag": "c61586f5-275f-49e7-846f-8548057ffeab"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:38.428959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-356a7e9a-a9bf-4781-b29e-382c4bc95358 req-01e13688-553a-45c8-8e04-d2ccfd823762 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:38.429645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-356a7e9a-a9bf-4781-b29e-382c4bc95358 req-01e13688-553a-45c8-8e04-d2ccfd823762 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:38.430350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-356a7e9a-a9bf-4781-b29e-382c4bc95358 req-01e13688-553a-45c8-8e04-d2ccfd823762 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:38.443164 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-356a7e9a-a9bf-4781-b29e-382c4bc95358 req-01e13688-553a-45c8-8e04-d2ccfd823762 service nova] Creating event network-changed:c61586f5-275f-49e7-846f-8548057ffeab for instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 on n-h2-852086-5 Aug 27 04:00:38.449580 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-356a7e9a-a9bf-4781-b29e-382c4bc95358 req-01e13688-553a-45c8-8e04-d2ccfd823762 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207229 Aug 27 04:00:38.450574 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3210/6707] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:00:39.324983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:39.325588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:39.333180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:39.333670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:39.334106 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:39.334842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:39.335295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:39.335715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:39.490110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:39.498345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0a257e3-8424-4ad5-97c1-e917ad7e34e9 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1281 microversion: 2.1 time: 0.178046 Aug 27 04:00:39.498939 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3498/6708] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:39 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:40.520750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:40.521691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:40.529275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:40.529779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:40.530262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:40.530988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:40.531458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:40.531899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:40.670201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:40.677961 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac41f135-4065-4ba6-9d90-b9a9a10e4a3e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1281 microversion: 2.1 time: 0.162490 Aug 27 04:00:40.678565 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3211/6709] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:40 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:41.700754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:41.701349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:41.708436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:41.708987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:41.709420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:41.710131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:41.710601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:41.711026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:41.860628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:41.868527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-262a8e19-3ca4-4cfd-9427-b2894b6e7c71 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1281 microversion: 2.1 time: 0.172872 Aug 27 04:00:41.869874 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3499/6710] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:41 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:42.891002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:42.891636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:42.898640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:42.899147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:42.899604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:42.900823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:42.901483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:42.901933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:43.035239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:43.043835 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-737300b4-19ae-48d7-84e9-09b01aae8966 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.156775 Aug 27 04:00:43.044400 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3212/6711] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:42 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:44.065264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:44.065883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:44.068570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:44.074824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:44.075309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:44.075748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:44.076446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:44.076902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:44.077328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:44.209450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:44.218490 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ad652d3-5a64-4337-996d-be5d9518f60b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.157356 Aug 27 04:00:44.219072 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3500/6712] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:44 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:45.238754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:45.239388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:45.241421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:45.242994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:45.249473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:45.249943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:45.250361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:45.251086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:45.251557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:45.252004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:45.388743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:45.396581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04aea4e9-e50b-482c-8dde-60de1e710e98 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.161763 Aug 27 04:00:45.397150 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3213/6713] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:45 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:46.417486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:46.418080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:46.424939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:46.425421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:46.425858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:46.426640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:46.427096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:46.427522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:46.565747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:46.573532 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20223fe5-f0b1-4755-b494-7be4c7fe12db tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.160528 Aug 27 04:00:46.574093 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3501/6714] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:46 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:47.594330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:47.595027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:47.603170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:47.603672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:47.604121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:47.606298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:47.606298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:47.606298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:47.743892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:47.752365 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28ce06ed-5618-4e64-85a6-223cd9e6c23e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.162295 Aug 27 04:00:47.752923 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3214/6715] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:47 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:48.772852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:48.773876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:48.780341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.780835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.781276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.781984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.782503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.782935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.917687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:48.925403 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ed5a8cf4-f785-4d59-8f7e-e7faa76ffec0 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.156576 Aug 27 04:00:48.925982 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3502/6716] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:48 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:49.946213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:49.946779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:49.957253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:49.957872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:49.958235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:49.958973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:49.959448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:49.959933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:50.107278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:50.115242 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f70aaa26-52f3-4de7-8431-10ff7b46c560 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.173020 Aug 27 04:00:50.115825 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3215/6717] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:49 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:51.137659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:51.138313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:51.148572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:51.149382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:51.150085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:51.151353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:51.152182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:51.152784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:51.285780 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:51.293823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-64e7a15d-fac2-4926-aa24-03d009813929 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.161169 Aug 27 04:00:51.294428 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3503/6718] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:51 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:52.224032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f1c8a8bd-5d89-47f5-9286-4b338956fbc8 req-fbe0afed-f511-47a1-bdc1-cd25c82ffaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e51918-b41c-4c2c-a5f2-6ade73df29d2", "name": "network-vif-plugged", "status": "completed", "tag": "c61586f5-275f-49e7-846f-8548057ffeab"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:52.234146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f1c8a8bd-5d89-47f5-9286-4b338956fbc8 req-fbe0afed-f511-47a1-bdc1-cd25c82ffaa6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:52.234677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f1c8a8bd-5d89-47f5-9286-4b338956fbc8 req-fbe0afed-f511-47a1-bdc1-cd25c82ffaa6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:52.235126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f1c8a8bd-5d89-47f5-9286-4b338956fbc8 req-fbe0afed-f511-47a1-bdc1-cd25c82ffaa6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:52.246786 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f1c8a8bd-5d89-47f5-9286-4b338956fbc8 req-fbe0afed-f511-47a1-bdc1-cd25c82ffaa6 service nova] Creating event network-vif-plugged:c61586f5-275f-49e7-846f-8548057ffeab for instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 on n-h2-852086-5 Aug 27 04:00:52.251983 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f1c8a8bd-5d89-47f5-9286-4b338956fbc8 req-fbe0afed-f511-47a1-bdc1-cd25c82ffaa6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106256 Aug 27 04:00:52.252753 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3216/6719] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:52.314258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:52.314880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:52.322198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:52.322891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:52.323551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:52.324213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:52.324677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:52.325104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:52.469247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:52.476924 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8a31333b-f462-466e-af6f-107df0b7ef54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.166859 Aug 27 04:00:52.477492 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3504/6720] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:52 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:53.501028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:53.501666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:53.507839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:53.508345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:53.508829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:53.509555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:53.510894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:53.511375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:53.659851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:53.667938 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d8fb245-baad-40c9-80ee-fa5fac4b099f tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1269 microversion: 2.1 time: 0.172174 Aug 27 04:00:53.668536 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3217/6721] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:53 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:54.689220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:54.689822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:54.696859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:54.697395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:54.697864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:54.698623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:54.699077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:54.699501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:54.829365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:54.837303 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6ad8ce23-ad98-47dc-876e-1a5d721c997e tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1458 microversion: 2.1 time: 0.152222 Aug 27 04:00:54.838513 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3505/6722] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:54 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:54.858662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:54.859232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:54.866147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:54.866678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:54.867136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:54.867863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:54.868339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:54.868786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:55.005226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:55.013476 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0daa7997-0a7c-4fd3-a2e0-4dc1793f6967 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1458 microversion: 2.1 time: 0.158867 Aug 27 04:00:55.014050 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3218/6723] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:54 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:57.035907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7be897f2-dacb-45a3-9e45-669d7fe93367 req-f55378e7-b740-4f46-89d5-39bd519a2de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e51918-b41c-4c2c-a5f2-6ade73df29d2", "tag": "c61586f5-275f-49e7-846f-8548057ffeab"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:57.047635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7be897f2-dacb-45a3-9e45-669d7fe93367 req-f55378e7-b740-4f46-89d5-39bd519a2de2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:57.048376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7be897f2-dacb-45a3-9e45-669d7fe93367 req-f55378e7-b740-4f46-89d5-39bd519a2de2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:57.048989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7be897f2-dacb-45a3-9e45-669d7fe93367 req-f55378e7-b740-4f46-89d5-39bd519a2de2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:57.061200 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7be897f2-dacb-45a3-9e45-669d7fe93367 req-f55378e7-b740-4f46-89d5-39bd519a2de2 service nova] Creating event network-changed:c61586f5-275f-49e7-846f-8548057ffeab for instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 on n-h2-852086-5 Aug 27 04:00:57.066730 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7be897f2-dacb-45a3-9e45-669d7fe93367 req-f55378e7-b740-4f46-89d5-39bd519a2de2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034431 Aug 27 04:00:57.067656 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3506/6724] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:58.361806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8ddaa439-fe7d-43e4-a246-fcc85ebceddb req-122c808c-a96e-4f14-ab31-2f2f583acb59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e51918-b41c-4c2c-a5f2-6ade73df29d2", "tag": "c61586f5-275f-49e7-846f-8548057ffeab"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:58.373043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ddaa439-fe7d-43e4-a246-fcc85ebceddb req-122c808c-a96e-4f14-ab31-2f2f583acb59 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:58.373784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ddaa439-fe7d-43e4-a246-fcc85ebceddb req-122c808c-a96e-4f14-ab31-2f2f583acb59 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:58.374429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ddaa439-fe7d-43e4-a246-fcc85ebceddb req-122c808c-a96e-4f14-ab31-2f2f583acb59 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:58.387189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8ddaa439-fe7d-43e4-a246-fcc85ebceddb req-122c808c-a96e-4f14-ab31-2f2f583acb59 service nova] Creating event network-changed:c61586f5-275f-49e7-846f-8548057ffeab for instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 on n-h2-852086-5 Aug 27 04:00:58.392725 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8ddaa439-fe7d-43e4-a246-fcc85ebceddb req-122c808c-a96e-4f14-ab31-2f2f583acb59 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034665 Aug 27 04:00:58.393348 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3219/6725] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:00.409528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f5566934-0b15-4ee6-8375-6917ff971f1b req-80a8054c-9b96-42ef-8dd6-95af2de45d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e51918-b41c-4c2c-a5f2-6ade73df29d2", "tag": "c61586f5-275f-49e7-846f-8548057ffeab"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:00.419769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f5566934-0b15-4ee6-8375-6917ff971f1b req-80a8054c-9b96-42ef-8dd6-95af2de45d60 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:00.420234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f5566934-0b15-4ee6-8375-6917ff971f1b req-80a8054c-9b96-42ef-8dd6-95af2de45d60 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:00.420662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f5566934-0b15-4ee6-8375-6917ff971f1b req-80a8054c-9b96-42ef-8dd6-95af2de45d60 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:00.431974 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f5566934-0b15-4ee6-8375-6917ff971f1b req-80a8054c-9b96-42ef-8dd6-95af2de45d60 service nova] Creating event network-changed:c61586f5-275f-49e7-846f-8548057ffeab for instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 on n-h2-852086-5 Aug 27 04:01:00.437414 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f5566934-0b15-4ee6-8375-6917ff971f1b req-80a8054c-9b96-42ef-8dd6-95af2de45d60 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032586 Aug 27 04:01:00.438076 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3507/6726] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:30.765376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:30.766921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=56 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:30.770914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6fc8d10c-5126-4a56-ae3d-87170c4bc459 req-2b7d08c2-b5b1-449c-a8d4-0c0aee077d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e51918-b41c-4c2c-a5f2-6ade73df29d2", "tag": "c61586f5-275f-49e7-846f-8548057ffeab"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:30.772138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:30.772896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:30.779984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:30.780854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=64 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:30.781753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:30.782446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:30.782926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:30.783631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:30.784117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:30.784683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:30.785592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6fc8d10c-5126-4a56-ae3d-87170c4bc459 req-2b7d08c2-b5b1-449c-a8d4-0c0aee077d3e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:30.786119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6fc8d10c-5126-4a56-ae3d-87170c4bc459 req-2b7d08c2-b5b1-449c-a8d4-0c0aee077d3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:30.786725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6fc8d10c-5126-4a56-ae3d-87170c4bc459 req-2b7d08c2-b5b1-449c-a8d4-0c0aee077d3e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:30.800436 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6fc8d10c-5126-4a56-ae3d-87170c4bc459 req-2b7d08c2-b5b1-449c-a8d4-0c0aee077d3e service nova] Creating event network-changed:c61586f5-275f-49e7-846f-8548057ffeab for instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 on n-h2-852086-5 Aug 27 04:01:30.806002 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6fc8d10c-5126-4a56-ae3d-87170c4bc459 req-2b7d08c2-b5b1-449c-a8d4-0c0aee077d3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039724 Aug 27 04:01:30.806641 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3508/6727] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:30.813063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:01:30.917779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53d1d9e7-4382-4d73-ba41-f0d16afb611c tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "DELETE /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 204 len: 0 microversion: 2.1 time: 0.154661 Aug 27 04:01:30.919651 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3220/6728] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:01:30 2022] DELETE /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:01:30.928672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:30.929390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:30.936078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:30.936585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:30.937030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:30.938020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:30.938802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:30.939242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:31.094221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:31.102730 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-06b31f63-083a-4def-9f18-4c535da683b2 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1582 microversion: 2.1 time: 0.178282 Aug 27 04:01:31.103455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3509/6729] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:30 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1582 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:32.128384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:32.129120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:32.136359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:32.136865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:32.137318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:32.138116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:32.138717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:32.139195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:32.328149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:32.336023 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20875a78-42cb-48d7-8b56-55f113da6481 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1582 microversion: 2.1 time: 0.212057 Aug 27 04:01:32.336601 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3221/6730] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:32 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1582 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:33.088657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-08952c14-cf80-4c93-9494-438231931293 req-0258046e-43f5-4aec-b9fd-e088fb795d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e51918-b41c-4c2c-a5f2-6ade73df29d2", "name": "network-vif-deleted", "tag": "c61586f5-275f-49e7-846f-8548057ffeab"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:33.099309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-08952c14-cf80-4c93-9494-438231931293 req-0258046e-43f5-4aec-b9fd-e088fb795d4f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:33.099791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-08952c14-cf80-4c93-9494-438231931293 req-0258046e-43f5-4aec-b9fd-e088fb795d4f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:33.100220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-08952c14-cf80-4c93-9494-438231931293 req-0258046e-43f5-4aec-b9fd-e088fb795d4f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:33.112223 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-08952c14-cf80-4c93-9494-438231931293 req-0258046e-43f5-4aec-b9fd-e088fb795d4f service nova] Creating event network-vif-deleted:c61586f5-275f-49e7-846f-8548057ffeab for instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 on n-h2-852086-5 Aug 27 04:01:33.117199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-08952c14-cf80-4c93-9494-438231931293 req-0258046e-43f5-4aec-b9fd-e088fb795d4f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032246 Aug 27 04:01:33.117799 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3510/6731] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:33.359352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:33.359991 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:33.367591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:33.368319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:33.368917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:33.369890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:33.370391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:33.370837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:33.444548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:33.452686 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af6dd101-a6ee-42ba-bf7a-019b315fe613 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1229 microversion: 2.1 time: 0.098442 Aug 27 04:01:33.453269 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3222/6732] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:33 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:34.474744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:34.475450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:34.481901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:34.482416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:34.482854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:34.483978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:34.484440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:34.484867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:34.555472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:34.564526 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-42b54a2d-886b-42f1-8ac4-69709b2ae4b8 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1229 microversion: 2.1 time: 0.094815 Aug 27 04:01:34.565110 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3511/6733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:34 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:35.586987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:35.587661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:35.594884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:35.595390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:35.595847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:35.596567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:35.597140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:35.597588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:35.663954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:35.672793 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecf5c8f6-8df0-40a2-9fe0-df0c40750c6b tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1229 microversion: 2.1 time: 0.089744 Aug 27 04:01:35.673390 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3223/6734] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:35 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:36.695218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:36.695218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:36.702516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:36.702997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:36.703425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:36.704121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:36.704569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:36.704987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:36.770942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093a2b5db3b64e01b4b2f891246fc64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865a493961694d77b60ba33be0a43867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:36.779464 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a391830c-ce60-4a23-80f0-d822d61b4fc3 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 200 len: 1229 microversion: 2.1 time: 0.088840 Aug 27 04:01:36.780236 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3512/6735] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:36 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:37.800336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:37.800879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] [instance: 41e51918-b41c-4c2c-a5f2-6ade73df29d2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:37.808177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:37.808679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:37.809131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:37.810918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:37.811405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:37.811848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:37.826529 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] HTTP exception thrown: Instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 could not be found. Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Request method failure captured: Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 HTTP/1.1 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZZr5GH13swB3wdxxHP0Zgxwl1y52eEtV2TSlx1aqMGQzh6MmBGhMRZjK_IE7KfO9SYW5aL1NWEgwy4cfYLU9feLMBddlEKBf9k2mM1J2qsi4Gm0ZVcvlJQYnsYGhMPTA3Nm2DacvFmP8-6wZC333DQNXmGkTZfr1vlHlYgCyzspgZI Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 865a493961694d77b60ba33be0a43867 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBackupRestore-1526840447 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/865a493961694d77b60ba33be0a43867"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/865a493961694d77b60ba33be0a43867"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_865a493961694d77b60ba33be0a43867", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/865a493961694d77b60ba33be0a43867"}]}] Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBackupRestore-1526840447 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 865a493961694d77b60ba33be0a43867 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1526840447 Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBackupRestore-1526840447-project Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 093a2b5db3b64e01b4b2f891246fc64c Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBackupRestore-1526840447-project Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 could not be found. Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '41e51918-b41c-4c2c-a5f2-6ade73df29d2'} Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 could not be found. Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 could not be found. Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:01:37.828283 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 could not be found. Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Returning 404 to user: Instance 41e51918-b41c-4c2c-a5f2-6ade73df29d2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34e7e940-0947-4159-9544-cebb02017b54 tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2" status: 404 len: 111 microversion: 2.1 time: 0.033379 Aug 27 04:01:37.832134 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3224/6736] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:37 2022] GET /compute/v2.1/servers/41e51918-b41c-4c2c-a5f2-6ade73df29d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:01:37.992305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5c1f8d9-2132-4c46-8710-6a18c5dfa2be tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] Calling method '.version_select at 0x7fe4568f1d30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:38.014564 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5c1f8d9-2132-4c46-8710-6a18c5dfa2be tempest-TestVolumeBackupRestore-1526840447 tempest-TestVolumeBackupRestore-1526840447-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1729280903" status: 202 len: 0 microversion: 2.1 time: 0.025737 Aug 27 04:01:38.015150 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3513/6737] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 04:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1729280903 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:02:00.305351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:00.306197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:00.418082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1324730529", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:00.472294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:02:00.670658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:02:00.671103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:02:00.671597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:02:00.672029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:02:00.672465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:02:00.681756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:00.682286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:00.682742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:00.683511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:00.683977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:00.684803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:00.703406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Getting quotas for project eff66e2b01a7444daab8a3a03ff44634. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:02:00.708705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Getting quotas for user 076c652bef0641d4bab19bb7895c1861 and project eff66e2b01a7444daab8a3a03ff44634. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:02:00.721437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:02:00.723764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:02:00.774653 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-634a4587-8d9a-48c2-8ef2-3e2d07805694 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474284 Aug 27 04:02:00.777514 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3225/6738] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:02:00.785875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=22 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:00.787002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:00.791081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02a980f0-0879-489b-9946-5c0d5dbd18b8 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:00.791887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02a980f0-0879-489b-9946-5c0d5dbd18b8 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:00.848697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02a980f0-0879-489b-9946-5c0d5dbd18b8 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:00.855626 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02a980f0-0879-489b-9946-5c0d5dbd18b8 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1222 microversion: 2.1 time: 0.071712 Aug 27 04:02:00.856429 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3514/6739] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:00 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:01.877066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c773ea4b-2abc-40a5-a331-e080ae5d76c0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:01.877690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c773ea4b-2abc-40a5-a331-e080ae5d76c0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:01.931722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c773ea4b-2abc-40a5-a331-e080ae5d76c0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:01.939675 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c773ea4b-2abc-40a5-a331-e080ae5d76c0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1222 microversion: 2.1 time: 0.067371 Aug 27 04:02:01.940236 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3226/6740] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:01 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:02.961961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:02.962798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:02.972561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:02.973217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:02.973690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:02.974434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:02.974891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:02.975347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:03.050886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:03.059953 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c62e7735-aae2-4c05-a7fa-870908495e61 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1292 microversion: 2.1 time: 0.101924 Aug 27 04:02:03.060713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3515/6741] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:02 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:02:04.081859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:04.083151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:04.092561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:04.093447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:04.094132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:04.095123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:04.095916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:04.096587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:04.329053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:04.336855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-581d4377-59bc-4390-9cba-d83eabc003f3 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1322 microversion: 2.1 time: 0.259413 Aug 27 04:02:04.337435 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3227/6742] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:04 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:04.718701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6568d516-03df-4536-94ec-73e1c9ad48c3 req-f154c911-f3cf-4d2c-aec9-25a300291082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b65189b-4011-45b8-bd7f-3c89b7f174c3", "tag": "4b3f6a94-e19a-4d36-ad9f-a2f88599c616"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:04.729443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6568d516-03df-4536-94ec-73e1c9ad48c3 req-f154c911-f3cf-4d2c-aec9-25a300291082 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:04.729920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6568d516-03df-4536-94ec-73e1c9ad48c3 req-f154c911-f3cf-4d2c-aec9-25a300291082 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:04.730408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6568d516-03df-4536-94ec-73e1c9ad48c3 req-f154c911-f3cf-4d2c-aec9-25a300291082 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:04.742508 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6568d516-03df-4536-94ec-73e1c9ad48c3 req-f154c911-f3cf-4d2c-aec9-25a300291082 service nova] Creating event network-changed:4b3f6a94-e19a-4d36-ad9f-a2f88599c616 for instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 on n-h2-852086-5 Aug 27 04:02:04.748092 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6568d516-03df-4536-94ec-73e1c9ad48c3 req-f154c911-f3cf-4d2c-aec9-25a300291082 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034264 Aug 27 04:02:04.748718 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3516/6743] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:05.361208 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:05.361724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:05.368622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:05.369120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:05.369573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:05.370318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:05.370789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:05.371228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:05.519706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:05.528349 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1738a088-aeba-4d2d-a5f1-598a3ef1b0a6 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1322 microversion: 2.1 time: 0.170742 Aug 27 04:02:05.529310 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3228/6744] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:05 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:02:06.551007 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:06.551708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:06.558054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:06.558587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:06.560322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:06.561032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:06.561490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:06.561914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:06.697583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:06.705612 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-39cab16f-5e80-40f8-9cb6-d09aca8b128e tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1322 microversion: 2.1 time: 0.159680 Aug 27 04:02:06.706220 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3517/6745] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:06 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:07.727386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:07.727963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:07.735554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:07.736058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:07.736509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:07.737216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:07.737692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:07.738131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:07.867825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:07.875925 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6cc9abb3-db8b-4026-a8b1-9b03a2cfbc18 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1322 microversion: 2.1 time: 0.152750 Aug 27 04:02:07.876501 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3229/6746] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:07 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:08.897234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:08.897771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:08.904778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:08.905269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:08.905703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:08.906459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:08.906915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:08.907344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:09.047451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:09.056432 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c33361c-5d49-49e1-9b4a-78ac7d0281a0 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1322 microversion: 2.1 time: 0.163373 Aug 27 04:02:09.057008 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3518/6747] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:08 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:10.077598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:10.078278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:10.085172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:10.085711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:10.086187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:10.086911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:10.087384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:10.087828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:10.222874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:10.230550 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29122848-53cc-42e0-9e02-c7c37b7bc9e1 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1322 microversion: 2.1 time: 0.157505 Aug 27 04:02:10.231141 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3230/6748] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:10 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:10.511261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6ec0acce-6c7c-4153-b98d-7b9e21c5fbeb req-468b13b9-e80f-4ac2-8d70-c5c38e62125b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b65189b-4011-45b8-bd7f-3c89b7f174c3", "name": "network-vif-plugged", "status": "completed", "tag": "4b3f6a94-e19a-4d36-ad9f-a2f88599c616"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:10.522428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ec0acce-6c7c-4153-b98d-7b9e21c5fbeb req-468b13b9-e80f-4ac2-8d70-c5c38e62125b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:10.522909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ec0acce-6c7c-4153-b98d-7b9e21c5fbeb req-468b13b9-e80f-4ac2-8d70-c5c38e62125b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:10.523335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6ec0acce-6c7c-4153-b98d-7b9e21c5fbeb req-468b13b9-e80f-4ac2-8d70-c5c38e62125b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:10.535296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6ec0acce-6c7c-4153-b98d-7b9e21c5fbeb req-468b13b9-e80f-4ac2-8d70-c5c38e62125b service nova] Creating event network-vif-plugged:4b3f6a94-e19a-4d36-ad9f-a2f88599c616 for instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 on n-h2-852086-5 Aug 27 04:02:10.540364 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6ec0acce-6c7c-4153-b98d-7b9e21c5fbeb req-468b13b9-e80f-4ac2-8d70-c5c38e62125b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032853 Aug 27 04:02:10.540971 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3519/6749] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:11.251710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:11.252343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:11.254445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:11.261027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:11.261537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:11.261989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:11.263052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:11.263538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:11.263987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:11.420021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:11.428583 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e62835a-262d-442c-9da4-542c1b4a24c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1322 microversion: 2.1 time: 0.180720 Aug 27 04:02:11.429314 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3231/6750] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:11 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:02:12.446390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:12.453452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:12.454179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:12.462324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:12.462807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:12.463248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:12.463957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:12.464438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:12.464852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:12.601158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:12.609313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4c54c13-5358-4a6c-98d2-922a07e19086 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1472 microversion: 2.1 time: 0.163989 Aug 27 04:02:12.610078 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3520/6751] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:12 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:12.634262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:12.685934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e50e37d-fe20-45fe-bc67-ca5aaaeab750 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Calling method '.version_select at 0x7fe4573b7790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:12.756311 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e50e37d-fe20-45fe-bc67-ca5aaaeab750 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/304ac68195824fd6b30101943a4217d9" status: 200 len: 371 microversion: 2.1 time: 0.126535 Aug 27 04:02:12.756878 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3232/6752] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 04:02:12 2022] GET /compute/v2.1/os-quota-sets/304ac68195824fd6b30101943a4217d9 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:02:12.768810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-affc4388-0276-4630-93e3-9967254a958e tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-224792838", "id": 1598526076, "os-flavor-access:is_public": "True"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:12.786279 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-affc4388-0276-4630-93e3-9967254a958e tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021059 Aug 27 04:02:12.786790 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3521/6753] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:02:12 2022] POST /compute/v2.1/flavors => generated 437 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:12.798430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1598526076"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:12.800658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:12.806693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:12.807190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:12.807638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:12.808339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:12.808806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:12.810291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:12.900706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '25cc80ebc62343aaa062092eb579094a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ac68195824fd6b30101943a4217d9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:12.907433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-224792838 {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:02:12.913819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:12.914346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:12.914795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:12.915537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:12.916005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:12.916446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:12.936783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Getting quotas for project eff66e2b01a7444daab8a3a03ff44634. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:02:12.942075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Getting quotas for user 076c652bef0641d4bab19bb7895c1861 and project eff66e2b01a7444daab8a3a03ff44634. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:02:12.955305 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] ram quota exceeded for 304ac68195824fd6b30101943a4217d9, tried to resize instance. Aug 27 04:02:12.955853 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Request method failure captured: Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3/action HTTP/1.1 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 39 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZc4c7wcoZisyqsQK2CTbTKMK5SfIyzkDENFEH_I8z9MixPk0TL3l2O-iz3mpdttTFzv0VrP_vyXc1XOqRQpTV-Twoz-144hOV5I5CAoP7z1EsExvdP9FJhzd-Tk4rFwaGdCCQqiajnAuPMhodL3GcCIz9BGU5ncXh1fx1_NhuRiN00 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 304ac68195824fd6b30101943a4217d9 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1845813025 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Role: admin,member,reader Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: admin,member,reader Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ac68195824fd6b30101943a4217d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ac68195824fd6b30101943a4217d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ac68195824fd6b30101943a4217d9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ac68195824fd6b30101943a4217d9"}]}] Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1845813025 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 304ac68195824fd6b30101943a4217d9 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1845813025 Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-1845813025-project-admin Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 25cc80ebc62343aaa062092eb579094a Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1845813025-project-admin Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: {"resize": {"flavorRef": "1598526076"}} Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3b65189b-4011-45b8-bd7f-3c89b7f174c3', 'body': {'resize': {'flavorRef': '1598526076'}}} Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:02:12.959332 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:02:12.963543 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-84d9f0f3-eb06-4d2e-82cf-1b1dc30b2c85 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3/action" status: 403 len: 118 microversion: 2.1 time: 0.166189 Aug 27 04:02:12.967280 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3233/6754] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:02:12 2022] POST /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3/action => generated 118 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:02:12.970194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aef086a7-300e-459c-a724-50f53c438700 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:12.987186 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aef086a7-300e-459c-a724-50f53c438700 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1598526076" status: 202 len: 0 microversion: 2.1 time: 0.020738 Aug 27 04:02:12.987755 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3522/6755] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 04:02:12 2022] DELETE /compute/v2.1/flavors/1598526076 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:02:12.995849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ca50292-2b29-4b4b-bbe3-4da057c46e58 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:13.017638 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ca50292-2b29-4b4b-bbe3-4da057c46e58 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025539 Aug 27 04:02:13.018209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3234/6756] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 04:02:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:13.037363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0b701f46-b56c-4867-bca5-b649395657f2 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Calling method '.version_select at 0x7fe456884550>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:13.114872 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0b701f46-b56c-4867-bca5-b649395657f2 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "GET /compute/v2.1/os-quota-sets/304ac68195824fd6b30101943a4217d9" status: 200 len: 371 microversion: 2.1 time: 0.081231 Aug 27 04:02:13.115455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3523/6757] 10.222.0.69 () {58 vars in 1242 bytes} [Sat Aug 27 04:02:13 2022] GET /compute/v2.1/os-quota-sets/304ac68195824fd6b30101943a4217d9 => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:13.128398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b7b2dd3c-3143-4675-ba66-9d293e445a70 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1306859301", "id": 1694396090, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:13.146008 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b7b2dd3c-3143-4675-ba66-9d293e445a70 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021286 Aug 27 04:02:13.146625 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3235/6758] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:02:13 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:02:13.159094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1694396090"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:13.161389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:13.167527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.168017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.168456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.169699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.170180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.170621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.361774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '25cc80ebc62343aaa062092eb579094a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304ac68195824fd6b30101943a4217d9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:13.368439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1306859301 {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:02:13.375894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.376375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.376811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.377536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.377991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.378451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.398482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Getting quotas for project eff66e2b01a7444daab8a3a03ff44634. Resources: {'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:02:13.403627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Getting quotas for user 076c652bef0641d4bab19bb7895c1861 and project eff66e2b01a7444daab8a3a03ff44634. Resources: {'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:02:13.415549 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.compute.api [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] cores quota exceeded for 304ac68195824fd6b30101943a4217d9, tried to resize instance. Aug 27 04:02:13.416120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Request method failure captured: Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3/action HTTP/1.1 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 39 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZc4c7wcoZisyqsQK2CTbTKMK5SfIyzkDENFEH_I8z9MixPk0TL3l2O-iz3mpdttTFzv0VrP_vyXc1XOqRQpTV-Twoz-144hOV5I5CAoP7z1EsExvdP9FJhzd-Tk4rFwaGdCCQqiajnAuPMhodL3GcCIz9BGU5ncXh1fx1_NhuRiN00 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 304ac68195824fd6b30101943a4217d9 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1845813025 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Role: admin,member,reader Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: admin,member,reader Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/304ac68195824fd6b30101943a4217d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ac68195824fd6b30101943a4217d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_304ac68195824fd6b30101943a4217d9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/304ac68195824fd6b30101943a4217d9"}]}] Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1845813025 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 304ac68195824fd6b30101943a4217d9 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1845813025 Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersAdminNegativeTestJSON-1845813025-project-admin Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 25cc80ebc62343aaa062092eb579094a Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1845813025-project-admin Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: {"resize": {"flavorRef": "1694396090"}} Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '3b65189b-4011-45b8-bd7f-3c89b7f174c3', 'body': {'resize': {'flavorRef': '1694396090'}}} Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:02:13.418132 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1234fb50-c599-4ebc-8015-18ce08f59596 tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "POST /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3/action" status: 403 len: 113 microversion: 2.1 time: 0.265351 Aug 27 04:02:13.422662 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3524/6759] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:02:13 2022] POST /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3/action => generated 113 bytes in 268 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:02:13.429841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-564de93d-bd6c-4e78-879d-821fe689732a tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:13.447828 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-564de93d-bd6c-4e78-879d-821fe689732a tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "DELETE /compute/v2.1/flavors/1694396090" status: 202 len: 0 microversion: 2.1 time: 0.021825 Aug 27 04:02:13.448386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3236/6760] 10.222.0.69 () {58 vars in 1161 bytes} [Sat Aug 27 04:02:13 2022] DELETE /compute/v2.1/flavors/1694396090 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:02:13.456699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-930b011d-f1d8-4a3d-9266-8f434d54fe2a tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:13.478313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-930b011d-f1d8-4a3d-9266-8f434d54fe2a tempest-ServersAdminNegativeTestJSON-1845813025 tempest-ServersAdminNegativeTestJSON-1845813025-project-admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025176 Aug 27 04:02:13.478886 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3525/6761] 10.222.0.69 () {58 vars in 1146 bytes} [Sat Aug 27 04:02:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:13.500322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:13.500822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:13.506800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.507297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.507745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.508451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.508916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.509355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.536205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:02:13.615455 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75b85a57-7718-4007-9de6-856f61143419 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 204 len: 0 microversion: 2.1 time: 0.119683 Aug 27 04:02:13.615959 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3237/6762] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:02:13 2022] DELETE /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:02:13.624895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:13.625510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:13.632807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.633299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.633743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.634493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:13.634979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:13.635459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:13.775721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:13.784416 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-522365dc-7a3c-491c-bbbb-d9e6dd0321c4 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1478 microversion: 2.1 time: 0.164267 Aug 27 04:02:13.785004 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3526/6763] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:13 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1478 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:14.807491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:14.808225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:14.816365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:14.816886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:14.817337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:14.818067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:14.818566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:14.819009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:14.959738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076c652bef0641d4bab19bb7895c1861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff66e2b01a7444daab8a3a03ff44634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:14.968354 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4b4e36e-0eba-441b-9db8-1e6d2d88aa79 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 200 len: 1478 microversion: 2.1 time: 0.165208 Aug 27 04:02:14.968956 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3238/6764] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:14 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 1478 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:15.449356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-354eed81-39f3-4a97-b025-bc65be49babc req-cfbfd0bc-9024-4157-8c7a-a58b6cc0ee39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b65189b-4011-45b8-bd7f-3c89b7f174c3", "name": "network-vif-deleted", "tag": "4b3f6a94-e19a-4d36-ad9f-a2f88599c616"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:15.465957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-354eed81-39f3-4a97-b025-bc65be49babc req-cfbfd0bc-9024-4157-8c7a-a58b6cc0ee39 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:15.466927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-354eed81-39f3-4a97-b025-bc65be49babc req-cfbfd0bc-9024-4157-8c7a-a58b6cc0ee39 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:15.467599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-354eed81-39f3-4a97-b025-bc65be49babc req-cfbfd0bc-9024-4157-8c7a-a58b6cc0ee39 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:15.481525 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-354eed81-39f3-4a97-b025-bc65be49babc req-cfbfd0bc-9024-4157-8c7a-a58b6cc0ee39 service nova] Creating event network-vif-deleted:4b3f6a94-e19a-4d36-ad9f-a2f88599c616 for instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 on n-h2-852086-5 Aug 27 04:02:15.486939 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-354eed81-39f3-4a97-b025-bc65be49babc req-cfbfd0bc-9024-4157-8c7a-a58b6cc0ee39 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041207 Aug 27 04:02:15.487868 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3527/6765] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:15.989741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:15.990402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] [instance: 3b65189b-4011-45b8-bd7f-3c89b7f174c3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:15.997247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:15.997963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:15.998595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:15.999376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:16.000032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:16.000473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:16.021064 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] HTTP exception thrown: Instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 could not be found. Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Request method failure captured: Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 HTTP/1.1 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZc3vpneUPtXIsrPI8FGPmQuvURDMSnXyKaQImC45tQcQA9_WHqFBQFqa57jWg_QH6gLYjpprkEJtG2Haiv88uxN9sNuRk-23LNbJgPqAO7q25EzbUGu0x9ZVIqNZHlXbcpvf7k2ClPsFeklT_ik-Ddtqi47oNOwzGea2fDQzefyrdo Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: eff66e2b01a7444daab8a3a03ff44634 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-633083219 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/eff66e2b01a7444daab8a3a03ff44634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/eff66e2b01a7444daab8a3a03ff44634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_eff66e2b01a7444daab8a3a03ff44634", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/eff66e2b01a7444daab8a3a03ff44634"}]}] Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-633083219 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: eff66e2b01a7444daab8a3a03ff44634 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-633083219 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-633083219-project Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 076c652bef0641d4bab19bb7895c1861 Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-633083219-project Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 could not be found. Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3b65189b-4011-45b8-bd7f-3c89b7f174c3'} Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 could not be found. Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 could not be found. Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:16.022768 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 could not be found. Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] Returning 404 to user: Instance 3b65189b-4011-45b8-bd7f-3c89b7f174c3 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:02:16.026214 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4dd4a525-52af-4e47-9227-fe606e740f84 tempest-ServersAdminNegativeTestJSON-633083219 tempest-ServersAdminNegativeTestJSON-633083219-project] 10.222.0.69 "GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3" status: 404 len: 111 microversion: 2.1 time: 0.039120 Aug 27 04:02:16.028411 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3239/6766] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:15 2022] GET /compute/v2.1/servers/3b65189b-4011-45b8-bd7f-3c89b7f174c3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:02:22.257689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1322295092", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "88fe9a9a-13c6-4265-bbaa-d7b73eb25b31"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:22.313360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] validate_networks() for [('88fe9a9a-13c6-4265-bbaa-d7b73eb25b31', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:02:22.706039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:02:22.706503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:02:22.706973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:02:22.707382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:02:22.707786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:02:22.717427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:22.717910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:22.718378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:22.719105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:22.719561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:22.719986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:22.737016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Getting quotas for project 262ce4d4eff04b87b5f29bc4bd7a0b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:02:22.742361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Getting quotas for user cff208e6ea9b462da7e4412e8a8e7b0b and project 262ce4d4eff04b87b5f29bc4bd7a0b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:02:22.755082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:02:22.757481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:02:22.803535 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-86fcb4ae-a84e-45a7-a47e-397f94ff2106 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671778 Aug 27 04:02:22.804395 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3528/6767] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:02:22.816496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-489f81fa-25b3-46a1-8a0a-f2de26b0e47e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:22.817247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-489f81fa-25b3-46a1-8a0a-f2de26b0e47e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:22.819767 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:02:22.820034 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:02:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b (ip 10.222.0.69) !!! Aug 27 04:02:22.822445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:22.899551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-489f81fa-25b3-46a1-8a0a-f2de26b0e47e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:22.907278 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-489f81fa-25b3-46a1-8a0a-f2de26b0e47e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1215 microversion: 2.1 time: 0.095279 Aug 27 04:02:22.907855 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3240/6768] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:22 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:23.928940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:23.929570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:23.938956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:23.939448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:23.939879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:23.940821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:23.941352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:23.941716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:24.010875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:24.020326 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9470836-97e9-4d60-abb7-df31914407f0 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1267 microversion: 2.1 time: 0.096070 Aug 27 04:02:24.021487 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3529/6769] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:23 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:25.041988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:25.042960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:25.045020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:25.060140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:25.060659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:25.061118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:25.061860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:25.062360 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:25.063059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:25.545422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:25.555828 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21b01188-3f1a-4853-a7aa-4aa7a031fdb2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.517661 Aug 27 04:02:25.556743 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3241/6770] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:25 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:25.856495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-64e7d26b-f1a9-45f0-b057-f0587f473bde req-ad38dcc4-3fab-41cb-981e-abb899bb93e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c675363-03a3-4217-b0d1-78e868b13b1b", "tag": "ebc50f8c-08ec-4efb-828c-9150a91fa51c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:25.867447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-64e7d26b-f1a9-45f0-b057-f0587f473bde req-ad38dcc4-3fab-41cb-981e-abb899bb93e1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:25.867933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-64e7d26b-f1a9-45f0-b057-f0587f473bde req-ad38dcc4-3fab-41cb-981e-abb899bb93e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:25.868361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-64e7d26b-f1a9-45f0-b057-f0587f473bde req-ad38dcc4-3fab-41cb-981e-abb899bb93e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:25.884720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-64e7d26b-f1a9-45f0-b057-f0587f473bde req-ad38dcc4-3fab-41cb-981e-abb899bb93e1 service nova] Creating event network-changed:ebc50f8c-08ec-4efb-828c-9150a91fa51c for instance 7c675363-03a3-4217-b0d1-78e868b13b1b on n-h2-852086-5 Aug 27 04:02:25.890611 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-64e7d26b-f1a9-45f0-b057-f0587f473bde req-ad38dcc4-3fab-41cb-981e-abb899bb93e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037972 Aug 27 04:02:25.891235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3530/6771] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:26.577815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:26.578488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:26.585891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:26.586416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:26.586864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:26.587582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:26.588046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:26.588482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:26.731877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:26.740102 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32d90c0b-74ac-44a7-9d32-1a35c00a2973 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.166827 Aug 27 04:02:26.740684 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3242/6772] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:26 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:27.763307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:27.764018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:27.770256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:27.770753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:27.771192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:27.771891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:27.772349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:27.772778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:27.907542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:27.915153 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e21e7cf7-28a9-41d8-8af3-09a3f8c8f522 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.157871 Aug 27 04:02:27.915723 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3531/6773] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:27 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:28.935870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:28.936399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:28.943527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:28.944027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:28.944476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:28.945189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:28.945655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:28.946094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:29.080004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:29.088055 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb4e317d-6c98-4631-9fd8-8adc668bec5a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.156399 Aug 27 04:02:29.088620 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3243/6774] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:28 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:30.110850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:30.111464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:30.118277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:30.118762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:30.119200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:30.119889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:30.120344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:30.120765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:30.250059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:30.257734 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b592df03-cde1-4b9f-89ce-09cc680469ba tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.151750 Aug 27 04:02:30.258329 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3532/6775] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:30 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:31.280729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:31.281359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:31.284053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:31.289397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:31.289900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:31.290390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:31.291091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:31.291561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:31.291996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:31.296349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:31.439731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:31.447869 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7214033-3326-4918-944a-ee0a5fe1d370 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.172679 Aug 27 04:02:31.448441 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3244/6776] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:31 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:32.468942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:32.469552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:32.472352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:32.477583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:32.478071 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:32.478531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:32.479238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:32.479688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:32.480115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:32.483499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=72 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:32.626134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:32.636554 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-db74bae1-1872-404e-a922-273cff786aef tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.171600 Aug 27 04:02:32.637373 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3533/6777] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:32 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:32.763824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-83b21f74-05dd-476c-9e37-296531cca774 req-8a792ac7-69e6-4988-919f-66d88f5d2cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c675363-03a3-4217-b0d1-78e868b13b1b", "name": "network-vif-plugged", "status": "completed", "tag": "ebc50f8c-08ec-4efb-828c-9150a91fa51c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:32.775466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83b21f74-05dd-476c-9e37-296531cca774 req-8a792ac7-69e6-4988-919f-66d88f5d2cd9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:32.775971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83b21f74-05dd-476c-9e37-296531cca774 req-8a792ac7-69e6-4988-919f-66d88f5d2cd9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:32.776826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83b21f74-05dd-476c-9e37-296531cca774 req-8a792ac7-69e6-4988-919f-66d88f5d2cd9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:32.789551 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-83b21f74-05dd-476c-9e37-296531cca774 req-8a792ac7-69e6-4988-919f-66d88f5d2cd9 service nova] Creating event network-vif-plugged:ebc50f8c-08ec-4efb-828c-9150a91fa51c for instance 7c675363-03a3-4217-b0d1-78e868b13b1b on n-h2-852086-5 Aug 27 04:02:32.795462 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-83b21f74-05dd-476c-9e37-296531cca774 req-8a792ac7-69e6-4988-919f-66d88f5d2cd9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Aug 27 04:02:32.795888 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3245/6778] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:33.658533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:33.659073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:33.660916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=5 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:33.661569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:33.669069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:33.669560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:33.670003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:33.670733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:33.671191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:33.671617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:33.820790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:33.829416 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-23c759aa-1fb4-4d71-8046-25c7b3dacc1b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1315 microversion: 2.1 time: 0.174839 Aug 27 04:02:33.830007 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3534/6779] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:33 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:34.851518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:34.852241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:34.854221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:34.861952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:34.862487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:34.862944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:34.863660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:34.864131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:34.864575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:34.997783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:35.005601 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc8ca33f-9c9f-46b8-aea3-df29d6a7546d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1503 microversion: 2.1 time: 0.158352 Aug 27 04:02:35.006205 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3246/6780] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:34 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:35.026332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:35.028709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:35.036455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:35.037045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:35.037597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:35.038434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:35.039036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:35.039471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:35.071693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:35.079985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Old instance type m1.heat2, new instance type m1.heat {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:02:35.088030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:02:35.088457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:02:35.088934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:02:35.089345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:02:35.089759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:02:35.158253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b3371d6-2169-4fa3-b106-b6407ae5cbea tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "POST /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b/action" status: 202 len: 0 microversion: 2.1 time: 0.135890 Aug 27 04:02:35.159277 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3535/6781] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:02:35 2022] POST /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:02:35.167581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:35.169273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:35.178633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:35.179160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:35.179737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:35.180629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:35.181383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:35.182083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:35.342823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:35.351035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4578ef7e-58c4-4f95-a894-8df1c715c33a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1512 microversion: 2.1 time: 0.187792 Aug 27 04:02:35.351633 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3247/6782] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:35 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:36.373470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:36.373990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:36.383581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:36.384073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:36.384533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:36.385228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:36.385692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:36.386132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:36.797173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:36.805003 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5f2bcaf-9602-47a3-b314-36a013a19e30 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1512 microversion: 2.1 time: 0.437033 Aug 27 04:02:36.805576 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3536/6783] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:36 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:37.827708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:37.828361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:37.835171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:37.835668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:37.836114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:37.836818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:37.837284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:37.837720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:37.968646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:37.976474 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09d1fddf-a64a-498f-b1fc-23bfcbac0ded tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.153467 Aug 27 04:02:37.977052 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3248/6784] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:37 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:38.999215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:38.999814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:39.006834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:39.007328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:39.007763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:39.008929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:39.008929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:39.009311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:39.149950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:39.158239 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-223dc5ae-d4b2-49db-b7d0-1dfba521d7d4 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.163428 Aug 27 04:02:39.158813 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3537/6785] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:38 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:40.180550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:40.181379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:40.189290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:40.189796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:40.190285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:40.191044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:40.191514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:40.191963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:40.350921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:40.359482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb096807-d2e3-4654-a305-915eda814a14 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.183808 Aug 27 04:02:40.360054 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3249/6786] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:40 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:41.381018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:41.381623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:41.389412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:41.389917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:41.390398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:41.391097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:41.391560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:41.392018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:41.524391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:41.533774 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8cea883e-2b33-4268-b447-4f35bfc6f27b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.156565 Aug 27 04:02:41.534334 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3538/6787] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:41 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:42.556026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:42.556663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:42.564511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:42.564998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:42.565454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:42.566202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:42.566682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:42.567129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:42.703022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:42.711507 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb294188-fde2-4ea4-af96-d5b6f4bad8ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.159436 Aug 27 04:02:42.712092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3250/6788] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:42 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:43.737324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:43.737838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:43.744797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:43.745278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:43.745708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:43.746427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:43.746878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:43.747299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:43.897813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:43.906326 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d2bc44b-317e-4d0c-bcc5-3d7645f940ac tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.176696 Aug 27 04:02:43.906905 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3539/6789] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:43 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:44.927560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:44.928221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:44.936144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:44.936651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:44.937110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:44.938135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:44.938637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:44.939083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:45.077382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:45.086683 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e45abf99-edc2-44ca-9480-718d35bfaea1 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.162617 Aug 27 04:02:45.087774 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3251/6790] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:44 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:46.112378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:46.112916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:46.119915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:46.120408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:46.120861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:46.121580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:46.122035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:46.122494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:46.256731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:46.265512 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-568a721e-9f1a-427f-8438-052d47885ff7 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.157202 Aug 27 04:02:46.266085 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3540/6791] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:46 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:47.287018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:47.287642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:47.295291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:47.295790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:47.296259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:47.296970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:47.297438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:47.297875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:47.428801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:47.437069 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec9e1652-2d60-416e-94a2-78d9b3fd3061 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.153994 Aug 27 04:02:47.437656 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3252/6792] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:47 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:48.460730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:48.461342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:48.468329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:48.468824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:48.469267 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:48.469973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:48.470457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:48.470894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:48.611977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:48.619706 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4c8c58d3-a4b4-4382-ab9f-5fda2f5c90f8 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.164442 Aug 27 04:02:48.620277 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3541/6793] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:48 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:49.642272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:49.642817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:49.648877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:49.649375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:49.649837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:49.650605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:49.651075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:49.651514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:49.786846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:49.794731 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f561fcd8-f4a5-40f4-9a3e-c0f3cbb4d0dd tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.158117 Aug 27 04:02:49.795305 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3253/6794] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:49 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:50.816312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:50.816853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:50.823818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:50.824344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:50.825082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:50.825779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:50.826275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:50.826706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:50.961639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:50.970320 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d965674d-1f63-43aa-be6b-688cdcefe449 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.158215 Aug 27 04:02:50.971212 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3542/6795] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:50 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:51.992785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:51.993408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:52.000559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:52.001094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:52.001573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:52.002321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:52.002803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:52.003246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:52.141229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:52.149121 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0c8c8c5-7d35-42ef-804e-be41d5acd721 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.160266 Aug 27 04:02:52.149709 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3254/6796] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:51 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:53.171213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:53.171826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:53.178816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:53.179297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:53.179732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:53.180430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:53.180883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:53.181310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:53.316350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:53.325182 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10515dcd-cc0d-4802-adc3-08c7331264fe tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.157463 Aug 27 04:02:53.325781 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3543/6797] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:53 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:54.346636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:54.347290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:54.354637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:54.355645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:54.356105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:54.356855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:54.357327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:54.357772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:54.492031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:54.500106 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4aa000fa-ba82-4a51-9b83-9ccb2d2fd75b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.157349 Aug 27 04:02:54.500697 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3255/6798] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:54 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:55.525118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:55.525741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:55.533286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:55.533909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:55.534283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:55.535006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:55.535461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:55.535892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:55.678515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:55.686508 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38b04224-17f0-4a17-892c-cb7d7f26e54e tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.166390 Aug 27 04:02:55.687091 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3544/6799] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:55 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:56.708825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:56.709468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:56.717550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:56.718078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:56.718623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:56.719348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:56.719820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:56.720272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:56.865474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:56.873739 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26edfcaa-57a3-4cdb-9842-0418a87e7c17 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.169060 Aug 27 04:02:56.874532 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3256/6800] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:56 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:57.896451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:57.897062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:57.904095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:57.904578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:57.905012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:57.905706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:57.906183 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:57.906611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:58.036865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:58.044733 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d392d14-087a-441e-8111-b98a07932158 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.152162 Aug 27 04:02:58.045315 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3545/6801] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:57 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:59.066066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:59.066746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:59.074135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:59.074672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:59.075120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:59.075828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:59.076300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:59.076731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:59.207556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:59.217377 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47efed7e-8cef-4a95-b7d5-46fe6dd24983 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.155412 Aug 27 04:02:59.217987 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3257/6802] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:59 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:00.239133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:00.239708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:00.247198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:00.247690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:00.248157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:00.248864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:00.249320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:00.249756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:00.385408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:00.393949 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f409ff6-a950-49f6-8511-16148d1aa20d tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.158878 Aug 27 04:03:00.394555 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3546/6803] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:00 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:01.415201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:01.415829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:01.419062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=28 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:01.424365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:01.424865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:01.425313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:01.426028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:01.426531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:01.427062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:01.429732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=80 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:01.560290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:01.568461 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c902c7d8-fe48-4a3c-9592-3293aeb83a38 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.157215 Aug 27 04:03:01.569064 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3258/6804] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:01 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:02.592588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:02.593618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:02.597789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=32 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:02.607253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:02.608137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:02.608965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:02.609829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:02.610315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:02.610748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:02.613469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:02.751142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:02.758890 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b27cde33-e4e1-4f54-858c-44185a2b14d3 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.173334 Aug 27 04:03:02.759471 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3547/6805] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:02 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:03.781586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:03.782222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:03.790357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:03.790916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:03.791410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:03.792252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:03.792943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:03.793485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:04.013302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:04.023056 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45cc98ea-653c-4679-bc86-8b940329681b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1517 microversion: 2.1 time: 0.245311 Aug 27 04:03:04.023665 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3259/6806] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:03 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:04.825460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e016cc83-ce22-4f3e-9e28-a8c564c1d887 req-4de43f4e-125f-4b94-8fe3-4afed110270a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c675363-03a3-4217-b0d1-78e868b13b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "ebc50f8c-08ec-4efb-828c-9150a91fa51c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:04.835701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e016cc83-ce22-4f3e-9e28-a8c564c1d887 req-4de43f4e-125f-4b94-8fe3-4afed110270a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:04.836213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e016cc83-ce22-4f3e-9e28-a8c564c1d887 req-4de43f4e-125f-4b94-8fe3-4afed110270a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:04.836690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e016cc83-ce22-4f3e-9e28-a8c564c1d887 req-4de43f4e-125f-4b94-8fe3-4afed110270a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:04.852112 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e016cc83-ce22-4f3e-9e28-a8c564c1d887 req-4de43f4e-125f-4b94-8fe3-4afed110270a service nova] Creating event network-vif-unplugged:ebc50f8c-08ec-4efb-828c-9150a91fa51c for instance 7c675363-03a3-4217-b0d1-78e868b13b1b on n-h1-852086-5 Aug 27 04:03:04.858074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-e016cc83-ce22-4f3e-9e28-a8c564c1d887 req-4de43f4e-125f-4b94-8fe3-4afed110270a service nova] Instance 7c675363-03a3-4217-b0d1-78e868b13b1b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:03:04.876851 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e016cc83-ce22-4f3e-9e28-a8c564c1d887 req-4de43f4e-125f-4b94-8fe3-4afed110270a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048711 Aug 27 04:03:04.876851 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3548/6807] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:05.046311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:05.046957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:05.055498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:05.056010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:05.056470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:05.057206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:05.057679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:05.059255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:05.289251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:05.297332 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f24e37cb-35fe-484a-89d8-090f0cae4c4f tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1516 microversion: 2.1 time: 0.255987 Aug 27 04:03:05.298075 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3260/6808] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:05 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:06.321641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:06.322369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:06.329219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:06.329703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:06.330141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:06.330930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:06.331385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:06.331812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:06.462874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:06.471370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-44173463-8289-4f81-b3d0-d85f158e423c tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1514 microversion: 2.1 time: 0.155003 Aug 27 04:03:06.471948 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3549/6809] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:06 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:06.894606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5457fe8e-4542-46d6-b5bc-11ddf6e60d69 req-463f1482-0981-4738-8d69-25182accb96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c675363-03a3-4217-b0d1-78e868b13b1b", "tag": "ebc50f8c-08ec-4efb-828c-9150a91fa51c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:06.905017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5457fe8e-4542-46d6-b5bc-11ddf6e60d69 req-463f1482-0981-4738-8d69-25182accb96d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:06.905440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5457fe8e-4542-46d6-b5bc-11ddf6e60d69 req-463f1482-0981-4738-8d69-25182accb96d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:06.905880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5457fe8e-4542-46d6-b5bc-11ddf6e60d69 req-463f1482-0981-4738-8d69-25182accb96d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:06.917168 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5457fe8e-4542-46d6-b5bc-11ddf6e60d69 req-463f1482-0981-4738-8d69-25182accb96d service nova] Creating event network-changed:ebc50f8c-08ec-4efb-828c-9150a91fa51c for instance 7c675363-03a3-4217-b0d1-78e868b13b1b on n-h1-852086-5 Aug 27 04:03:06.922472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-5457fe8e-4542-46d6-b5bc-11ddf6e60d69 req-463f1482-0981-4738-8d69-25182accb96d service nova] Instance 7c675363-03a3-4217-b0d1-78e868b13b1b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:03:06.933817 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5457fe8e-4542-46d6-b5bc-11ddf6e60d69 req-463f1482-0981-4738-8d69-25182accb96d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042197 Aug 27 04:03:06.934439 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3261/6810] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:07.492397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:07.493044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:07.501174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:07.501666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:07.502113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:07.502848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:07.503378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:07.503822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:07.656127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:07.664097 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0f0c4ef2-c32b-4531-b969-9b966479e5af tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1511 microversion: 2.1 time: 0.175658 Aug 27 04:03:07.664671 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3550/6811] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:07 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:07.685128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:07.685778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:07.692335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:07.692832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:07.693282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:07.693992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:07.694493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:07.694937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:07.721859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:03:07.771700 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Found an unconfirmed migration during delete, id: 16, status: finished Aug 27 04:03:09.919734 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af1d3884-5b00-4d3f-8630-6c0c7c91f8c2 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 204 len: 0 microversion: 2.1 time: 2.237600 Aug 27 04:03:09.920445 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3262/6812] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:03:07 2022] DELETE /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 0 bytes in 2240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:03:09.930800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:09.931424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:09.939709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:09.940206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:09.940649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:09.941361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:09.941821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:09.942278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:09.965168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0e3091d3-49b9-4fd7-945b-c12bdb00da7e req-64db51b9-f406-467e-996d-68badaac281e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c675363-03a3-4217-b0d1-78e868b13b1b", "name": "network-vif-plugged", "status": "completed", "tag": "ebc50f8c-08ec-4efb-828c-9150a91fa51c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:09.979278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0e3091d3-49b9-4fd7-945b-c12bdb00da7e req-64db51b9-f406-467e-996d-68badaac281e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:09.980087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0e3091d3-49b9-4fd7-945b-c12bdb00da7e req-64db51b9-f406-467e-996d-68badaac281e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:09.980533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0e3091d3-49b9-4fd7-945b-c12bdb00da7e req-64db51b9-f406-467e-996d-68badaac281e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:09.993665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0e3091d3-49b9-4fd7-945b-c12bdb00da7e req-64db51b9-f406-467e-996d-68badaac281e service nova] Creating event network-vif-plugged:ebc50f8c-08ec-4efb-828c-9150a91fa51c for instance 7c675363-03a3-4217-b0d1-78e868b13b1b on n-h1-852086-5 Aug 27 04:03:10.000412 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0e3091d3-49b9-4fd7-945b-c12bdb00da7e req-64db51b9-f406-467e-996d-68badaac281e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040781 Aug 27 04:03:10.001286 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3263/6813] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:10.138688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:10.146501 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9cd2b8ec-c0e3-4db3-94eb-9c39bf780478 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1503 microversion: 2.1 time: 0.221243 Aug 27 04:03:10.147077 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3551/6814] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:09 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:11.169188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:11.169907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:11.176966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:11.177462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:11.177910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:11.179000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:11.179469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:11.179906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:11.484703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:11.493045 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e8cce7e-2218-496e-8275-ebed8a80f4ee tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1503 microversion: 2.1 time: 0.329293 Aug 27 04:03:11.493825 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3264/6815] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:11 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:11.841056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-a8653729-e442-4e12-ad15-f1bdf14736ad req-7f837691-335c-4d3b-ac78-9d43eb42554d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c675363-03a3-4217-b0d1-78e868b13b1b", "name": "network-vif-deleted", "tag": "ebc50f8c-08ec-4efb-828c-9150a91fa51c"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:11.855581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a8653729-e442-4e12-ad15-f1bdf14736ad req-7f837691-335c-4d3b-ac78-9d43eb42554d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:11.856651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a8653729-e442-4e12-ad15-f1bdf14736ad req-7f837691-335c-4d3b-ac78-9d43eb42554d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:11.857102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-a8653729-e442-4e12-ad15-f1bdf14736ad req-7f837691-335c-4d3b-ac78-9d43eb42554d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:11.869931 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-a8653729-e442-4e12-ad15-f1bdf14736ad req-7f837691-335c-4d3b-ac78-9d43eb42554d service nova] Creating event network-vif-deleted:ebc50f8c-08ec-4efb-828c-9150a91fa51c for instance 7c675363-03a3-4217-b0d1-78e868b13b1b on n-h1-852086-5 Aug 27 04:03:11.876712 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-a8653729-e442-4e12-ad15-f1bdf14736ad req-7f837691-335c-4d3b-ac78-9d43eb42554d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040539 Aug 27 04:03:11.877963 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3552/6816] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:12.516582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:12.517131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:12.524924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:12.525432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:12.525905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:12.527092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:12.527672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:12.528098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:12.567932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:12.568512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:12.568939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:12.569402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lazy-loading 'fault' on Instance uuid 7c675363-03a3-4217-b0d1-78e868b13b1b {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:03:12.615121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff208e6ea9b462da7e4412e8a8e7b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ce4d4eff04b87b5f29bc4bd7a0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:12.623511 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c00fef1-617d-4266-9e85-288eeea891d9 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 200 len: 1305 microversion: 2.1 time: 0.112199 Aug 27 04:03:12.624118 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3265/6817] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:12 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:13.645614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:13.646340 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:13.653594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:13.654078 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:13.654827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:13.655529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:13.655983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:13.656412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:13.669858 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] HTTP exception thrown: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Request method failure captured: Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b HTTP/1.1 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZdNndF6bLJePb-b_-9evEvtogBFRxIMvgZ_KuEGkqMwAbIks3jy-8zUJvVIv1WaqT_NyKPzZrOrAyCIU5cDzATTKo5_yM_p-iInzcTj1j8avu6IwU_BeSzr8fh8XmG-HKHN-XppmMUjUgRqRBCxrxwftLLgABlaoyKqQOLcb3jb2Ow Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 262ce4d4eff04b87b5f29bc4bd7a0b12 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_262ce4d4eff04b87b5f29bc4bd7a0b12", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}] Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 262ce4d4eff04b87b5f29bc4bd7a0b12 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-395429801-project Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: cff208e6ea9b462da7e4412e8a8e7b0b Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-395429801-project Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7c675363-03a3-4217-b0d1-78e868b13b1b'} Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:03:13.671545 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Returning 404 to user: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6714507a-0033-4c81-85b9-5501439caf71 tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 404 len: 111 microversion: 2.1 time: 0.031612 Aug 27 04:03:13.675847 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3553/6818] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:13 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:13.686253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:13.686806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:13.693933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:13.694470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:13.694923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:13.695632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:13.696099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:13.696536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:13.710825 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] HTTP exception thrown: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Request method failure captured: Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b HTTP/1.1 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZdNndF6bLJePb-b_-9evEvtogBFRxIMvgZ_KuEGkqMwAbIks3jy-8zUJvVIv1WaqT_NyKPzZrOrAyCIU5cDzATTKo5_yM_p-iInzcTj1j8avu6IwU_BeSzr8fh8XmG-HKHN-XppmMUjUgRqRBCxrxwftLLgABlaoyKqQOLcb3jb2Ow Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 262ce4d4eff04b87b5f29bc4bd7a0b12 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_262ce4d4eff04b87b5f29bc4bd7a0b12", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}] Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 262ce4d4eff04b87b5f29bc4bd7a0b12 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-395429801-project Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: cff208e6ea9b462da7e4412e8a8e7b0b Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-395429801-project Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '7c675363-03a3-4217-b0d1-78e868b13b1b'} Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:03:13.712552 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Returning 404 to user: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01cd8c94-c1ce-4c68-a502-74f4c702377b tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 404 len: 111 microversion: 2.1 time: 0.032359 Aug 27 04:03:13.717257 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3266/6819] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:03:13 2022] DELETE /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:13.723023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:13.723671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] [instance: 7c675363-03a3-4217-b0d1-78e868b13b1b] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:13.729620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:13.730104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:13.730572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:13.732012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:13.732473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:13.732899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:13.745980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] HTTP exception thrown: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Request method failure captured: Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b HTTP/1.1 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZdNndF6bLJePb-b_-9evEvtogBFRxIMvgZ_KuEGkqMwAbIks3jy-8zUJvVIv1WaqT_NyKPzZrOrAyCIU5cDzATTKo5_yM_p-iInzcTj1j8avu6IwU_BeSzr8fh8XmG-HKHN-XppmMUjUgRqRBCxrxwftLLgABlaoyKqQOLcb3jb2Ow Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 262ce4d4eff04b87b5f29bc4bd7a0b12 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_262ce4d4eff04b87b5f29bc4bd7a0b12", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/262ce4d4eff04b87b5f29bc4bd7a0b12"}]}] Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 262ce4d4eff04b87b5f29bc4bd7a0b12 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-DeleteServersTestJSON-395429801 Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-DeleteServersTestJSON-395429801-project Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: cff208e6ea9b462da7e4412e8a8e7b0b Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-DeleteServersTestJSON-395429801-project Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '7c675363-03a3-4217-b0d1-78e868b13b1b'} Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:03:13.747720 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] Returning 404 to user: Instance 7c675363-03a3-4217-b0d1-78e868b13b1b could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ccb7a96b-4a98-4dd0-b84d-10fc38c4389a tempest-DeleteServersTestJSON-395429801 tempest-DeleteServersTestJSON-395429801-project] 10.222.0.69 "GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b" status: 404 len: 111 microversion: 2.1 time: 0.029953 Aug 27 04:03:13.752058 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3554/6820] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:13 2022] GET /compute/v2.1/servers/7c675363-03a3-4217-b0d1-78e868b13b1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:22.279154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-971768123", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "b4f2a69f-01b2-402e-9e17-729a3bea69fb"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:22.336069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] validate_networks() for [('b4f2a69f-01b2-402e-9e17-729a3bea69fb', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:03:22.713760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:03:22.714260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:03:22.714762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:03:22.715909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:03:22.716478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:03:22.725759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:22.726567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:22.727027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:22.727788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:22.728262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:22.728737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:22.748169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Getting quotas for project 8bd4e534197b499fa31c2f0a361ac48d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:03:22.754044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Getting quotas for user be54fe679e404282908cd2340449bf23 and project 8bd4e534197b499fa31c2f0a361ac48d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:03:22.767549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:03:22.769912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:03:22.818135 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82df874d-4c5e-4532-a18b-ba4120eefa90 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664199 Aug 27 04:03:22.818992 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3267/6821] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:03:22.830306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-681dde3a-07c9-450d-a98b-a1a94bad792c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:22.830937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-681dde3a-07c9-450d-a98b-a1a94bad792c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:22.896496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-681dde3a-07c9-450d-a98b-a1a94bad792c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:22.904833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-681dde3a-07c9-450d-a98b-a1a94bad792c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1217 microversion: 2.1 time: 0.078251 Aug 27 04:03:22.916285 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3555/6822] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:22 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:23.927525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:23.929110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:23.942671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:23.943580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:23.944102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:23.945293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:23.945838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:23.946370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:24.049544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:24.059941 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7c57f0a-1754-4bca-8bfd-757449625a20 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1277 microversion: 2.1 time: 0.138006 Aug 27 04:03:24.060635 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3268/6823] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:23 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:25.084541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:25.085701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:25.087854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=33 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:25.096055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:25.096832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:25.097436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:25.098349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:25.099203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:25.099790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:25.287211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:25.296130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-abbbc8fe-845f-4ce6-8bc5-1a73f56b078e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.218199 Aug 27 04:03:25.297358 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3556/6824] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:25 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:25.648927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d0c65ec8-024b-4de7-b2b6-6febd1318d0a req-c7f8daa7-cefa-421c-a9c6-a7813d6fca49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabbbf50-eb14-4eb3-921c-d361f118772d", "tag": "5003c2bf-e1d3-423a-8302-e18aec3947dd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:25.687333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0c65ec8-024b-4de7-b2b6-6febd1318d0a req-c7f8daa7-cefa-421c-a9c6-a7813d6fca49 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:25.688732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0c65ec8-024b-4de7-b2b6-6febd1318d0a req-c7f8daa7-cefa-421c-a9c6-a7813d6fca49 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:25.689773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d0c65ec8-024b-4de7-b2b6-6febd1318d0a req-c7f8daa7-cefa-421c-a9c6-a7813d6fca49 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:25.721567 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d0c65ec8-024b-4de7-b2b6-6febd1318d0a req-c7f8daa7-cefa-421c-a9c6-a7813d6fca49 service nova] Creating event network-changed:5003c2bf-e1d3-423a-8302-e18aec3947dd for instance dabbbf50-eb14-4eb3-921c-d361f118772d on n-h2-852086-5 Aug 27 04:03:25.733538 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d0c65ec8-024b-4de7-b2b6-6febd1318d0a req-c7f8daa7-cefa-421c-a9c6-a7813d6fca49 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088908 Aug 27 04:03:25.735377 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3269/6825] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:03:26.317693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:26.318341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:26.325904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:26.326360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:26.326800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:26.327539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:26.328000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:26.328426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:26.472005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:26.480206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a8aceb2-b66c-4656-b66b-1c5dccb229ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.166724 Aug 27 04:03:26.481057 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3557/6826] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:26 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:27.502673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:27.503581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:27.510767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:27.511278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:27.511777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:27.512520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:27.513051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:27.513625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:27.651989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:27.660720 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20a1311f-e159-4fb4-b3c4-5ac7bd71ae92 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.162557 Aug 27 04:03:27.661288 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3270/6827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:27 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:28.682461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:28.683080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:28.691459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:28.691947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:28.692385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:28.693243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:28.693653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:28.694051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:28.824236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:28.832511 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6e2c2487-5044-455a-9810-824cd0d51bb5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.154006 Aug 27 04:03:28.833087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3558/6828] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:28 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:29.853243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:29.853913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:29.861075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:29.861568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:29.862016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:29.862752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:29.863215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:29.863650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:29.993285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:30.001758 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3d8d7b5-e078-490b-b247-02fc96d4c00d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.152442 Aug 27 04:03:30.002358 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3271/6829] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:29 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:31.023060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:31.023677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:31.032095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:31.032587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:31.033026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:31.033739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:31.034221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:31.034656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:31.178438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:31.186351 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f90304b-7d8e-495c-a4cc-1e06c222dc1c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.167217 Aug 27 04:03:31.186936 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3559/6830] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:31 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:32.208268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:32.209002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:32.211685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:32.217921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:32.218444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:32.218894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:32.219600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:32.220062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:32.220495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:32.224027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:32.360706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:32.368569 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64f9c8aa-e243-40f0-bd82-633b04376209 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.164259 Aug 27 04:03:32.369149 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3272/6831] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:32 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:32.903536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-756c159d-ee88-4afc-b903-afb628e2477a req-217cb8e4-a588-4d20-b8fe-47f06585385a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabbbf50-eb14-4eb3-921c-d361f118772d", "name": "network-vif-plugged", "status": "completed", "tag": "5003c2bf-e1d3-423a-8302-e18aec3947dd"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:32.909201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:32.909860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=28 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:32.915448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-756c159d-ee88-4afc-b903-afb628e2477a req-217cb8e4-a588-4d20-b8fe-47f06585385a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:32.916006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-756c159d-ee88-4afc-b903-afb628e2477a req-217cb8e4-a588-4d20-b8fe-47f06585385a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:32.916441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-756c159d-ee88-4afc-b903-afb628e2477a req-217cb8e4-a588-4d20-b8fe-47f06585385a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:32.928588 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-756c159d-ee88-4afc-b903-afb628e2477a req-217cb8e4-a588-4d20-b8fe-47f06585385a service nova] Creating event network-vif-plugged:5003c2bf-e1d3-423a-8302-e18aec3947dd for instance dabbbf50-eb14-4eb3-921c-d361f118772d on n-h2-852086-5 Aug 27 04:03:32.934301 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-756c159d-ee88-4afc-b903-afb628e2477a req-217cb8e4-a588-4d20-b8fe-47f06585385a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Aug 27 04:03:32.935334 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3560/6832] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:33.390626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:33.391346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:33.393386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:33.394081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:33.401166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:33.401663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:33.402110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:33.403516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:33.403957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:33.404395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:33.541469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:33.549972 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4c725e6-fa21-40e6-96d7-3cd917a9ee6e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1317 microversion: 2.1 time: 0.163603 Aug 27 04:03:33.554214 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3273/6833] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:33 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:34.577090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:34.577792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:34.584107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:34.584585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:34.585016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:34.585700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:34.586151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:34.586594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:34.720015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:34.727887 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-acc820a7-7df4-4088-a058-5cc336cc52f8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1506 microversion: 2.1 time: 0.156576 Aug 27 04:03:34.728461 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3561/6834] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:34 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:34.747832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:34.748488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:34.755359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:34.755853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:34.756300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:34.757003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:34.757462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:34.757895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:34.889685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:34.897412 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8784a47a-3677-488b-8523-4bb0754de641 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1506 microversion: 2.1 time: 0.153516 Aug 27 04:03:34.897985 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3274/6835] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:34 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:34.916874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:34.919838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:34.925896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:34.926431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:34.926873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:34.927574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:34.928029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:34.928451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:34.994861 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ee10bb35-ea2e-4542-916b-680473f88dbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "PUT /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1078 microversion: 2.1 time: 0.081766 Aug 27 04:03:34.995513 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3562/6836] 10.222.0.69 () {60 vars in 1256 bytes} [Sat Aug 27 04:03:34 2022] PUT /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1078 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:35.012272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:35.012892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:35.018959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.019447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.019888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.020584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.021046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.021482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.152622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:35.160620 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-965d8230-2e36-4c77-a76b-a39fff49781f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1504 microversion: 2.1 time: 0.152334 Aug 27 04:03:35.161199 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3275/6837] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:35 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:35.181115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:35.181723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:35.188463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.188967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.189401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.190088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.190570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.190993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.331645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:35.339435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-55d1aa11-640f-4b7c-8708-cdffd416b6d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1504 microversion: 2.1 time: 0.162318 Aug 27 04:03:35.341175 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3563/6838] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:35 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:35.360319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:35.362568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:35.368694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.369199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.369657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.370400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.370945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.371938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.401312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:35.407862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:03:35.414248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:03:35.414691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:03:35.415184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:03:35.415614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:03:35.416042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:03:35.478211 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-92789543-ae67-4fcd-ad98-53d7b80dee2e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "POST /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d/action" status: 202 len: 0 microversion: 2.1 time: 0.122209 Aug 27 04:03:35.478583 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3276/6839] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:03:35 2022] POST /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:03:35.487322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:35.487874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:35.493768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.494380 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.494821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.495521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:35.496080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:35.496935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:35.651130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:35.660022 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32183d2a-794d-4033-9e9a-61296cf8a245 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1515 microversion: 2.1 time: 0.176923 Aug 27 04:03:35.660696 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3564/6840] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:35 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:36.682219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:36.682985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:36.691206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:36.691705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:36.692207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:36.692852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:36.693315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:36.693748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:36.919037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:36.926941 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a288d8f1-f9de-40eb-9e49-c2919bd99df4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1515 microversion: 2.1 time: 0.249542 Aug 27 04:03:36.927526 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3277/6841] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:36 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:37.949797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:37.950424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:37.957293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:37.957781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:37.958248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:37.958945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:37.959404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:37.959832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:38.094461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:38.102211 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8e73565c-dbaf-4504-88be-22220020a18e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.157004 Aug 27 04:03:38.102784 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3565/6842] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:37 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:39.124473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:39.125128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:39.132448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:39.132946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:39.133415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:39.134128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:39.134619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:39.135054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:39.269813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:39.277771 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e267ac2-8383-4170-aa18-966cff6bf285 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.158146 Aug 27 04:03:39.278398 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3278/6843] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:39 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:40.302731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:40.303342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:40.311068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:40.311548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:40.311982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:40.312675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:40.313414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:40.313837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:40.452049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.460377 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-86d9c891-d253-43e1-aa2f-98fa3e6ac16d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.164618 Aug 27 04:03:40.460941 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3566/6844] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:40 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:41.482411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:41.483039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:41.489849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:41.490646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:41.490860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:41.491574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:41.492072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:41.492511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:41.635219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:41.643370 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b624754-c544-4098-93f0-d03ad42e7c48 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.165379 Aug 27 04:03:41.643961 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3279/6845] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:41 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:42.668529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:42.669231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:42.676925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:42.677420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:42.677860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:42.678603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:42.679065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:42.679496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:42.816593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:42.825077 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eac7e67c-db55-42f2-8310-3abbe363e5fd tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.161473 Aug 27 04:03:42.825685 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3567/6846] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:42 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:43.846946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:43.847568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:43.855865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:43.856379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:43.856831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:43.857541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:43.858010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:43.858474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:43.999223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.007411 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ab9b79a-5d8f-42b3-9f1a-17c8baac8cf4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.164378 Aug 27 04:03:44.007986 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3280/6847] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:43 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:45.029199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:45.029868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:45.037540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:45.038040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:45.038520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:45.039240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:45.039769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:45.040202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:45.175984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:45.184199 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8dc41d55-1c7a-4d08-a1d3-4d881e378bbe tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.159958 Aug 27 04:03:45.184778 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3568/6848] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:45 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:46.205244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:46.205872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:46.212334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:46.212774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:46.213290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:46.213999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:46.215248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:46.215708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:46.348887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:46.356942 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e3b65ad-4517-41be-b6a1-4faa392ae262 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.155581 Aug 27 04:03:46.357524 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3281/6849] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:46 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:47.378228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:47.379169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:47.386665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:47.387011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:47.387584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:47.388581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:47.389045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:47.389480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:47.525051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.534202 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-73c967e3-b513-48fb-b717-dc6df76284e9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.159878 Aug 27 04:03:47.534347 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3569/6850] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:47 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:48.555254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:48.555912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:48.562877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:48.563637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:48.564089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:48.564803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:48.565272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:48.565713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:48.703068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:48.711948 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9aebdfe4-7ad1-4836-a149-f2d6046e9ada tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.160563 Aug 27 04:03:48.712531 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3282/6851] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:48 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:49.734253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:49.734787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:49.741677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:49.742181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:49.742622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:49.743321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:49.743775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:49.744204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:49.878457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:49.886181 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-078281fe-565b-400c-b204-2c0dc20a8531 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.156512 Aug 27 04:03:49.886864 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3570/6852] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:49 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:50.907752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:50.908286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:50.915461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:50.915967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:50.916426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:50.917143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:50.917789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:50.918346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:51.053153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:51.063650 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-912dd040-f407-47ec-bd32-b30304d2a65c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.160022 Aug 27 04:03:51.064227 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3283/6853] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:50 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:52.085144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:52.085754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:52.092951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:52.093444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:52.093884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:52.094629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:52.095088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:52.095518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:52.232034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:52.239920 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8e0d7e3-cd28-4cb5-89a7-ff8d5714055c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.158634 Aug 27 04:03:52.240435 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3571/6854] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:52 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:53.262318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:53.262959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:53.269949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:53.270777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:53.271277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:53.272003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:53.272477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:53.272923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:53.410762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:53.419724 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec53af8b-02af-4b80-951a-cc3d92792131 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.162213 Aug 27 04:03:53.420290 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3284/6855] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:53 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:54.441206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:54.441835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:54.450005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:54.450763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:54.451211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:54.451932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:54.452396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:54.452826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:54.472980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:54.591537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:54.599344 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8be40405-f949-45d4-a118-c77e7b7896e1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.162354 Aug 27 04:03:54.599916 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3572/6856] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:54 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:55.621197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:55.621736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:55.628762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:55.629264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:55.629744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:55.630491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:55.630965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:55.631406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:55.776254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.784812 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81af2583-4db0-4d3b-98b9-efc24f58827d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.167797 Aug 27 04:03:55.785600 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3285/6857] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:55 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:56.806185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:56.806921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:56.814759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:56.815250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:56.815688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:56.816426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:56.816944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:56.817378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:56.955145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.963063 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-05270d07-2f78-4b78-a5c2-7c615a637e46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.161007 Aug 27 04:03:56.963649 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3573/6858] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:56 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:57.984941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:57.985586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:57.992695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:57.993199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:57.993653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:57.994405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:57.994879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:57.995328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:58.132315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:58.140289 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca293cdd-460f-4f6d-998d-1aa8fad224d9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.159307 Aug 27 04:03:58.140870 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3286/6859] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:57 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:59.161274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:59.161889 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:59.169076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:59.169595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:59.170034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:59.170772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:59.171235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:59.171667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:59.309092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:59.317093 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f55c1189-5cac-4f64-b746-cac2dd78de4d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.159832 Aug 27 04:03:59.317671 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3574/6860] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:59 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:00.337832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:00.338427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:00.346275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:00.346775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:00.347219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:00.347927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:00.348390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:00.348825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:00.364141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:00.484954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.492873 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb44c5c8-29d8-4bf5-9925-3f5615c93471 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.159029 Aug 27 04:04:00.493445 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3287/6861] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:00 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:01.518696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:01.519351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:01.526285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:01.526787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:01.527232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:01.527946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:01.528410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:01.528842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:01.668589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.676345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-632229c1-4a16-4f01-926e-c15dff73612b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.161634 Aug 27 04:04:01.676930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3575/6862] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:01 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:02.701932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:02.702996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:02.707155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=36 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:02.713349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:02.713870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:02.714977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:02.715771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:02.716252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:02.716742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:02.873401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:02.881483 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc7c3e46-1a6c-4bc4-af88-505b6de523ea tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.185767 Aug 27 04:04:02.882073 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3288/6863] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:02 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:03.904526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:03.905130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:03.907877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=32 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:03.915924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:03.916430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:03.916879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:03.918123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:03.918619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:03.919060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:04.063990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:04.075467 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-35896f32-70c7-4f27-840e-599edda574c7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1520 microversion: 2.1 time: 0.176579 Aug 27 04:04:04.076097 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3576/6864] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:03 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:04.937792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-81f96e19-0c53-46cc-941d-d7e0be30c362 req-014efe97-5022-4c0c-9b7e-32a82cf85910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabbbf50-eb14-4eb3-921c-d361f118772d", "name": "network-vif-unplugged", "status": "completed", "tag": "5003c2bf-e1d3-423a-8302-e18aec3947dd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:04.950617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81f96e19-0c53-46cc-941d-d7e0be30c362 req-014efe97-5022-4c0c-9b7e-32a82cf85910 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:04.951181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81f96e19-0c53-46cc-941d-d7e0be30c362 req-014efe97-5022-4c0c-9b7e-32a82cf85910 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:04.951625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81f96e19-0c53-46cc-941d-d7e0be30c362 req-014efe97-5022-4c0c-9b7e-32a82cf85910 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:04.963825 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-81f96e19-0c53-46cc-941d-d7e0be30c362 req-014efe97-5022-4c0c-9b7e-32a82cf85910 service nova] Creating event network-vif-unplugged:5003c2bf-e1d3-423a-8302-e18aec3947dd for instance dabbbf50-eb14-4eb3-921c-d361f118772d on n-h1-852086-5 Aug 27 04:04:04.971129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-81f96e19-0c53-46cc-941d-d7e0be30c362 req-014efe97-5022-4c0c-9b7e-32a82cf85910 service nova] Instance dabbbf50-eb14-4eb3-921c-d361f118772d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:04:04.984255 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-81f96e19-0c53-46cc-941d-d7e0be30c362 req-014efe97-5022-4c0c-9b7e-32a82cf85910 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051526 Aug 27 04:04:04.985252 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3289/6865] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:05.098093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:05.098789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:05.106547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.106547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.106547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.107531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:05.108057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:05.108569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:05.252784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.262999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-18d7580d-5f8e-4b3e-b924-77826d54873c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1519 microversion: 2.1 time: 0.168632 Aug 27 04:04:05.263850 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3577/6866] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:05 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:06.285894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:06.286657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:06.296215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:06.296730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:06.297186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:06.297919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:06.298420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:06.298872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:06.435150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:06.443368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8081b95-8b46-461e-862b-bd3dd9e30e89 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1517 microversion: 2.1 time: 0.161783 Aug 27 04:04:06.443885 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3290/6867] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:06 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:07.014606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5ee26e1a-af98-4503-971b-fdd82a0c4e60 req-f736bb9b-8982-4b32-a256-58289312aaab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabbbf50-eb14-4eb3-921c-d361f118772d", "tag": "5003c2bf-e1d3-423a-8302-e18aec3947dd"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:07.025017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5ee26e1a-af98-4503-971b-fdd82a0c4e60 req-f736bb9b-8982-4b32-a256-58289312aaab service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:07.025492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5ee26e1a-af98-4503-971b-fdd82a0c4e60 req-f736bb9b-8982-4b32-a256-58289312aaab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:07.025920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5ee26e1a-af98-4503-971b-fdd82a0c4e60 req-f736bb9b-8982-4b32-a256-58289312aaab service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:07.037431 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5ee26e1a-af98-4503-971b-fdd82a0c4e60 req-f736bb9b-8982-4b32-a256-58289312aaab service nova] Creating event network-changed:5003c2bf-e1d3-423a-8302-e18aec3947dd for instance dabbbf50-eb14-4eb3-921c-d361f118772d on n-h1-852086-5 Aug 27 04:04:07.043359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-5ee26e1a-af98-4503-971b-fdd82a0c4e60 req-f736bb9b-8982-4b32-a256-58289312aaab service nova] Instance dabbbf50-eb14-4eb3-921c-d361f118772d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:04:07.053965 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5ee26e1a-af98-4503-971b-fdd82a0c4e60 req-f736bb9b-8982-4b32-a256-58289312aaab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043111 Aug 27 04:04:07.054673 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3578/6868] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:07.468928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:07.469602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:07.476528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:07.477028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:07.477481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:07.478219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:07.478684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:07.479126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:07.763981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:07.772436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a4d60c2-25b6-465d-a960-7c5f17b0b859 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1517 microversion: 2.1 time: 0.310902 Aug 27 04:04:07.773039 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3291/6869] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:07 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:08.797427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:08.798133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:08.804381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:08.804870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:08.805308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:08.806012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:08.806496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:08.806926 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:08.941372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:08.950011 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c5d54b2e-f2b7-40b6-8014-2b9de09229a4 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1514 microversion: 2.1 time: 0.159121 Aug 27 04:04:08.950669 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3579/6870] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:08 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:08.969986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:08.970565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:08.977490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:08.977984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:08.978467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:08.979168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:08.979792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:08.980312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:09.038426 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73b031e8-d92a-4296-b403-0c5a43cad526 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "POST /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d/action" status: 204 len: 0 microversion: 2.1 time: 0.072073 Aug 27 04:04:09.039171 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3292/6871] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:04:08 2022] POST /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:04:09.048870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:09.050036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:09.055538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:09.056029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:09.056467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:09.057248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:09.058258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:09.059365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:09.209678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:09.218513 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83306d3d-f285-4fe6-81c5-8e8cc0555aec tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1514 microversion: 2.1 time: 0.174476 Aug 27 04:04:09.222199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3580/6872] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:09 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:10.247673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:10.248518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:10.255841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:10.256357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:10.256841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:10.257560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:10.258030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:10.258505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:10.398674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:10.406606 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0f13613-3bdf-41a0-8ba3-a62048ed048f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1506 microversion: 2.1 time: 0.164450 Aug 27 04:04:10.407178 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3293/6873] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:10 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:10.427359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:10.427965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:10.435529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:10.436011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:10.436448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:10.437150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:10.437601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:10.438024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:10.578933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:10.586753 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-13bc042d-72cc-433c-aa21-f9ef32b1833e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1506 microversion: 2.1 time: 0.163661 Aug 27 04:04:10.587336 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3581/6874] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:10 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:10.611479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-857ffecc-271e-49c5-b438-bf40f913b665 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'create', calling method: .version_select at 0x7fe46039b430>, body: {"keypair": {"name": "tempest-keypair-919808920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0GCiUdi8V60zxQ2sb2sW+OPIZkNN0swQm+A2pezBGDxRListqkr4wddYldsGYqIuLuFcxhQ/aRXoJued90e0C/pxA8jeonfB66F7yHJ26StxhlEnQsCdcOXGqCCBanYg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:10.627854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-857ffecc-271e-49c5-b438-bf40f913b665 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Getting quotas for project 8bd4e534197b499fa31c2f0a361ac48d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:04:10.632933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-857ffecc-271e-49c5-b438-bf40f913b665 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Getting quotas for user be54fe679e404282908cd2340449bf23 and project 8bd4e534197b499fa31c2f0a361ac48d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:04:10.660579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-857ffecc-271e-49c5-b438-bf40f913b665 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052927 Aug 27 04:04:10.661112 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3294/6875] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:04:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:11.891406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:11.892069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:11.899009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:11.899506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:11.899955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:11.900664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:11.901124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:11.901689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.041517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:12.050529 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16af89dd-1d16-4a69-9318-648eb2aa4150 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 200 len: 1506 microversion: 2.1 time: 0.162952 Aug 27 04:04:12.051111 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3582/6876] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:11 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:12.073023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:12.075000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:12.081757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:12.082288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:12.082740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.083508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:12.084138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:12.084575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.111644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:04:12.197711 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43bac25f-1575-4722-903f-053007a0f8d8 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 204 len: 0 microversion: 2.1 time: 0.129118 Aug 27 04:04:12.200536 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3295/6877] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:04:12 2022] DELETE /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:04:12.233444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-70ab56d4-59b2-4f69-a200-93db0627a782 req-46d3cb2b-a774-4be2-843b-9e8978245a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabbbf50-eb14-4eb3-921c-d361f118772d", "name": "network-vif-plugged", "status": "completed", "tag": "5003c2bf-e1d3-423a-8302-e18aec3947dd"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:12.243997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-70ab56d4-59b2-4f69-a200-93db0627a782 req-46d3cb2b-a774-4be2-843b-9e8978245a8a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:12.245018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-70ab56d4-59b2-4f69-a200-93db0627a782 req-46d3cb2b-a774-4be2-843b-9e8978245a8a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:12.247927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-70ab56d4-59b2-4f69-a200-93db0627a782 req-46d3cb2b-a774-4be2-843b-9e8978245a8a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.264347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1395129303", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "b4f2a69f-01b2-402e-9e17-729a3bea69fb"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:12.268001 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-70ab56d4-59b2-4f69-a200-93db0627a782 req-46d3cb2b-a774-4be2-843b-9e8978245a8a service nova] Creating event network-vif-plugged:5003c2bf-e1d3-423a-8302-e18aec3947dd for instance dabbbf50-eb14-4eb3-921c-d361f118772d on n-h1-852086-5 Aug 27 04:04:12.274401 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-70ab56d4-59b2-4f69-a200-93db0627a782 req-46d3cb2b-a774-4be2-843b-9e8978245a8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045285 Aug 27 04:04:12.275330 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3583/6878] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:12.329744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] validate_networks() for [('b4f2a69f-01b2-402e-9e17-729a3bea69fb', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:04:12.734320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:04:12.734823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:04:12.735320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:04:12.735745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:04:12.736173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:04:12.745234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:12.745758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:12.746247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.747001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:12.747476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:12.747925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:12.764588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Getting quotas for project 8bd4e534197b499fa31c2f0a361ac48d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:04:12.769897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Getting quotas for user be54fe679e404282908cd2340449bf23 and project 8bd4e534197b499fa31c2f0a361ac48d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:04:12.782735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:04:12.785161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:04:12.830462 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3006538-746d-482a-a739-d94fa6dcfb96 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571758 Aug 27 04:04:12.831115 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3296/6879] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:04:12.843119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a5a20c38-5246-4ef6-953d-c0cf05e2e3d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:12.843826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a5a20c38-5246-4ef6-953d-c0cf05e2e3d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:12.898894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a5a20c38-5246-4ef6-953d-c0cf05e2e3d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:12.909930 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a5a20c38-5246-4ef6-953d-c0cf05e2e3d5 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1218 microversion: 2.1 time: 0.071682 Aug 27 04:04:12.910537 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3584/6880] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:12 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:13.932089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:13.933989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:13.942932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:13.943791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:13.944480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:13.945435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:13.946123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:13.946845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:14.053194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:14.062098 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a4522db-014f-4330-a97e-debee10fc0da tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1276 microversion: 2.1 time: 0.134723 Aug 27 04:04:14.062927 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3297/6881] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:13 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:14.431918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-800593a6-e489-446a-9aae-a773b2308062 req-81f36e02-42c2-4389-b5d8-10c0c249401c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabbbf50-eb14-4eb3-921c-d361f118772d", "name": "network-vif-deleted", "tag": "5003c2bf-e1d3-423a-8302-e18aec3947dd"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:14.444495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-800593a6-e489-446a-9aae-a773b2308062 req-81f36e02-42c2-4389-b5d8-10c0c249401c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:14.445123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-800593a6-e489-446a-9aae-a773b2308062 req-81f36e02-42c2-4389-b5d8-10c0c249401c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:14.455648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-800593a6-e489-446a-9aae-a773b2308062 req-81f36e02-42c2-4389-b5d8-10c0c249401c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:14.467852 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-800593a6-e489-446a-9aae-a773b2308062 req-81f36e02-42c2-4389-b5d8-10c0c249401c service nova] Creating event network-vif-deleted:5003c2bf-e1d3-423a-8302-e18aec3947dd for instance dabbbf50-eb14-4eb3-921c-d361f118772d on n-h1-852086-5 Aug 27 04:04:14.472764 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-800593a6-e489-446a-9aae-a773b2308062 req-81f36e02-42c2-4389-b5d8-10c0c249401c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044533 Aug 27 04:04:14.473394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3585/6882] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:15.085102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:15.085702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:15.093218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:15.093821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:15.094392 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:15.095231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:15.095714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:15.096159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:15.355775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:15.365851 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a5fdf48-6643-48b9-9999-db03342edd9e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1318 microversion: 2.1 time: 0.284822 Aug 27 04:04:15.366702 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3298/6883] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:15 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:16.390466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:16.391084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:16.397381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:16.397920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:16.398408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:16.399111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:16.399571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:16.400000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:16.488230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-52ca3f3b-7f24-4fb0-bd32-46cb14ea0153 req-ce4ef1f4-3cee-441b-bb90-907f43bb2ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276e0824-da05-4557-b042-72afeef09d96", "tag": "905b81c3-76d9-4fb5-9748-942abb226c9e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:16.499238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-52ca3f3b-7f24-4fb0-bd32-46cb14ea0153 req-ce4ef1f4-3cee-441b-bb90-907f43bb2ad3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:16.499735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-52ca3f3b-7f24-4fb0-bd32-46cb14ea0153 req-ce4ef1f4-3cee-441b-bb90-907f43bb2ad3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:16.500179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-52ca3f3b-7f24-4fb0-bd32-46cb14ea0153 req-ce4ef1f4-3cee-441b-bb90-907f43bb2ad3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:16.513484 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-52ca3f3b-7f24-4fb0-bd32-46cb14ea0153 req-ce4ef1f4-3cee-441b-bb90-907f43bb2ad3 service nova] Creating event network-changed:905b81c3-76d9-4fb5-9748-942abb226c9e for instance 276e0824-da05-4557-b042-72afeef09d96 on n-h2-852086-5 Aug 27 04:04:16.519474 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-52ca3f3b-7f24-4fb0-bd32-46cb14ea0153 req-ce4ef1f4-3cee-441b-bb90-907f43bb2ad3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035502 Aug 27 04:04:16.520092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3299/6884] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:04:16.547832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:16.555730 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8dba5025-7c99-432b-ac49-609cd0643122 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1318 microversion: 2.1 time: 0.171098 Aug 27 04:04:16.556311 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3586/6885] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:16 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:17.578132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:17.578894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:17.586264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:17.586773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:17.587228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:17.587942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:17.588415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:17.588859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:17.723487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:17.731796 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66cb7e79-94c9-4813-9887-212e9d00557e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1318 microversion: 2.1 time: 0.158480 Aug 27 04:04:17.732368 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3300/6886] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:17 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:18.753621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:18.754272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:18.761316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:18.762456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:18.762901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:18.763610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:18.764070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:18.764501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:18.893724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:18.901358 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d97ca78-d1b1-44ec-b2b4-0e464814b38b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1318 microversion: 2.1 time: 0.152005 Aug 27 04:04:18.901927 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3587/6887] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:18 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:19.921995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:19.922658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:19.929633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:19.930127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:19.930605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:19.931312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:19.931782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:19.932220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:20.066182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:20.075403 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d5f18c5-5f56-474c-ac24-c56335c1ff33 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1318 microversion: 2.1 time: 0.157387 Aug 27 04:04:20.076092 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3301/6888] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:19 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:21.097318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:21.097937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:21.098482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9cff4ac9-94cc-4417-9bc4-5b4fb489717c req-53b2ba4d-be67-4e8a-bef2-f326bc810ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276e0824-da05-4557-b042-72afeef09d96", "name": "network-vif-plugged", "status": "completed", "tag": "905b81c3-76d9-4fb5-9748-942abb226c9e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:21.106027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:21.106678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:21.107393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:21.107998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:21.108461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:21.109072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:21.111129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9cff4ac9-94cc-4417-9bc4-5b4fb489717c req-53b2ba4d-be67-4e8a-bef2-f326bc810ea8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:21.111742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9cff4ac9-94cc-4417-9bc4-5b4fb489717c req-53b2ba4d-be67-4e8a-bef2-f326bc810ea8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:21.112266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9cff4ac9-94cc-4417-9bc4-5b4fb489717c req-53b2ba4d-be67-4e8a-bef2-f326bc810ea8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:21.124062 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9cff4ac9-94cc-4417-9bc4-5b4fb489717c req-53b2ba4d-be67-4e8a-bef2-f326bc810ea8 service nova] Creating event network-vif-plugged:905b81c3-76d9-4fb5-9748-942abb226c9e for instance 276e0824-da05-4557-b042-72afeef09d96 on n-h2-852086-5 Aug 27 04:04:21.129227 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9cff4ac9-94cc-4417-9bc4-5b4fb489717c req-53b2ba4d-be67-4e8a-bef2-f326bc810ea8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035634 Aug 27 04:04:21.130131 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3302/6889] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:04:21.265814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:21.275369 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-41070bc9-017f-4067-bcc4-49c7b8b12ab1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1318 microversion: 2.1 time: 0.181986 Aug 27 04:04:21.275967 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3588/6890] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:21 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:22.299556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:22.300281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:22.307014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:22.307580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:22.308135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:22.309700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:22.309994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:22.310480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:22.456289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:22.463923 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-858cd2a1-c248-4ba9-ac77-6839ba5ef584 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1318 microversion: 2.1 time: 0.169908 Aug 27 04:04:22.465000 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3303/6891] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:22 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:23.485180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:23.485704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:23.488527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:23.494760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.495252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.495695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:23.496425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.496886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.497320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:23.631850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:23.640237 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2739bded-88c5-49c5-a622-76a2511797c1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1507 microversion: 2.1 time: 0.159457 Aug 27 04:04:23.640826 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3589/6892] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:23 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:23.661076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:23.661699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:23.663732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:23.664519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:23.671253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.671748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.672189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:23.672892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.673353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.673786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:23.693509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:23.809410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:23.817451 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fe682cf-b2e7-4761-b023-c3512026cbf1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1507 microversion: 2.1 time: 0.160209 Aug 27 04:04:23.818024 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3304/6893] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:23 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:23.837794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:23.840128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:23.846120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.846646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.847094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:23.847797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.848260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.848694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:23.877426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:23.883260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Old instance type m1.heat2, new instance type m1.heat {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:04:23.890480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:04:23.890903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:04:23.891381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:04:23.891792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:04:23.892205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:04:23.928245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:23.956395 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c8c178b3-5882-405a-9ebb-d4e3e2827863 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "POST /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96/action" status: 202 len: 0 microversion: 2.1 time: 0.122533 Aug 27 04:04:23.957155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3590/6894] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:04:23 2022] POST /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:23.965291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:23.965935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:23.972005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.972511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.972963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:23.973674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:23.974344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:23.974787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:24.113624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:24.123492 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a93a03b-3aef-4359-a954-8b678b80f257 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1514 microversion: 2.1 time: 0.162226 Aug 27 04:04:24.124240 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3305/6895] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:23 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:25.148611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:25.150718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:25.165832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:25.166383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:25.166943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:25.168316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:25.168827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:25.169277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:25.304371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:25.313153 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-776c24ad-bdd6-4a62-b18e-e21bc6e35819 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1514 microversion: 2.1 time: 0.172570 Aug 27 04:04:25.314010 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3591/6896] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:25 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:26.334942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:26.335576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:26.343178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:26.343682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:26.344135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:26.344847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:26.345316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:26.345753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:26.477450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:26.485689 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08a13952-0dfc-48f1-a3b7-09d1c1caa02d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.154717 Aug 27 04:04:26.486279 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3306/6897] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:26 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:27.506652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:27.507286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:27.515482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:27.515965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:27.516400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:27.517094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:27.517547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:27.517968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:27.655467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:27.663828 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c748b531-8c33-44c9-b2d9-8b25d7c60211 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.161121 Aug 27 04:04:27.664417 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3592/6898] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:27 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:28.685660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:28.686320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:28.693479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:28.693972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:28.694487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:28.695272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:28.695739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:28.696195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:28.827841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:28.835633 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb35e60c-b423-4fa3-a661-c4d722d036b1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.155082 Aug 27 04:04:28.836208 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3307/6899] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:28 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:29.857700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:29.858365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:29.865330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:29.865821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:29.866299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:29.867012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:29.867473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:29.867905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:29.998189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:30.005939 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c827939f-59ae-4c57-a1a3-ae7b98616231 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.152340 Aug 27 04:04:30.006545 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3593/6900] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:29 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:31.028068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:31.028727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:31.035863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:31.036396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:31.036856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:31.037577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:31.038050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:31.038527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:31.173755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:31.181784 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f53d410b-f774-4d21-b936-2b5af079f25d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.158286 Aug 27 04:04:31.182400 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3308/6901] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:31 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:32.204249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:32.204865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:32.212018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:32.212506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:32.212948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:32.213655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:32.214116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:32.214682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:32.352321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:32.360998 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e81c1fcf-5fe3-493c-8728-12ec1b34af8c tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.160792 Aug 27 04:04:32.361573 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3594/6902] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:32 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:33.383161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:33.383790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:33.387040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:33.392296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:33.392793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:33.393240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:33.393952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:33.394459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:33.394894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:33.528638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:33.536518 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7487233-1178-45ce-b769-c1b6eadb082d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.157256 Aug 27 04:04:33.537093 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3309/6903] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:33 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:34.557061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:34.557705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:34.560876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=44 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:34.566859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:34.567356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:34.567800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:34.568515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:34.568978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:34.569413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:34.703845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:34.712017 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cac3bebe-26fe-433c-bf9e-b9141c1cfef3 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.158840 Aug 27 04:04:34.712858 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3595/6904] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:34 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:35.735730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:35.736314 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:35.743411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:35.743913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:35.744384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:35.745092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:35.745570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:35.746016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:35.884511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:35.892341 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-537bdbd9-c41d-4c0f-8ed1-eb736f0c484e tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.160664 Aug 27 04:04:35.892908 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3310/6905] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:35 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:36.913911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:36.914494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:36.922675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:36.923155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:36.923589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:36.924284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:36.924736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:36.925157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:37.066231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:37.074722 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1af620be-2417-4bd9-ab2b-20438a937d86 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.164469 Aug 27 04:04:37.075312 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3596/6906] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:36 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:38.096280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:38.096904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:38.103813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:38.104305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:38.104778 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:38.105967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:38.106603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:38.107041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:38.242881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:38.251373 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d73108c-511b-46e1-88c0-61649088eb14 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.158978 Aug 27 04:04:38.251980 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3311/6907] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:38 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:39.272914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:39.273535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:39.281264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:39.281757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:39.282228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:39.282945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:39.283406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:39.283838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:39.420077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:39.428055 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a57c2c4-3c2b-4146-9e42-71458ba6dcd2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.159079 Aug 27 04:04:39.428639 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3597/6908] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:39 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:40.450839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:40.451466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:40.458351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:40.458839 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:40.459282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:40.459983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:40.460444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:40.460876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:40.591801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:40.599591 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-521f9134-1db3-437e-9728-8cdcb03178ed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.153372 Aug 27 04:04:40.600409 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3312/6909] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:40 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:41.623190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:41.623792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:41.630804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:41.631299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:41.631743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:41.632491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:41.632949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:41.633379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:41.766383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:41.774491 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-11907a5c-e0aa-4cbb-9938-0922d9d16f75 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.156035 Aug 27 04:04:41.775078 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3598/6910] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:41 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:42.797577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:42.798270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:42.808104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:42.808638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:42.810013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:42.810798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:42.811281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:42.811731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:42.961330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:42.970353 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2a74a90-9559-4e69-8803-b10cd65e96f7 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.177237 Aug 27 04:04:42.970947 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3313/6911] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:42 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:43.992458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:43.993091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:44.000877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:44.001370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:44.001814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:44.002563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:44.003024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:44.003459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:44.460976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:44.468845 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cfd1dbb7-852f-4ccc-a6d9-69bab957829f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.480520 Aug 27 04:04:44.469444 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3599/6912] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:43 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:45.490632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:45.491321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:45.499408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:45.499903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:45.500352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:45.501060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:45.501523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:45.501957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:45.640912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:45.649166 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d06330c-89fe-4577-be5f-9903cf3e70b0 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.162534 Aug 27 04:04:45.649741 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3314/6913] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:45 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:46.671634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:46.672255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:46.679573 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:46.680065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:46.680506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:46.681217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:46.681675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:46.682109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:46.815933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:46.823789 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2656fa5e-adef-4ca5-9d18-1bde0ab89ec2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.156836 Aug 27 04:04:46.824411 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3600/6914] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:46 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:47.845459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:47.846086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:47.852500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:47.852996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:47.853447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:47.854150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:47.854636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:47.855073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:47.992764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:48.001138 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e7ef044-269c-4130-a45a-1154e75d29b2 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.159762 Aug 27 04:04:48.001713 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3315/6915] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:47 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:49.023546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:49.024174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:49.030684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:49.031178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:49.031626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:49.032337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:49.032798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:49.033229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:49.172702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:49.180573 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9b81b240-0ea9-4531-9d98-52d385c97fdb tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.161448 Aug 27 04:04:49.181146 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3601/6916] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:49 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:50.202289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:50.202902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:50.209631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:50.210121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:50.210599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:50.211305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:50.211767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:50.212196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:50.343766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:50.351609 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85ba77af-b2a4-430d-9036-d0e98f545515 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.154567 Aug 27 04:04:50.352190 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3316/6917] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:50 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:51.373722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:51.374378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:51.381407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:51.381893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:51.382409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:51.383066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:51.383497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:51.383925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:51.516487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:51.524753 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2c192d4b-2409-4d7c-bab6-926220086375 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.155616 Aug 27 04:04:51.525333 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3602/6918] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:51 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:52.547531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:52.548153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:52.555422 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:52.555922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:52.556366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:52.557079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:52.557619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:52.558043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:52.698605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:52.706842 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9947f584-84bf-4184-9af7-3cd9fcd53082 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1519 microversion: 2.1 time: 0.164053 Aug 27 04:04:52.707425 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3317/6919] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:52 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:53.368806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-86c0dc13-7fe6-41ba-81f8-287756a0b7b5 req-5a46e69b-4ff7-4236-91ff-707e12f6a2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276e0824-da05-4557-b042-72afeef09d96", "name": "network-vif-unplugged", "status": "completed", "tag": "905b81c3-76d9-4fb5-9748-942abb226c9e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:53.380664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-86c0dc13-7fe6-41ba-81f8-287756a0b7b5 req-5a46e69b-4ff7-4236-91ff-707e12f6a2d8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:53.381298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-86c0dc13-7fe6-41ba-81f8-287756a0b7b5 req-5a46e69b-4ff7-4236-91ff-707e12f6a2d8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:53.381740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-86c0dc13-7fe6-41ba-81f8-287756a0b7b5 req-5a46e69b-4ff7-4236-91ff-707e12f6a2d8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:53.394448 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-86c0dc13-7fe6-41ba-81f8-287756a0b7b5 req-5a46e69b-4ff7-4236-91ff-707e12f6a2d8 service nova] Creating event network-vif-unplugged:905b81c3-76d9-4fb5-9748-942abb226c9e for instance 276e0824-da05-4557-b042-72afeef09d96 on n-h1-852086-5 Aug 27 04:04:53.399879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-86c0dc13-7fe6-41ba-81f8-287756a0b7b5 req-5a46e69b-4ff7-4236-91ff-707e12f6a2d8 service nova] Instance 276e0824-da05-4557-b042-72afeef09d96 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:04:53.411089 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-86c0dc13-7fe6-41ba-81f8-287756a0b7b5 req-5a46e69b-4ff7-4236-91ff-707e12f6a2d8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045995 Aug 27 04:04:53.411727 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3603/6920] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:53.728961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:53.729596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:53.737897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:53.738627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:53.739084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:53.739807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:53.740275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:53.740772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:53.745082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=81 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:53.951613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:53.959665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-610a5af4-28f0-4b51-af62-94e21e3fbbed tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1518 microversion: 2.1 time: 0.234556 Aug 27 04:04:53.960265 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3318/6921] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:53 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1518 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:54.984050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:54.984671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:54.991133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:54.991622 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:54.992059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:54.992759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:54.993221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:54.993651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:54.996325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:55.134055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:55.142374 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-213d4f68-4852-4d17-9fe4-0bcc65b8fed1 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1516 microversion: 2.1 time: 0.164308 Aug 27 04:04:55.142986 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3604/6922] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:54 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:55.427682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1471b669-f8cb-4a24-b334-83dc0f8dc9a8 req-53d08c30-c464-439c-a732-c32a822a4196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276e0824-da05-4557-b042-72afeef09d96", "tag": "905b81c3-76d9-4fb5-9748-942abb226c9e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:55.439067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1471b669-f8cb-4a24-b334-83dc0f8dc9a8 req-53d08c30-c464-439c-a732-c32a822a4196 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:55.439572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1471b669-f8cb-4a24-b334-83dc0f8dc9a8 req-53d08c30-c464-439c-a732-c32a822a4196 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:55.440007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1471b669-f8cb-4a24-b334-83dc0f8dc9a8 req-53d08c30-c464-439c-a732-c32a822a4196 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:55.452050 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1471b669-f8cb-4a24-b334-83dc0f8dc9a8 req-53d08c30-c464-439c-a732-c32a822a4196 service nova] Creating event network-changed:905b81c3-76d9-4fb5-9748-942abb226c9e for instance 276e0824-da05-4557-b042-72afeef09d96 on n-h1-852086-5 Aug 27 04:04:55.457382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-1471b669-f8cb-4a24-b334-83dc0f8dc9a8 req-53d08c30-c464-439c-a732-c32a822a4196 service nova] Instance 276e0824-da05-4557-b042-72afeef09d96 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:04:55.468288 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1471b669-f8cb-4a24-b334-83dc0f8dc9a8 req-53d08c30-c464-439c-a732-c32a822a4196 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044334 Aug 27 04:04:55.468958 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3319/6923] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:56.165528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:56.166144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:56.172855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:56.178723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:56.179181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:56.179934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:56.180398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:56.180830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:56.314898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:56.322736 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d27f707a-ba35-4336-8f7e-fa9268d22c6f tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1513 microversion: 2.1 time: 0.161175 Aug 27 04:04:56.323318 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3605/6924] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:56 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:56.343646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:56.344290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:56.352936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:56.352936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:56.352936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:56.352936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:56.353462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:56.353637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:56.415402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec6edf8c-7d04-4f9c-8e58-75e4c571ea9b tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "POST /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96/action" status: 204 len: 0 microversion: 2.1 time: 0.075938 Aug 27 04:04:56.416388 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3320/6925] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:04:56 2022] POST /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:04:56.425150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:56.425806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:56.432561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:56.433117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:56.433940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:56.434750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:56.437389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:56.437957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:56.577552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:56.585678 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f5ff7142-801c-4519-860f-3205150ad315 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1513 microversion: 2.1 time: 0.164418 Aug 27 04:04:56.586275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3606/6926] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:56 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:57.607880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:57.608671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:57.616914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.617420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.617873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:57.618649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.619119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.619562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:57.763598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:57.771397 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09813aef-cbca-4ec4-ab9b-f3f2e297e601 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1505 microversion: 2.1 time: 0.168417 Aug 27 04:04:57.771968 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3321/6927] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:57 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:57.791783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:57.792402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:57.799492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.799982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.800424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:57.801126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.801584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.802011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:57.934846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:57.943629 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10c94b5f-9d67-4417-a914-1ade46e25f46 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1505 microversion: 2.1 time: 0.155687 Aug 27 04:04:57.944286 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3607/6928] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:57 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:57.963309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:57.963928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:57.970297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.970794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.971241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:57.971939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.972405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.972838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:58.100179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:58.108341 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-acc6bb0d-d3b4-4e9d-814f-63f6849bf739 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1505 microversion: 2.1 time: 0.148938 Aug 27 04:04:58.108909 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3322/6929] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:57 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:58.128496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:58.129002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:58.135076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:58.135561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:58.135999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:58.136693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:58.137149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:58.137603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:58.162943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:04:58.241348 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8adabe38-0dba-4671-b4b0-db39954f3ffa tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "DELETE /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 204 len: 0 microversion: 2.1 time: 0.116396 Aug 27 04:04:58.242137 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3608/6930] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:04:58 2022] DELETE /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:04:58.259254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:58.259800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:58.266542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:58.267035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:58.267478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:58.268184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:58.268646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:58.269079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:58.294507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:04:58.341957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.compute.api [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Instance is already in deleting state, ignoring this request Aug 27 04:04:58.342838 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-081b44e7-5597-4a53-8f07-c2edc36125db tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "DELETE /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 204 len: 0 microversion: 2.1 time: 0.087787 Aug 27 04:04:58.343410 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3323/6931] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:04:58 2022] DELETE /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:04:58.351852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:58.352555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:58.359067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:58.359554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:58.359986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:58.360691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:58.361143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:58.361562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:58.500293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:58.508046 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-002bd37c-eb84-4e96-bad6-6efb157f2e67 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1511 microversion: 2.1 time: 0.160419 Aug 27 04:04:58.508629 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3609/6932] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:58 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:59.530213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:59.530978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:59.538410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:59.538908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:59.539397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:59.540084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:59.540577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:59.541732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:59.674300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be54fe679e404282908cd2340449bf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd4e534197b499fa31c2f0a361ac48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:59.682276 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-076dc146-fde0-48f5-a0bf-041e4e237216 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 200 len: 1511 microversion: 2.1 time: 0.156892 Aug 27 04:04:59.682859 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3324/6933] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:04:59 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:00.137759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b744f35d-7d35-4661-9020-64833f1ec309 req-67fe460c-acbc-4c01-830c-b84f3618af94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276e0824-da05-4557-b042-72afeef09d96", "name": "network-vif-deleted", "tag": "905b81c3-76d9-4fb5-9748-942abb226c9e"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:00.149416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b744f35d-7d35-4661-9020-64833f1ec309 req-67fe460c-acbc-4c01-830c-b84f3618af94 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:00.149897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b744f35d-7d35-4661-9020-64833f1ec309 req-67fe460c-acbc-4c01-830c-b84f3618af94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:00.150450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b744f35d-7d35-4661-9020-64833f1ec309 req-67fe460c-acbc-4c01-830c-b84f3618af94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:00.162751 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b744f35d-7d35-4661-9020-64833f1ec309 req-67fe460c-acbc-4c01-830c-b84f3618af94 service nova] Creating event network-vif-deleted:905b81c3-76d9-4fb5-9748-942abb226c9e for instance 276e0824-da05-4557-b042-72afeef09d96 on n-h1-852086-5 Aug 27 04:05:00.168227 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b744f35d-7d35-4661-9020-64833f1ec309 req-67fe460c-acbc-4c01-830c-b84f3618af94 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034176 Aug 27 04:05:00.168824 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3610/6934] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:00.703857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:00.704393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: 276e0824-da05-4557-b042-72afeef09d96] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:00.711278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:00.711773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:00.712251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:00.712959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:00.713425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:00.713891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:00.730352 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] HTTP exception thrown: Instance 276e0824-da05-4557-b042-72afeef09d96 could not be found. Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Request method failure captured: Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 HTTP/1.1 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZeKqpDiPwjF_qMlwWvaoSYM9bS_98DqmlJI8U0PItRbYc0n4ayGX1xEpv6c0iyjqhRPIVsiEDplrx2IJ7PREK__i5hVXBCEB8dtzvGWEStKpuboQa-nSy1NYIZhUCWi0V1srY_qn0iQ9IxyMg8t83p4ZclzvMfm9Qgu9To2q5Vyu1k Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8bd4e534197b499fa31c2f0a361ac48d Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bd4e534197b499fa31c2f0a361ac48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd4e534197b499fa31c2f0a361ac48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bd4e534197b499fa31c2f0a361ac48d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd4e534197b499fa31c2f0a361ac48d"}]}] Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8bd4e534197b499fa31c2f0a361ac48d Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerDiskConfigTestJSON-160265836-project Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: be54fe679e404282908cd2340449bf23 Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerDiskConfigTestJSON-160265836-project Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 276e0824-da05-4557-b042-72afeef09d96 could not be found. Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '276e0824-da05-4557-b042-72afeef09d96'} Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276e0824-da05-4557-b042-72afeef09d96 could not be found. Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276e0824-da05-4557-b042-72afeef09d96 could not be found. Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:00.733005 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276e0824-da05-4557-b042-72afeef09d96 could not be found. Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Returning 404 to user: Instance 276e0824-da05-4557-b042-72afeef09d96 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23ffb7a3-b725-4a45-9e33-1c5f4de659a9 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96" status: 404 len: 111 microversion: 2.1 time: 0.034648 Aug 27 04:05:00.737170 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3325/6935] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:00 2022] GET /compute/v2.1/servers/276e0824-da05-4557-b042-72afeef09d96 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:05:00.743661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d5f5db3a-84fc-42ab-a5a1-11a27fca207d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '.version_select at 0x7fe456999430>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:00.764478 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d5f5db3a-84fc-42ab-a5a1-11a27fca207d tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919808920" status: 202 len: 0 microversion: 2.1 time: 0.024819 Aug 27 04:05:00.765048 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3611/6936] 10.222.0.69 () {58 vars in 1218 bytes} [Sat Aug 27 04:05:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919808920 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:01.699529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:01.700039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:01.706929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:01.707504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:01.707866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:01.708579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:01.709047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:01.709493 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:01.725189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] HTTP exception thrown: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Request method failure captured: Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d HTTP/1.1 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZeKqpDiPwjF_qMlwWvaoSYM9bS_98DqmlJI8U0PItRbYc0n4ayGX1xEpv6c0iyjqhRPIVsiEDplrx2IJ7PREK__i5hVXBCEB8dtzvGWEStKpuboQa-nSy1NYIZhUCWi0V1srY_qn0iQ9IxyMg8t83p4ZclzvMfm9Qgu9To2q5Vyu1k Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 8bd4e534197b499fa31c2f0a361ac48d Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bd4e534197b499fa31c2f0a361ac48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd4e534197b499fa31c2f0a361ac48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bd4e534197b499fa31c2f0a361ac48d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd4e534197b499fa31c2f0a361ac48d"}]}] Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 8bd4e534197b499fa31c2f0a361ac48d Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerDiskConfigTestJSON-160265836-project Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: be54fe679e404282908cd2340449bf23 Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerDiskConfigTestJSON-160265836-project Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'dabbbf50-eb14-4eb3-921c-d361f118772d'} Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:05:01.726807 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Returning 404 to user: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33921f0e-f869-40e5-a97d-4260744f3a87 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 404 len: 111 microversion: 2.1 time: 0.032595 Aug 27 04:05:01.730562 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3326/6937] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:05:01 2022] DELETE /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:05:01.738421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:01.739172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] [instance: dabbbf50-eb14-4eb3-921c-d361f118772d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:01.748504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:01.748989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:01.749436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:01.750139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:01.750623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:01.751051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:01.764882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] HTTP exception thrown: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Request method failure captured: Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d HTTP/1.1 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZeKqpDiPwjF_qMlwWvaoSYM9bS_98DqmlJI8U0PItRbYc0n4ayGX1xEpv6c0iyjqhRPIVsiEDplrx2IJ7PREK__i5hVXBCEB8dtzvGWEStKpuboQa-nSy1NYIZhUCWi0V1srY_qn0iQ9IxyMg8t83p4ZclzvMfm9Qgu9To2q5Vyu1k Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 8bd4e534197b499fa31c2f0a361ac48d Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8bd4e534197b499fa31c2f0a361ac48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd4e534197b499fa31c2f0a361ac48d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8bd4e534197b499fa31c2f0a361ac48d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8bd4e534197b499fa31c2f0a361ac48d"}]}] Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 8bd4e534197b499fa31c2f0a361ac48d Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-160265836 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerDiskConfigTestJSON-160265836-project Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: be54fe679e404282908cd2340449bf23 Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerDiskConfigTestJSON-160265836-project Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'dabbbf50-eb14-4eb3-921c-d361f118772d'} Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:05:01.766556 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] Returning 404 to user: Instance dabbbf50-eb14-4eb3-921c-d361f118772d could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-80c1c747-e694-442d-892d-ce9faba36c54 tempest-ServerDiskConfigTestJSON-160265836 tempest-ServerDiskConfigTestJSON-160265836-project] 10.222.0.69 "GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d" status: 404 len: 111 microversion: 2.1 time: 0.034432 Aug 27 04:05:01.771048 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3612/6938] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:01 2022] GET /compute/v2.1/servers/dabbbf50-eb14-4eb3-921c-d361f118772d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:05:10.317173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6119b89a-efbf-4bda-8092-7a4e0eb58566 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'create', calling method: .version_select at 0x7fe457567a60>, body: {"keypair": {"name": "tempest-keypair-1869727490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcYGr6vRbGBmaGbVBk4VWJh25Vtjm/3ma2UtoSnuLDPYGCdS7S7jsPDnPJGH0EDknBttWPxTDE2tJktSZeJmGy6w8fM6dSF1jKF9eqhgQz+unlbWvbyuGwTren0BUXowA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:10.322930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=36 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:10.335690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6119b89a-efbf-4bda-8092-7a4e0eb58566 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for project 179eda37730a40abb49c3a406654e757. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:05:10.342076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6119b89a-efbf-4bda-8092-7a4e0eb58566 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for user 90a17a05dcfd4d118e9045ce62f541eb and project 179eda37730a40abb49c3a406654e757. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:05:10.370404 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6119b89a-efbf-4bda-8092-7a4e0eb58566 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194552 Aug 27 04:05:10.371014 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3327/6939] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:05:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:11.747076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-558019667", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "422500aa-3b41-4a71-98a1-805a226c6889"}], "security_groups": [{"name": "tempest-securitygroup--189521497"}], "key_name": "tempest-keypair-1869727490", "user_data": "}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:11.767919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:11.769103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:11.883076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] validate_networks() for [('422500aa-3b41-4a71-98a1-805a226c6889', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:05:12.286571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:05:12.287084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:05:12.287632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:05:12.288109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:05:12.288760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:05:12.298643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:12.298930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:12.299612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:12.300549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:12.301211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:12.301714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:12.320847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:05:12.328424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for user 90a17a05dcfd4d118e9045ce62f541eb and project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:05:12.342663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:05:12.345321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:05:12.396753 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1af20f9e-6ed3-44b1-9cd3-441cafc731b6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.655270 Aug 27 04:05:12.397972 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3613/6940] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:05:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:05:12.408449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-176b7b88-9c7f-4fde-ae7c-b8076b89f696 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:12.410118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-176b7b88-9c7f-4fde-ae7c-b8076b89f696 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:12.415115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:12.484112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-176b7b88-9c7f-4fde-ae7c-b8076b89f696 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:12.499248 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-176b7b88-9c7f-4fde-ae7c-b8076b89f696 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1238 microversion: 2.1 time: 0.094468 Aug 27 04:05:12.500490 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3328/6941] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:12 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:13.521013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:13.522901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:13.559432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:13.561069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:13.561820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:13.562957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:13.564141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:13.564940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:13.646734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:13.656472 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d373e3d-dd2a-4b6e-b648-518f583f09cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1298 microversion: 2.1 time: 0.140515 Aug 27 04:05:13.657550 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3614/6942] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:13 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:14.681154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:14.681960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:14.689810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:14.690340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:14.690789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:14.691508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:14.691975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:14.692410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:14.914699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:14.923706 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3a8890c-0924-4df0-a2ca-1546529b757b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1363 microversion: 2.1 time: 0.246593 Aug 27 04:05:14.924296 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3329/6943] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:14 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:15.110565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0f0e8112-e25e-4758-b149-84479650b1f5 req-d512021a-40cc-480f-8073-9d5b6b97e916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f32d3f-8964-4b3d-844d-ca9b31623226", "tag": "3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:15.124152 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0f0e8112-e25e-4758-b149-84479650b1f5 req-d512021a-40cc-480f-8073-9d5b6b97e916 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:15.124636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0f0e8112-e25e-4758-b149-84479650b1f5 req-d512021a-40cc-480f-8073-9d5b6b97e916 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:15.125068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0f0e8112-e25e-4758-b149-84479650b1f5 req-d512021a-40cc-480f-8073-9d5b6b97e916 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:15.141097 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0f0e8112-e25e-4758-b149-84479650b1f5 req-d512021a-40cc-480f-8073-9d5b6b97e916 service nova] Creating event network-changed:3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6 for instance 62f32d3f-8964-4b3d-844d-ca9b31623226 on n-h2-852086-5 Aug 27 04:05:15.155213 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0f0e8112-e25e-4758-b149-84479650b1f5 req-d512021a-40cc-480f-8073-9d5b6b97e916 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047752 Aug 27 04:05:15.156374 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3615/6944] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:15.944330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:15.944959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:15.951733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:15.952237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:15.952692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:15.953538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:15.954180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:15.954690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:16.154508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:16.162680 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edbfba95-9859-40d6-a798-8baf7843b762 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1363 microversion: 2.1 time: 0.222218 Aug 27 04:05:16.163298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3330/6945] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:15 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:17.185868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:17.186598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:17.193929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:17.194449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:17.194895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:17.195602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:17.196065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:17.196497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:17.368875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:17.377548 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-88646044-5f20-4fe8-8e0b-36860240f080 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1363 microversion: 2.1 time: 0.197390 Aug 27 04:05:17.378124 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3616/6946] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:17 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:18.398185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:18.398814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:18.405822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:18.406365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:18.406813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:18.407519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:18.407979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:18.408416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:18.623411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:18.631368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34285d4a-dba2-405e-a93e-3942112514e6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1363 microversion: 2.1 time: 0.237261 Aug 27 04:05:18.631940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3331/6947] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:18 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:19.652371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:19.652994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:19.660102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:19.660597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:19.661044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:19.661755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:19.662242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:19.662680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:19.898315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:19.906955 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d08d0d8c-d7f8-4252-9694-aa690b9ec481 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1363 microversion: 2.1 time: 0.258414 Aug 27 04:05:19.907902 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3617/6948] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:19 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:20.929821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:20.930477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:20.938742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:20.939502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:20.939950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:20.940669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:20.941139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:20.941581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:21.070571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:21.078416 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8de466e-8ed0-4264-82fb-66eeef076a2a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1363 microversion: 2.1 time: 0.152953 Aug 27 04:05:21.078991 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3332/6949] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:20 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:21.574097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-086ea832-a3b9-4de9-a88e-45c30506f3bd req-ec0d85c6-4d5e-4e6e-bdf8-32887e73c9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f32d3f-8964-4b3d-844d-ca9b31623226", "name": "network-vif-plugged", "status": "completed", "tag": "3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:21.587064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-086ea832-a3b9-4de9-a88e-45c30506f3bd req-ec0d85c6-4d5e-4e6e-bdf8-32887e73c9b5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:21.587911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-086ea832-a3b9-4de9-a88e-45c30506f3bd req-ec0d85c6-4d5e-4e6e-bdf8-32887e73c9b5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:21.588363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-086ea832-a3b9-4de9-a88e-45c30506f3bd req-ec0d85c6-4d5e-4e6e-bdf8-32887e73c9b5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:21.601021 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-086ea832-a3b9-4de9-a88e-45c30506f3bd req-ec0d85c6-4d5e-4e6e-bdf8-32887e73c9b5 service nova] Creating event network-vif-plugged:3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6 for instance 62f32d3f-8964-4b3d-844d-ca9b31623226 on n-h2-852086-5 Aug 27 04:05:21.607489 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-086ea832-a3b9-4de9-a88e-45c30506f3bd req-ec0d85c6-4d5e-4e6e-bdf8-32887e73c9b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035904 Aug 27 04:05:21.608201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3618/6950] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:22.099226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:22.099777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:22.107833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:22.108382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:22.108856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:22.110097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:22.110097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:22.110617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:22.244574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:22.252738 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e00ef20-832e-4ca9-85b3-dd566d567b08 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1363 microversion: 2.1 time: 0.157520 Aug 27 04:05:22.253336 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3333/6951] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:22 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:23.275791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:23.276496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:23.279324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:23.280176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:23.286769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:23.287254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:23.287687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:23.288381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:23.288833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:23.289253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:23.427486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:23.435660 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f24bca27-eb4e-40af-92aa-456c21598914 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1551 microversion: 2.1 time: 0.164141 Aug 27 04:05:23.436197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3619/6952] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:23 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:23.456660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:23.457178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:23.459104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:23.466504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:23.467017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:23.467500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:23.468245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:23.468719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:23.469163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:23.554238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fba21579-ff56-4b40-87bd-8061e3c62a97 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101397 Aug 27 04:05:23.554875 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3334/6953] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 04:05:23 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:24.483561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-be7d4951-74e0-426e-99c7-132aec0a9f2b req-e4fdd736-2ed1-4e62-b2f4-c57b3152eb8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f32d3f-8964-4b3d-844d-ca9b31623226", "tag": "3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:24.493789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-be7d4951-74e0-426e-99c7-132aec0a9f2b req-e4fdd736-2ed1-4e62-b2f4-c57b3152eb8a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:24.494296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-be7d4951-74e0-426e-99c7-132aec0a9f2b req-e4fdd736-2ed1-4e62-b2f4-c57b3152eb8a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:24.494736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-be7d4951-74e0-426e-99c7-132aec0a9f2b req-e4fdd736-2ed1-4e62-b2f4-c57b3152eb8a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:24.506100 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-be7d4951-74e0-426e-99c7-132aec0a9f2b req-e4fdd736-2ed1-4e62-b2f4-c57b3152eb8a service nova] Creating event network-changed:3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6 for instance 62f32d3f-8964-4b3d-844d-ca9b31623226 on n-h2-852086-5 Aug 27 04:05:24.511187 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-be7d4951-74e0-426e-99c7-132aec0a9f2b req-e4fdd736-2ed1-4e62-b2f4-c57b3152eb8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031930 Aug 27 04:05:24.511858 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3620/6954] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:59.696258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:59.697091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=34 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:59.703454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:59.704114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:59.711801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:59.712468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:59.712961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:59.713723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:59.714232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:59.714687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:59.859673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:59.867907 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f68c22f-ba08-4542-9d79-7ebd4dfb384e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1670 microversion: 2.1 time: 0.173530 Aug 27 04:05:59.868728 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3335/6955] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:59 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:59.888614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:59.889501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=32 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:59.894517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:59.895220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:59.903387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:59.903872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:59.904373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:59.906005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:59.906812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:59.907475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:00.052401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:00.060753 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9d291027-a36c-424a-8f53-d7148328db5c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1670 microversion: 2.1 time: 0.175853 Aug 27 04:06:00.061454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3621/6956] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:59 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:00.084929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:00.085567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:00.091830 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:00.092988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:00.093723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:00.094680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:00.095159 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:00.095602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:00.230307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:00.238506 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fce392ec-30ae-4e38-b5b3-f266923d9afb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1670 microversion: 2.1 time: 0.157549 Aug 27 04:06:00.239077 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3336/6957] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:00 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:00.258386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:00.260557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:00.267660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:00.268149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:00.268590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:00.269296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:00.269765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:00.270225 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:00.299455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:00.305679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Old instance type m1.heat2, new instance type m1.heat {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:06:00.313046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:06:00.313451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:06:00.313930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:06:00.314625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:06:00.315043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:06:00.382529 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b04ce77a-5e8d-47a0-b1bf-6b5cc1195095 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226/action" status: 202 len: 0 microversion: 2.1 time: 0.128103 Aug 27 04:06:00.383163 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3622/6958] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:06:00 2022] POST /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:00.392078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:00.392836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:00.399827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:00.400336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:00.400858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:00.401581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:00.402055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:00.402532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:00.542814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:00.550526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c2f3c64-5567-4d19-b818-d4d030ebb29d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1679 microversion: 2.1 time: 0.162860 Aug 27 04:06:00.551186 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3337/6959] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:00 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:01.573068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:01.573681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:01.580477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:01.580969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:01.581410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:01.582112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:01.582601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:01.583028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:01.721828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:01.731091 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-586056e8-738c-49fb-89e7-18c924d21d55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1679 microversion: 2.1 time: 0.162786 Aug 27 04:06:01.731685 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3623/6960] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:01 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:02.755030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:02.755729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:02.762599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:02.763103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:02.763551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:02.764388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:02.765027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:02.765507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:02.898062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:02.906432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de02a4a9-6800-4795-9439-549fca5cdbc6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.155308 Aug 27 04:06:02.907010 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3338/6961] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:02 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:03.928546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:03.929163 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:03.936615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:03.937241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:03.937525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:03.938437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:03.938724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:03.939412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:04.080695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:04.088604 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b8fb6c23-df0b-49d8-a800-c4696d7b6a37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.164110 Aug 27 04:06:04.089184 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3624/6962] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:03 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:05.111172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:05.111838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:05.118763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:05.119261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:05.119706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:05.120421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:05.120894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:05.121332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:05.259633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:05.268383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2322cf48-a7f7-4fe2-afa0-8c2bfcb9dffb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.161961 Aug 27 04:06:05.268949 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3339/6963] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:05 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:06.289881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:06.290544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:06.297400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:06.297885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:06.298361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:06.299063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:06.299523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:06.299951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:06.440846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:06.448625 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3f8fbd45-4abd-42e5-9912-04b796b2f634 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.162692 Aug 27 04:06:06.449203 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3625/6964] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:06 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:07.469300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:07.469988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:07.477744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:07.478282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:07.478735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:07.479461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:07.479966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:07.480403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:07.621386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:07.630269 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27080652-414b-46d4-985f-2d523ca482d3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.165095 Aug 27 04:06:07.630847 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3340/6965] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:07 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:08.651608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:08.652247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:08.660708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:08.661205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:08.661643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:08.662403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:08.662862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:08.663287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:08.799991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:08.807759 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d414b97-da45-4fc6-ad2d-c02c9cd09668 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.160067 Aug 27 04:06:08.808334 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3626/6966] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:08 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:09.829646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:09.830297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:09.837358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:09.837862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:09.838340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:09.839052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:09.839517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:09.839957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:09.976784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:09.985838 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc4cc091-edec-4d42-80ea-ae168775a635 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.160794 Aug 27 04:06:09.986636 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3341/6967] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:09 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:11.011345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:11.012060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:11.020489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:11.020994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:11.021433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:11.022376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:11.022854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:11.023294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:11.190189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:11.199456 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-71525801-6857-41b0-a302-6ca626618fd1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.195149 Aug 27 04:06:11.200170 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3627/6968] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:11 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:12.221887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:12.222456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:12.229560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:12.230068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:12.230549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:12.231272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:12.231772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:12.232203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:12.378871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:12.387524 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94a326b9-ead2-46d7-8886-3465d217deda tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.170432 Aug 27 04:06:12.388101 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3342/6969] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:12 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:13.408985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:13.409604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:13.416817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:13.417308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:13.417756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:13.418959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:13.418959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:13.419392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:13.553139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:13.560901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad7310c1-79bf-4149-9a7a-c5d990baf3f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.155918 Aug 27 04:06:13.562083 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3628/6970] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:13 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:14.583244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:14.583882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:14.590868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:14.591361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:14.591804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:14.592503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:14.593530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:14.593975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:14.724767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:14.732529 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99bd27a9-2aaa-4c73-9d92-ae39f30fadd4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.153277 Aug 27 04:06:14.733103 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3343/6971] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:14 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:15.756382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:15.756995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:15.763059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:15.763545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:15.763988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:15.764835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:15.765454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:15.765884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:15.904839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:15.912686 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5171ce04-e672-409e-8066-adcbc804d35b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.161411 Aug 27 04:06:15.913284 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3629/6972] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:15 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:16.934883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:16.935429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:16.942027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:16.942559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:16.943015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:16.943724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:16.944195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:16.944653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:17.078439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:17.086232 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c57bf16-0a1b-4f15-b668-3b2ba12a8ceb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.155511 Aug 27 04:06:17.086813 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3344/6973] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:16 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:18.108979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:18.109596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:18.115876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:18.116372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:18.116809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:18.117521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:18.117978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:18.118433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:18.255749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:18.264052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21b06b00-9818-47ca-8fc2-c859a1efbf62 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.159869 Aug 27 04:06:18.264717 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3630/6974] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:18 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:19.290185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:19.290835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:19.299343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:19.299757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:19.300288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:19.301155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:19.301737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:19.302242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:19.450616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:19.458980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ecef0592-19e4-4505-a4b3-e96163bfb41a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1684 microversion: 2.1 time: 0.176133 Aug 27 04:06:19.459681 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3345/6975] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:19 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:20.096366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-43be3ff7-d41f-4c32-a234-297196458cc6 req-e5d2a600-2ac7-40ee-bc0d-ec61ea321c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f32d3f-8964-4b3d-844d-ca9b31623226", "name": "network-vif-unplugged", "status": "completed", "tag": "3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:20.107748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-43be3ff7-d41f-4c32-a234-297196458cc6 req-e5d2a600-2ac7-40ee-bc0d-ec61ea321c26 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:20.108797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-43be3ff7-d41f-4c32-a234-297196458cc6 req-e5d2a600-2ac7-40ee-bc0d-ec61ea321c26 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:20.109246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-43be3ff7-d41f-4c32-a234-297196458cc6 req-e5d2a600-2ac7-40ee-bc0d-ec61ea321c26 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:20.121111 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-43be3ff7-d41f-4c32-a234-297196458cc6 req-e5d2a600-2ac7-40ee-bc0d-ec61ea321c26 service nova] Creating event network-vif-unplugged:3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6 for instance 62f32d3f-8964-4b3d-844d-ca9b31623226 on n-h1-852086-5 Aug 27 04:06:20.127466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-43be3ff7-d41f-4c32-a234-297196458cc6 req-e5d2a600-2ac7-40ee-bc0d-ec61ea321c26 service nova] Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:06:20.138709 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-43be3ff7-d41f-4c32-a234-297196458cc6 req-e5d2a600-2ac7-40ee-bc0d-ec61ea321c26 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109802 Aug 27 04:06:20.140220 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3631/6976] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:20.479733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:20.480358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:20.487849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:20.488354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:20.488861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:20.489607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:20.490106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:20.490595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:20.707169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:20.715263 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-178b3e7c-ce2d-4d2e-9e59-99ea1a9e2f88 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1683 microversion: 2.1 time: 0.239430 Aug 27 04:06:20.715837 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3346/6977] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:20 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1683 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:21.740286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:21.740906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:21.747215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:21.747705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:21.748144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:21.749497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:21.749962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:21.750421 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:21.893172 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:21.901073 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1079f403-eb1e-4573-b9e2-2150b66ac5d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1681 microversion: 2.1 time: 0.166182 Aug 27 04:06:21.901656 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3632/6978] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:21 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:22.157423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-45bff379-c783-481e-bbb1-ace74f6b0dd8 req-a958b6fb-866e-4a7c-91ae-bbc6e2c6333c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f32d3f-8964-4b3d-844d-ca9b31623226", "tag": "3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:22.168254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-45bff379-c783-481e-bbb1-ace74f6b0dd8 req-a958b6fb-866e-4a7c-91ae-bbc6e2c6333c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:22.168741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-45bff379-c783-481e-bbb1-ace74f6b0dd8 req-a958b6fb-866e-4a7c-91ae-bbc6e2c6333c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:22.169179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-45bff379-c783-481e-bbb1-ace74f6b0dd8 req-a958b6fb-866e-4a7c-91ae-bbc6e2c6333c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:22.182029 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-45bff379-c783-481e-bbb1-ace74f6b0dd8 req-a958b6fb-866e-4a7c-91ae-bbc6e2c6333c service nova] Creating event network-changed:3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6 for instance 62f32d3f-8964-4b3d-844d-ca9b31623226 on n-h1-852086-5 Aug 27 04:06:22.188295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-45bff379-c783-481e-bbb1-ace74f6b0dd8 req-a958b6fb-866e-4a7c-91ae-bbc6e2c6333c service nova] Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:06:22.199343 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-45bff379-c783-481e-bbb1-ace74f6b0dd8 req-a958b6fb-866e-4a7c-91ae-bbc6e2c6333c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046924 Aug 27 04:06:22.199975 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3347/6979] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:22.923332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:22.924052 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:22.931012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:22.931504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:22.931941 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:22.932683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:22.933141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:22.933564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:23.073567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:23.081636 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e3fca84-8ce5-4128-bcc0-fe37d985503f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1678 microversion: 2.1 time: 0.162704 Aug 27 04:06:23.082248 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3633/6980] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:22 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:23.103555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:23.104268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:23.111437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:23.112011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:23.112530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:23.113307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:23.113866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:23.114398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:23.174979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b414047-72fa-49e6-8005-791873e457b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226/action" status: 204 len: 0 microversion: 2.1 time: 0.075448 Aug 27 04:06:23.175961 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3348/6981] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:06:23 2022] POST /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:06:23.186246 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:23.186872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:23.194378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:23.194922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:23.195505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:23.197040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:23.197502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:23.198388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:23.339858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:23.349075 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f6cd83c0-e4f8-4dab-8b65-ddb96117f784 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1678 microversion: 2.1 time: 0.168923 Aug 27 04:06:23.349713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3634/6982] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:23 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:24.371841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:24.372596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:24.381539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.382044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.382526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.383287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.383757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.384198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.527441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:24.538290 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-506b7359-1d9b-4996-ac98-fe0ed6d52150 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1670 microversion: 2.1 time: 0.171116 Aug 27 04:06:24.546369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3349/6983] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:24 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:24.560588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:24.561227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:24.568760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.569317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.569934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.570665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.571281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.571701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.710924 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:24.719901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df1825f6-4a2f-422d-bb9e-7798603af08c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1670 microversion: 2.1 time: 0.163146 Aug 27 04:06:24.720853 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3635/6984] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:24 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:24.740791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:24.741420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:24.747517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.748025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.748473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.749251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.749723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.750730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.880403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:24.882747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:24.889971 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d38b35d-b450-40bc-aa6b-3f2d4166c59f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1670 microversion: 2.1 time: 0.153189 Aug 27 04:06:24.890579 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3350/6985] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:24 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:24.909977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:24.910572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:24.916655 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.917146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.917589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.918344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:24.918812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:24.919243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:24.939006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:24.948567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:06:25.033527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f76e3bc8-f591-49fc-9ff8-2d393002d034 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 204 len: 0 microversion: 2.1 time: 0.124019 Aug 27 04:06:25.034956 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3636/6986] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:06:24 2022] DELETE /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:06:25.044057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:25.044802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:25.052925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:25.053444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:25.053900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:25.054659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:25.055163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:25.056023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:25.189887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:25.199124 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7625a228-8212-4f96-bbba-6522e30fe980 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1676 microversion: 2.1 time: 0.160288 Aug 27 04:06:25.199703 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3351/6987] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:25 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:26.221095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:26.221796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:26.229058 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:26.229545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:26.229983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:26.230716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:26.231175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:26.231600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:26.369891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:26.377923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10662b27-f1f5-4ad0-bdea-ac6e02831f31 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1676 microversion: 2.1 time: 0.161816 Aug 27 04:06:26.378564 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3637/6988] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:26 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:26.772438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-742e8050-e674-4eeb-9dbe-287f0dddb765 req-0284fc73-0f71-4d4d-9412-c76a355b0966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f32d3f-8964-4b3d-844d-ca9b31623226", "name": "network-vif-plugged", "status": "completed", "tag": "3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:26.783118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-742e8050-e674-4eeb-9dbe-287f0dddb765 req-0284fc73-0f71-4d4d-9412-c76a355b0966 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:26.783335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-742e8050-e674-4eeb-9dbe-287f0dddb765 req-0284fc73-0f71-4d4d-9412-c76a355b0966 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:26.783713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-742e8050-e674-4eeb-9dbe-287f0dddb765 req-0284fc73-0f71-4d4d-9412-c76a355b0966 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:26.795101 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-742e8050-e674-4eeb-9dbe-287f0dddb765 req-0284fc73-0f71-4d4d-9412-c76a355b0966 service nova] Creating event network-vif-plugged:3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6 for instance 62f32d3f-8964-4b3d-844d-ca9b31623226 on n-h1-852086-5 Aug 27 04:06:26.801033 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-742e8050-e674-4eeb-9dbe-287f0dddb765 req-0284fc73-0f71-4d4d-9412-c76a355b0966 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091578 Aug 27 04:06:26.801692 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3352/6989] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:27.399524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:27.400268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:27.408711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:27.409199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:27.409637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:27.410375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:27.410827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:27.411303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:27.484521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:27.493579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f96b46b-ba87-4f36-8daa-c03762ba7871 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 200 len: 1609 microversion: 2.1 time: 0.097953 Aug 27 04:06:27.506202 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3638/6990] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:27 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 1609 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:27.755692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2b647ce4-76e3-4041-9054-ff7b04a48a44 req-1660baba-2c5a-4e9c-a4a6-de3ece592002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f32d3f-8964-4b3d-844d-ca9b31623226", "name": "network-vif-deleted", "tag": "3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:27.767455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2b647ce4-76e3-4041-9054-ff7b04a48a44 req-1660baba-2c5a-4e9c-a4a6-de3ece592002 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:27.768374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2b647ce4-76e3-4041-9054-ff7b04a48a44 req-1660baba-2c5a-4e9c-a4a6-de3ece592002 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:27.768890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2b647ce4-76e3-4041-9054-ff7b04a48a44 req-1660baba-2c5a-4e9c-a4a6-de3ece592002 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:27.781155 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2b647ce4-76e3-4041-9054-ff7b04a48a44 req-1660baba-2c5a-4e9c-a4a6-de3ece592002 service nova] Creating event network-vif-deleted:3e88ff19-cbb6-4d8b-8e63-a0cab4e696b6 for instance 62f32d3f-8964-4b3d-844d-ca9b31623226 on n-h1-852086-5 Aug 27 04:06:27.786330 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2b647ce4-76e3-4041-9054-ff7b04a48a44 req-1660baba-2c5a-4e9c-a4a6-de3ece592002 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034555 Aug 27 04:06:27.787369 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3353/6991] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:28.516943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:28.517550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:28.524695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:28.525186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:28.525624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:28.526370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:28.526830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:28.527257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:28.543980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 HTTP/1.1 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '62f32d3f-8964-4b3d-844d-ca9b31623226'} Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:06:28.545931 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3b38fb7e-1586-4969-b11a-78355bb3c8dd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 404 len: 111 microversion: 2.1 time: 0.035453 Aug 27 04:06:28.549904 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3639/6992] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:28 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:06:28.560751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:28.561875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:28.569081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:28.569596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:28.570052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:28.570869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:28.571351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:28.571799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:28.586416 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 HTTP/1.1 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '62f32d3f-8964-4b3d-844d-ca9b31623226'} Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:06:28.588105 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b3675c5-1fa5-42fb-87f0-99c3b6cc8019 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 404 len: 111 microversion: 2.1 time: 0.033090 Aug 27 04:06:28.593481 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3354/6993] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:28 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:06:28.639643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1978834216", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "422500aa-3b41-4a71-98a1-805a226c6889"}], "security_groups": [{"name": "tempest-securitygroup--189521497"}], "key_name": "tempest-keypair-1869727490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:28.756566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] validate_networks() for [('422500aa-3b41-4a71-98a1-805a226c6889', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:06:29.210213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:06:29.210638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:06:29.211113 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:06:29.211518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:06:29.212044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:06:29.221533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:29.222043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:29.222522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:29.223272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:29.223724 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:29.224147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:29.240830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:06:29.246054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for user 90a17a05dcfd4d118e9045ce62f541eb and project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:06:29.258374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:06:29.260635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:06:29.307540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-722af48e-96e2-432b-baf0-68bf9c9862f3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.672249 Aug 27 04:06:29.308183 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3640/6994] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:06:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:06:29.319345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8608063b-2cba-41cd-adc3-94e47f3430c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:29.319970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8608063b-2cba-41cd-adc3-94e47f3430c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:29.378385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8608063b-2cba-41cd-adc3-94e47f3430c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:29.386917 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8608063b-2cba-41cd-adc3-94e47f3430c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1239 microversion: 2.1 time: 0.071366 Aug 27 04:06:29.387482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3355/6995] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:29 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:30.410297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:30.411150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:30.414428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:30.420866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:30.421647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:30.422296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:30.423017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:30.423474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:30.423903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:30.493350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:30.503553 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-796f4201-3019-479c-9908-3429b3d9303e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1299 microversion: 2.1 time: 0.098739 Aug 27 04:06:30.504311 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3641/6996] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:30 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:31.526252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:31.527095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:31.530559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=45 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:31.536455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:31.536965 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:31.537448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:31.538144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:31.538654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:31.539094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:31.781577 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:31.789653 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c803940a-b3a6-48bf-aa02-ae07e7a9645b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1364 microversion: 2.1 time: 0.267359 Aug 27 04:06:31.790350 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3356/6997] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:31 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:31.839207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8c448921-08af-484b-a2a7-ff5b28b56aac req-7e927a49-63d2-4383-b6d6-0a8970ad0a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d845c2c0-6d81-4aa5-8fa5-81da323c17c4", "tag": "b6c4af19-887b-4f8a-b747-3e1b57c8186a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:31.853090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8c448921-08af-484b-a2a7-ff5b28b56aac req-7e927a49-63d2-4383-b6d6-0a8970ad0a7e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:31.853671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8c448921-08af-484b-a2a7-ff5b28b56aac req-7e927a49-63d2-4383-b6d6-0a8970ad0a7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:31.854154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8c448921-08af-484b-a2a7-ff5b28b56aac req-7e927a49-63d2-4383-b6d6-0a8970ad0a7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:31.874890 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8c448921-08af-484b-a2a7-ff5b28b56aac req-7e927a49-63d2-4383-b6d6-0a8970ad0a7e service nova] Creating event network-changed:b6c4af19-887b-4f8a-b747-3e1b57c8186a for instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 on n-h1-852086-5 Aug 27 04:06:31.879972 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8c448921-08af-484b-a2a7-ff5b28b56aac req-7e927a49-63d2-4383-b6d6-0a8970ad0a7e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044540 Aug 27 04:06:31.880881 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3642/6998] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:32.812598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:32.813179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:32.822442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:32.822944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:32.823395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:32.824108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:32.824582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:32.825021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:32.959641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:32.968409 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-056d65b1-5628-41dd-a9cb-d8e7f0e701c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1364 microversion: 2.1 time: 0.158939 Aug 27 04:06:32.968896 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3357/6999] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:32 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:33.990635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:33.991342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:33.997565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:33.998053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:33.998660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:33.999369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:33.999887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:34.000261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:34.132930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:34.142110 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8e183648-7326-4d34-b029-3207f62961a0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1364 microversion: 2.1 time: 0.156552 Aug 27 04:06:34.142730 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3643/7000] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:33 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:35.164023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:35.164729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:35.173227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:35.173733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:35.174225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:35.174946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:35.175428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:35.175874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:35.308678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:35.317721 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8db78ca8-db05-4223-ab0c-6f115b1aa857 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1364 microversion: 2.1 time: 0.157659 Aug 27 04:06:35.318316 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3358/7001] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:35 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:36.338425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:36.339039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:36.346483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:36.346978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:36.347423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:36.348130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:36.348595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:36.349030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:36.726956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3b8c7905-6006-4290-b775-540c411448ad req-eee919b2-22db-4a34-b21e-ac99a4722052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d845c2c0-6d81-4aa5-8fa5-81da323c17c4", "name": "network-vif-plugged", "status": "completed", "tag": "b6c4af19-887b-4f8a-b747-3e1b57c8186a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:36.743180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3b8c7905-6006-4290-b775-540c411448ad req-eee919b2-22db-4a34-b21e-ac99a4722052 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:36.744101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3b8c7905-6006-4290-b775-540c411448ad req-eee919b2-22db-4a34-b21e-ac99a4722052 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:36.744758 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3b8c7905-6006-4290-b775-540c411448ad req-eee919b2-22db-4a34-b21e-ac99a4722052 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:36.757574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3b8c7905-6006-4290-b775-540c411448ad req-eee919b2-22db-4a34-b21e-ac99a4722052 service nova] Creating event network-vif-plugged:b6c4af19-887b-4f8a-b747-3e1b57c8186a for instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 on n-h1-852086-5 Aug 27 04:06:36.763202 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3b8c7905-6006-4290-b775-540c411448ad req-eee919b2-22db-4a34-b21e-ac99a4722052 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040435 Aug 27 04:06:36.764692 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3359/7002] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:36.812227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:36.826355 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20f27164-2658-4168-9abf-952c4adbfc59 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1364 microversion: 2.1 time: 0.491827 Aug 27 04:06:36.827924 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3644/7003] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:36 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1364 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:37.850745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:37.851469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:37.858317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:37.859076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:37.859305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:37.860027 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:37.860503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:37.860947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:38.004582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:38.013020 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b7354716-af75-4731-83e7-bd25c22bf703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1364 microversion: 2.1 time: 0.167405 Aug 27 04:06:38.013635 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3360/7004] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:37 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:39.034148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:39.035006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:39.041917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:39.042441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:39.042883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:39.043594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:39.044059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:39.044493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:39.179027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:39.186733 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-acc1ef51-0899-4b30-ab40-807d5f980fcb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1551 microversion: 2.1 time: 0.156497 Aug 27 04:06:39.188110 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3645/7005] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:06:39 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:39.208968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:39.209502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:39.216820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:39.217256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:39.217711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:39.218538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:39.219026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:39.219462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:39.306085 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-542b6ba6-c5a0-4e16-a689-5e129e189642 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100933 Aug 27 04:06:39.306741 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3361/7006] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 04:06:39 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:40.266709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-47a726a1-82fd-4e9d-91bd-7a0a1d6cee02 req-9d1586fa-442f-4d38-b2a3-4522f54ade5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d845c2c0-6d81-4aa5-8fa5-81da323c17c4", "tag": "b6c4af19-887b-4f8a-b747-3e1b57c8186a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:40.271379 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:40.272047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:40.279505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47a726a1-82fd-4e9d-91bd-7a0a1d6cee02 req-9d1586fa-442f-4d38-b2a3-4522f54ade5f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:40.279981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47a726a1-82fd-4e9d-91bd-7a0a1d6cee02 req-9d1586fa-442f-4d38-b2a3-4522f54ade5f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:40.280411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-47a726a1-82fd-4e9d-91bd-7a0a1d6cee02 req-9d1586fa-442f-4d38-b2a3-4522f54ade5f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:40.293034 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-47a726a1-82fd-4e9d-91bd-7a0a1d6cee02 req-9d1586fa-442f-4d38-b2a3-4522f54ade5f service nova] Creating event network-changed:b6c4af19-887b-4f8a-b747-3e1b57c8186a for instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 on n-h1-852086-5 Aug 27 04:06:40.299215 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-47a726a1-82fd-4e9d-91bd-7a0a1d6cee02 req-9d1586fa-442f-4d38-b2a3-4522f54ade5f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037190 Aug 27 04:06:40.299853 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3646/7007] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:21.067834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:21.069960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=11 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:21.070666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=43 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:21.074994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-54e7cf17-d4bc-4633-b4c0-84c3f72d707a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:21.084948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54e7cf17-d4bc-4633-b4c0-84c3f72d707a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:21.085456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54e7cf17-d4bc-4633-b4c0-84c3f72d707a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:21.085899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54e7cf17-d4bc-4633-b4c0-84c3f72d707a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:21.108594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-54e7cf17-d4bc-4633-b4c0-84c3f72d707a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 04:07:21.152402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-54e7cf17-d4bc-4633-b4c0-84c3f72d707a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action" status: 202 len: 0 microversion: 2.1 time: 0.085159 Aug 27 04:07:21.153006 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3362/7008] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:07:21 2022] POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:21.159859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=11 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:21.161751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:21.166271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:21.167063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:21.184190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:21.184680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:21.185121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:21.185843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:21.186336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:21.186771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:21.327694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:21.335671 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a628e2d8-ae5c-4704-8087-7b71eeef55f9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.178028 Aug 27 04:07:21.336251 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3647/7009] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:21 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:22.358552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.359278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:22.366476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:22.366990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:22.367451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:22.368185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:22.368660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:22.369104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:22.509362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:22.517563 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b988b28a-69e3-4d2a-aa73-b7778b618a55 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.164179 Aug 27 04:07:22.518147 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3363/7010] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:22 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:23.540481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:23.541456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:23.549228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:23.549760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:23.550230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:23.551009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:23.551540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:23.551860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:23.688956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:23.698665 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6cb6d8f7-52ab-451b-8888-77390244b48c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.162180 Aug 27 04:07:23.699266 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3648/7011] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:23 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:24.719955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:24.720617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:24.729062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:24.729579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:24.730038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:24.730781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:24.731258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:24.731706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:24.861151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:24.870130 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d5633fa-6e96-4c73-a6ec-7d5427b2ae0c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.154104 Aug 27 04:07:24.870735 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3364/7012] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:24 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:25.890266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:25.890854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:25.898393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:25.898884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:25.899322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:25.900051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:25.900509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:25.900938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:26.033285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:26.042453 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6a63fc09-fa8f-4f6a-8c1f-c1e10836b8ee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.156153 Aug 27 04:07:26.043030 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3649/7013] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:25 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:27.063548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:27.064177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:27.071241 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:27.071734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:27.072184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:27.072888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:27.073359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:27.073795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:27.464972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:27.472848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-733059e1-d0a0-47d2-81ae-7625b5d93fc8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.413264 Aug 27 04:07:27.473418 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3365/7014] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:27 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:28.494375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:28.494995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:28.501870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:28.502394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:28.502828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:28.503522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:28.504027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:28.504576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:28.639047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:28.646859 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b10cc20e-ebd8-4934-8cee-acce86515ba1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.156502 Aug 27 04:07:28.647441 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3650/7015] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:28 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:29.667689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:29.668326 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:29.675054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:29.676061 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:29.676691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:29.677206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:29.677702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:29.678138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:29.810428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:29.818559 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2b24902-2493-47de-9776-8e9d17894a30 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.154705 Aug 27 04:07:29.819119 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3366/7016] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:29 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:30.840342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:30.840912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:30.847971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:30.848457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:30.848896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:30.849600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:30.850059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:30.850521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:30.985997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:30.994669 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9428b14f-d638-4dcc-9939-7df8e07d5643 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.158302 Aug 27 04:07:30.995265 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3651/7017] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:30 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:32.015922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:32.016561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:32.023694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:32.024205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:32.024661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:32.025380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:32.025857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:32.026339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:32.156826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:32.165153 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a8f4bc2-afcc-47d1-a1b3-98c978beb232 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.153240 Aug 27 04:07:32.165721 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3367/7018] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:32 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:33.187551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:33.188144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:33.195467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:33.195942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:33.196371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:33.197060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:33.197515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:33.197933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:33.334642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:33.342377 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-59912132-0142-49be-9255-5c94c0428141 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.158708 Aug 27 04:07:33.342953 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3652/7019] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:33 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:34.363763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:34.364559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:34.372044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:34.372545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:34.373005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:34.373722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:34.374217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:34.374660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:34.508357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:34.516474 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-228c95cb-6fb7-47de-a22b-0260eba16e73 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.156670 Aug 27 04:07:34.517049 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3368/7020] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:34 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:35.539570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:35.540193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:35.547122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:35.547612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:35.548057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:35.548761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:35.549227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:35.549658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:35.679201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:35.687049 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c11070fc-2e42-4c38-8677-9a218b3877bc tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.152367 Aug 27 04:07:35.687631 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3653/7021] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:35 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:36.708117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:36.708776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:36.715664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:36.716169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:36.716626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:36.717343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:36.717815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:36.718290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:36.852210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:36.859925 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c54600d-44c3-4a27-834a-7c3cce4ed95f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1657 microversion: 2.1 time: 0.155776 Aug 27 04:07:36.860491 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3369/7022] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:36 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:36.881019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:36.883293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:36.889991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:36.890503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:36.890936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:36.891625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:36.892076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:36.892495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:36.922768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:36.929747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Old instance type m1.heat2, new instance type m1.heat {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:07:36.936795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:07:36.937313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:07:36.937868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:07:36.938387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:07:36.938876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:07:37.022083 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6d5212b4-dbf6-4add-8d8c-b17e387cdac6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action" status: 202 len: 0 microversion: 2.1 time: 0.144989 Aug 27 04:07:37.025918 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3654/7023] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:07:36 2022] POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:37.031391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:37.032036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:37.039124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:37.039637 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:37.040101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:37.040838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:37.041352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:37.041800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:37.190941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:37.200434 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0768f212-caab-468f-9acf-d1fcf2780f04 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.173310 Aug 27 04:07:37.201134 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3370/7024] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:37 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:38.224942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:38.225863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:38.231896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:38.232383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:38.232815 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:38.233611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:38.234065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:38.234692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:38.379413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:38.387870 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4d9f5f99-c367-4269-909c-8c941c637e3a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1680 microversion: 2.1 time: 0.168445 Aug 27 04:07:38.388462 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3655/7025] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:38 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:39.410083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:39.411174 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:39.418212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:39.418718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:39.419172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:39.419901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:39.420366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:39.420804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:39.556841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:39.565564 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8e4065f-6944-4948-ae5e-0a050bfd3097 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1685 microversion: 2.1 time: 0.159551 Aug 27 04:07:39.566231 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3371/7026] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:39 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:40.589394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:40.590012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:40.593090 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:40.593237 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:07:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 (ip 10.222.0.69) !!! Aug 27 04:07:40.602100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:40.602625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:40.603066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:40.603776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:40.604237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:40.604692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:40.745374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:40.753253 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad5a55b9-1c5b-4c42-a48b-06d81d1bdcf1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1685 microversion: 2.1 time: 0.167807 Aug 27 04:07:40.753823 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3656/7027] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:40 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:41.775387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:41.776016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:41.778341 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:41.778491 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 (ip 10.222.0.69) !!! Aug 27 04:07:41.780137 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:41.780275 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 (ip 10.222.0.69) !!! Aug 27 04:07:41.798613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:41.799118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:41.799569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:41.800290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:41.800762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:41.801200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:42.032062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:42.047804 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1b91727-1686-4b96-b17e-b15bf6e7e398 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1684 microversion: 2.1 time: 0.277112 Aug 27 04:07:42.048392 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3372/7028] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:41 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1684 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:42.140014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-adb7addc-eba7-4920-ab7b-cb05e622b072 req-e624343b-b1d0-4dce-b85f-7b856e7c9b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d845c2c0-6d81-4aa5-8fa5-81da323c17c4", "name": "network-vif-unplugged", "status": "completed", "tag": "b6c4af19-887b-4f8a-b747-3e1b57c8186a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:42.151599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-adb7addc-eba7-4920-ab7b-cb05e622b072 req-e624343b-b1d0-4dce-b85f-7b856e7c9b3f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:42.152096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-adb7addc-eba7-4920-ab7b-cb05e622b072 req-e624343b-b1d0-4dce-b85f-7b856e7c9b3f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:42.152533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-adb7addc-eba7-4920-ab7b-cb05e622b072 req-e624343b-b1d0-4dce-b85f-7b856e7c9b3f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:42.168194 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-adb7addc-eba7-4920-ab7b-cb05e622b072 req-e624343b-b1d0-4dce-b85f-7b856e7c9b3f service nova] Creating event network-vif-unplugged:b6c4af19-887b-4f8a-b747-3e1b57c8186a for instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 on n-h2-852086-5 Aug 27 04:07:42.173902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-adb7addc-eba7-4920-ab7b-cb05e622b072 req-e624343b-b1d0-4dce-b85f-7b856e7c9b3f service nova] Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:07:42.185999 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-adb7addc-eba7-4920-ab7b-cb05e622b072 req-e624343b-b1d0-4dce-b85f-7b856e7c9b3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049966 Aug 27 04:07:42.185999 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3657/7029] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:43.070796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:43.071341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:43.078446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:43.078964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:43.079424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:43.080149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:43.080621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:43.081065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:43.222199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:43.231957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8ffda49-a76a-481f-945b-82bfdef433bb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1684 microversion: 2.1 time: 0.165571 Aug 27 04:07:43.232615 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3373/7030] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:43 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:44.227112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6b567759-a55d-4445-b4eb-86c568adecf5 req-20d15f54-0c15-45ab-9abe-0bb78d513b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d845c2c0-6d81-4aa5-8fa5-81da323c17c4", "tag": "b6c4af19-887b-4f8a-b747-3e1b57c8186a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:44.237129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6b567759-a55d-4445-b4eb-86c568adecf5 req-20d15f54-0c15-45ab-9abe-0bb78d513b51 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:44.237605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6b567759-a55d-4445-b4eb-86c568adecf5 req-20d15f54-0c15-45ab-9abe-0bb78d513b51 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:44.238033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6b567759-a55d-4445-b4eb-86c568adecf5 req-20d15f54-0c15-45ab-9abe-0bb78d513b51 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:44.250333 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6b567759-a55d-4445-b4eb-86c568adecf5 req-20d15f54-0c15-45ab-9abe-0bb78d513b51 service nova] Creating event network-changed:b6c4af19-887b-4f8a-b747-3e1b57c8186a for instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 on n-h2-852086-5 Aug 27 04:07:44.254480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:44.255234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:44.256483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-6b567759-a55d-4445-b4eb-86c568adecf5 req-20d15f54-0c15-45ab-9abe-0bb78d513b51 service nova] Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:07:44.263388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:44.263897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:44.264348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:44.265101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:44.265566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:44.266005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:44.268685 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6b567759-a55d-4445-b4eb-86c568adecf5 req-20d15f54-0c15-45ab-9abe-0bb78d513b51 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046683 Aug 27 04:07:44.269170 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3658/7031] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:44.615070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:44.624044 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12196bf3-e6d7-4f7d-8c80-2755908f7c2d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1682 microversion: 2.1 time: 0.373397 Aug 27 04:07:44.624645 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3374/7032] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:44 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1682 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:45.648336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:45.649035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:45.655848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:45.656564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:45.656976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:45.657721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:45.657979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:45.658591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:45.813882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:45.823837 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c89f67c9-2060-4371-a5b6-1c607552d39e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1678 microversion: 2.1 time: 0.181228 Aug 27 04:07:45.824429 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3659/7033] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:45 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:45.847901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:45.848573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:45.856913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:45.857452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:45.858067 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:45.859335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:45.860140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:45.860896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:45.930469 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63b6a2a7-57a0-4d4e-bda3-2e9bf7c08162 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action" status: 204 len: 0 microversion: 2.1 time: 0.087480 Aug 27 04:07:45.931549 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3375/7034] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:07:45 2022] POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:45.940595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:45.941318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:45.948612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:45.949035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:45.949557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:45.950438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:45.951029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:45.951468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:46.118570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:46.127539 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d7d481e8-9338-4647-97c4-5961f55f5cc0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1678 microversion: 2.1 time: 0.191851 Aug 27 04:07:46.128592 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3660/7035] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:45 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:47.151181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:47.151901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:47.158979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:47.159485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:47.159946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:47.160666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:47.161141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:47.161585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:47.176649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:47.303879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:47.312299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3cc3810-3878-44aa-a04e-76f95808191e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1678 microversion: 2.1 time: 0.166064 Aug 27 04:07:47.312866 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3376/7036] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:47 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:48.081048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-83377099-e1b1-4c94-9e40-a18861307479 req-2f6cfe76-0c85-449c-99bf-469155927e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d845c2c0-6d81-4aa5-8fa5-81da323c17c4", "name": "network-vif-plugged", "status": "completed", "tag": "b6c4af19-887b-4f8a-b747-3e1b57c8186a"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:48.092942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-83377099-e1b1-4c94-9e40-a18861307479 req-2f6cfe76-0c85-449c-99bf-469155927e86 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.093438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-83377099-e1b1-4c94-9e40-a18861307479 req-2f6cfe76-0c85-449c-99bf-469155927e86 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.093881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-83377099-e1b1-4c94-9e40-a18861307479 req-2f6cfe76-0c85-449c-99bf-469155927e86 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.105577 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-83377099-e1b1-4c94-9e40-a18861307479 req-2f6cfe76-0c85-449c-99bf-469155927e86 service nova] Creating event network-vif-plugged:b6c4af19-887b-4f8a-b747-3e1b57c8186a for instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 on n-h2-852086-5 Aug 27 04:07:48.110658 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-83377099-e1b1-4c94-9e40-a18861307479 req-2f6cfe76-0c85-449c-99bf-469155927e86 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Aug 27 04:07:48.111307 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3661/7037] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:48.333561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:48.334211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:48.341527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.342035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.342538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.343259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.343738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.344179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.476169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.484009 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6820425-36e7-41e4-853b-c0914937f9e1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1657 microversion: 2.1 time: 0.154348 Aug 27 04:07:48.484574 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3377/7038] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:48 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:48.504935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:48.505633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:48.511903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.512382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.512817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.513510 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.513963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.514414 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.644922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.653271 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f01b3640-7e34-4e9f-bd78-126b4ef99294 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1657 microversion: 2.1 time: 0.152553 Aug 27 04:07:48.653854 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3662/7039] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:48 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:48.674124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0ec468b-7bd4-495a-8641-a8f0a5d8cf06 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:48.680787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0ec468b-7bd4-495a-8641-a8f0a5d8cf06 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.681296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0ec468b-7bd4-495a-8641-a8f0a5d8cf06 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.681754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0ec468b-7bd4-495a-8641-a8f0a5d8cf06 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.704544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0ec468b-7bd4-495a-8641-a8f0a5d8cf06 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Going to try to start instance {{(pid=122408) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 04:07:48.748007 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0ec468b-7bd4-495a-8641-a8f0a5d8cf06 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action" status: 202 len: 0 microversion: 2.1 time: 0.077700 Aug 27 04:07:48.748620 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3378/7040] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:07:48 2022] POST /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:48.757648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:48.758778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:48.766953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.767560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.768003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.768888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:48.769349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:48.769781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:48.790618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:48.909908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.919427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8fb72e37-6a63-4ad6-bc42-e51a6088c8d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1666 microversion: 2.1 time: 0.166306 Aug 27 04:07:48.920032 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3663/7041] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:48 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:49.942766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:49.943487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:49.950525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:49.951030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:49.951490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:49.952210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:49.952683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:49.953137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:50.093175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.103745 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1106b93b-ba43-4b97-a4e2-cff389af71b8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1670 microversion: 2.1 time: 0.166271 Aug 27 04:07:50.104430 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3379/7042] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:49 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:50.125048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:50.125578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:50.133045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:50.133566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:50.134014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:50.134752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:50.135212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:50.135642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:50.164665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:07:50.242224 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e4d5bb81-9192-4b7a-a00b-0dd29ab7dd0d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 204 len: 0 microversion: 2.1 time: 0.120100 Aug 27 04:07:50.242836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3664/7043] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:07:50 2022] DELETE /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:50.252954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:50.253586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:50.259794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:50.260925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:50.260925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:50.262060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:50.262060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:50.262885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:50.405975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.414041 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c1fe077-4d11-467f-a619-83427b3d4a4d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1676 microversion: 2.1 time: 0.164942 Aug 27 04:07:50.414658 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3380/7044] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:50 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:51.436005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:51.436721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:51.439646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:51.446591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:51.447252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:51.447645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:51.448481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:51.449354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:51.449354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:51.593959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:51.602694 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c441b49-033e-449c-acfe-22131bed56f6 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1676 microversion: 2.1 time: 0.170947 Aug 27 04:07:51.603239 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3665/7045] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:51 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:52.450359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a0656f5e-f575-422a-9dc0-2f00a7f519b8 req-babf2516-a55c-45e3-b32e-f0f7fa305b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d845c2c0-6d81-4aa5-8fa5-81da323c17c4", "name": "network-vif-deleted", "tag": "b6c4af19-887b-4f8a-b747-3e1b57c8186a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:52.455537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=39 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:52.462433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0656f5e-f575-422a-9dc0-2f00a7f519b8 req-babf2516-a55c-45e3-b32e-f0f7fa305b9c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:52.463205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0656f5e-f575-422a-9dc0-2f00a7f519b8 req-babf2516-a55c-45e3-b32e-f0f7fa305b9c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:52.463650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0656f5e-f575-422a-9dc0-2f00a7f519b8 req-babf2516-a55c-45e3-b32e-f0f7fa305b9c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:52.476720 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a0656f5e-f575-422a-9dc0-2f00a7f519b8 req-babf2516-a55c-45e3-b32e-f0f7fa305b9c service nova] Creating event network-vif-deleted:b6c4af19-887b-4f8a-b747-3e1b57c8186a for instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 on n-h2-852086-5 Aug 27 04:07:52.481976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a0656f5e-f575-422a-9dc0-2f00a7f519b8 req-babf2516-a55c-45e3-b32e-f0f7fa305b9c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Aug 27 04:07:52.482629 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3381/7046] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:52.623945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:52.624956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:52.633182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:52.634024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:52.634568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:52.635398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:52.636055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:52.636696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:52.681696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:52.682557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:52.683318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:52.683891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lazy-loading 'fault' on Instance uuid d845c2c0-6d81-4aa5-8fa5-81da323c17c4 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:07:52.743160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:52.751331 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5946bcf8-358a-474d-9b79-1425a5a31137 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 200 len: 1329 microversion: 2.1 time: 0.131331 Aug 27 04:07:52.751931 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3666/7047] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:52 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 1329 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:53.776131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:53.776850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:53.783020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:53.783519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:53.783966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:53.784668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:53.785134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:53.785573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:53.799306 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 HTTP/1.1 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'd845c2c0-6d81-4aa5-8fa5-81da323c17c4'} Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:53.800930 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fe9b3f5-9c81-4ff9-a485-1ddabd6a72f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 404 len: 111 microversion: 2.1 time: 0.032429 Aug 27 04:07:53.805575 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3382/7048] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:53 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:53.816621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:53.817231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:53.824803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:53.825289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:53.825728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:53.826451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:53.826910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:53.827331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:53.841683 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 HTTP/1.1 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd845c2c0-6d81-4aa5-8fa5-81da323c17c4'} Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:53.843368 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d2f46ff1-7084-4f50-a7d4-362b66f2b868 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 404 len: 111 microversion: 2.1 time: 0.032346 Aug 27 04:07:53.847069 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3667/7049] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:53 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:53.894544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-272193720", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "422500aa-3b41-4a71-98a1-805a226c6889"}], "security_groups": [{"name": "tempest-securitygroup--189521497"}], "key_name": "tempest-keypair-1869727490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:54.002302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] validate_networks() for [('422500aa-3b41-4a71-98a1-805a226c6889', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:07:54.456162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:07:54.456602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:07:54.457088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:07:54.457539 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:07:54.457997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:07:54.470088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:54.470630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:54.471089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:54.471842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:54.472317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:54.472764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:54.492934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:07:54.498196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for user 90a17a05dcfd4d118e9045ce62f541eb and project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:07:54.510661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:07:54.513000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:07:54.563803 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4380d5a8-a686-4518-98b9-43c06254f31e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673101 Aug 27 04:07:54.564459 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3383/7050] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:07:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:07:54.576235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9e80b720-27c6-4347-8240-4cbc4d8752ea tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:54.576547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9e80b720-27c6-4347-8240-4cbc4d8752ea tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:54.633374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9e80b720-27c6-4347-8240-4cbc4d8752ea tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:54.642941 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9e80b720-27c6-4347-8240-4cbc4d8752ea tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1238 microversion: 2.1 time: 0.070878 Aug 27 04:07:54.643516 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3668/7051] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:54 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:55.665598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:55.666601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:55.674722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:55.675506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:55.675963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:55.676747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:55.677223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:55.677662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:55.776132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:55.785027 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f18817bd-b936-42b9-b58f-44cd20558a13 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1308 microversion: 2.1 time: 0.124021 Aug 27 04:07:55.785532 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3384/7052] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:55 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1308 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:56.810405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:56.811025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:56.819101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:56.819743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:56.820408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:56.821124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:56.821582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:56.822009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:56.958114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.965929 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9414e724-5d61-4eaa-8cfa-68b504a17844 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1363 microversion: 2.1 time: 0.159553 Aug 27 04:07:56.966636 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3669/7053] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:56 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:57.033572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5d56a9a3-4e5f-46a6-9e22-6c04848bcc4c req-1c16e5f5-7fad-4919-8f27-83de75364942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:57.045519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5d56a9a3-4e5f-46a6-9e22-6c04848bcc4c req-1c16e5f5-7fad-4919-8f27-83de75364942 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:57.046125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5d56a9a3-4e5f-46a6-9e22-6c04848bcc4c req-1c16e5f5-7fad-4919-8f27-83de75364942 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:57.046611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5d56a9a3-4e5f-46a6-9e22-6c04848bcc4c req-1c16e5f5-7fad-4919-8f27-83de75364942 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:57.059434 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5d56a9a3-4e5f-46a6-9e22-6c04848bcc4c req-1c16e5f5-7fad-4919-8f27-83de75364942 service nova] Creating event network-changed:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h2-852086-5 Aug 27 04:07:57.064446 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5d56a9a3-4e5f-46a6-9e22-6c04848bcc4c req-1c16e5f5-7fad-4919-8f27-83de75364942 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034976 Aug 27 04:07:57.065392 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3385/7054] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:57.988043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:57.988569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:57.997452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:57.997949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:57.998425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:57.999142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:57.999755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:58.000287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:58.144252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:58.152438 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6babfb7c-eee6-4a54-912e-1ad848d7d19e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1363 microversion: 2.1 time: 0.168391 Aug 27 04:07:58.153030 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3670/7055] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:57 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:59.174461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:59.175179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:59.181818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:59.182373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:59.182883 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:59.183641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:59.184118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:59.184566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:59.324359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:59.332354 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bd1010b-3a9e-48aa-b085-0f39046b5c80 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1363 microversion: 2.1 time: 0.163103 Aug 27 04:07:59.332932 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3386/7056] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:59 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:00.353702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:00.354446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:00.361671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:00.362179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:00.362618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:00.363320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:00.363775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:00.364204 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:00.500794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:00.508980 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7cc766c5-e73d-4283-80ca-590312d394d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1363 microversion: 2.1 time: 0.159258 Aug 27 04:08:00.510204 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3671/7057] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:00 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:01.530488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:01.531040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:01.539455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:01.539968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:01.540423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:01.541152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:01.541627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:01.542358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:01.677266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:01.685201 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-976c72fb-8885-41d8-9725-87ce16017969 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1363 microversion: 2.1 time: 0.158869 Aug 27 04:08:01.685762 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3387/7058] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:01 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:02.129027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8dedadb0-5cbb-4767-96ba-a6f55b4b9da9 req-e99c8e38-92ac-4369-82e7-6bfbfb558aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "name": "network-vif-plugged", "status": "completed", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:02.139802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8dedadb0-5cbb-4767-96ba-a6f55b4b9da9 req-e99c8e38-92ac-4369-82e7-6bfbfb558aee service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:02.140290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8dedadb0-5cbb-4767-96ba-a6f55b4b9da9 req-e99c8e38-92ac-4369-82e7-6bfbfb558aee service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:02.142814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8dedadb0-5cbb-4767-96ba-a6f55b4b9da9 req-e99c8e38-92ac-4369-82e7-6bfbfb558aee service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:02.153930 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8dedadb0-5cbb-4767-96ba-a6f55b4b9da9 req-e99c8e38-92ac-4369-82e7-6bfbfb558aee service nova] Creating event network-vif-plugged:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h2-852086-5 Aug 27 04:08:02.158967 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8dedadb0-5cbb-4767-96ba-a6f55b4b9da9 req-e99c8e38-92ac-4369-82e7-6bfbfb558aee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 Aug 27 04:08:02.159659 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3672/7059] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:02.708380 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:02.709012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:02.715441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:02.715952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:02.716566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:02.717196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:02.717756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:02.718230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:02.863028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:02.871964 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e347b56-2693-4edb-8460-b00fb9c17873 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1363 microversion: 2.1 time: 0.169417 Aug 27 04:08:02.872537 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3388/7060] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:02 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:03.894913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:03.895624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:03.902405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:03.902897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:03.903341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:03.904053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:03.904512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:03.904944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:04.035679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:04.044658 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dead056d-4989-4abf-aac2-e9910e5e34b1 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1550 microversion: 2.1 time: 0.155087 Aug 27 04:08:04.045241 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3673/7061] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:03 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:04.066321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:04.066853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:04.074079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:04.074633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:04.075092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:04.075811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:04.076291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:04.076761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:04.156079 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd35f218-200a-4809-bfae-4dc1689d70ef tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093885 Aug 27 04:08:04.156678 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3389/7062] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 04:08:04 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:05.104817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6c647b88-2d98-43aa-b8e5-13c1a27f125a req-f55fe6c6-e9b0-4a07-9982-cc229c524735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:05.109758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:05.116296 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6c647b88-2d98-43aa-b8e5-13c1a27f125a req-f55fe6c6-e9b0-4a07-9982-cc229c524735 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:05.117419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6c647b88-2d98-43aa-b8e5-13c1a27f125a req-f55fe6c6-e9b0-4a07-9982-cc229c524735 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:05.117882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6c647b88-2d98-43aa-b8e5-13c1a27f125a req-f55fe6c6-e9b0-4a07-9982-cc229c524735 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:05.129412 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6c647b88-2d98-43aa-b8e5-13c1a27f125a req-f55fe6c6-e9b0-4a07-9982-cc229c524735 service nova] Creating event network-changed:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h2-852086-5 Aug 27 04:08:05.134467 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6c647b88-2d98-43aa-b8e5-13c1a27f125a req-f55fe6c6-e9b0-4a07-9982-cc229c524735 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035213 Aug 27 04:08:05.135141 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3674/7063] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:38.058667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:38.059466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:38.061972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:38.062832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:38.068219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:38.070594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:38.079708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:38.080334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:38.080796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:38.081527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:38.082000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:38.082606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:38.113973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:38.122711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:08:38.129558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:08:38.130000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:08:38.130533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:08:38.130969 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:08:38.131406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:08:38.198583 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dfe5ad86-ba45-4cea-a9c8-7f728d3c6257 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338/action" status: 202 len: 0 microversion: 2.1 time: 0.140294 Aug 27 04:08:38.199831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3390/7064] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:08:38 2022] POST /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:08:38.206393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=23 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:38.207627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:08:38.213202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:38.213931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:38.221846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:38.222420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:38.222947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:38.223682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:38.224281 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:38.224939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:38.394621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:38.402817 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c837448-e202-47ca-8f30-3297bc79690a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1678 microversion: 2.1 time: 0.198625 Aug 27 04:08:38.403416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3675/7065] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:38 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:08:39.425405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:39.426040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:39.433944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:39.434560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:39.435013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:39.435810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:39.436239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:39.436678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:39.594033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:39.603045 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42818c40-ac35-495c-9a4a-28c24931575a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1678 microversion: 2.1 time: 0.182276 Aug 27 04:08:39.603523 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3391/7066] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:39 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:40.624699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:40.625317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:40.632329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:40.632813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:40.633248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.634612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:40.635070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:40.635494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:40.775098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:40.782940 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-218b8de0-caae-4bdd-a365-5c979d49ef54 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.162181 Aug 27 04:08:40.783807 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3676/7067] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:40 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:41.806694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:41.807340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:41.816376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:41.816892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:41.817349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:41.818080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:41.818599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:41.819050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:41.952459 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:41.960301 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4f7d622-63bd-4ccc-9dbc-b6260e130ab5 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.158939 Aug 27 04:08:41.960914 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3392/7068] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:41 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:42.983055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:42.983719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:42.990645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:42.991136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:42.991582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:42.992288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:42.993291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:42.993729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:43.125902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:43.134893 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc3d8827-48d9-47a2-bee9-621a1c383c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.155219 Aug 27 04:08:43.135469 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3677/7069] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:42 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:44.156385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:44.157052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:44.163901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:44.164413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:44.164872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:44.165591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:44.166065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:44.166538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:44.299205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:44.307841 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26912598-8b88-436c-914b-050dcc4c96b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.155372 Aug 27 04:08:44.308422 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3393/7070] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:44 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:45.332240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:45.332833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:45.340092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:45.340574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:45.341006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:45.341713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:45.342181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:45.342619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:45.480429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:45.488308 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85c08140-24c5-4280-a19e-b45a198222f2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.161096 Aug 27 04:08:45.488890 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3678/7071] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:45 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:46.510503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:46.511132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:46.517220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:46.517720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:46.518191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:46.518900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:46.519367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:46.519805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:46.655872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:46.663823 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70482826-1cf3-4bcc-97a1-36ad7607f93c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.158231 Aug 27 04:08:46.664482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3394/7072] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:46 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:47.687589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:47.688645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:47.695274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:47.695896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:47.696339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:47.697048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:47.697504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:47.697930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:47.842436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:47.850588 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17249806-38b8-477d-89e0-b21aeb6d17de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.167241 Aug 27 04:08:47.851197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3679/7073] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:47 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:48.879802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:48.880336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:48.888038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:48.888536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:48.889072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:48.889779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:48.890272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:48.890720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:49.025769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:49.033651 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a45381e6-47ee-4034-bd48-7cb6c0563565 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.157944 Aug 27 04:08:49.034249 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3395/7074] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:48 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:50.054855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:50.055842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:50.062959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:50.063445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:50.063877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:50.064571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:50.065024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:50.065713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:50.199420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:50.207418 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ad7fee6-5c1e-4991-8691-2f06ee05b13e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.156433 Aug 27 04:08:50.208000 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3680/7075] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:50 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:51.229327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:51.229957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:51.236939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:51.237467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:51.237917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:51.238660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:51.239131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:51.239576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:51.382260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:51.391010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94784fe8-7b06-4ad9-9acb-1ddc13044067 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.166201 Aug 27 04:08:51.391600 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3396/7076] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:51 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:52.412501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:52.413161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:52.420356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:52.420878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:52.421332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:52.422037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:52.422534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:52.422971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:52.558428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:52.566422 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-714be073-9a70-4a89-a586-95f10ea6aece tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.157888 Aug 27 04:08:52.567007 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3681/7077] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:52 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:53.590485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:53.591796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:53.598036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:53.598565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:53.599016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:53.599810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:53.600281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:53.600722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:53.732908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:53.741152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c62b10b0-c961-44b4-8f73-f0a18a32a088 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.155021 Aug 27 04:08:53.741718 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3397/7078] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:53 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:54.763051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:54.763698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:54.771312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:54.771810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:54.772256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:54.772973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:54.773469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:54.773932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:54.903095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:54.910766 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-484d9296-51fe-48f5-98a3-7db2710e7c37 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.151993 Aug 27 04:08:54.911364 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3682/7079] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:54 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:55.933119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:55.933732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:55.940882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:55.941377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:55.941827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:55.942569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:55.943039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:55.943480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:56.092844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:56.101028 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31f3bad6-0a8f-4a50-8c2d-887013abf73f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1683 microversion: 2.1 time: 0.171890 Aug 27 04:08:56.101610 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3398/7080] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:55 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:57.122344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:57.123072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:57.130238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:57.130825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:57.131386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:57.132168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:57.132668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:57.133745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:57.279393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:57.287680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fbd976a4-9930-4e45-af6c-72884e3df438 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1682 microversion: 2.1 time: 0.169701 Aug 27 04:08:57.288451 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3683/7081] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:57 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:57.567615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e173b865-def4-4e96-b07b-a373ced54f96 req-f0676e6e-3722-4b52-84e7-6ecde1cd9194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "name": "network-vif-unplugged", "status": "completed", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:57.580220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e173b865-def4-4e96-b07b-a373ced54f96 req-f0676e6e-3722-4b52-84e7-6ecde1cd9194 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:57.580810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e173b865-def4-4e96-b07b-a373ced54f96 req-f0676e6e-3722-4b52-84e7-6ecde1cd9194 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:57.581570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e173b865-def4-4e96-b07b-a373ced54f96 req-f0676e6e-3722-4b52-84e7-6ecde1cd9194 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:57.597398 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e173b865-def4-4e96-b07b-a373ced54f96 req-f0676e6e-3722-4b52-84e7-6ecde1cd9194 service nova] Creating event network-vif-unplugged:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h1-852086-5 Aug 27 04:08:57.603409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-e173b865-def4-4e96-b07b-a373ced54f96 req-f0676e6e-3722-4b52-84e7-6ecde1cd9194 service nova] Instance 65912517-3430-4e51-a7d6-e65dfe16f338 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:08:57.614950 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e173b865-def4-4e96-b07b-a373ced54f96 req-f0676e6e-3722-4b52-84e7-6ecde1cd9194 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051327 Aug 27 04:08:57.615559 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3399/7082] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:58.311887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:58.312497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:58.320795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:58.321321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:58.321758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:58.322500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:58.322961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:58.325200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:58.463648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:58.471627 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8bf13c6f-4a24-4722-a4d9-a077819677c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1682 microversion: 2.1 time: 0.166122 Aug 27 04:08:58.472216 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3684/7083] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:58 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:59.493972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:59.494729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:08:59.501887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:59.502429 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:59.502893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:59.503622 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:59.504100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:59.504551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:59.637518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:59.645342 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed8304d5-d319-4b41-8037-f5423e41cce2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1680 microversion: 2.1 time: 0.156398 Aug 27 04:08:59.645921 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3400/7084] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:08:59 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:59.651337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-53973c61-9f96-4864-87f4-ca79844c47c5 req-3320bce1-d3bb-49d8-a934-6145dcf5232e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:59.661517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-53973c61-9f96-4864-87f4-ca79844c47c5 req-3320bce1-d3bb-49d8-a934-6145dcf5232e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:08:59.662008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-53973c61-9f96-4864-87f4-ca79844c47c5 req-3320bce1-d3bb-49d8-a934-6145dcf5232e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:08:59.662476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-53973c61-9f96-4864-87f4-ca79844c47c5 req-3320bce1-d3bb-49d8-a934-6145dcf5232e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:08:59.677727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-53973c61-9f96-4864-87f4-ca79844c47c5 req-3320bce1-d3bb-49d8-a934-6145dcf5232e service nova] Creating event network-changed:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h1-852086-5 Aug 27 04:08:59.684187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-53973c61-9f96-4864-87f4-ca79844c47c5 req-3320bce1-d3bb-49d8-a934-6145dcf5232e service nova] Instance 65912517-3430-4e51-a7d6-e65dfe16f338 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:08:59.695555 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-53973c61-9f96-4864-87f4-ca79844c47c5 req-3320bce1-d3bb-49d8-a934-6145dcf5232e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047868 Aug 27 04:08:59.696214 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3685/7085] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:09:00.667590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:00.668741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:00.675982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:00.676494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:00.676987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:00.677745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:00.678257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:00.678751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:00.822405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:00.830186 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db7644c5-8efd-449a-8fe4-f13644e8049a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1677 microversion: 2.1 time: 0.167268 Aug 27 04:09:00.830782 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3401/7086] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:00 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:00.853413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:00.854046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:00.860471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:00.860956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:00.861397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:00.862097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:00.862586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:00.863015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:00.901434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:00.901928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:00.902384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:00.903116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:00.903575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:00.904003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:00.927198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for project 179eda37730a40abb49c3a406654e757. Resources: {'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:09:00.932619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for user 90a17a05dcfd4d118e9045ce62f541eb and project 179eda37730a40abb49c3a406654e757. Resources: {'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:09:01.034278 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e359cd9f-bffc-4df9-aea5-7ea5503d99bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338/action" status: 202 len: 0 microversion: 2.1 time: 0.186433 Aug 27 04:09:01.034898 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3686/7087] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:09:00 2022] POST /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:09:01.043446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:01.044199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:01.051338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:01.051732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:01.052253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:01.052908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:01.053402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:01.053813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:01.261195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:01.269839 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9580409-a796-47c4-8a03-8c86f92fedaf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1676 microversion: 2.1 time: 0.230371 Aug 27 04:09:01.274326 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3402/7088] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:01 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:02.296346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:02.297051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:02.304253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:02.305382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:02.305957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:02.306710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:02.307171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:02.307600 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:02.443220 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:02.451217 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f245a1d2-42b4-4aaf-9cc3-b5232716d92e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1676 microversion: 2.1 time: 0.160102 Aug 27 04:09:02.451892 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3687/7089] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:02 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:03.420119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-efb45521-907e-41cb-a723-d403048eaeca req-711ec2fb-b34f-4727-b1d7-e08c3fc3ccf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "name": "network-vif-plugged", "status": "completed", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:03.431166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-efb45521-907e-41cb-a723-d403048eaeca req-711ec2fb-b34f-4727-b1d7-e08c3fc3ccf6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:03.431732 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-efb45521-907e-41cb-a723-d403048eaeca req-711ec2fb-b34f-4727-b1d7-e08c3fc3ccf6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:03.432247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-efb45521-907e-41cb-a723-d403048eaeca req-711ec2fb-b34f-4727-b1d7-e08c3fc3ccf6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:03.444764 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-efb45521-907e-41cb-a723-d403048eaeca req-711ec2fb-b34f-4727-b1d7-e08c3fc3ccf6 service nova] Creating event network-vif-plugged:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h1-852086-5 Aug 27 04:09:03.450953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-efb45521-907e-41cb-a723-d403048eaeca req-711ec2fb-b34f-4727-b1d7-e08c3fc3ccf6 service nova] Instance 65912517-3430-4e51-a7d6-e65dfe16f338 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:09:03.462478 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-efb45521-907e-41cb-a723-d403048eaeca req-711ec2fb-b34f-4727-b1d7-e08c3fc3ccf6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046062 Aug 27 04:09:03.463083 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3403/7090] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:03.472294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:03.472911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:03.480074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:03.481134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:03.481265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:03.481908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:03.482390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:03.482995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:03.620798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:03.624366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:03.630552 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-eed23581-777b-4648-9617-cef6faa6bc0f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1676 microversion: 2.1 time: 0.162155 Aug 27 04:09:03.631165 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3688/7091] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:03 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:09:04.402754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-da6acf7c-4298-4182-ba54-7a081b784d1c req-defd9f3f-b9fb-4a60-a263-6b7d62bc00e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "name": "network-vif-unplugged", "status": "completed", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:04.412846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-da6acf7c-4298-4182-ba54-7a081b784d1c req-defd9f3f-b9fb-4a60-a263-6b7d62bc00e9 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:04.413357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-da6acf7c-4298-4182-ba54-7a081b784d1c req-defd9f3f-b9fb-4a60-a263-6b7d62bc00e9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:04.413805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-da6acf7c-4298-4182-ba54-7a081b784d1c req-defd9f3f-b9fb-4a60-a263-6b7d62bc00e9 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:04.425703 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-da6acf7c-4298-4182-ba54-7a081b784d1c req-defd9f3f-b9fb-4a60-a263-6b7d62bc00e9 service nova] Creating event network-vif-unplugged:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h2-852086-5 Aug 27 04:09:04.434207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-da6acf7c-4298-4182-ba54-7a081b784d1c req-defd9f3f-b9fb-4a60-a263-6b7d62bc00e9 service nova] Instance 65912517-3430-4e51-a7d6-e65dfe16f338 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:09:04.446482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-da6acf7c-4298-4182-ba54-7a081b784d1c req-defd9f3f-b9fb-4a60-a263-6b7d62bc00e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047273 Aug 27 04:09:04.447421 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3404/7092] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:04.653929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:04.654624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:04.662988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:04.663569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:04.664114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:04.664931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:04.665391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:04.665821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:04.807335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:04.815869 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5fea7241-9e30-4411-bc15-fde336a1da8a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1676 microversion: 2.1 time: 0.165796 Aug 27 04:09:04.816460 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3689/7093] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:04 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:05.840956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:05.841667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:05.848558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:05.849055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:05.849500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:05.850252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:05.850703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:05.851142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:06.000913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:06.009466 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ae6cdc1-94fb-4424-b6dd-c7f42ba09412 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1676 microversion: 2.1 time: 0.174363 Aug 27 04:09:06.010062 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3405/7094] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:05 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:06.484285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7afbb9fd-44b0-4a6b-9a52-bc4ebf0ddf0d req-9d4efa8b-a950-4a1d-9a0b-7cc30853e91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:06.499119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7afbb9fd-44b0-4a6b-9a52-bc4ebf0ddf0d req-9d4efa8b-a950-4a1d-9a0b-7cc30853e91e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:06.499784 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7afbb9fd-44b0-4a6b-9a52-bc4ebf0ddf0d req-9d4efa8b-a950-4a1d-9a0b-7cc30853e91e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:06.500377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7afbb9fd-44b0-4a6b-9a52-bc4ebf0ddf0d req-9d4efa8b-a950-4a1d-9a0b-7cc30853e91e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:06.514755 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7afbb9fd-44b0-4a6b-9a52-bc4ebf0ddf0d req-9d4efa8b-a950-4a1d-9a0b-7cc30853e91e service nova] Creating event network-changed:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h2-852086-5 Aug 27 04:09:06.520450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-7afbb9fd-44b0-4a6b-9a52-bc4ebf0ddf0d req-9d4efa8b-a950-4a1d-9a0b-7cc30853e91e service nova] Instance 65912517-3430-4e51-a7d6-e65dfe16f338 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:09:06.533804 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7afbb9fd-44b0-4a6b-9a52-bc4ebf0ddf0d req-9d4efa8b-a950-4a1d-9a0b-7cc30853e91e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053099 Aug 27 04:09:06.534225 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3690/7095] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:07.030604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:07.031245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:07.039829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.040343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.040795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.041843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.041980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.042460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.047056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:07.338861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:07.347147 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24c7566a-3c74-44bd-97b6-4668032e5e00 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1669 microversion: 2.1 time: 0.320445 Aug 27 04:09:07.347942 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3406/7096] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:07 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1669 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:07.369620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:07.370442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:07.376659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.377142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.377575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.378344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.378842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.379265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.526018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:07.535105 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04955605-2c55-4ade-ac5d-8bc20ec128cf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1669 microversion: 2.1 time: 0.170012 Aug 27 04:09:07.535904 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3691/7097] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:07 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:07.556044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:07.556960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:07.564738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.565887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.566741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.567958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.568586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.569044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.847093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:07.855625 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f703da2e-e1a6-402c-a5a5-9b6a98f55da7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1669 microversion: 2.1 time: 0.303660 Aug 27 04:09:07.856485 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3407/7098] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:07 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:07.877094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:07.877588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:07.884435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.884919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.885350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.886051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:07.886533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:07.886955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:07.912922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:09:07.996811 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c9eddc0a-e7ce-4886-8cbd-a87a2885ecf3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 204 len: 0 microversion: 2.1 time: 0.123444 Aug 27 04:09:08.001692 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3692/7099] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:09:07 2022] DELETE /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:09:08.006346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:08.006990 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:08.015312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:08.015828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:08.016286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:08.017035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:08.017514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:08.017938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:08.156012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:08.164169 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59fc67b7-eeee-4316-b3a2-04e9c3239703 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1675 microversion: 2.1 time: 0.161963 Aug 27 04:09:08.164850 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3408/7100] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:08 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:09.186000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:09.186746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:09.189532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:09.196961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:09.197535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:09.197978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:09.198735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:09.199305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:09.199631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:09.343719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:09.352025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0e75ac90-309a-43e6-878d-1f966c152373 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1675 microversion: 2.1 time: 0.170479 Aug 27 04:09:09.352629 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3693/7101] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:09 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:10.380736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:10.381524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:10.388649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=43 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:10.391127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:10.391934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:10.392491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:10.393465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:10.394047 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:10.394617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:10.463202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:10.486873 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc13260e-9e7a-44a9-85fc-7b359ac2d838 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 200 len: 1608 microversion: 2.1 time: 0.109916 Aug 27 04:09:10.491329 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3409/7102] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:10 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 1608 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:10.524046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-221a4675-8a3c-4d01-bb2b-a77cd080599d req-41d9e376-6970-41e8-bbd6-452b68d75cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65912517-3430-4e51-a7d6-e65dfe16f338", "name": "network-vif-deleted", "tag": "cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:10.537038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-221a4675-8a3c-4d01-bb2b-a77cd080599d req-41d9e376-6970-41e8-bbd6-452b68d75cb6 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:10.537534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-221a4675-8a3c-4d01-bb2b-a77cd080599d req-41d9e376-6970-41e8-bbd6-452b68d75cb6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:10.537973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-221a4675-8a3c-4d01-bb2b-a77cd080599d req-41d9e376-6970-41e8-bbd6-452b68d75cb6 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:10.551925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-221a4675-8a3c-4d01-bb2b-a77cd080599d req-41d9e376-6970-41e8-bbd6-452b68d75cb6 service nova] Creating event network-vif-deleted:cdb4c0ab-dac2-484c-9c6c-d42192ceb0c3 for instance 65912517-3430-4e51-a7d6-e65dfe16f338 on n-h2-852086-5 Aug 27 04:09:10.559888 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-221a4675-8a3c-4d01-bb2b-a77cd080599d req-41d9e376-6970-41e8-bbd6-452b68d75cb6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040108 Aug 27 04:09:10.560631 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3694/7103] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:11.508655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:11.509285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:11.517909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:11.518721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:11.519115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:11.520083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:11.520756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:11.521305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:11.550785 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 HTTP/1.1 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '65912517-3430-4e51-a7d6-e65dfe16f338'} Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:09:11.554303 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b136d4d-7bbe-4a88-8d6e-8ae6e2fe074c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 404 len: 111 microversion: 2.1 time: 0.052658 Aug 27 04:09:11.558764 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3410/7104] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:11 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:09:11.577636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:11.579139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:11.584967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:11.588590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:11.589305 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:11.589948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:11.590883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:11.591523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:11.592435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:11.608611 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 HTTP/1.1 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '65912517-3430-4e51-a7d6-e65dfe16f338'} Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:09:11.610336 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1bbcd0f3-df26-4db9-9a99-881ad38945d4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 404 len: 111 microversion: 2.1 time: 0.038562 Aug 27 04:09:11.617641 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3695/7105] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:11 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:09:11.662688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1549528106", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "422500aa-3b41-4a71-98a1-805a226c6889"}], "security_groups": [{"name": "tempest-securitygroup--189521497"}], "key_name": "tempest-keypair-1869727490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:11.773945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] validate_networks() for [('422500aa-3b41-4a71-98a1-805a226c6889', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:09:12.154356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:09:12.154802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:09:12.155297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:09:12.155751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:09:12.156179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:09:12.165609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:12.166108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:12.166590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:12.167342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:12.167813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:12.168259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:12.186458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:09:12.191998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for user 90a17a05dcfd4d118e9045ce62f541eb and project 179eda37730a40abb49c3a406654e757. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:09:12.205021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:09:12.207399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:09:12.256018 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a290432-e0f9-4480-b995-bde5287434d0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.597313 Aug 27 04:09:12.256787 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3411/7106] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:09:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:09:12.269997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34283a93-2a7b-4c7d-9601-41fa3c6bcfa0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:12.270935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34283a93-2a7b-4c7d-9601-41fa3c6bcfa0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:12.332430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34283a93-2a7b-4c7d-9601-41fa3c6bcfa0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:12.340185 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34283a93-2a7b-4c7d-9601-41fa3c6bcfa0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1239 microversion: 2.1 time: 0.075622 Aug 27 04:09:12.341341 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3696/7107] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:12 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:13.362843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:13.364076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:13.371840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:13.372720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:13.373400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:13.374248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:13.374942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:13.375468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:13.456829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:13.465573 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee7dcb51-9f23-406b-81be-52d3f3baf749 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1309 microversion: 2.1 time: 0.108150 Aug 27 04:09:13.466202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3412/7108] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:13 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:14.487826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:14.488624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:14.497301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:14.497801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:14.498263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:14.499001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:14.499453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:14.499877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:14.636560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-df503eca-62e5-4279-bff5-3c16c75217ef req-fcc2b680-8ae4-4c49-a747-c1c05d23c1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:14.646259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:14.652239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-df503eca-62e5-4279-bff5-3c16c75217ef req-fcc2b680-8ae4-4c49-a747-c1c05d23c1f5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:14.652743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-df503eca-62e5-4279-bff5-3c16c75217ef req-fcc2b680-8ae4-4c49-a747-c1c05d23c1f5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:14.653190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-df503eca-62e5-4279-bff5-3c16c75217ef req-fcc2b680-8ae4-4c49-a747-c1c05d23c1f5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:14.655625 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91708d53-e12d-4110-9332-53fc6552fef9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1364 microversion: 2.1 time: 0.171733 Aug 27 04:09:14.656552 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3697/7109] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:14 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:14.682364 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-df503eca-62e5-4279-bff5-3c16c75217ef req-fcc2b680-8ae4-4c49-a747-c1c05d23c1f5 service nova] Creating event network-changed:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h2-852086-5 Aug 27 04:09:14.687624 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-df503eca-62e5-4279-bff5-3c16c75217ef req-fcc2b680-8ae4-4c49-a747-c1c05d23c1f5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061979 Aug 27 04:09:14.688758 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3413/7110] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:15.677276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:15.677823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:15.685501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:15.686006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:15.686481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:15.687351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:15.687665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:15.688096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:15.828279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:15.837739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0c37cc8c-d034-4bcd-81e6-962e6b26bed8 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1364 microversion: 2.1 time: 0.163892 Aug 27 04:09:15.837739 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3698/7111] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:15 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:16.859881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:16.860742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:16.867506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:16.868014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:16.868472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:16.869204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:16.869684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:16.870138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:17.079561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:17.087532 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a6b08ac-08e8-4da5-ad82-4a03275c78d7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1364 microversion: 2.1 time: 0.232033 Aug 27 04:09:17.088123 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3414/7112] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:16 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:18.108676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:18.109292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:18.115690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:18.116182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:18.116625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:18.117563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:18.118045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:18.118502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:18.250470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:18.259230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ab68357d-a241-420d-93a7-98c08a57d67b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1364 microversion: 2.1 time: 0.154628 Aug 27 04:09:18.259882 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3699/7113] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:18 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:19.280540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:19.281177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:19.288148 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:19.288659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:19.289347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:19.290070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:19.290573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:19.291025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:19.422086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:19.431004 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5866020b-c1c8-4a58-92b1-6460a9017855 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1364 microversion: 2.1 time: 0.154195 Aug 27 04:09:19.431587 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3415/7114] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:19 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:20.448584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-0c1b2153-79c5-43aa-a57c-6b794cd59bcb req-c8142e67-1373-49c8-9aba-b96792da7f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "name": "network-vif-plugged", "status": "completed", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:20.452012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:20.453305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:20.460533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:20.461317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:20.461694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0c1b2153-79c5-43aa-a57c-6b794cd59bcb req-c8142e67-1373-49c8-9aba-b96792da7f0a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:20.461845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:20.462226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0c1b2153-79c5-43aa-a57c-6b794cd59bcb req-c8142e67-1373-49c8-9aba-b96792da7f0a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:20.462595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:20.462823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-0c1b2153-79c5-43aa-a57c-6b794cd59bcb req-c8142e67-1373-49c8-9aba-b96792da7f0a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:20.463232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:20.463842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:20.479328 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-0c1b2153-79c5-43aa-a57c-6b794cd59bcb req-c8142e67-1373-49c8-9aba-b96792da7f0a service nova] Creating event network-vif-plugged:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h2-852086-5 Aug 27 04:09:20.484932 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-0c1b2153-79c5-43aa-a57c-6b794cd59bcb req-c8142e67-1373-49c8-9aba-b96792da7f0a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039989 Aug 27 04:09:20.485762 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3700/7115] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:20.654796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:20.662565 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab4e01b8-978c-4167-82cf-44e9f2431355 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1364 microversion: 2.1 time: 0.214377 Aug 27 04:09:20.663150 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3416/7116] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:20 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:09:21.685541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:21.686284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:21.694472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:21.696097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:21.696370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:21.697139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:21.697601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:21.698026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:21.841883 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:21.850818 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fd8d3211-7b38-4f5b-8904-8689eee3a024 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1364 microversion: 2.1 time: 0.169452 Aug 27 04:09:21.858041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3701/7117] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:21 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:22.873444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:22.874138 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:22.877541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:22.878373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:22.884574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:22.885094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:22.885542 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:22.886284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:22.886750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:22.887187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:23.021658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:23.029743 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02d2766c-88a4-4cea-abed-8470b3897c23 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1551 microversion: 2.1 time: 0.160224 Aug 27 04:09:23.030356 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3417/7118] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:09:22 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:23.050584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:23.051129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:09:23.053038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:09:23.060344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:23.060831 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:23.061269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:23.061970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:23.062465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:23.062891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:23.142297 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b4fa048b-84a3-4646-870b-383c9618cb90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095592 Aug 27 04:09:23.142906 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3702/7119] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 04:09:23 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:24.204811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8266e3a6-1c50-45e1-b427-fd7a987abff3 req-6b0b200b-b809-4005-8ddb-c9b9a1e09c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:24.215482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8266e3a6-1c50-45e1-b427-fd7a987abff3 req-6b0b200b-b809-4005-8ddb-c9b9a1e09c63 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:09:24.216147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8266e3a6-1c50-45e1-b427-fd7a987abff3 req-6b0b200b-b809-4005-8ddb-c9b9a1e09c63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:09:24.216599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8266e3a6-1c50-45e1-b427-fd7a987abff3 req-6b0b200b-b809-4005-8ddb-c9b9a1e09c63 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:09:24.228056 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8266e3a6-1c50-45e1-b427-fd7a987abff3 req-6b0b200b-b809-4005-8ddb-c9b9a1e09c63 service nova] Creating event network-changed:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h2-852086-5 Aug 27 04:09:24.233225 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8266e3a6-1c50-45e1-b427-fd7a987abff3 req-6b0b200b-b809-4005-8ddb-c9b9a1e09c63 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083629 Aug 27 04:09:24.234283 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3418/7120] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:00.699104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=21 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:00.699912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:00.704659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:00.705277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:00.714264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:00.714762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:00.715208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:00.715963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:00.716381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:00.716811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:00.860015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:00.867800 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d6a8bc51-544d-4915-b3f4-efbae2444308 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1670 microversion: 2.1 time: 0.170689 Aug 27 04:10:00.868470 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3703/7121] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:00 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:00.887267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:00.888033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=60 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:00.892963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc7c4a93-9bf3-46eb-94aa-c44e4f26d795"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:00.895723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:00.904431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:00.904942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:00.905406 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:00.906129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:00.906635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:00.907085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:01.149980 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b6d5092-9a86-4f11-b1e8-b6a9fc98f577 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264273 Aug 27 04:10:01.150958 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3419/7122] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 04:10:00 2022] POST /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:12.024054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:12.026594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:12.029447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:12.030110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:12.036265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:12.036762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:12.037205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:12.037963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:12.038457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:12.038890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:12.070227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:12.077293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Old instance type m1.heat2, new instance type m1.heat {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:10:12.084290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:10:12.084715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:10:12.085196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:10:12.085610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:10:12.086027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:10:12.151215 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-27131c77-c72a-432b-802c-d088369ecb58 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/action" status: 202 len: 0 microversion: 2.1 time: 0.131073 Aug 27 04:10:12.152041 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3704/7123] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:10:12 2022] POST /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:10:12.158058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:12.159054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:12.167674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:12.172030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:12.179624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:12.181749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:12.182287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:12.183001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:12.183690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:12.184187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:12.335332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:12.344848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05c3c86f-9795-424f-ad3b-00cc5f7cbcfb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1725 microversion: 2.1 time: 0.188622 Aug 27 04:10:12.345422 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3420/7124] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:12 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:13.366069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:13.366822 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:13.374800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:13.375292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:13.375727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:13.376434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:13.377548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:13.377976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:13.520047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:13.528944 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-497aa7b2-dd1b-4da8-8e9a-b796b50f1ffd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1725 microversion: 2.1 time: 0.167604 Aug 27 04:10:13.529895 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3705/7125] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:13 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:14.551305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:14.551941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:14.559787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:14.560310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:14.560746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:14.561470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:14.561943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:14.562413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:14.698270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:14.706687 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8d0d63c-333f-4ee5-aea8-4ec7cfd8266a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.159366 Aug 27 04:10:14.707263 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3421/7126] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:14 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:15.729975 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:15.730549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:15.737402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:15.737894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:15.738492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:15.739074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:15.739545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:15.740012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:15.898291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:15.910143 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4e69d848-563b-444e-913e-99cda69005c2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.184960 Aug 27 04:10:15.910797 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3706/7127] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:15 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:16.932006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:16.932558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:16.942789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:16.943316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:16.943805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:16.944527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:16.945004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:16.945632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:17.076588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:17.085342 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-005b3aab-f719-43b3-a01f-29bd8498a173 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.157929 Aug 27 04:10:17.085925 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3422/7128] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:16 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:18.108564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:18.109165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:18.115237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:18.115715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:18.116171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:18.116860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:18.117896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:18.118602 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:18.255050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:18.263354 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-edafe4e5-c8ff-465a-939e-3f8ed6e3d687 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.159067 Aug 27 04:10:18.263936 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3707/7129] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:18 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:19.284567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:19.285195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:19.292791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:19.293291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:19.293739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:19.294483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:19.294954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:19.295393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:19.474943 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:19.483483 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1f8b8c6-a0b0-4f67-8e9f-f0d6d9fd4d1d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.203073 Aug 27 04:10:19.484060 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3423/7130] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:19 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:20.505533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:20.506096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:20.513594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:20.514084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:20.514556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:20.515264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:20.515722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:20.516150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:20.700153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:20.708429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c22aabdd-6de8-474e-ad55-b7a2c14e60e0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.206924 Aug 27 04:10:20.709005 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3708/7131] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:20 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:21.731187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:21.731827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:21.738810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:21.739249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:21.739707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:21.740501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:21.741076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:21.741570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:21.876837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:21.885399 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-97952c6c-e289-4f3c-91eb-44f7994d30b2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.158838 Aug 27 04:10:21.885964 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3424/7132] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:21 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:22.906489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:22.907105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:22.914196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:22.914767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:22.915209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:22.915909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:22.916366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:22.916792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:23.054481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:23.066856 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-627eba0b-8696-43ab-a903-eeaf828d89de tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.163927 Aug 27 04:10:23.067989 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3709/7133] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:22 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:24.089676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:24.090333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:24.097343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:24.097843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:24.098323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:24.099037 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:24.099508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:24.099953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:24.237581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:24.247111 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-479bfd52-c871-49f9-9add-1acdd481cf17 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.162066 Aug 27 04:10:24.247688 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3425/7134] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:24 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:25.270544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:25.271200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:25.279561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:25.279982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:25.280464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:25.281313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:25.281803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:25.282266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:25.420105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:25.431355 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-913e7ee2-a596-4e78-91b7-292b86d49c74 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.164711 Aug 27 04:10:25.431967 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3710/7135] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:25 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:26.453019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:26.453561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:26.460443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:26.460946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:26.461455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:26.462498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:26.462973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:26.463415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:26.602202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:26.611008 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4093322c-bcb9-4441-af56-dfafd2d01ac4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.161934 Aug 27 04:10:26.611598 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3426/7136] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:26 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:27.632657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:27.633914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:27.640244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:27.640858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:27.641298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:27.642011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:27.642496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:27.642936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:27.780332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:27.789580 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-957a1edc-96e3-466d-b11f-24e73ea49558 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1730 microversion: 2.1 time: 0.160144 Aug 27 04:10:27.790356 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3711/7137] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:27 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:28.585218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-53ca6829-b603-4226-81d4-95c5d3e04149 req-3c9ce315-0817-4c83-84b1-94c6d75b5e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:28.596324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-53ca6829-b603-4226-81d4-95c5d3e04149 req-3c9ce315-0817-4c83-84b1-94c6d75b5e05 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:28.597073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-53ca6829-b603-4226-81d4-95c5d3e04149 req-3c9ce315-0817-4c83-84b1-94c6d75b5e05 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:28.597522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-53ca6829-b603-4226-81d4-95c5d3e04149 req-3c9ce315-0817-4c83-84b1-94c6d75b5e05 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:28.610093 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-53ca6829-b603-4226-81d4-95c5d3e04149 req-3c9ce315-0817-4c83-84b1-94c6d75b5e05 service nova] Creating event network-vif-unplugged:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h1-852086-5 Aug 27 04:10:28.615416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-53ca6829-b603-4226-81d4-95c5d3e04149 req-3c9ce315-0817-4c83-84b1-94c6d75b5e05 service nova] Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:10:28.627561 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-53ca6829-b603-4226-81d4-95c5d3e04149 req-3c9ce315-0817-4c83-84b1-94c6d75b5e05 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046043 Aug 27 04:10:28.628482 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3427/7138] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:10:28.811797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:28.812412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:28.819567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:28.820055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:28.820610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:28.821616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:28.822080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:28.822535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:28.961082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:28.970695 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-50bf61e3-f30b-4ed0-b63f-31213cacaef0 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1729 microversion: 2.1 time: 0.162812 Aug 27 04:10:28.971286 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3712/7139] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:28 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:29.995016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:29.995761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:30.002108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:30.002645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:30.003111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:30.003838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:30.004312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:30.011530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:30.150947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:30.159420 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff575b7a-f4b1-4c2c-aff0-36d873acb4e7 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.170275 Aug 27 04:10:30.160003 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3428/7140] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:29 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:30.671285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6117c31b-78a2-4e8f-b878-7e1d419b504a req-df08fa4c-1df8-4db2-b2a2-6b7b60381e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:30.683369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6117c31b-78a2-4e8f-b878-7e1d419b504a req-df08fa4c-1df8-4db2-b2a2-6b7b60381e1b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:30.683848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6117c31b-78a2-4e8f-b878-7e1d419b504a req-df08fa4c-1df8-4db2-b2a2-6b7b60381e1b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:30.684276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6117c31b-78a2-4e8f-b878-7e1d419b504a req-df08fa4c-1df8-4db2-b2a2-6b7b60381e1b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:30.700362 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6117c31b-78a2-4e8f-b878-7e1d419b504a req-df08fa4c-1df8-4db2-b2a2-6b7b60381e1b service nova] Creating event network-changed:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h1-852086-5 Aug 27 04:10:30.706375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-6117c31b-78a2-4e8f-b878-7e1d419b504a req-df08fa4c-1df8-4db2-b2a2-6b7b60381e1b service nova] Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:10:30.718221 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6117c31b-78a2-4e8f-b878-7e1d419b504a req-df08fa4c-1df8-4db2-b2a2-6b7b60381e1b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050887 Aug 27 04:10:30.718960 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3713/7141] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:31.182287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:31.183631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:31.191178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:31.192064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:31.192582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:31.193386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:31.194065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:31.194707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:31.522441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:31.543870 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04a3cc8c-34ee-43d0-b582-489390d12e7f tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.366577 Aug 27 04:10:31.544577 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3429/7142] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:31 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:32.566627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:32.567338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:32.574011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:32.574545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:32.574987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:32.575771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:32.576228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:32.576664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:32.720499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:32.729984 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce9bb9af-33a5-4d45-a818-23455c407ab3 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.168719 Aug 27 04:10:32.730754 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3714/7143] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:32 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:33.753212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:33.753771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:33.761966 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:33.762496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:33.762948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:33.763666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:33.764133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:33.764574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:33.896679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:33.905586 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb50b7fc-0499-4843-bb76-04cdb103d453 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.156469 Aug 27 04:10:33.906153 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3430/7144] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:33 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:34.927330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:34.927856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:34.935627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:34.936116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:34.936557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:34.937285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:34.937772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:34.938233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:35.076200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:35.084639 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a9a84d9-e69c-480c-b7af-66c6958e0f5d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.161279 Aug 27 04:10:35.085224 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3715/7145] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:34 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:36.107516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:36.108145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:36.115132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:36.115628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:36.116073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:36.116777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:36.118080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:36.118650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:36.253125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:36.261682 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d6e90ae-7dc3-4ea8-b860-ae184aad1f95 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.158166 Aug 27 04:10:36.262343 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3431/7146] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:36 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:37.282828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:37.283461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:37.290960 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:37.291442 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:37.291875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:37.292562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:37.293016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:37.293439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:37.429994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:37.439607 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-16168b5d-7ed6-42ca-819c-44333678f126 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.160653 Aug 27 04:10:37.440212 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3716/7147] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:37 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:38.462220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:38.462858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:38.469769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:38.470301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:38.470756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:38.471471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:38.471945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:38.472390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:38.606852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:38.615319 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-892dfb1d-6e4e-45a0-a532-c95ca9bec720 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.157814 Aug 27 04:10:38.615900 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3432/7148] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:38 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:39.637457 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:39.638075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:39.645168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:39.645654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:39.646090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:39.646812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:39.647266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:39.647690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:39.784704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:39.793455 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4e0bebd2-71e8-4ffa-8db0-9acbb69a187e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.159874 Aug 27 04:10:39.794040 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3717/7149] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:39 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:40.817409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:40.817941 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:40.825231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:40.825727 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:40.826203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:40.826983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:40.827449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:40.827889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:40.957671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:40.966745 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c144c607-8a8f-4a0f-ac60-7d5b7c7e7f22 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.153682 Aug 27 04:10:40.967328 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3433/7150] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:40 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:41.988697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:41.989312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:41.996652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:41.997137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:41.997576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:41.998348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:41.998811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:41.999239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:42.129748 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:42.133854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:42.143106 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cd66e196-b0d6-466f-b5b9-9cc896a7d107 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1727 microversion: 2.1 time: 0.158277 Aug 27 04:10:42.143945 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3718/7151] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:41 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:43.165403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:43.166030 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:43.168843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=29 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:43.174080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.174650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.175105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.175817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.176291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.176738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.180284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=83 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:43.313573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:43.322825 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37062eed-1ea4-4d15-aed6-792dd5eb3102 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1724 microversion: 2.1 time: 0.162177 Aug 27 04:10:43.323403 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3434/7152] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:43 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:43.343356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:43.343906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:43.346621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=35 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:43.352826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.353331 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.353771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.354652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.355234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.355547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.397402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.397886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.398365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.399098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.399558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.399988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.420838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for project 179eda37730a40abb49c3a406654e757. Resources: {'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:10:43.426043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Getting quotas for user 90a17a05dcfd4d118e9045ce62f541eb and project 179eda37730a40abb49c3a406654e757. Resources: {'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:10:43.530781 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc682a42-b36e-4bb3-bb33-0f40d01e7a90 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "POST /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/action" status: 202 len: 0 microversion: 2.1 time: 0.191408 Aug 27 04:10:43.531442 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3719/7153] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:10:43 2022] POST /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:10:43.539835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:43.540480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:43.546682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.547188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.547651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.548390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.548961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.549495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.756973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:43.766371 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4f5cd33-f62c-4f0e-a6df-3828b1f4feee tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.230556 Aug 27 04:10:43.770210 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3435/7154] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:43 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:43.896118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-26ff37c1-d5b1-47d5-85b7-9e5e7f86f9fb req-b61c82cc-fb0c-4b81-bc83-c89f5f0ea795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "name": "network-vif-plugged", "status": "completed", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:43.908065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26ff37c1-d5b1-47d5-85b7-9e5e7f86f9fb req-b61c82cc-fb0c-4b81-bc83-c89f5f0ea795 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:43.908559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26ff37c1-d5b1-47d5-85b7-9e5e7f86f9fb req-b61c82cc-fb0c-4b81-bc83-c89f5f0ea795 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:43.909360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-26ff37c1-d5b1-47d5-85b7-9e5e7f86f9fb req-b61c82cc-fb0c-4b81-bc83-c89f5f0ea795 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:43.922772 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-26ff37c1-d5b1-47d5-85b7-9e5e7f86f9fb req-b61c82cc-fb0c-4b81-bc83-c89f5f0ea795 service nova] Creating event network-vif-plugged:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h1-852086-5 Aug 27 04:10:43.929109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-26ff37c1-d5b1-47d5-85b7-9e5e7f86f9fb req-b61c82cc-fb0c-4b81-bc83-c89f5f0ea795 service nova] Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:10:43.941853 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-26ff37c1-d5b1-47d5-85b7-9e5e7f86f9fb req-b61c82cc-fb0c-4b81-bc83-c89f5f0ea795 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051376 Aug 27 04:10:43.943058 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3720/7155] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:10:44.788560 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:44.789114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:44.796689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:44.797195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:44.797651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:44.798403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:44.798879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:44.799325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:44.929923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:44.940335 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-763a2b7d-0a77-458d-b8b2-8d05f0be6520 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.155886 Aug 27 04:10:44.941174 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3436/7156] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:44 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:45.963140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:45.963759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:45.971198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:45.971684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:45.972124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:45.972827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:45.973285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:45.973716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:46.108410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:46.116891 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-80a5907c-e861-42e9-8938-483f9b473155 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.158180 Aug 27 04:10:46.117523 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3721/7157] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:45 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:10:47.140517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:47.141158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:47.147423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:47.147934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:47.148396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:47.149126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:47.149628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:47.150080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:47.286128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:47.294815 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65f6fdab-b22c-4fce-b8c8-ff25a3021acf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.158607 Aug 27 04:10:47.295402 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3437/7158] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:47 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:48.317234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:48.317856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:48.324511 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:48.324997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:48.325447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:48.326189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:48.326643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:48.327073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:48.470585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:48.480120 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fdcea3db-b410-4c15-bffb-699750e95ec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.167073 Aug 27 04:10:48.480715 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3722/7159] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:48 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:49.030698 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6af6189a-af35-411f-bca1-f1a37d4d2dcc req-fd0ba5f6-2261-4fe6-82de-ae56352cc247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "name": "network-vif-unplugged", "status": "completed", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:49.043082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6af6189a-af35-411f-bca1-f1a37d4d2dcc req-fd0ba5f6-2261-4fe6-82de-ae56352cc247 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:49.043649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6af6189a-af35-411f-bca1-f1a37d4d2dcc req-fd0ba5f6-2261-4fe6-82de-ae56352cc247 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:49.044127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6af6189a-af35-411f-bca1-f1a37d4d2dcc req-fd0ba5f6-2261-4fe6-82de-ae56352cc247 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:49.060340 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6af6189a-af35-411f-bca1-f1a37d4d2dcc req-fd0ba5f6-2261-4fe6-82de-ae56352cc247 service nova] Creating event network-vif-unplugged:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h2-852086-5 Aug 27 04:10:49.066407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-6af6189a-af35-411f-bca1-f1a37d4d2dcc req-fd0ba5f6-2261-4fe6-82de-ae56352cc247 service nova] Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:10:49.077500 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6af6189a-af35-411f-bca1-f1a37d4d2dcc req-fd0ba5f6-2261-4fe6-82de-ae56352cc247 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050592 Aug 27 04:10:49.078441 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3438/7160] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:10:49.501030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:49.501641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:49.508879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:49.509575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:49.510196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:49.511451 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:49.512252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:49.512692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:49.668661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:49.678731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-25f16619-8c6c-4ce9-9f21-bc5a775ab04b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.181587 Aug 27 04:10:49.679331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3723/7161] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:49 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:50.702592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:50.703308 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:50.709546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:50.710044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:50.710522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:50.711252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:50.712388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:50.712968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:50.856240 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:50.864643 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24254cc5-c1dd-4558-a997-7bc4e19b49eb tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.167265 Aug 27 04:10:50.865213 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3439/7162] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:50 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:51.114995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-38e4efe5-990e-4bd4-b817-a854e9de5d8c req-8d7a88c2-8e22-4ffb-a217-fa4fb03f956a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:51.126063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38e4efe5-990e-4bd4-b817-a854e9de5d8c req-8d7a88c2-8e22-4ffb-a217-fa4fb03f956a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:51.126577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38e4efe5-990e-4bd4-b817-a854e9de5d8c req-8d7a88c2-8e22-4ffb-a217-fa4fb03f956a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:51.127009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38e4efe5-990e-4bd4-b817-a854e9de5d8c req-8d7a88c2-8e22-4ffb-a217-fa4fb03f956a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:51.139161 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-38e4efe5-990e-4bd4-b817-a854e9de5d8c req-8d7a88c2-8e22-4ffb-a217-fa4fb03f956a service nova] Creating event network-changed:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h2-852086-5 Aug 27 04:10:51.144589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-38e4efe5-990e-4bd4-b817-a854e9de5d8c req-8d7a88c2-8e22-4ffb-a217-fa4fb03f956a service nova] Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:10:51.155679 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-38e4efe5-990e-4bd4-b817-a854e9de5d8c req-8d7a88c2-8e22-4ffb-a217-fa4fb03f956a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044374 Aug 27 04:10:51.156540 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3724/7163] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:51.886079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:51.886926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:51.894814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:51.895405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:51.895933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:51.896733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:51.897302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:51.897950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:52.152222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:52.161077 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85def4e2-0ab0-4a61-a8bb-43d9a9b225bf tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.280016 Aug 27 04:10:52.161750 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3440/7164] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:51 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:53.184080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:53.184817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:53.191714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:53.192207 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:53.192642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:53.193347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:53.193827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:53.194293 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:53.333149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:53.343234 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-00bd194c-4955-4186-a964-bcc084c24e7d tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.164476 Aug 27 04:10:53.343830 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3725/7165] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:53 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:54.365078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:54.365712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:54.373513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:54.374028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:54.374524 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:54.375247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:54.375723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:54.376173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:54.520157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:54.530927 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62870526-6aab-4507-b081-2ddc904c0a8c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.169688 Aug 27 04:10:54.531717 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3441/7166] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:54 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:55.551773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:55.552390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:55.554427 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:10:55.561811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:55.562347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:55.562785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:55.563496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:55.563956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:55.564385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:55.699714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:55.708121 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc81f12b-27e9-4c91-a152-18d53332c2cd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.160238 Aug 27 04:10:55.708637 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3726/7167] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:55 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:56.729885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:56.730550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:56.737468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:56.737978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:56.738468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:56.739188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:56.739662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:56.740109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:56.871345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:56.879941 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b036a3b4-cfee-4357-b48a-6383b843e06e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.154631 Aug 27 04:10:56.880525 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3442/7168] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:56 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:57.901640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:57.902206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:57.908820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:57.909306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:57.909750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:57.910468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:57.910932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:57.911362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:58.042890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:58.051294 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c7583503-1373-4a66-904f-db7ff80efc29 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.153683 Aug 27 04:10:58.051866 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3727/7169] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:57 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:59.073289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:59.073919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:10:59.080939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:59.081438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:59.081892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:59.082642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:10:59.083109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:10:59.083548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:10:59.214736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:59.223107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79ad80bc-a926-4440-832c-e9c83bef3e63 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.154516 Aug 27 04:10:59.223661 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3443/7170] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:10:59 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:00.245770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:00.246346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:00.253522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:00.254020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:00.254568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:00.255277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:00.255739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:00.256175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:00.392168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:00.401210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6d1ba70-ddcc-49dc-aade-61f0de148b51 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.160231 Aug 27 04:11:00.401791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3728/7171] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:00 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:01.422348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:01.422983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:01.431460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:01.432085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:01.433034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:01.433882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:01.434470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:01.434928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:01.590292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:01.599508 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa70e6cd-082e-40c6-b233-01b195768666 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1723 microversion: 2.1 time: 0.181174 Aug 27 04:11:01.600103 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3444/7172] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:01 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:02.624349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:02.624967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:02.628151 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:11:02.628293 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd (ip 10.222.0.69) !!! Aug 27 04:11:02.634887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:02.635363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:02.635798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:02.636494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:02.636946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:02.637370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:02.771908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:02.781296 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2a7c8b8-4b99-4678-9668-b8b3503b7729 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1716 microversion: 2.1 time: 0.160808 Aug 27 04:11:02.781884 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3729/7173] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:02 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:02.802790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:02.803343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:02.811034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:02.811533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:02.811981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:02.812691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:02.813171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:02.813598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:02.881027 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:11:02.881275 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd (ip 10.222.0.69) !!! Aug 27 04:11:02.950002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:02.958337 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4021b3cb-8c3c-4f9a-b149-a2e1d0021113 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1716 microversion: 2.1 time: 0.159420 Aug 27 04:11:02.959020 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3445/7174] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:02 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:02.981136 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:02.981763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:02.987978 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:02.988488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:02.988933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:02.989651 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:02.990111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:02.990564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:03.140590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:03.150912 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-95fc6110-a89d-4488-a611-d331f3d1fec4 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1716 microversion: 2.1 time: 0.174188 Aug 27 04:11:03.151524 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3730/7175] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:02 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:03.171079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:03.171601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:03.177724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:03.178274 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:03.178734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:03.179461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:03.179940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:03.180385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:03.208412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:11:03.292745 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76010076-6507-4495-b86e-fd63f978dd02 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 204 len: 0 microversion: 2.1 time: 0.125090 Aug 27 04:11:03.293486 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3446/7176] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:03 2022] DELETE /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:11:03.309807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:03.310654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:03.317240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:03.317664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:03.318114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:03.318855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:03.319316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:03.319775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:03.474689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:03.483578 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91d0b093-ef9b-4655-a047-00da7f9d0732 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1722 microversion: 2.1 time: 0.178287 Aug 27 04:11:03.484193 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3731/7177] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:03 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:04.508196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:04.509888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:04.517516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:04.518019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:04.518500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:04.519272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:04.519725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:04.520162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:04.672123 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:04.680694 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37d762d2-4339-40e3-8324-d31bca58367b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1722 microversion: 2.1 time: 0.177466 Aug 27 04:11:04.681291 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3447/7178] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:04 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:11:05.000893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-38a6fec3-4c71-478c-901b-fcd454b30005 req-505351b0-0386-4d70-bb99-cdbfeed2503d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "name": "network-vif-plugged", "status": "completed", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:05.018266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38a6fec3-4c71-478c-901b-fcd454b30005 req-505351b0-0386-4d70-bb99-cdbfeed2503d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:05.018854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38a6fec3-4c71-478c-901b-fcd454b30005 req-505351b0-0386-4d70-bb99-cdbfeed2503d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:05.019309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-38a6fec3-4c71-478c-901b-fcd454b30005 req-505351b0-0386-4d70-bb99-cdbfeed2503d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:05.032649 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-38a6fec3-4c71-478c-901b-fcd454b30005 req-505351b0-0386-4d70-bb99-cdbfeed2503d service nova] Creating event network-vif-plugged:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h2-852086-5 Aug 27 04:11:05.038074 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-38a6fec3-4c71-478c-901b-fcd454b30005 req-505351b0-0386-4d70-bb99-cdbfeed2503d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040983 Aug 27 04:11:05.038741 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3732/7179] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:05.705108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:05.705744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:05.714726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:05.715447 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:05.715897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:05.716629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:05.717102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:05.717541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:05.797463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:05.806527 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f6f2479-c195-4d68-8cc0-fca343d918ca tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1655 microversion: 2.1 time: 0.104598 Aug 27 04:11:05.807313 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3448/7180] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:05 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:05.901001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-177d2b49-5c9f-4a71-b5f4-8db2cf51dcbf req-5e81cc7b-e561-48c4-868e-9b3a1965bf0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad8b612-c92a-4262-9726-fe32ad8d3ddd", "name": "network-vif-deleted", "tag": "2b6e6d17-3454-4d36-a35c-1628087b79db"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:05.916206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-177d2b49-5c9f-4a71-b5f4-8db2cf51dcbf req-5e81cc7b-e561-48c4-868e-9b3a1965bf0a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:05.916777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-177d2b49-5c9f-4a71-b5f4-8db2cf51dcbf req-5e81cc7b-e561-48c4-868e-9b3a1965bf0a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:05.916777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-177d2b49-5c9f-4a71-b5f4-8db2cf51dcbf req-5e81cc7b-e561-48c4-868e-9b3a1965bf0a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:05.935339 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-177d2b49-5c9f-4a71-b5f4-8db2cf51dcbf req-5e81cc7b-e561-48c4-868e-9b3a1965bf0a service nova] Creating event network-vif-deleted:2b6e6d17-3454-4d36-a35c-1628087b79db for instance cad8b612-c92a-4262-9726-fe32ad8d3ddd on n-h2-852086-5 Aug 27 04:11:05.941673 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-177d2b49-5c9f-4a71-b5f4-8db2cf51dcbf req-5e81cc7b-e561-48c4-868e-9b3a1965bf0a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045028 Aug 27 04:11:05.941974 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3733/7181] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:06.828559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:06.829252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:06.836530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:06.837351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:06.837810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:06.838591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:06.839098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:06.839559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:06.856007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:06.913894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:06.928878 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a26f828-8c20-485d-b87c-b0c2dd99ee15 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1370 microversion: 2.1 time: 0.104432 Aug 27 04:11:06.929510 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3449/7182] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:06 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:07.951104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:07.952193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:07.960436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:07.960921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:07.961359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:07.962675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:07.963137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:07.963565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:07.980198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:08.035800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:08.045473 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-589407ec-537f-46d7-bc5d-4a75cc64d313 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1370 microversion: 2.1 time: 0.099627 Aug 27 04:11:08.046082 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3734/7183] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:07 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:09.067264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:09.067892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:09.075141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:09.075641 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:09.076090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:09.076803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:09.077277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:09.077721 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:09.147850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:09.157267 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be877984-a405-42d5-87da-75b30166a695 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1370 microversion: 2.1 time: 0.094143 Aug 27 04:11:09.157862 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3450/7184] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:09 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:10.178271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:10.178886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:10.186153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:10.186697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:10.187290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:10.188001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:10.188463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:10.188885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:10.226948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:10.227912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:10.228023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:10.230671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lazy-loading 'fault' on Instance uuid cad8b612-c92a-4262-9726-fe32ad8d3ddd {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:11:10.275212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a17a05dcfd4d118e9045ce62f541eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179eda37730a40abb49c3a406654e757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:10.283571 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e583e943-2da7-4b34-95a7-99bff631fa3b tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 200 len: 1375 microversion: 2.1 time: 0.109330 Aug 27 04:11:10.284166 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3735/7185] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:10 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 1375 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:11:11.305239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:11.306134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:11.313059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:11.313557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:11.314004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:11.314745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:11.315211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:11.315650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:11.329455 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd HTTP/1.1 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'cad8b612-c92a-4262-9726-fe32ad8d3ddd'} Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:11.331432 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afa423aa-b573-4d90-b901-55abd6f02974 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 404 len: 111 microversion: 2.1 time: 0.031624 Aug 27 04:11:11.335455 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3451/7186] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:11 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:11.394862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:11.397056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:11.404765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:11.405363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:11.405887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:11.406686 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:11.407212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:11.407736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:11.421148 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/os-volume_attachments HTTP/1.1 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': 'cad8b612-c92a-4262-9726-fe32ad8d3ddd'} Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:11.422937 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-092e96b4-eeb6-4bc9-8ecb-6adcd6fb4cf2 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033619 Aug 27 04:11:11.427540 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3736/7187] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:11:11 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:14.764751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.765264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:14.768187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:14.773808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.774351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.774814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.775556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.776035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.776485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.791987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd HTTP/1.1 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'cad8b612-c92a-4262-9726-fe32ad8d3ddd'} Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:14.793496 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9386f6bd-8977-4cca-8926-a807551b24df tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 404 len: 111 microversion: 2.1 time: 0.034244 Aug 27 04:11:14.797437 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3452/7188] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:14 2022] DELETE /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:14.803675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.804303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: cad8b612-c92a-4262-9726-fe32ad8d3ddd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:14.807925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:14.813185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.813678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.814121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.814851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.815314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.815747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.831651 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd HTTP/1.1 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'cad8b612-c92a-4262-9726-fe32ad8d3ddd'} Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.833205 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance cad8b612-c92a-4262-9726-fe32ad8d3ddd could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f44b0ae9-6124-48a9-b894-a36fe66ae78c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd" status: 404 len: 111 microversion: 2.1 time: 0.035198 Aug 27 04:11:14.837202 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3737/7189] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:14 2022] GET /compute/v2.1/servers/cad8b612-c92a-4262-9726-fe32ad8d3ddd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:11:14.843671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.844195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:14.850384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.850958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.851420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.853433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.853433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.854029 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.867635 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 HTTP/1.1 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '65912517-3430-4e51-a7d6-e65dfe16f338'} Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:14.869757 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-274f7538-1f26-420e-ae41-4217e85cb8d9 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 404 len: 111 microversion: 2.1 time: 0.031450 Aug 27 04:11:14.874545 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3453/7190] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:14 2022] DELETE /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:14.879992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.880605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 65912517-3430-4e51-a7d6-e65dfe16f338] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:14.887369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.887864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.888304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.889011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.889468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.889896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.905265 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 HTTP/1.1 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '65912517-3430-4e51-a7d6-e65dfe16f338'} Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.906944 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 65912517-3430-4e51-a7d6-e65dfe16f338 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-04959158-54b7-4183-bb3a-3f0ad7f6619a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338" status: 404 len: 111 microversion: 2.1 time: 0.032501 Aug 27 04:11:14.910787 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3738/7191] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:14 2022] GET /compute/v2.1/servers/65912517-3430-4e51-a7d6-e65dfe16f338 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:14.918235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.918760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:14.925024 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.925614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.926065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.926819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.927321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.927782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.943751 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 HTTP/1.1 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'd845c2c0-6d81-4aa5-8fa5-81da323c17c4'} Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:14.945374 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0ab5230-b449-4d29-8b4c-13ea68a2868c tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 404 len: 111 microversion: 2.1 time: 0.034451 Aug 27 04:11:14.949890 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3454/7192] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:14 2022] DELETE /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:14.956795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.957413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: d845c2c0-6d81-4aa5-8fa5-81da323c17c4] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:14.963791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.964285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.964729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.965454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:14.965916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:14.966454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:14.981680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 HTTP/1.1 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'd845c2c0-6d81-4aa5-8fa5-81da323c17c4'} Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:14.983286 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance d845c2c0-6d81-4aa5-8fa5-81da323c17c4 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f876c29-535e-4bc9-98ae-099998097900 tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4" status: 404 len: 111 microversion: 2.1 time: 0.031856 Aug 27 04:11:14.987239 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3739/7193] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:14 2022] GET /compute/v2.1/servers/d845c2c0-6d81-4aa5-8fa5-81da323c17c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:14.994474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.995011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:15.001142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:15.001653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:15.002111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:15.002864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:15.003341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:15.003791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:15.017803 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 HTTP/1.1 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '62f32d3f-8964-4b3d-844d-ca9b31623226'} Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:15.019421 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d385cb02-c820-4db5-8f47-e019f0ffd41e tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 404 len: 111 microversion: 2.1 time: 0.031363 Aug 27 04:11:15.024449 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3455/7194] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:14 2022] DELETE /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:15.030186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:15.030824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] [instance: 62f32d3f-8964-4b3d-844d-ca9b31623226] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:15.036956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:15.037448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:15.037895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:15.038632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:15.039140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:15.039659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:15.055000 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] HTTP exception thrown: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Request method failure captured: Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 HTTP/1.1 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZf2aPSjG6eFNIgZGusrivWQqEVgJQKmO2PZcJ7WG6hjw5btgfdcpleeuAg4_TbYGJPctP2HvhOSrnuHMIFfccg-JnQ39xWAgWEosT8I8yYlRnz5GXz4o3_Z9eNfPOB0xXFajAlraRiFH5mfAVHLb3xh4QGYTZ4GRf0Dwk8yS1T-NJg Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/179eda37730a40abb49c3a406654e757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_179eda37730a40abb49c3a406654e757", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/179eda37730a40abb49c3a406654e757"}]}] Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 179eda37730a40abb49c3a406654e757 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServerActionsTestJSON-363959539 Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 90a17a05dcfd4d118e9045ce62f541eb Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServerActionsTestJSON-363959539-project Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '62f32d3f-8964-4b3d-844d-ca9b31623226'} Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:15.056761 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Returning 404 to user: Instance 62f32d3f-8964-4b3d-844d-ca9b31623226 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21fb8272-9d1a-4ed4-ad3e-8d13ad14d66a tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226" status: 404 len: 111 microversion: 2.1 time: 0.031891 Aug 27 04:11:15.060951 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3740/7195] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:15 2022] GET /compute/v2.1/servers/62f32d3f-8964-4b3d-844d-ca9b31623226 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:15.067313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f25da654-ccf2-49c4-858a-1a61f3e965bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] Calling method '.version_select at 0x7fe45c72e4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:15.092781 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f25da654-ccf2-49c4-858a-1a61f3e965bd tempest-ServerActionsTestJSON-363959539 tempest-ServerActionsTestJSON-363959539-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869727490" status: 202 len: 0 microversion: 2.1 time: 0.029468 Aug 27 04:11:15.096693 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3456/7196] 10.222.0.69 () {58 vars in 1221 bytes} [Sat Aug 27 04:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869727490 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:11:24.846859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1316718318", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "fa4a9bd6-e725-47ee-bb01-a4035105d191"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:24.905179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] validate_networks() for [('fa4a9bd6-e725-47ee-bb01-a4035105d191', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:11:25.045164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=21 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:25.281944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:11:25.282398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:11:25.282873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:11:25.283425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:11:25.283868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:11:25.293642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:25.294125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:25.294591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:25.295319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:25.295775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:25.296200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:25.313711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Getting quotas for project 88be8e4bc4fa440ea8a59210c692b6ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:11:25.319345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Getting quotas for user 96a99d18a1cc436aab157c8520724151 and project 88be8e4bc4fa440ea8a59210c692b6ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:11:25.334778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:11:25.337089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:11:25.387384 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-067b4bbc-19a6-4eae-bb2c-76b95bfbb5d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690640 Aug 27 04:11:25.388397 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3741/7197] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:11:25.397244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=19 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:25.398705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:25.404561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8d1aac9-50f1-4ace-84c9-bbaccc22c9df tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:25.405207 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8d1aac9-50f1-4ace-84c9-bbaccc22c9df tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:25.470007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8d1aac9-50f1-4ace-84c9-bbaccc22c9df tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:25.488706 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8d1aac9-50f1-4ace-84c9-bbaccc22c9df tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1217 microversion: 2.1 time: 0.093123 Aug 27 04:11:25.490011 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3457/7198] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:25 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:26.514634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:26.515406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:26.526059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:26.532316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:26.533208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:26.534479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:26.540103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:26.540963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:26.614621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:26.626333 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-69f1e2e9-c93f-4e78-a8c8-0440edb6642c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1277 microversion: 2.1 time: 0.117984 Aug 27 04:11:26.640417 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3742/7199] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:26 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:27.664271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:27.664927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:27.674661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:27.675162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:27.675808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:27.676553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:27.677032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:27.677483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:27.896868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:27.909376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6531bd47-fda7-440c-a0d7-03cfe74c80d1 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1317 microversion: 2.1 time: 0.264713 Aug 27 04:11:27.910205 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3458/7200] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:27 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:28.464531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-84fb2baf-e383-4ab9-9d44-22dee550edf4 req-6d2f6a9f-9ff9-4f8f-b932-15c2c7c715b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25466fe7-55b0-4640-8812-71b2e9fb3ecd", "tag": "e3200a1f-7049-47ce-9737-be3fb9b2776b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:28.474901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84fb2baf-e383-4ab9-9d44-22dee550edf4 req-6d2f6a9f-9ff9-4f8f-b932-15c2c7c715b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:28.475424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84fb2baf-e383-4ab9-9d44-22dee550edf4 req-6d2f6a9f-9ff9-4f8f-b932-15c2c7c715b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:28.475866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-84fb2baf-e383-4ab9-9d44-22dee550edf4 req-6d2f6a9f-9ff9-4f8f-b932-15c2c7c715b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:28.496614 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-84fb2baf-e383-4ab9-9d44-22dee550edf4 req-6d2f6a9f-9ff9-4f8f-b932-15c2c7c715b8 service nova] Creating event network-changed:e3200a1f-7049-47ce-9737-be3fb9b2776b for instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd on n-h2-852086-5 Aug 27 04:11:28.499758 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-84fb2baf-e383-4ab9-9d44-22dee550edf4 req-6d2f6a9f-9ff9-4f8f-b932-15c2c7c715b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106875 Aug 27 04:11:28.500378 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3743/7201] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:28.932120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:28.932750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:28.939529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:28.940036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:28.940495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:28.941479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:28.941952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:28.942431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:29.080610 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:29.089218 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33e2e739-0e7c-4ff2-97c8-387d411a1811 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1317 microversion: 2.1 time: 0.161908 Aug 27 04:11:29.089797 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3459/7202] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:28 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:30.111119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:30.111833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:30.118412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:30.118905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:30.120002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:30.120809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:30.121272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:30.121721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:30.265524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:30.273326 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec2b68f7-18e0-4637-8509-b57f844fc826 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1317 microversion: 2.1 time: 0.167524 Aug 27 04:11:30.273891 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3744/7203] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:30 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:31.293433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:31.294086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:31.302652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:31.303139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:31.303601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:31.304355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:31.304827 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:31.306181 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:31.444873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:31.453069 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95a5b53a-11b2-4f94-a0a6-efe4b5764f84 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1317 microversion: 2.1 time: 0.163822 Aug 27 04:11:31.453668 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3460/7204] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:31 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:32.474619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:32.475233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:32.483326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:32.483813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:32.484252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:32.484950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:32.485412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:32.485837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:32.624601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:32.632477 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-946a59e5-27b1-48c3-bd30-e409e45a014c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1317 microversion: 2.1 time: 0.161716 Aug 27 04:11:32.633087 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3745/7205] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:32 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:33.213901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-808b61dc-3bec-4023-a931-9aa5f6f1e9bc req-c6406f9d-a8eb-4f6a-b88e-86195d8fe967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25466fe7-55b0-4640-8812-71b2e9fb3ecd", "name": "network-vif-plugged", "status": "completed", "tag": "e3200a1f-7049-47ce-9737-be3fb9b2776b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:33.223659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-808b61dc-3bec-4023-a931-9aa5f6f1e9bc req-c6406f9d-a8eb-4f6a-b88e-86195d8fe967 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:33.224150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-808b61dc-3bec-4023-a931-9aa5f6f1e9bc req-c6406f9d-a8eb-4f6a-b88e-86195d8fe967 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:33.224626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-808b61dc-3bec-4023-a931-9aa5f6f1e9bc req-c6406f9d-a8eb-4f6a-b88e-86195d8fe967 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:33.236613 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-808b61dc-3bec-4023-a931-9aa5f6f1e9bc req-c6406f9d-a8eb-4f6a-b88e-86195d8fe967 service nova] Creating event network-vif-plugged:e3200a1f-7049-47ce-9737-be3fb9b2776b for instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd on n-h2-852086-5 Aug 27 04:11:33.241582 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-808b61dc-3bec-4023-a931-9aa5f6f1e9bc req-c6406f9d-a8eb-4f6a-b88e-86195d8fe967 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094395 Aug 27 04:11:33.242223 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3461/7206] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:33.653818 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:33.654548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:33.661480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:33.661970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:33.662435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:33.663155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:33.663610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:33.664039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:33.811969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:33.820390 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e68f8b17-92ac-4294-ab2a-b0cfe824f94f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1317 microversion: 2.1 time: 0.171280 Aug 27 04:11:33.820982 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3746/7207] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:33 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:34.844460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:34.844460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:34.850498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:34.850999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:34.851456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:34.852167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:34.852647 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:34.853627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:34.985005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:34.992986 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d53e036e-7521-473a-8fac-ab7a57de5274 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1506 microversion: 2.1 time: 0.155355 Aug 27 04:11:34.993567 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3462/7208] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:34 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:35.051858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2091243691", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "fa4a9bd6-e725-47ee-bb01-a4035105d191"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:35.108382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] validate_networks() for [('fa4a9bd6-e725-47ee-bb01-a4035105d191', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:11:35.302351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:35.328283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:35.524598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:11:35.525642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:11:35.526323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:11:35.526841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:11:35.527431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:11:35.536371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:35.536863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:35.537333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:35.538073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:35.538561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:35.538989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:35.556947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Getting quotas for project 88be8e4bc4fa440ea8a59210c692b6ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:11:35.562292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Getting quotas for user 96a99d18a1cc436aab157c8520724151 and project 88be8e4bc4fa440ea8a59210c692b6ba. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:11:35.576161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:11:35.578541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:11:35.625902 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2c4b6ac5-65cd-47b2-b324-86e0476459a8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578368 Aug 27 04:11:35.626659 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3747/7209] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:11:35.637596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f41f85c5-e458-440e-b30c-705c113fa812 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:35.638463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f41f85c5-e458-440e-b30c-705c113fa812 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:35.640664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:35.695710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f41f85c5-e458-440e-b30c-705c113fa812 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:35.703426 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f41f85c5-e458-440e-b30c-705c113fa812 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1217 microversion: 2.1 time: 0.069925 Aug 27 04:11:35.704002 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3463/7210] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:35 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:36.725341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:36.726718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:36.734992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:36.735534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:36.735954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:36.736626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:36.737363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:36.737792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:36.805154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:36.814761 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7400db58-06a9-4d4a-b8e3-38e84f40b7de tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1287 microversion: 2.1 time: 0.094481 Aug 27 04:11:36.815438 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3748/7211] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:36 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:37.835511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:37.836322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:37.844335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:37.844982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:37.845452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:37.846279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:37.846828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:37.847364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:38.107532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:38.117568 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23a5dcff-2961-480d-b21c-4ebcdbae87ff tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1317 microversion: 2.1 time: 0.285893 Aug 27 04:11:38.119399 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3464/7212] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:37 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:38.240291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-52f4226b-2e87-42e2-9c7c-6f2390f3a6e9 req-3ff35993-efe7-4689-86fe-1075518840bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4128c1c3-3273-48b0-91d2-6f41da170a77", "tag": "a96a8c30-3c3f-42a8-939d-0d4e4a9cc749"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:38.250834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52f4226b-2e87-42e2-9c7c-6f2390f3a6e9 req-3ff35993-efe7-4689-86fe-1075518840bf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:38.251417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52f4226b-2e87-42e2-9c7c-6f2390f3a6e9 req-3ff35993-efe7-4689-86fe-1075518840bf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:38.252111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-52f4226b-2e87-42e2-9c7c-6f2390f3a6e9 req-3ff35993-efe7-4689-86fe-1075518840bf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:38.273932 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-52f4226b-2e87-42e2-9c7c-6f2390f3a6e9 req-3ff35993-efe7-4689-86fe-1075518840bf service nova] Creating event network-changed:a96a8c30-3c3f-42a8-939d-0d4e4a9cc749 for instance 4128c1c3-3273-48b0-91d2-6f41da170a77 on n-h1-852086-5 Aug 27 04:11:38.279968 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-52f4226b-2e87-42e2-9c7c-6f2390f3a6e9 req-3ff35993-efe7-4689-86fe-1075518840bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043549 Aug 27 04:11:38.280585 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3749/7213] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:39.139627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:39.140280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:39.147210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:39.147705 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:39.148153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:39.148861 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:39.149327 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:39.149772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:39.285161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:39.294381 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa9d1eb2-402a-445a-8f00-59256bbb59a5 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1317 microversion: 2.1 time: 0.158605 Aug 27 04:11:39.295006 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3465/7214] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:39 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:40.317574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:40.318339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:40.326662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:40.327534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:40.328302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:40.329969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:40.330474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:40.330915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:40.467004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:40.474788 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c740b908-e13e-4a4c-b5fe-b5300e48094e tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1317 microversion: 2.1 time: 0.162752 Aug 27 04:11:40.475380 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3750/7215] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:40 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:41.496017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:41.496653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:41.503687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:41.504194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:41.504651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:41.505374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:41.505845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:41.506336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:41.640495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:41.648238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-baf45736-ac60-444c-9cf6-ac2ecad2a922 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1317 microversion: 2.1 time: 0.156282 Aug 27 04:11:41.648821 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3466/7216] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:41 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:42.669546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:42.670292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:42.678096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:42.678612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:42.679051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:42.679760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:42.680217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:42.680644 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:42.815118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:42.823749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-33bbe40b-9c23-4722-8091-450a91149f06 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1317 microversion: 2.1 time: 0.158734 Aug 27 04:11:42.824326 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3751/7217] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:42 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:43.844592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:43.845219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:43.852135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:43.852632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:43.853680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:43.854443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:43.854910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:43.855351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:43.989950 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:43.998987 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a42abf4-b8bf-4000-a4de-d1a8633a5e34 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1317 microversion: 2.1 time: 0.158306 Aug 27 04:11:43.999568 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3467/7218] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:43 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:44.179801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-cc2c6b75-243f-492b-b26e-06ccee5b5cba req-64047208-9bed-4c6a-86c4-b47fea7ae760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4128c1c3-3273-48b0-91d2-6f41da170a77", "name": "network-vif-plugged", "status": "completed", "tag": "a96a8c30-3c3f-42a8-939d-0d4e4a9cc749"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:44.191619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc2c6b75-243f-492b-b26e-06ccee5b5cba req-64047208-9bed-4c6a-86c4-b47fea7ae760 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:44.192194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc2c6b75-243f-492b-b26e-06ccee5b5cba req-64047208-9bed-4c6a-86c4-b47fea7ae760 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:44.192649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-cc2c6b75-243f-492b-b26e-06ccee5b5cba req-64047208-9bed-4c6a-86c4-b47fea7ae760 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:44.205555 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-cc2c6b75-243f-492b-b26e-06ccee5b5cba req-64047208-9bed-4c6a-86c4-b47fea7ae760 service nova] Creating event network-vif-plugged:a96a8c30-3c3f-42a8-939d-0d4e4a9cc749 for instance 4128c1c3-3273-48b0-91d2-6f41da170a77 on n-h1-852086-5 Aug 27 04:11:44.210591 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-cc2c6b75-243f-492b-b26e-06ccee5b5cba req-64047208-9bed-4c6a-86c4-b47fea7ae760 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034588 Aug 27 04:11:44.211203 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3752/7219] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:45.020105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:45.020646 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:45.028928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:45.029430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:45.029889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:45.030629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:45.031097 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:45.031535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:45.168658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:45.177891 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c12a576-b47c-4f44-8651-256db3d8cfb6 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1317 microversion: 2.1 time: 0.161802 Aug 27 04:11:45.178572 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3468/7220] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:45 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:46.197895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:46.198708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:46.203258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:46.203967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:46.205737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:46.213751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:46.214273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:46.214708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:46.215407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:46.215854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:46.216326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:46.357709 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:46.366326 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a84e034a-2c25-43c1-9e4c-3df9e2b4c055 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1505 microversion: 2.1 time: 0.170836 Aug 27 04:11:46.366917 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3753/7221] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:46 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:46.389463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:46.390033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:46.392094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:46.397684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:46.398200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:46.398652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:46.399412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:46.399903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:46.401334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:46.427911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:11:46.513126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe54e26c-bb0a-4214-8db9-ab2dbd15bb26 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 204 len: 0 microversion: 2.1 time: 0.128649 Aug 27 04:11:46.513724 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3469/7222] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:46 2022] DELETE /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:11:46.522464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:46.523079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:46.529440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:46.530013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:46.530559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:46.531388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:46.531907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:46.532398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:46.671212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:46.679077 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d114d2a-9c51-4503-bfdc-c412ef74de24 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1511 microversion: 2.1 time: 0.160739 Aug 27 04:11:46.679815 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3754/7223] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:46 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:47.702588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:47.704421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:47.711438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:47.711947 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:47.712509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:47.713173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:47.714094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:47.714767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:47.851979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:47.860236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eea4ad3f-0068-43f9-b0d2-2521afd595c7 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1511 microversion: 2.1 time: 0.162176 Aug 27 04:11:47.860812 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3470/7224] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:47 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:48.365487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-bc1a8aec-85dc-423e-ba7b-5267a0f03879 req-41fea94a-a2ee-4233-b0a9-bcc18cfaf558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4128c1c3-3273-48b0-91d2-6f41da170a77", "name": "network-vif-deleted", "tag": "a96a8c30-3c3f-42a8-939d-0d4e4a9cc749"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:48.380155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bc1a8aec-85dc-423e-ba7b-5267a0f03879 req-41fea94a-a2ee-4233-b0a9-bcc18cfaf558 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:48.381234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bc1a8aec-85dc-423e-ba7b-5267a0f03879 req-41fea94a-a2ee-4233-b0a9-bcc18cfaf558 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:48.382038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-bc1a8aec-85dc-423e-ba7b-5267a0f03879 req-41fea94a-a2ee-4233-b0a9-bcc18cfaf558 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:48.398435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-bc1a8aec-85dc-423e-ba7b-5267a0f03879 req-41fea94a-a2ee-4233-b0a9-bcc18cfaf558 service nova] Creating event network-vif-deleted:a96a8c30-3c3f-42a8-939d-0d4e4a9cc749 for instance 4128c1c3-3273-48b0-91d2-6f41da170a77 on n-h1-852086-5 Aug 27 04:11:48.409162 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-bc1a8aec-85dc-423e-ba7b-5267a0f03879 req-41fea94a-a2ee-4233-b0a9-bcc18cfaf558 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047698 Aug 27 04:11:48.410272 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3755/7225] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:48.881109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:48.881784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:48.889304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:48.889812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:48.890611 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:48.891389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:48.892031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:48.892609 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:48.927120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:48.927699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:48.928766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:48.929256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lazy-loading 'fault' on Instance uuid 4128c1c3-3273-48b0-91d2-6f41da170a77 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:11:48.975773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:48.983973 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d243c6b1-b028-4c81-9183-89788a477ab0 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 200 len: 1307 microversion: 2.1 time: 0.106946 Aug 27 04:11:48.984559 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3471/7226] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:48 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:50.008802 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:50.009905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.016592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.017087 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.017532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.018287 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.018753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.019190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.040059 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] HTTP exception thrown: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Request method failure captured: Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 HTTP/1.1 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZlsqwXnLndXeoWpByhcw2ovV3lEYg0QS9yKB8rZttLLL_C4KErQU5L47YHJmnPR1srv-bZGrszehjH1wa_HXjfGp61K2HvbFLiObJa3k4T-4WEu-fAyyaMuluhTJkIN8n5liLp-G2GKuy7s0K0ZxVSbyzrAjoh_BiKE_Hj2fZOqeD8 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88be8e4bc4fa440ea8a59210c692b6ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}] Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 96a99d18a1cc436aab157c8520724151 Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4128c1c3-3273-48b0-91d2-6f41da170a77'} Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:50.042548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Returning 404 to user: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1c7bdbfd-ca5b-485e-8d4d-379b8db304a3 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 404 len: 111 microversion: 2.1 time: 0.041714 Aug 27 04:11:50.047580 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3756/7227] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:50 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:11:50.053788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:50.054681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.062554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.063065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.063515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.064318 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.064854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.065291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.221742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:50.231641 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67f231d3-d042-4cb3-ac60-d7974c939469 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1506 microversion: 2.1 time: 0.181788 Aug 27 04:11:50.232757 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3472/7228] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:50 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:50.259882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3a09280-74f3-40a8-927a-c2b482a0e845 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:50.262577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e3a09280-74f3-40a8-927a-c2b482a0e845 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: be45bf17-9967-49c9-a5cd-8c703840aae5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.269709 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-e3a09280-74f3-40a8-927a-c2b482a0e845 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] HTTP exception thrown: Instance be45bf17-9967-49c9-a5cd-8c703840aae5 could not be found. Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3a09280-74f3-40a8-927a-c2b482a0e845 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Request method failure captured: Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/be45bf17-9967-49c9-a5cd-8c703840aae5/action HTTP/1.1 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 32 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZlsqwXnLndXeoWpByhcw2ovV3lEYg0QS9yKB8rZttLLL_C4KErQU5L47YHJmnPR1srv-bZGrszehjH1wa_HXjfGp61K2HvbFLiObJa3k4T-4WEu-fAyyaMuluhTJkIN8n5liLp-G2GKuy7s0K0ZxVSbyzrAjoh_BiKE_Hj2fZOqeD8 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88be8e4bc4fa440ea8a59210c692b6ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}] Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 96a99d18a1cc436aab157c8520724151 Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: {"resize": {"flavorRef": "452"}} Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance be45bf17-9967-49c9-a5cd-8c703840aae5 could not be found. Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'be45bf17-9967-49c9-a5cd-8c703840aae5', 'body': {'resize': {'flavorRef': '452'}}} Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be45bf17-9967-49c9-a5cd-8c703840aae5 could not be found. Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:50.271548 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be45bf17-9967-49c9-a5cd-8c703840aae5 could not be found. Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be45bf17-9967-49c9-a5cd-8c703840aae5 could not be found. Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e3a09280-74f3-40a8-927a-c2b482a0e845 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Returning 404 to user: Instance be45bf17-9967-49c9-a5cd-8c703840aae5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e3a09280-74f3-40a8-927a-c2b482a0e845 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "POST /compute/v2.1/servers/be45bf17-9967-49c9-a5cd-8c703840aae5/action" status: 404 len: 111 microversion: 2.1 time: 0.020008 Aug 27 04:11:50.278491 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3757/7229] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:11:50 2022] POST /compute/v2.1/servers/be45bf17-9967-49c9-a5cd-8c703840aae5/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:50.284801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:50.285465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.299602 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.300117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.300572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.301305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.301773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.302245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.440263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:50.449338 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da1c3f10-2bb6-4c95-b756-ef111db0015b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1506 microversion: 2.1 time: 0.168385 Aug 27 04:11:50.449928 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3473/7230] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:50 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:50.470768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:50.471384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.478477 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.478973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.479526 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.480168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.480637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.481073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.616605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:50.625704 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-aee09024-bbc7-48da-adc5-07cf0ee11ea2 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1506 microversion: 2.1 time: 0.158854 Aug 27 04:11:50.626306 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3758/7231] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:50 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:11:50.646081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "4635c5d2-ca98-47c0-bf8d-9bd54bbe0961"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:50.648445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.655147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.655643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.656093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.656793 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.657255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.657687 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.661938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:50.689756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:50.695935 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] HTTP exception thrown: Flavor 4635c5d2-ca98-47c0-bf8d-9bd54bbe0961 could not be found. Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Request method failure captured: Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd/action HTTP/1.1 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 65 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZlsqwXnLndXeoWpByhcw2ovV3lEYg0QS9yKB8rZttLLL_C4KErQU5L47YHJmnPR1srv-bZGrszehjH1wa_HXjfGp61K2HvbFLiObJa3k4T-4WEu-fAyyaMuluhTJkIN8n5liLp-G2GKuy7s0K0ZxVSbyzrAjoh_BiKE_Hj2fZOqeD8 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88be8e4bc4fa440ea8a59210c692b6ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}] Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 96a99d18a1cc436aab157c8520724151 Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: {"resize": {"flavorRef": "4635c5d2-ca98-47c0-bf8d-9bd54bbe0961"}} Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: exception: Flavor 4635c5d2-ca98-47c0-bf8d-9bd54bbe0961 could not be found. Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '25466fe7-55b0-4640-8812-71b2e9fb3ecd', 'body': {'resize': {'flavorRef': '4635c5d2-ca98-47c0-bf8d-9bd54bbe0961'}}} Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:50.719720 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 4635c5d2-ca98-47c0-bf8d-9bd54bbe0961 could not be found. Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 4635c5d2-ca98-47c0-bf8d-9bd54bbe0961 could not be found. Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 4635c5d2-ca98-47c0-bf8d-9bd54bbe0961 could not be found. Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Returning 400 to user: Flavor 4635c5d2-ca98-47c0-bf8d-9bd54bbe0961 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4423925b-88f3-45ec-8821-644966c5f5ac tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "POST /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd/action" status: 400 len: 107 microversion: 2.1 time: 0.079181 Aug 27 04:11:50.723962 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3474/7232] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:11:50 2022] POST /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd/action => generated 107 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:11:50.730127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:50.730770 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.737400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.737876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.738347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.739251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.739881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.740308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.884954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:50.892829 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9513542-acc6-4ff5-ba04-86b4218d206b tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1506 microversion: 2.1 time: 0.166555 Aug 27 04:11:50.893526 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3759/7233] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:50 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:50.913859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:50.914525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:50.921229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.921736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.922223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:50.922944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:50.923420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:50.923866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.065489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:51.074438 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb9c2002-3a3e-4c10-8d0d-b6772b6d48d8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1506 microversion: 2.1 time: 0.164423 Aug 27 04:11:51.075014 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3475/7234] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:50 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:51.096681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf49d9cc-6e48-47d2-8f33-a1f9c2180379 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf49d9cc-6e48-47d2-8f33-a1f9c2180379 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Request method failure captured: Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: request: POST /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd/action HTTP/1.1 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 29 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZlsqwXnLndXeoWpByhcw2ovV3lEYg0QS9yKB8rZttLLL_C4KErQU5L47YHJmnPR1srv-bZGrszehjH1wa_HXjfGp61K2HvbFLiObJa3k4T-4WEu-fAyyaMuluhTJkIN8n5liLp-G2GKuy7s0K0ZxVSbyzrAjoh_BiKE_Hj2fZOqeD8 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88be8e4bc4fa440ea8a59210c692b6ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}] Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 96a99d18a1cc436aab157c8520724151 Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: {"resize": {"flavorRef": ""}} Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '25466fe7-55b0-4640-8812-71b2e9fb3ecd', 'body': {'resize': {'flavorRef': ''}}} Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise error Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi '' Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.105453 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-bf49d9cc-6e48-47d2-8f33-a1f9c2180379 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-bf49d9cc-6e48-47d2-8f33-a1f9c2180379 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "POST /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd/action" status: 400 len: 113 microversion: 2.1 time: 0.016158 Aug 27 04:11:51.110362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3760/7235] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:11:51 2022] POST /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd/action => generated 113 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:11:51.115996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:51.116636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:51.123171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.123679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.124137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.124867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.125340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.125785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.264262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:51.272213 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1b731df-c9ef-4f13-b839-40163de91545 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1506 microversion: 2.1 time: 0.160136 Aug 27 04:11:51.272792 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3476/7236] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:51 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:51.299284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:51.299790 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:51.309206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.309710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.310181 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.310903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.311366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.311798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.326611 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] HTTP exception thrown: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Request method failure captured: Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 HTTP/1.1 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZlsqwXnLndXeoWpByhcw2ovV3lEYg0QS9yKB8rZttLLL_C4KErQU5L47YHJmnPR1srv-bZGrszehjH1wa_HXjfGp61K2HvbFLiObJa3k4T-4WEu-fAyyaMuluhTJkIN8n5liLp-G2GKuy7s0K0ZxVSbyzrAjoh_BiKE_Hj2fZOqeD8 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88be8e4bc4fa440ea8a59210c692b6ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}] Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 96a99d18a1cc436aab157c8520724151 Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '4128c1c3-3273-48b0-91d2-6f41da170a77'} Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:51.328218 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Returning 404 to user: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32ab27a7-4eff-401a-801c-0d34efc3bfc8 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 404 len: 111 microversion: 2.1 time: 0.035182 Aug 27 04:11:51.332890 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3761/7237] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:51 2022] DELETE /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:51.339438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:51.340077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 4128c1c3-3273-48b0-91d2-6f41da170a77] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:51.346178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.346761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.347167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.347882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.348357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.348800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.362543 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] HTTP exception thrown: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Request method failure captured: Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 HTTP/1.1 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZlsqwXnLndXeoWpByhcw2ovV3lEYg0QS9yKB8rZttLLL_C4KErQU5L47YHJmnPR1srv-bZGrszehjH1wa_HXjfGp61K2HvbFLiObJa3k4T-4WEu-fAyyaMuluhTJkIN8n5liLp-G2GKuy7s0K0ZxVSbyzrAjoh_BiKE_Hj2fZOqeD8 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88be8e4bc4fa440ea8a59210c692b6ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}] Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 96a99d18a1cc436aab157c8520724151 Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '4128c1c3-3273-48b0-91d2-6f41da170a77'} Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:51.364120 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Returning 404 to user: Instance 4128c1c3-3273-48b0-91d2-6f41da170a77 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45e32860-ff30-4c65-9425-6de4126bbd4c tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77" status: 404 len: 111 microversion: 2.1 time: 0.030846 Aug 27 04:11:51.369933 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3477/7238] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:51 2022] GET /compute/v2.1/servers/4128c1c3-3273-48b0-91d2-6f41da170a77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:11:51.375272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:51.375949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:51.383713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.383713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.383713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.384661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.384928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.385372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.411958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:11:51.490274 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-467d495a-1419-4089-a09a-840e247d0b92 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "DELETE /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 204 len: 0 microversion: 2.1 time: 0.118611 Aug 27 04:11:51.491097 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3762/7239] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:11:51 2022] DELETE /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:11:51.499707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:51.500348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:51.507075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.507471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.507889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.508614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:51.509808 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:51.510358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:51.652206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:51.660501 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b65e816-10cb-41b6-bcdb-f8721bdfdf45 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1512 microversion: 2.1 time: 0.164726 Aug 27 04:11:51.661241 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3478/7240] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:51 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:11:52.685354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:52.686237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:52.694769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:52.695325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:52.695762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:52.697002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:52.697653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:52.698318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:52.703661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:11:52.847628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a99d18a1cc436aab157c8520724151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88be8e4bc4fa440ea8a59210c692b6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:52.855557 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2e15b39-1829-47eb-a75b-b1e991ca429f tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 200 len: 1512 microversion: 2.1 time: 0.176512 Aug 27 04:11:52.856130 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3763/7241] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:52 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:53.357895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6279dc6e-11e9-4651-9a2c-2c6ccb59825a req-bfd3c30d-ce1f-481b-ae5f-0ccda1aaff60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25466fe7-55b0-4640-8812-71b2e9fb3ecd", "name": "network-vif-deleted", "tag": "e3200a1f-7049-47ce-9737-be3fb9b2776b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:53.372604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6279dc6e-11e9-4651-9a2c-2c6ccb59825a req-bfd3c30d-ce1f-481b-ae5f-0ccda1aaff60 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:53.373364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6279dc6e-11e9-4651-9a2c-2c6ccb59825a req-bfd3c30d-ce1f-481b-ae5f-0ccda1aaff60 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:53.374093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6279dc6e-11e9-4651-9a2c-2c6ccb59825a req-bfd3c30d-ce1f-481b-ae5f-0ccda1aaff60 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:53.388001 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6279dc6e-11e9-4651-9a2c-2c6ccb59825a req-bfd3c30d-ce1f-481b-ae5f-0ccda1aaff60 service nova] Creating event network-vif-deleted:e3200a1f-7049-47ce-9737-be3fb9b2776b for instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd on n-h2-852086-5 Aug 27 04:11:53.394740 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6279dc6e-11e9-4651-9a2c-2c6ccb59825a req-bfd3c30d-ce1f-481b-ae5f-0ccda1aaff60 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040347 Aug 27 04:11:53.395603 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3479/7242] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:53.878811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:53.879607 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] [instance: 25466fe7-55b0-4640-8812-71b2e9fb3ecd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:11:53.886823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:53.887307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:53.887737 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:53.888444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:11:53.888894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:11:53.889315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:11:53.904540 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] HTTP exception thrown: Instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd could not be found. Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Request method failure captured: Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd HTTP/1.1 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZlsqwXnLndXeoWpByhcw2ovV3lEYg0QS9yKB8rZttLLL_C4KErQU5L47YHJmnPR1srv-bZGrszehjH1wa_HXjfGp61K2HvbFLiObJa3k4T-4WEu-fAyyaMuluhTJkIN8n5liLp-G2GKuy7s0K0ZxVSbyzrAjoh_BiKE_Hj2fZOqeD8 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88be8e4bc4fa440ea8a59210c692b6ba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88be8e4bc4fa440ea8a59210c692b6ba"}]}] Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 88be8e4bc4fa440ea8a59210c692b6ba Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1816862671 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 96a99d18a1cc436aab157c8520724151 Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-ServersNegativeTestJSON-1816862671-project Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd could not be found. Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '25466fe7-55b0-4640-8812-71b2e9fb3ecd'} Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd could not be found. Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd could not be found. Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:11:53.906217 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd could not be found. Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] Returning 404 to user: Instance 25466fe7-55b0-4640-8812-71b2e9fb3ecd could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-359e360e-2a52-4dd2-ab56-537d03569617 tempest-ServersNegativeTestJSON-1816862671 tempest-ServersNegativeTestJSON-1816862671-project] 10.222.0.69 "GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd" status: 404 len: 111 microversion: 2.1 time: 0.034039 Aug 27 04:11:53.910823 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3764/7243] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:11:53 2022] GET /compute/v2.1/servers/25466fe7-55b0-4640-8812-71b2e9fb3ecd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:12:27.709014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:27.709853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=24 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:27.919676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c619b505-e77f-4fa1-aa87-43111cde9512 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: .version_select at 0x7fe457644280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-139962834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXerbGuUsmwkxr9SqP8vUu1eBhbcag7RmZxTsV3gLVKKVV2SmLZh245rSuAM05P6lqUt+7XcsRDjywAdMgBJx7S+mSicNLSmzZ2w8pGayyBn5c3+WX3F2KN/TQjDPco4g=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:27.935903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c619b505-e77f-4fa1-aa87-43111cde9512 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:12:27.941343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c619b505-e77f-4fa1-aa87-43111cde9512 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for user 546d611c04a347c9bdc21cf67f58c0fc and project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:12:27.968534 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c619b505-e77f-4fa1-aa87-43111cde9512 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.264900 Aug 27 04:12:27.969366 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3480/7244] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:12:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:28.022894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1001021865", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-139962834", "networks": [{"uuid": "b97031cd-6b57-41d2-9deb-a8fec201838a"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:28.032891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:28.033663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:28.089920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] validate_networks() for [('b97031cd-6b57-41d2-9deb-a8fec201838a', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:12:28.536523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:12:28.537170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:12:28.537653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:12:28.538070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:12:28.538736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:12:28.549041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:28.549825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:28.550308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:28.551064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:28.551534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:28.551976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:28.572492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:12:28.578143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for user 546d611c04a347c9bdc21cf67f58c0fc and project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:12:28.592277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:12:28.594694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:12:28.645324 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fdcba47d-359e-4ffc-a5cb-ef12a9ad219e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626459 Aug 27 04:12:28.646073 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3765/7245] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:12:28.658898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-912ad1ce-2268-4e36-b22d-214dcd0bb092 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:28.659660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-912ad1ce-2268-4e36-b22d-214dcd0bb092 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:28.722910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-912ad1ce-2268-4e36-b22d-214dcd0bb092 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:28.731462 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-912ad1ce-2268-4e36-b22d-214dcd0bb092 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1262 microversion: 2.1 time: 0.076561 Aug 27 04:12:28.732732 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3481/7246] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:28 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:29.755768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:29.757211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:29.766238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:29.766988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:29.771016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:29.771995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:29.772471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:29.772910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:29.855749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:29.872443 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b994a977-0a05-4ca4-a1a1-0299011c25e5 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1322 microversion: 2.1 time: 0.123113 Aug 27 04:12:29.873224 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3766/7247] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:29 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1322 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:30.895914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:30.897394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:30.905845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:30.906396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:30.906858 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:30.907591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:30.908070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:30.908718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:31.133443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:31.150527 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9710eb21-6aaa-42ed-b081-02cf69b991d2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1362 microversion: 2.1 time: 0.258896 Aug 27 04:12:31.151126 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3482/7248] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:30 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:31.218938 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ce5abebe-96bc-4af8-883f-15be5396af82 req-a0759efb-30be-44f6-b52f-7bcff638c451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654ebce8-8016-4535-9a0d-80217e067baf", "tag": "9877ea95-7fb9-4311-8e2d-a8698e91e2a9"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:31.232400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ce5abebe-96bc-4af8-883f-15be5396af82 req-a0759efb-30be-44f6-b52f-7bcff638c451 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:31.233190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ce5abebe-96bc-4af8-883f-15be5396af82 req-a0759efb-30be-44f6-b52f-7bcff638c451 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:31.233939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ce5abebe-96bc-4af8-883f-15be5396af82 req-a0759efb-30be-44f6-b52f-7bcff638c451 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:31.250935 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ce5abebe-96bc-4af8-883f-15be5396af82 req-a0759efb-30be-44f6-b52f-7bcff638c451 service nova] Creating event network-changed:9877ea95-7fb9-4311-8e2d-a8698e91e2a9 for instance 654ebce8-8016-4535-9a0d-80217e067baf on n-h2-852086-5 Aug 27 04:12:31.257169 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ce5abebe-96bc-4af8-883f-15be5396af82 req-a0759efb-30be-44f6-b52f-7bcff638c451 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042521 Aug 27 04:12:31.259292 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3767/7249] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:32.172719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:32.173439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:32.181177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:32.181811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:32.182362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:32.183195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:32.183747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:32.184270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:32.328485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:32.338568 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f901df5-ec6d-4ccc-8639-f75752913001 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1362 microversion: 2.1 time: 0.170252 Aug 27 04:12:32.339161 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3483/7250] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:32 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:33.360806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:33.362128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:33.369299 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:33.370032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:33.370499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:33.371214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:33.371684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:33.372107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:33.521574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:33.530579 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a648d2f3-453f-443c-adcd-6b0314c734a0 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1362 microversion: 2.1 time: 0.174705 Aug 27 04:12:33.531186 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3768/7251] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:33 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:34.552920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:34.553557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:34.560704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:34.561218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:34.561671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:34.562421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:34.562925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:34.563371 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:34.697270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:34.705124 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3464191-324a-497f-b48f-79f2b216724c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1362 microversion: 2.1 time: 0.156086 Aug 27 04:12:34.705697 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3484/7252] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:34 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:35.369994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-594fb9f8-4b10-4531-92db-59289bdfee60 req-04071d83-c511-476f-9268-9b5382486983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654ebce8-8016-4535-9a0d-80217e067baf", "name": "network-vif-plugged", "status": "completed", "tag": "9877ea95-7fb9-4311-8e2d-a8698e91e2a9"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:35.380983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-594fb9f8-4b10-4531-92db-59289bdfee60 req-04071d83-c511-476f-9268-9b5382486983 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:35.381525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-594fb9f8-4b10-4531-92db-59289bdfee60 req-04071d83-c511-476f-9268-9b5382486983 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:35.382030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-594fb9f8-4b10-4531-92db-59289bdfee60 req-04071d83-c511-476f-9268-9b5382486983 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:35.396497 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-594fb9f8-4b10-4531-92db-59289bdfee60 req-04071d83-c511-476f-9268-9b5382486983 service nova] Creating event network-vif-plugged:9877ea95-7fb9-4311-8e2d-a8698e91e2a9 for instance 654ebce8-8016-4535-9a0d-80217e067baf on n-h2-852086-5 Aug 27 04:12:35.401507 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-594fb9f8-4b10-4531-92db-59289bdfee60 req-04071d83-c511-476f-9268-9b5382486983 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036029 Aug 27 04:12:35.402105 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3769/7253] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:35.727386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:35.728025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:35.734978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:35.735475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:35.735927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:35.736640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:35.737106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:35.737545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:35.873711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:35.881865 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8322cbc9-974e-4914-96c7-96f98366905b tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1362 microversion: 2.1 time: 0.158949 Aug 27 04:12:35.882486 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3485/7254] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:35 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:36.904215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:36.904855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:36.911851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:36.912327 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:36.912761 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:36.913450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:36.913986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:36.914484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:37.050504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:37.058639 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2d9e5330-bff8-45ae-845c-8f67ab2baf76 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1554 microversion: 2.1 time: 0.158817 Aug 27 04:12:37.059225 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3770/7255] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:36 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:37.079055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:37.079693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:37.087196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:37.087702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:37.088160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:37.088879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:37.089356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:37.089804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:37.224871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:37.232859 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-055b6dc7-fb2d-480b-92cb-61e1bfc66ff7 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1554 microversion: 2.1 time: 0.157733 Aug 27 04:12:37.233436 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3486/7256] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:37 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:38.848086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:38.850480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:38.853348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:38.854015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:38.859678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:38.860159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:38.860590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:38.861280 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:38.861745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:38.862148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:39.115357 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a9d39ac7-0a06-4117-bba7-ca69198c5468 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271729 Aug 27 04:12:39.116151 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3771/7257] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 04:12:38 2022] POST /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:49.824294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:49.825180 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:49.828517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:49.830126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:49.830699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=30 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:49.839582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:49.840094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:49.840554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:49.841288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:49.841759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:49.842229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:49.927225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lazy-loading 'services' on Instance uuid 654ebce8-8016-4535-9a0d-80217e067baf {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:12:50.006295 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-821267f5-b763-49b5-b576-c489f521e3b2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments/fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd" status: 202 len: 0 microversion: 2.1 time: 0.186893 Aug 27 04:12:50.007070 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3487/7258] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:12:49 2022] DELETE /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments/fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:50.015228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:50.016387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:12:50.020962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:50.024024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:50.034734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:50.035315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:50.035853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:50.036653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:50.037193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:50.037765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:50.076258 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-92c7f546-e238-4732-a6cc-0f7539eec0ab tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063455 Aug 27 04:12:50.077452 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3772/7259] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:12:50 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:12:51.100654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:51.105350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:51.114820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:51.117137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:51.117137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:51.117137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:51.117137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:51.119605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:51.159663 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e76bf8fd-5768-4291-a2f5-21499d7a9cc2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073372 Aug 27 04:12:51.160260 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3488/7260] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:12:51 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:52.173961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:52.176291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:52.184542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:52.185040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:52.185484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:52.186235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:52.186700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:52.187131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:52.223622 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-915f3bf5-055a-4986-a165-1960c4394404 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053703 Aug 27 04:12:52.224230 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3773/7261] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:12:52 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:53.236289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:53.239231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:53.247112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:53.247599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:53.248054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:53.248776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:53.249238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:53.249717 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:53.282172 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e1bda96-632d-49cd-801e-5684952d5bf6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049887 Aug 27 04:12:53.282772 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3489/7262] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:12:53 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:54.296230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:54.298488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:54.307307 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:54.307792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:54.308234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:54.308944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:54.309388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:54.309827 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:54.352735 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6bb23aa4-214c-421e-8489-0f0dc0add2ce tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060590 Aug 27 04:12:54.353396 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3774/7263] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:12:54 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:12:55.365340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:55.368213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:55.375194 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:55.375700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:55.376154 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:55.376876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:55.377346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:55.377789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:55.408468 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8a0c1d4-fa39-4af6-9878-fcce3daf90a8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047162 Aug 27 04:12:55.409031 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3490/7264] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:12:55 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:12:55.420086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:55.420653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:55.427391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:55.427878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:55.428362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:55.429028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:55.430462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:55.430894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:55.514108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] HTTP exception thrown: Instance 654ebce8-8016-4535-9a0d-80217e067baf is not attached to volume fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Request method failure captured: Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments/fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd HTTP/1.1 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZmmp0IfYsZlXG_bVovq6h6355wrKVK8EaE4gf1AckZkrh9O5SiWm5_FEHV-IE4DbfxLZ5QKpylV1bHYuVa9ynjxmOukUVHIBIXVqyL9yyx2_-aU0cdWMH65PWHbGSHtB4yQaCUv5MS5i9AODsdDSRgDAbt9733wAV6dn4k6yAYacTs Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a7a10a78b2d644908d8c4caa02b47b89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}] Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 546d611c04a347c9bdc21cf67f58c0fc Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 654ebce8-8016-4535-9a0d-80217e067baf is not attached to volume fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': '654ebce8-8016-4535-9a0d-80217e067baf', 'id': 'fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd'} Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd. Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654ebce8-8016-4535-9a0d-80217e067baf is not attached to volume fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:12:55.524239 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:12:55.528348 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:12:55.528348 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:12:55.528348 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654ebce8-8016-4535-9a0d-80217e067baf is not attached to volume fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd Aug 27 04:12:55.528348 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:12:55.528348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Returning 404 to user: Instance 654ebce8-8016-4535-9a0d-80217e067baf is not attached to volume fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:12:55.528348 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90ae4c37-28ff-4153-b69f-a3a11d9c37da tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments/fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd" status: 404 len: 154 microversion: 2.1 time: 0.109690 Aug 27 04:12:55.528348 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3775/7265] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:12:55 2022] DELETE /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf/os-volume_attachments/fbd0a1e2-6495-48b9-80a4-9f9643e0a9cd => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:12:58.899008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:58.899740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:58.906551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:58.907066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:58.907521 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:58.908242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:58.908749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:58.909197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:58.936385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:12:59.019061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3bf612dc-888f-4348-9c77-324507db6d34 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 204 len: 0 microversion: 2.1 time: 0.124466 Aug 27 04:12:59.019712 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3491/7266] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:12:58 2022] DELETE /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:12:59.029561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:59.030410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:12:59.041008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:59.041008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:59.041433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:59.042227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:12:59.042695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:12:59.043133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:12:59.201681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:59.211420 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5d7abb9a-5fa2-4a3f-9057-b03dfc89acd8 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1560 microversion: 2.1 time: 0.185193 Aug 27 04:12:59.212149 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3776/7267] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:12:59 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:00.234214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:00.234953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:00.243038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:00.243532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:00.244017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:00.244755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:00.245228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:00.245703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:00.394773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:00.403956 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3fee4d1-1199-444f-92e8-07ba29550775 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1560 microversion: 2.1 time: 0.174222 Aug 27 04:13:00.404613 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3492/7268] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:00 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:01.157931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7f212299-6f45-4bda-a381-c362fe7e2be0 req-ed9d98f1-6ded-422e-9966-25e1285782c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654ebce8-8016-4535-9a0d-80217e067baf", "name": "network-vif-deleted", "tag": "9877ea95-7fb9-4311-8e2d-a8698e91e2a9"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:01.172473 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7f212299-6f45-4bda-a381-c362fe7e2be0 req-ed9d98f1-6ded-422e-9966-25e1285782c4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:01.172967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7f212299-6f45-4bda-a381-c362fe7e2be0 req-ed9d98f1-6ded-422e-9966-25e1285782c4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:01.173395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7f212299-6f45-4bda-a381-c362fe7e2be0 req-ed9d98f1-6ded-422e-9966-25e1285782c4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:01.187680 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7f212299-6f45-4bda-a381-c362fe7e2be0 req-ed9d98f1-6ded-422e-9966-25e1285782c4 service nova] Creating event network-vif-deleted:9877ea95-7fb9-4311-8e2d-a8698e91e2a9 for instance 654ebce8-8016-4535-9a0d-80217e067baf on n-h2-852086-5 Aug 27 04:13:01.194370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7f212299-6f45-4bda-a381-c362fe7e2be0 req-ed9d98f1-6ded-422e-9966-25e1285782c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040084 Aug 27 04:13:01.195911 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3777/7269] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:01.427868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:01.428445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:01.436336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:01.436844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:01.437304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:01.438036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:01.438537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:01.438983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:01.475840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:01.476878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:01.477319 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:01.477786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lazy-loading 'fault' on Instance uuid 654ebce8-8016-4535-9a0d-80217e067baf {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:13:01.520025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:01.528903 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fac51f69-d42c-4666-9d98-f57b2696ddec tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 200 len: 1352 microversion: 2.1 time: 0.105093 Aug 27 04:13:01.529513 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3493/7270] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:01 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:02.551658 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:02.552521 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 654ebce8-8016-4535-9a0d-80217e067baf] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:02.560312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:02.560794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:02.561229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:02.561923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:02.562412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:02.562835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:02.577352 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] HTTP exception thrown: Instance 654ebce8-8016-4535-9a0d-80217e067baf could not be found. Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Request method failure captured: Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf HTTP/1.1 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZmmp0IfYsZlXG_bVovq6h6355wrKVK8EaE4gf1AckZkrh9O5SiWm5_FEHV-IE4DbfxLZ5QKpylV1bHYuVa9ynjxmOukUVHIBIXVqyL9yyx2_-aU0cdWMH65PWHbGSHtB4yQaCUv5MS5i9AODsdDSRgDAbt9733wAV6dn4k6yAYacTs Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a7a10a78b2d644908d8c4caa02b47b89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}] Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 546d611c04a347c9bdc21cf67f58c0fc Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 654ebce8-8016-4535-9a0d-80217e067baf could not be found. Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '654ebce8-8016-4535-9a0d-80217e067baf'} Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654ebce8-8016-4535-9a0d-80217e067baf could not be found. Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654ebce8-8016-4535-9a0d-80217e067baf could not be found. Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:02.578995 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654ebce8-8016-4535-9a0d-80217e067baf could not be found. Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Returning 404 to user: Instance 654ebce8-8016-4535-9a0d-80217e067baf could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c11036c5-010c-4e79-8dc4-b0c575838d52 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf" status: 404 len: 111 microversion: 2.1 time: 0.033018 Aug 27 04:13:02.583634 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3778/7271] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:02 2022] GET /compute/v2.1/servers/654ebce8-8016-4535-9a0d-80217e067baf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:02.590025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57f2e0ca-2772-4c8a-9b1a-ff7cf4f44f18 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '.version_select at 0x7fe460284b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:02.610013 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57f2e0ca-2772-4c8a-9b1a-ff7cf4f44f18 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-139962834" status: 202 len: 0 microversion: 2.1 time: 0.024711 Aug 27 04:13:02.610645 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3494/7272] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 04:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-139962834 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:02.627881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9ee7f24-c390-4460-b6ac-831427071c3f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: .version_select at 0x7fe457bc0790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1897989058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGt9l2Qvmb6r9TG/DycTpd3ntjMTXhg3nBDKBaRm3NH4C7ADwWUFWJO3It1JkX1uQpw4oRHFE/MUkrwNfVGsZjc2jsAy5rWxpsTWN5F+W409UkyknxfEGK8RpgIsfALtRQ=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:02.643910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-f9ee7f24-c390-4460-b6ac-831427071c3f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:13:02.650148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-f9ee7f24-c390-4460-b6ac-831427071c3f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for user 546d611c04a347c9bdc21cf67f58c0fc and project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:13:02.676852 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9ee7f24-c390-4460-b6ac-831427071c3f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052987 Aug 27 04:13:02.677554 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3779/7273] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:13:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:02.729986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1561660165", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1897989058", "networks": [{"uuid": "b97031cd-6b57-41d2-9deb-a8fec201838a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:02.784550 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] validate_networks() for [('b97031cd-6b57-41d2-9deb-a8fec201838a', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:13:03.251301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:13:03.251746 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:13:03.252239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:13:03.252665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:13:03.253094 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:13:03.263028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:03.263532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:03.263973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:03.264711 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:03.265304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:03.265772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:03.283191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:13:03.288673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for user 546d611c04a347c9bdc21cf67f58c0fc and project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:13:03.301388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:13:03.303740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:13:03.352228 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-566043e1-707c-47f3-af4e-365f9748884e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626592 Aug 27 04:13:03.352890 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3495/7274] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:13:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:13:03.363736 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-752c97f9-878d-4b28-9f6a-0db1bdc35afd tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:03.364354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-752c97f9-878d-4b28-9f6a-0db1bdc35afd tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:03.424943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-752c97f9-878d-4b28-9f6a-0db1bdc35afd tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:03.432429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-752c97f9-878d-4b28-9f6a-0db1bdc35afd tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1263 microversion: 2.1 time: 0.072662 Aug 27 04:13:03.433001 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3780/7275] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:03 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:04.455829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:04.456461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:04.465638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:04.466032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:04.466601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:04.467287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:04.467708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:04.468128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:04.891503 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:04.901599 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a985df01-a569-4298-b393-339cfa69ddf3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1323 microversion: 2.1 time: 0.450620 Aug 27 04:13:04.902448 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3496/7276] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:04 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:05.924107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:05.924976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:05.932405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:05.932903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:05.933345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:05.934059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:05.934550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:05.934980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:06.073638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:06.081524 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c84c0410-95b4-44e8-8e59-18c7f2d2275c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1363 microversion: 2.1 time: 0.162001 Aug 27 04:13:06.082213 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3781/7277] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:05 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:06.130573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-81e1287d-ef03-4253-a004-b5f19dc01dad req-a2daadd4-ca19-49bc-9970-3297dae2e47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68a1bc9-b35d-4efb-845d-92f0324a667d", "tag": "b1fc5f6a-3e8f-46d2-b65b-d5a1ec5b8510"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:06.141953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81e1287d-ef03-4253-a004-b5f19dc01dad req-a2daadd4-ca19-49bc-9970-3297dae2e47c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:06.142621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81e1287d-ef03-4253-a004-b5f19dc01dad req-a2daadd4-ca19-49bc-9970-3297dae2e47c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:06.143164 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-81e1287d-ef03-4253-a004-b5f19dc01dad req-a2daadd4-ca19-49bc-9970-3297dae2e47c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:06.155976 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-81e1287d-ef03-4253-a004-b5f19dc01dad req-a2daadd4-ca19-49bc-9970-3297dae2e47c service nova] Creating event network-changed:b1fc5f6a-3e8f-46d2-b65b-d5a1ec5b8510 for instance c68a1bc9-b35d-4efb-845d-92f0324a667d on n-h2-852086-5 Aug 27 04:13:06.160936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-81e1287d-ef03-4253-a004-b5f19dc01dad req-a2daadd4-ca19-49bc-9970-3297dae2e47c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035726 Aug 27 04:13:06.161687 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3497/7278] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:07.102863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:07.103474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:07.110502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:07.110985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:07.111425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:07.112130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:07.112586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:07.113006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:07.251142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:07.260229 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-179173bd-d4be-4e2d-b4c1-febd706be8a2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1363 microversion: 2.1 time: 0.161307 Aug 27 04:13:07.260877 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3782/7279] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:07 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:08.282667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:08.283390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:08.289812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:08.290348 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:08.290802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:08.291515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:08.291986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:08.292435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:08.428694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:08.437420 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64a126a8-b289-4973-b99d-00fc9659645d tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1363 microversion: 2.1 time: 0.159937 Aug 27 04:13:08.437998 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3498/7280] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:08 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:09.458479 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:09.459089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:09.467092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:09.467576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:09.468010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:09.468708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:09.469157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:09.469578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:09.620810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:09.628990 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81036281-6216-4489-8c4f-281c48370223 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1363 microversion: 2.1 time: 0.174477 Aug 27 04:13:09.629690 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3783/7281] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:09 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:10.652242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:10.652877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:10.659909 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:10.660412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:10.660867 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:10.661579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:10.662052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:10.662523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:10.798604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:10.806439 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48d7fe49-30af-4f55-99f2-db9dd023d6f3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1363 microversion: 2.1 time: 0.158820 Aug 27 04:13:10.807015 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3499/7282] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:10 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:11.486742 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-defe6140-52b4-45fc-99a9-cf38616a7639 req-eaef3f17-515b-4ba6-acc0-f21a020f6e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68a1bc9-b35d-4efb-845d-92f0324a667d", "name": "network-vif-plugged", "status": "completed", "tag": "b1fc5f6a-3e8f-46d2-b65b-d5a1ec5b8510"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:11.503391 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-defe6140-52b4-45fc-99a9-cf38616a7639 req-eaef3f17-515b-4ba6-acc0-f21a020f6e12 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:11.503931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-defe6140-52b4-45fc-99a9-cf38616a7639 req-eaef3f17-515b-4ba6-acc0-f21a020f6e12 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:11.504453 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-defe6140-52b4-45fc-99a9-cf38616a7639 req-eaef3f17-515b-4ba6-acc0-f21a020f6e12 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:11.517504 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-defe6140-52b4-45fc-99a9-cf38616a7639 req-eaef3f17-515b-4ba6-acc0-f21a020f6e12 service nova] Creating event network-vif-plugged:b1fc5f6a-3e8f-46d2-b65b-d5a1ec5b8510 for instance c68a1bc9-b35d-4efb-845d-92f0324a667d on n-h2-852086-5 Aug 27 04:13:11.524859 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-defe6140-52b4-45fc-99a9-cf38616a7639 req-eaef3f17-515b-4ba6-acc0-f21a020f6e12 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041901 Aug 27 04:13:11.526954 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3784/7283] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:11.827968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:11.828617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:11.837042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:11.837554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:11.838014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:11.838820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:11.839304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:11.839750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:11.988386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:11.996947 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bd12d05-c7cd-415c-ab53-a3710f89a7ee tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1363 microversion: 2.1 time: 0.173028 Aug 27 04:13:11.997540 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3500/7284] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:11 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:13.018902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:13.019528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:13.027095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:13.027586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:13.028032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:13.028903 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:13.029373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:13.029807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:13.162976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:13.171361 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-85bce9e9-0052-44d0-a38b-575da03eb425 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1555 microversion: 2.1 time: 0.156863 Aug 27 04:13:13.171958 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3785/7285] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:13 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:13:13.192998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:13.193620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:13.200987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:13.201479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:13.201928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:13.202681 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:13.203140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:13.203582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:13.274511 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:13.295847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:13.336323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:13.344165 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61894c8b-4d8c-43b2-bb6c-cbdd9f972c98 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1555 microversion: 2.1 time: 0.155327 Aug 27 04:13:13.344758 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3501/7286] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:13 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:13:14.846217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47554de9-98a5-4df7-b511-daa1dcade80c"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:14.848598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:14.851326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:14.857847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:14.858493 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:14.858998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:14.859811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:14.860274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:14.860682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:15.147355 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc9277cb-05e5-430f-8e23-b271a4fb8850 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305295 Aug 27 04:13:15.150201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3786/7287] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 04:13:14 2022] POST /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:13:25.871931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:25.872532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:25.874437 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:25.875211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:25.882355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:25.882873 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:25.883321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:25.884041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:25.884510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:25.884949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:25.969916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lazy-loading 'services' on Instance uuid c68a1bc9-b35d-4efb-845d-92f0324a667d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:13:26.044883 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-083a27db-298d-4e9e-94ed-dca783fa9dae tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments/47554de9-98a5-4df7-b511-daa1dcade80c" status: 202 len: 0 microversion: 2.1 time: 0.176998 Aug 27 04:13:26.045877 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3502/7288] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:13:25 2022] DELETE /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments/47554de9-98a5-4df7-b511-daa1dcade80c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:26.057458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:26.060009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:26.064448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:26.065438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:26.073297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:26.073798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:26.074264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:26.075621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:26.076098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:26.076812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:26.119312 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0de944ee-a5bc-4e7d-ab2e-8490fef10209 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067174 Aug 27 04:13:26.120290 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3787/7289] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:13:26 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:27.136713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:27.139250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:27.145680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:27.146204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:27.146672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:27.148074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:27.148607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:27.149059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:27.180297 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb2858e1-c36b-4896-b264-65bc945c6379 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049627 Aug 27 04:13:27.180900 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3503/7290] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:13:27 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:28.192940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:28.195773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:28.202880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:28.203365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:28.203801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:28.204513 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:28.204970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:28.205396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:28.237640 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1ee69700-7703-47cf-a402-ff1e763887a6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Aug 27 04:13:28.242298 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3788/7291] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:13:28 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:29.249974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:29.252205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:29.260469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:29.260973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:29.261513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:29.262264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:29.262734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:29.263171 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:29.294880 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43a5bb9a-3f83-474e-bdf5-fa0661300a78 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048938 Aug 27 04:13:29.295659 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3504/7292] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:13:29 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:30.307991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:30.310313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:30.317714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:30.318313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:30.318824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:30.319692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:30.320135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:30.320563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:30.355294 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f0a9815-c227-4f06-8e67-8c7da9866df2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052231 Aug 27 04:13:30.356228 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3789/7293] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:13:30 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:31.370473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:31.372679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:31.379831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:31.380333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:31.380780 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:31.382132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:31.382983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:31.383438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:31.414386 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eef53260-491b-45bd-93a1-0fde3bdf2ffa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048699 Aug 27 04:13:31.414962 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3505/7294] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:13:31 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:13:31.425399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:31.425976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:31.434179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:31.434666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:31.435099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:31.435811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:31.436266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:31.436694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:31.515153 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] HTTP exception thrown: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d is not attached to volume 47554de9-98a5-4df7-b511-daa1dcade80c Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Request method failure captured: Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: request: DELETE /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments/47554de9-98a5-4df7-b511-daa1dcade80c HTTP/1.1 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZmmp0IfYsZlXG_bVovq6h6355wrKVK8EaE4gf1AckZkrh9O5SiWm5_FEHV-IE4DbfxLZ5QKpylV1bHYuVa9ynjxmOukUVHIBIXVqyL9yyx2_-aU0cdWMH65PWHbGSHtB4yQaCUv5MS5i9AODsdDSRgDAbt9733wAV6dn4k6yAYacTs Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a7a10a78b2d644908d8c4caa02b47b89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}] Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 546d611c04a347c9bdc21cf67f58c0fc Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d is not attached to volume 47554de9-98a5-4df7-b511-daa1dcade80c Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'server_id': 'c68a1bc9-b35d-4efb-845d-92f0324a667d', 'id': '47554de9-98a5-4df7-b511-daa1dcade80c'} Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 47554de9-98a5-4df7-b511-daa1dcade80c. Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d is not attached to volume 47554de9-98a5-4df7-b511-daa1dcade80c Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:13:31.516762 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:13:31.521377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:13:31.521377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:13:31.521377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d is not attached to volume 47554de9-98a5-4df7-b511-daa1dcade80c Aug 27 04:13:31.521377 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:31.521377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Returning 404 to user: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d is not attached to volume 47554de9-98a5-4df7-b511-daa1dcade80c {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:13:31.521377 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a367bbb2-9c03-428f-8cfc-d9e779f002d9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments/47554de9-98a5-4df7-b511-daa1dcade80c" status: 404 len: 154 microversion: 2.1 time: 0.096878 Aug 27 04:13:31.521377 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3790/7295] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:13:31 2022] DELETE /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d/os-volume_attachments/47554de9-98a5-4df7-b511-daa1dcade80c => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:34.917882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:34.918526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:34.925409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:34.925921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:34.926583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:34.927339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:34.927811 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:34.928379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:34.956927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:13:35.048974 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c364da71-347c-42a6-9991-2c850f7dbb37 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 204 len: 0 microversion: 2.1 time: 0.136065 Aug 27 04:13:35.049543 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3506/7296] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:13:34 2022] DELETE /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:13:35.058612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:35.059232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:35.069549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:35.070593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:35.071147 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:35.071973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:35.072512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:35.073017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:35.243150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:35.252568 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-587b5b65-8d51-4b11-a259-89a33f497115 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1561 microversion: 2.1 time: 0.198015 Aug 27 04:13:35.253386 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3791/7297] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:35 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:36.276959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:36.277689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:36.284964 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:36.285468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:36.285914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:36.286673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:36.287188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:36.288412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:36.448669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:36.456923 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e43b4aab-e801-4198-9576-b82bd39aaa97 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1561 microversion: 2.1 time: 0.184844 Aug 27 04:13:36.457507 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3507/7298] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:36 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:37.236248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-23dca7d6-dac7-4b98-be18-5e0f657afb1f req-605e9279-bbee-4aa5-b394-e287af50684f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68a1bc9-b35d-4efb-845d-92f0324a667d", "name": "network-vif-deleted", "tag": "b1fc5f6a-3e8f-46d2-b65b-d5a1ec5b8510"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:37.248470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-23dca7d6-dac7-4b98-be18-5e0f657afb1f req-605e9279-bbee-4aa5-b394-e287af50684f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:37.249895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-23dca7d6-dac7-4b98-be18-5e0f657afb1f req-605e9279-bbee-4aa5-b394-e287af50684f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:37.250431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-23dca7d6-dac7-4b98-be18-5e0f657afb1f req-605e9279-bbee-4aa5-b394-e287af50684f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:37.263995 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-23dca7d6-dac7-4b98-be18-5e0f657afb1f req-605e9279-bbee-4aa5-b394-e287af50684f service nova] Creating event network-vif-deleted:b1fc5f6a-3e8f-46d2-b65b-d5a1ec5b8510 for instance c68a1bc9-b35d-4efb-845d-92f0324a667d on n-h2-852086-5 Aug 27 04:13:37.270350 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-23dca7d6-dac7-4b98-be18-5e0f657afb1f req-605e9279-bbee-4aa5-b394-e287af50684f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037923 Aug 27 04:13:37.270998 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3792/7299] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:37.479294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:37.479845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:37.486847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:37.487351 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:37.487805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:37.488545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:37.489019 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:37.489747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:37.523433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:37.523937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:37.524386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:37.524854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lazy-loading 'fault' on Instance uuid c68a1bc9-b35d-4efb-845d-92f0324a667d {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:13:37.567992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:37.577392 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89ab2cfd-69d4-483b-b384-9de61f94eb9c tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 200 len: 1353 microversion: 2.1 time: 0.102330 Aug 27 04:13:37.577975 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3508/7300] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:37 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:38.599240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:38.600001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: c68a1bc9-b35d-4efb-845d-92f0324a667d] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:38.607374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:38.607867 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:38.608311 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:38.609016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:38.609484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:38.609914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:38.623484 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] HTTP exception thrown: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d could not be found. Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Request method failure captured: Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d HTTP/1.1 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZmmp0IfYsZlXG_bVovq6h6355wrKVK8EaE4gf1AckZkrh9O5SiWm5_FEHV-IE4DbfxLZ5QKpylV1bHYuVa9ynjxmOukUVHIBIXVqyL9yyx2_-aU0cdWMH65PWHbGSHtB4yQaCUv5MS5i9AODsdDSRgDAbt9733wAV6dn4k6yAYacTs Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a7a10a78b2d644908d8c4caa02b47b89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}] Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 546d611c04a347c9bdc21cf67f58c0fc Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d could not be found. Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': 'c68a1bc9-b35d-4efb-845d-92f0324a667d'} Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d could not be found. Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d could not be found. Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:38.625176 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d could not be found. Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Returning 404 to user: Instance c68a1bc9-b35d-4efb-845d-92f0324a667d could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-74b3379a-9080-47d7-b337-f3dffaeb02e1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d" status: 404 len: 111 microversion: 2.1 time: 0.031639 Aug 27 04:13:38.629433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3793/7301] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:38 2022] GET /compute/v2.1/servers/c68a1bc9-b35d-4efb-845d-92f0324a667d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:13:38.638279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31ad9e1d-76a3-48cd-b4fb-9ef2b61d1aa2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '.version_select at 0x7fe457f04f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:38.659619 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31ad9e1d-76a3-48cd-b4fb-9ef2b61d1aa2 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1897989058" status: 202 len: 0 microversion: 2.1 time: 0.027846 Aug 27 04:13:38.660453 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3509/7302] 10.222.0.69 () {58 vars in 1278 bytes} [Sat Aug 27 04:13:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1897989058 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:38.676500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-74afab69-c93b-4fd8-bd90-caa1b671705e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: .version_select at 0x7fe4602eb160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-802419747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6HurnQ5ECkMft1nUAFW/x3JhxbYfAsxQ3AOM2c53aohBO4oeJ9GqDjzsGeeg7U7iusj1mR4s17j1OCrISx/zhTk3LLkmAmqohMpTA7ATwjWGR6i7zq2TojJ1YM8PjY9Q=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:38.692467 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-74afab69-c93b-4fd8-bd90-caa1b671705e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:13:38.702115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-74afab69-c93b-4fd8-bd90-caa1b671705e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for user 546d611c04a347c9bdc21cf67f58c0fc and project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:13:38.723370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-74afab69-c93b-4fd8-bd90-caa1b671705e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.050746 Aug 27 04:13:38.724150 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3794/7303] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:13:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:38.775431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-269863278", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-802419747", "networks": [{"uuid": "b97031cd-6b57-41d2-9deb-a8fec201838a"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:38.831868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] validate_networks() for [('b97031cd-6b57-41d2-9deb-a8fec201838a', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:13:39.207518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:13:39.207982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:13:39.208502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:13:39.208948 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:13:39.209430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:13:39.218760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:39.219291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:39.219750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:39.220509 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:39.220987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:39.221436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:39.238981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:13:39.245468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Getting quotas for user 546d611c04a347c9bdc21cf67f58c0fc and project a7a10a78b2d644908d8c4caa02b47b89. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:13:39.258307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:13:39.260663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:13:39.308160 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c983d5a-1a4e-4b64-85f6-f5ba708866b3 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536701 Aug 27 04:13:39.309014 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3510/7304] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:13:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:13:39.319853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4c00eb9a-1d68-4a6e-b9cf-50d307b279d6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:39.320472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4c00eb9a-1d68-4a6e-b9cf-50d307b279d6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:39.380297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4c00eb9a-1d68-4a6e-b9cf-50d307b279d6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:39.388178 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4c00eb9a-1d68-4a6e-b9cf-50d307b279d6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1261 microversion: 2.1 time: 0.072566 Aug 27 04:13:39.388766 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3795/7305] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:39 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1261 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:40.411266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:40.413576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:40.419923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:40.420466 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:40.420876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:40.421804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:40.422333 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:40.422847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:40.507113 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:40.517284 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de1acb66-2826-4482-9f44-3bbc08db3828 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1331 microversion: 2.1 time: 0.110626 Aug 27 04:13:40.517983 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3511/7306] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:40 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:41.539329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:41.539949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:41.547042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:41.547627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:41.548079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:41.548795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:41.549256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:41.549688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:41.683561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5059c4a2-e36e-4993-ae9e-ab55325f8465 req-2e8ed414-3743-4d1a-89d1-f0bcebd19ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25791959-5f5a-48ec-86b1-52ea6316e456", "tag": "128cfd84-9779-4927-a798-8e841644bd2e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:41.699880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:41.708163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5059c4a2-e36e-4993-ae9e-ab55325f8465 req-2e8ed414-3743-4d1a-89d1-f0bcebd19ab3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:41.708677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5059c4a2-e36e-4993-ae9e-ab55325f8465 req-2e8ed414-3743-4d1a-89d1-f0bcebd19ab3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:41.708871 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-17b54bba-672b-480d-b426-c126be965c86 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1361 microversion: 2.1 time: 0.173753 Aug 27 04:13:41.709132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5059c4a2-e36e-4993-ae9e-ab55325f8465 req-2e8ed414-3743-4d1a-89d1-f0bcebd19ab3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:41.718209 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3796/7307] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:41 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:41.724256 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5059c4a2-e36e-4993-ae9e-ab55325f8465 req-2e8ed414-3743-4d1a-89d1-f0bcebd19ab3 service nova] Creating event network-changed:128cfd84-9779-4927-a798-8e841644bd2e for instance 25791959-5f5a-48ec-86b1-52ea6316e456 on n-h2-852086-5 Aug 27 04:13:41.730590 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5059c4a2-e36e-4993-ae9e-ab55325f8465 req-2e8ed414-3743-4d1a-89d1-f0bcebd19ab3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055210 Aug 27 04:13:41.731519 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3512/7308] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:42.733066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:42.733679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:42.741035 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:42.741580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:42.742143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:42.743439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:42.743928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:42.744381 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:42.886595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:42.894470 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-472e73a7-9015-4eff-9451-67be0526b78f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1361 microversion: 2.1 time: 0.165449 Aug 27 04:13:42.895067 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3797/7309] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:42 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:43.918052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:43.918807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:43.926377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:43.927244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:43.928069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:43.929349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:43.931136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:43.931890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:44.078116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:44.086570 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75c12c97-4f8f-4943-81a7-c7a3a8965e83 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1361 microversion: 2.1 time: 0.173183 Aug 27 04:13:44.087275 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3513/7310] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:43 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:45.116388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:45.117031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:45.124746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:45.125226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:45.125660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:45.126383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:45.126837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:45.127257 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:45.258619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:45.266283 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-30fe6167-b148-4411-83cb-38b1cd784995 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1361 microversion: 2.1 time: 0.153830 Aug 27 04:13:45.266857 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3798/7311] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:45 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:45.629325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2eaf7cb3-bb44-45e2-a2e2-321a3e1f5756 req-7d266f96-4adb-4237-85e4-39097e1170fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25791959-5f5a-48ec-86b1-52ea6316e456", "name": "network-vif-plugged", "status": "completed", "tag": "128cfd84-9779-4927-a798-8e841644bd2e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:45.641278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2eaf7cb3-bb44-45e2-a2e2-321a3e1f5756 req-7d266f96-4adb-4237-85e4-39097e1170fd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:45.641936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2eaf7cb3-bb44-45e2-a2e2-321a3e1f5756 req-7d266f96-4adb-4237-85e4-39097e1170fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:45.642430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2eaf7cb3-bb44-45e2-a2e2-321a3e1f5756 req-7d266f96-4adb-4237-85e4-39097e1170fd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:45.655074 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2eaf7cb3-bb44-45e2-a2e2-321a3e1f5756 req-7d266f96-4adb-4237-85e4-39097e1170fd service nova] Creating event network-vif-plugged:128cfd84-9779-4927-a798-8e841644bd2e for instance 25791959-5f5a-48ec-86b1-52ea6316e456 on n-h2-852086-5 Aug 27 04:13:45.659970 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2eaf7cb3-bb44-45e2-a2e2-321a3e1f5756 req-7d266f96-4adb-4237-85e4-39097e1170fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034445 Aug 27 04:13:45.660887 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3514/7312] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:46.287326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:46.287916 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:46.295326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:46.295809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:46.296244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:46.296949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:46.297392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:46.297806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:46.440805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:46.452136 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-573c7f7b-1f2b-48ad-8997-b7ab13c8077e tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1361 microversion: 2.1 time: 0.168555 Aug 27 04:13:46.452999 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3799/7313] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:46 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:47.476412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:47.477690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:47.484057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:47.484557 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:47.485012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:47.485750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:47.486249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:47.486694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:47.623877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:47.631624 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78a9d612-9b69-4413-9a5b-2f6368490ac1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1552 microversion: 2.1 time: 0.160568 Aug 27 04:13:47.632205 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3515/7314] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:47 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:47.652009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:47.652626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:47.659070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:47.659556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:47.659992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:47.660700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:47.661159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:47.661587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:47.795445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:47.803203 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c50f3b7c-7ab1-4b44-bc50-0b891cc1a770 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1552 microversion: 2.1 time: 0.155661 Aug 27 04:13:47.803771 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3800/7315] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:13:47 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:49.292356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6068f0ed-b67a-404b-a14b-cc19ad5c8d7c"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:49.294901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:13:49.297745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:49.298457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:13:49.304603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:49.305739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:49.306484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:49.307209 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:13:49.307688 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:13:49.308131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:13:49.557821 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05c2189b-7976-4de4-87e9-348824d5c2b1 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "POST /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269817 Aug 27 04:13:49.558512 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3516/7316] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 04:13:49 2022] POST /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:00.296474 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:00.297004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:00.299763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:00.300618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:00.301196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=64 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:00.308829 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:00.309320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:00.309757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:00.310536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:00.311036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:00.311460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:00.397256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lazy-loading 'services' on Instance uuid 25791959-5f5a-48ec-86b1-52ea6316e456 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:14:00.470728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5d71cdd-5916-432f-af8f-b930bcd37e17 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments/6068f0ed-b67a-404b-a14b-cc19ad5c8d7c" status: 202 len: 0 microversion: 2.1 time: 0.177987 Aug 27 04:14:00.471330 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3801/7317] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:14:00 2022] DELETE /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments/6068f0ed-b67a-404b-a14b-cc19ad5c8d7c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:14:00.482114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:00.484846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:00.487770 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:00.488635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:00.494581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:00.495110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:00.495573 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:00.496369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:00.496782 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:00.497220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:00.536061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b01b036-51b6-439c-a2ef-bc5ce3fd4765 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057820 Aug 27 04:14:00.536254 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3517/7318] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:14:00 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:01.552150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:01.555182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:01.561465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:01.561943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:01.562412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:01.563105 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:01.563560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:01.563977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:01.595541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-83d5cf60-9bbb-4a78-938d-07a6284d7faa tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048558 Aug 27 04:14:01.596107 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3802/7319] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:14:01 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:02.608667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:02.610963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:02.618115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:02.618714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:02.619163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:02.619886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:02.620358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:02.620802 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:02.653123 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-458c598d-12da-46aa-a7dd-b60b0a895faf tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048395 Aug 27 04:14:02.653701 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3518/7320] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:14:02 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:03.667074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:03.670551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:03.682302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:03.682788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:03.683266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:03.683988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:03.684445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:03.684870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:03.716920 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3cd561a3-8187-4bdb-8e9b-086e8971b6e6 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055685 Aug 27 04:14:03.717490 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3803/7321] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:14:03 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:04.729592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:04.731919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:04.739232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:04.739738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:04.740191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:04.741043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:04.741516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:04.742561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:04.779216 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7cb56adb-b1b8-4340-b638-694e6ae05a5f tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053738 Aug 27 04:14:04.779820 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3519/7322] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:14:04 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:05.792438 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:05.794578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:05.801403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:05.801891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:05.802369 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:05.803075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:05.803538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:05.803967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:05.837523 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b793da19-22ad-4f08-a9b6-27228ec86a81 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049813 Aug 27 04:14:05.838078 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3804/7323] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:14:05 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:14:05.848820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:05.850001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:05.856753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:05.857247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:05.857695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:05.858510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:05.858984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:05.859425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:05.937143 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] HTTP exception thrown: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 is not attached to volume 6068f0ed-b67a-404b-a14b-cc19ad5c8d7c Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Request method failure captured: Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments/6068f0ed-b67a-404b-a14b-cc19ad5c8d7c HTTP/1.1 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZmmp0IfYsZlXG_bVovq6h6355wrKVK8EaE4gf1AckZkrh9O5SiWm5_FEHV-IE4DbfxLZ5QKpylV1bHYuVa9ynjxmOukUVHIBIXVqyL9yyx2_-aU0cdWMH65PWHbGSHtB4yQaCUv5MS5i9AODsdDSRgDAbt9733wAV6dn4k6yAYacTs Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a7a10a78b2d644908d8c4caa02b47b89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}] Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 546d611c04a347c9bdc21cf67f58c0fc Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 is not attached to volume 6068f0ed-b67a-404b-a14b-cc19ad5c8d7c Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': '25791959-5f5a-48ec-86b1-52ea6316e456', 'id': '6068f0ed-b67a-404b-a14b-cc19ad5c8d7c'} Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6068f0ed-b67a-404b-a14b-cc19ad5c8d7c. Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 is not attached to volume 6068f0ed-b67a-404b-a14b-cc19ad5c8d7c Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:14:05.939115 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:14:05.944302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:14:05.944302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:14:05.944302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 is not attached to volume 6068f0ed-b67a-404b-a14b-cc19ad5c8d7c Aug 27 04:14:05.944302 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:05.944302 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Returning 404 to user: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 is not attached to volume 6068f0ed-b67a-404b-a14b-cc19ad5c8d7c {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:14:05.944302 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ff61c8f-58e8-4c60-85b3-ce53f822fd45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments/6068f0ed-b67a-404b-a14b-cc19ad5c8d7c" status: 404 len: 154 microversion: 2.1 time: 0.096133 Aug 27 04:14:05.944302 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3520/7324] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:14:05 2022] DELETE /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456/os-volume_attachments/6068f0ed-b67a-404b-a14b-cc19ad5c8d7c => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:14:09.300788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:09.301291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:09.308893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:09.309383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:09.309860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:09.310611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:09.311073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:09.311502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:09.339689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:14:09.429018 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a3f209be-ebf0-416e-841f-0c77e1d56300 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 204 len: 0 microversion: 2.1 time: 0.131559 Aug 27 04:14:09.431235 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3805/7325] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:14:09 2022] DELETE /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:14:09.441612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:09.443843 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:09.452685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:09.453197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:09.453660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:09.454423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:09.454898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:09.455342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:09.616356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:09.625901 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8ac8368-5917-4a4f-8f47-84d06ff1e896 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1558 microversion: 2.1 time: 0.188268 Aug 27 04:14:09.626651 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3521/7326] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:09 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:10.649886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:10.650701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:10.659139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:10.659358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:10.659814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:10.660635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:10.661219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:10.661648 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:10.809619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:10.818814 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7367f0af-85ed-4dfd-a472-a8d7cc009cc4 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1558 microversion: 2.1 time: 0.174383 Aug 27 04:14:10.819409 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3806/7327] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:10 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:11.657218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8f0ed209-5e6a-4ce4-bf3c-ee41a566a63b req-a2f3f3ef-31d0-45a6-b415-7820970792b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25791959-5f5a-48ec-86b1-52ea6316e456", "name": "network-vif-deleted", "tag": "128cfd84-9779-4927-a798-8e841644bd2e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:11.681014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8f0ed209-5e6a-4ce4-bf3c-ee41a566a63b req-a2f3f3ef-31d0-45a6-b415-7820970792b8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:11.681797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8f0ed209-5e6a-4ce4-bf3c-ee41a566a63b req-a2f3f3ef-31d0-45a6-b415-7820970792b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:11.682458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8f0ed209-5e6a-4ce4-bf3c-ee41a566a63b req-a2f3f3ef-31d0-45a6-b415-7820970792b8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:11.700114 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8f0ed209-5e6a-4ce4-bf3c-ee41a566a63b req-a2f3f3ef-31d0-45a6-b415-7820970792b8 service nova] Creating event network-vif-deleted:128cfd84-9779-4927-a798-8e841644bd2e for instance 25791959-5f5a-48ec-86b1-52ea6316e456 on n-h2-852086-5 Aug 27 04:14:11.705883 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8f0ed209-5e6a-4ce4-bf3c-ee41a566a63b req-a2f3f3ef-31d0-45a6-b415-7820970792b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058571 Aug 27 04:14:11.706938 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3522/7328] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:11.842529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:11.843413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:11.853666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:11.854243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:11.854698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:11.855436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:11.855983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:11.856339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:11.896767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:11.897700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:11.897700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:11.898312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lazy-loading 'fault' on Instance uuid 25791959-5f5a-48ec-86b1-52ea6316e456 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:14:11.950626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546d611c04a347c9bdc21cf67f58c0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a10a78b2d644908d8c4caa02b47b89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:11.958867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ec65a6b6-d0d5-4999-a456-77698f05d164 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 200 len: 1351 microversion: 2.1 time: 0.120550 Aug 27 04:14:11.959476 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3807/7329] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:11 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:12.981918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:12.982671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] [instance: 25791959-5f5a-48ec-86b1-52ea6316e456] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:12.988996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:12.989499 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:12.989954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:12.990707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:12.991200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:12.991635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:13.005524 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] HTTP exception thrown: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 could not be found. Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Request method failure captured: Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 HTTP/1.1 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZmmp0IfYsZlXG_bVovq6h6355wrKVK8EaE4gf1AckZkrh9O5SiWm5_FEHV-IE4DbfxLZ5QKpylV1bHYuVa9ynjxmOukUVHIBIXVqyL9yyx2_-aU0cdWMH65PWHbGSHtB4yQaCUv5MS5i9AODsdDSRgDAbt9733wAV6dn4k6yAYacTs Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a7a10a78b2d644908d8c4caa02b47b89", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a7a10a78b2d644908d8c4caa02b47b89"}]}] Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: a7a10a78b2d644908d8c4caa02b47b89 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1394676227 Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 546d611c04a347c9bdc21cf67f58c0fc Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestEncryptedCinderVolumes-1394676227-project Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 could not be found. Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '25791959-5f5a-48ec-86b1-52ea6316e456'} Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 could not be found. Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 could not be found. Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:13.007737 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 could not be found. Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Returning 404 to user: Instance 25791959-5f5a-48ec-86b1-52ea6316e456 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fcb1c7cf-fa72-4bea-a79a-0655a70b0db9 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456" status: 404 len: 111 microversion: 2.1 time: 0.032475 Aug 27 04:14:13.013152 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3523/7330] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:12 2022] GET /compute/v2.1/servers/25791959-5f5a-48ec-86b1-52ea6316e456 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:14:13.018084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cbf81d62-0e57-4ab1-b149-0b2b15f93a45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] Calling method '.version_select at 0x7fe457bb78b0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:13.039054 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cbf81d62-0e57-4ab1-b149-0b2b15f93a45 tempest-TestEncryptedCinderVolumes-1394676227 tempest-TestEncryptedCinderVolumes-1394676227-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-802419747" status: 202 len: 0 microversion: 2.1 time: 0.024822 Aug 27 04:14:13.039626 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3808/7331] 10.222.0.69 () {58 vars in 1275 bytes} [Sat Aug 27 04:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-802419747 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:14:40.245438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79b04b88-cd32-4e98-9924-8f44c32ca73d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'create', calling method: .version_select at 0x7fe460353430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-457139436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJOKE+zq5nLopzP1IA7kOa5uSEb/wIUuPcBWtlS29Z5jbEp0g9xQ6NWoRtmsfqTFCW2C9apcFhVe2ejcGMjEFl59OA4rWh6NnxZ6WR6uRIrX+QKT3ji9J7Xa452wqPjcA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:40.251445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:40.252248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=34 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:40.265323 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-79b04b88-cd32-4e98-9924-8f44c32ca73d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:14:40.273588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-79b04b88-cd32-4e98-9924-8f44c32ca73d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for user b55b863ebcc24ba583015bf4728932e1 and project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:14:40.302129 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79b04b88-cd32-4e98-9924-8f44c32ca73d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060874 Aug 27 04:14:40.302755 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3524/7332] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:14:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:40.354710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-935414492", "imageRef": "1cac1aac-bc1e-4bb6-b705-d7511e2f0a31", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-457139436", "networks": [{"uuid": "2622e9de-2e24-4379-b531-ca9038c8fcc6"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:40.364145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:40.364769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:40.365681 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:40.365875 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:14:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.69) !!! Aug 27 04:14:40.418115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] validate_networks() for [('2622e9de-2e24-4379-b531-ca9038c8fcc6', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:14:40.791002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:14:40.791433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:14:40.791911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:14:40.792323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:14:40.792764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:14:40.801640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:40.802124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:40.802592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:40.803842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:40.804355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:40.804814 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:40.823279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:14:40.828835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for user b55b863ebcc24ba583015bf4728932e1 and project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:14:40.841516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:14:40.843782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cac1aac-bc1e-4bb6-b705-d7511e2f0a31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:14:40.890506 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5f067318-5f41-4230-83b2-18980737fcb5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540436 Aug 27 04:14:40.891090 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3809/7333] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:14:40.901984 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c905129a-a919-49cd-ac79-657c67af27bc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:40.902644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c905129a-a919-49cd-ac79-657c67af27bc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:40.957874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c905129a-a919-49cd-ac79-657c67af27bc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:40.965520 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c905129a-a919-49cd-ac79-657c67af27bc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1257 microversion: 2.1 time: 0.067771 Aug 27 04:14:40.966099 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3525/7334] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:40 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:41.988174 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:41.988851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:41.996348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:41.996841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:41.997271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:41.997982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:41.998469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:41.998892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:42.067086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:42.075940 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1f980b36-e046-4983-99c0-b0e8cd27999b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1327 microversion: 2.1 time: 0.093224 Aug 27 04:14:42.076667 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3810/7335] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:41 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:43.100178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:43.101197 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:43.108244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:43.108756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:43.109213 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:43.109952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:43.110453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:43.110938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:43.260548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:43.268752 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8762489-b103-421f-b719-f59d53d9f58b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.174450 Aug 27 04:14:43.269336 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3526/7336] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:43 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:14:44.294117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:44.295763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:44.301944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:44.302463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:44.302910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:44.304294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:44.304760 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:44.305263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:44.455046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:44.465308 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8290cc7f-5d93-49db-8f74-72cdb54488db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.178778 Aug 27 04:14:44.466016 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3811/7337] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:44 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:45.487418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:45.488287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:45.497031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:45.497682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:45.498365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:45.499102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:45.499572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:45.500014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:45.662361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:45.675021 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40d61c43-1669-4d66-92dd-55cab3455fc8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.191744 Aug 27 04:14:45.676622 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3527/7338] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:45 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:46.698487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:46.699444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:46.707166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:46.707663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:46.708103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:46.708824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:46.709286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:46.710344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:46.859433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:46.870914 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7c02482f-5dea-4306-af44-862fa16d674a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.177435 Aug 27 04:14:46.871936 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3812/7339] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:46 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:47.892533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:47.893391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:47.901186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:47.901700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:47.902149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:47.902917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:47.903842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:47.904280 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:48.066054 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:48.074571 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8cd2d266-99d3-401c-a8fa-81b272884189 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.186222 Aug 27 04:14:48.075264 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3528/7340] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:47 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:49.098180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:49.098750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:49.105345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:49.105846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:49.106324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:49.107038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:49.107499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:49.107932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:49.270227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:49.281379 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a4478e9e-71b0-411f-8285-99fd6b243bce tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.187375 Aug 27 04:14:49.282199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3813/7341] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:49 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:50.302465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:50.303130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:50.310390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:50.310885 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:50.311335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:50.312044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:50.312514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:50.312944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:50.517585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:50.526035 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d35b3a16-40d8-4e81-92e8-46b20182f975 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.227462 Aug 27 04:14:50.526767 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3529/7342] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:50 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:51.009628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-65a87467-3a46-41d0-b486-d3788c9a6a79 req-4bffcaea-899d-4237-b52f-583683ae2c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c738322-0347-474f-9e32-1127d7c01d3f", "tag": "930c3c63-93d9-47ae-a806-6cdfa5d426ea"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:51.017528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:51.018284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:51.024592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-65a87467-3a46-41d0-b486-d3788c9a6a79 req-4bffcaea-899d-4237-b52f-583683ae2c2a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:51.025164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-65a87467-3a46-41d0-b486-d3788c9a6a79 req-4bffcaea-899d-4237-b52f-583683ae2c2a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:51.025666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-65a87467-3a46-41d0-b486-d3788c9a6a79 req-4bffcaea-899d-4237-b52f-583683ae2c2a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:51.041736 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-65a87467-3a46-41d0-b486-d3788c9a6a79 req-4bffcaea-899d-4237-b52f-583683ae2c2a service nova] Creating event network-changed:930c3c63-93d9-47ae-a806-6cdfa5d426ea for instance 6c738322-0347-474f-9e32-1127d7c01d3f on n-h2-852086-5 Aug 27 04:14:51.047674 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-65a87467-3a46-41d0-b486-d3788c9a6a79 req-4bffcaea-899d-4237-b52f-583683ae2c2a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043761 Aug 27 04:14:51.048457 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3814/7343] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:51.546476 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:51.547071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:51.548890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:14:51.555565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:51.556070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:51.556517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:51.557239 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:51.557706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:51.558143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:51.706559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:51.716007 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4003985c-64db-4bae-b855-f3165acae380 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.173528 Aug 27 04:14:51.716685 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3530/7344] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:51 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:14:52.742472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:52.743187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:52.750359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:52.750849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:52.751289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:52.752000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:52.752465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:52.752899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:52.890036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:52.898689 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-492abc91-d4a5-4f2a-9493-476461c9161e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.160549 Aug 27 04:14:52.899268 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3815/7345] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:52 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:53.919571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:53.920220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:53.927147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:53.927657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:53.928163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:53.928892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:53.929370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:53.929818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:54.068289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:54.076961 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eef628e7-8570-4ad2-ba8d-bc1449765179 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.161336 Aug 27 04:14:54.077545 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3531/7346] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:53 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:55.099028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:55.099677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:55.107383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:55.107871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:55.108309 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:55.109013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:55.109471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:55.109901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:55.240541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:55.248539 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9d1c6c78-7b8f-486a-8ac0-9467a725ffbc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.153471 Aug 27 04:14:55.249155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3816/7347] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:55 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:56.109386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9b74cc89-7b17-45f3-bd01-695d677dbc80 req-d48cce42-e0ab-4115-97e8-0cc3f36201e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c738322-0347-474f-9e32-1127d7c01d3f", "name": "network-vif-plugged", "status": "completed", "tag": "930c3c63-93d9-47ae-a806-6cdfa5d426ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:56.120674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9b74cc89-7b17-45f3-bd01-695d677dbc80 req-d48cce42-e0ab-4115-97e8-0cc3f36201e4 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:56.121176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9b74cc89-7b17-45f3-bd01-695d677dbc80 req-d48cce42-e0ab-4115-97e8-0cc3f36201e4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:56.121631 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9b74cc89-7b17-45f3-bd01-695d677dbc80 req-d48cce42-e0ab-4115-97e8-0cc3f36201e4 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:56.133904 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9b74cc89-7b17-45f3-bd01-695d677dbc80 req-d48cce42-e0ab-4115-97e8-0cc3f36201e4 service nova] Creating event network-vif-plugged:930c3c63-93d9-47ae-a806-6cdfa5d426ea for instance 6c738322-0347-474f-9e32-1127d7c01d3f on n-h2-852086-5 Aug 27 04:14:56.139054 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9b74cc89-7b17-45f3-bd01-695d677dbc80 req-d48cce42-e0ab-4115-97e8-0cc3f36201e4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033437 Aug 27 04:14:56.139848 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3532/7348] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:56.268969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:56.269706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:56.277776 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:56.278294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:56.278727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:56.279428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:56.279877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:56.280301 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:56.425348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:56.434526 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6de53410-514c-4bcb-b0f6-cff4bac61457 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1357 microversion: 2.1 time: 0.169424 Aug 27 04:14:56.435130 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3817/7349] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:56 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:57.456585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:57.458277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:57.465057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.465565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.466076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.466865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.467337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.467810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.601473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:57.610828 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d612f42a-c4fb-467d-ae44-120e6c3d4762 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1547 microversion: 2.1 time: 0.159363 Aug 27 04:14:57.611459 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3533/7350] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:57 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:14:57.632081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:57.633055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:57.639955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.640475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.640917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.641656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.642212 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.642646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.774887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:57.782621 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6f1b5018-d39e-4a0c-8833-0b3708bad021 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1547 microversion: 2.1 time: 0.154356 Aug 27 04:14:57.783199 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3818/7351] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:57 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:57.802083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:57.807225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:57.808004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Searching by: {'deleted': False, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:14:57.813278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.813766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.814261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.814982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.815443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.815879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.840842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:14:57.868376 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7fbd0132-ca8c-4029-8262-7ab7d331269b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070119 Aug 27 04:14:57.868957 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3534/7352] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 04:14:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:57.880173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:57.880786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:57.887621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.888109 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.888549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:57.889242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:57.889697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:57.890123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:58.026733 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:58.034556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8a10c4e0-213b-44a4-8878-26919000359a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1547 microversion: 2.1 time: 0.158227 Aug 27 04:14:58.035281 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3819/7353] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:14:57 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:14:59.574418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1be940cf-e3d3-47bf-b053-b6284492f172"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:59.576911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:14:59.583848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:59.584353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:59.584812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:59.585605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:14:59.586080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:14:59.586551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:14:59.829483 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50b76e58-eba5-4635-994d-84cdb9558466 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259599 Aug 27 04:14:59.830115 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3535/7354] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 04:14:59 2022] POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:13.059030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:13.059673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:13.062749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:13.063404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=58 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:13.070060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:13.070659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:13.071138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:13.071907 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:13.072365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:13.072796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:13.210816 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:13.221800 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b71dc58a-a1c7-49be-a697-79b965f894ef tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1593 microversion: 2.1 time: 0.166492 Aug 27 04:15:13.222281 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3820/7355] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:13 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1593 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:14.973538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8cb33ea8-1591-4070-9cf3-9fdf876922dd req-4a8065ae-e0bb-4e7e-814d-66ce6ab58561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c738322-0347-474f-9e32-1127d7c01d3f", "tag": "930c3c63-93d9-47ae-a806-6cdfa5d426ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:14.983513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:14.984221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:14.985038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:15:14.987287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8cb33ea8-1591-4070-9cf3-9fdf876922dd req-4a8065ae-e0bb-4e7e-814d-66ce6ab58561 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:14.988167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8cb33ea8-1591-4070-9cf3-9fdf876922dd req-4a8065ae-e0bb-4e7e-814d-66ce6ab58561 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:14.988167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8cb33ea8-1591-4070-9cf3-9fdf876922dd req-4a8065ae-e0bb-4e7e-814d-66ce6ab58561 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:15.001790 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8cb33ea8-1591-4070-9cf3-9fdf876922dd req-4a8065ae-e0bb-4e7e-814d-66ce6ab58561 service nova] Creating event network-changed:930c3c63-93d9-47ae-a806-6cdfa5d426ea for instance 6c738322-0347-474f-9e32-1127d7c01d3f on n-h2-852086-5 Aug 27 04:15:15.009624 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8cb33ea8-1591-4070-9cf3-9fdf876922dd req-4a8065ae-e0bb-4e7e-814d-66ce6ab58561 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039986 Aug 27 04:15:15.013669 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3536/7356] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:16.228772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-127768238"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:16.230545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:16.236472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.236966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.237480 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.238258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.238712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.239162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.380693 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.network.security_group_api [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Adding security group 7740a4e0-5a74-4ce8-9a06-5fde74b3582e to port 930c3c63-93d9-47ae-a806-6cdfa5d426ea Aug 27 04:15:16.718516 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc0d4dda-8a8b-4046-bd5a-5221a59be00b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/action" status: 202 len: 0 microversion: 2.1 time: 0.494454 Aug 27 04:15:16.730601 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3821/7357] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:15:16 2022] POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:15:16.739065 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:16.740090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:15:16.747623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.748416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.749272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.750188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.750841 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.751447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.905897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-dd5e5b16-6c8e-40bb-88ff-359427202e47 req-b4a982ea-c08d-4d9a-a43f-d45e72c192de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c738322-0347-474f-9e32-1127d7c01d3f", "tag": "930c3c63-93d9-47ae-a806-6cdfa5d426ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:16.919143 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dd5e5b16-6c8e-40bb-88ff-359427202e47 req-b4a982ea-c08d-4d9a-a43f-d45e72c192de service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:15:16.919868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dd5e5b16-6c8e-40bb-88ff-359427202e47 req-b4a982ea-c08d-4d9a-a43f-d45e72c192de service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:15:16.920549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dd5e5b16-6c8e-40bb-88ff-359427202e47 req-b4a982ea-c08d-4d9a-a43f-d45e72c192de service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:15:16.936410 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-dd5e5b16-6c8e-40bb-88ff-359427202e47 req-b4a982ea-c08d-4d9a-a43f-d45e72c192de service nova] Creating event network-changed:930c3c63-93d9-47ae-a806-6cdfa5d426ea for instance 6c738322-0347-474f-9e32-1127d7c01d3f on n-h2-852086-5 Aug 27 04:15:16.941574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:16.941775 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-dd5e5b16-6c8e-40bb-88ff-359427202e47 req-b4a982ea-c08d-4d9a-a43f-d45e72c192de service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218341 Aug 27 04:15:16.942815 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3537/7358] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:16.953076 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-807422cf-8881-4570-a6b9-c62aff10b5c3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1758 microversion: 2.1 time: 0.220588 Aug 27 04:15:16.954562 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3822/7359] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:15:16 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:56.633908 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:16:56.634478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:56.635230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:56.636462 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:16:56.636591 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:16:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/action (ip 10.222.0.69) !!! Aug 27 04:16:56.643678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:56.646026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:16:56.654562 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:16:56.655065 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:16:56.655526 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:16:56.656272 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:16:56.656760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:16:56.657196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:16:56.730749 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aeab75e9-111f-4bd8-a922-bcf6c133d219 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/action" status: 202 len: 0 microversion: 2.1 time: 0.098941 Aug 27 04:16:56.731337 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3538/7360] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:16:56 2022] POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:16:56.739211 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:16:56.740157 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:16:56.740666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:56.741580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=16 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:56.744350 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 04:16:56.751173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:56.751873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:16:56.760594 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:16:56.761088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:16:56.761532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:16:56.762292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:16:56.762740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:16:56.763169 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:16:57.021170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:57.030332 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ef13f025-ed87-4327-a640-d502fad8a0ae tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1760 microversion: 2.1 time: 0.293597 Aug 27 04:16:57.030933 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3823/7361] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:16:56 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1760 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:58.054142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:58.054894 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:16:58.062228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:16:58.062742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:16:58.063953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:16:58.064689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:16:58.065169 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:16:58.065615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:16:58.069625 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 41036. Aug 27 04:16:58.265772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:58.274408 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6f11821-db7d-4824-a954-b62d94facf2d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1758 microversion: 2.1 time: 0.226015 Aug 27 04:16:58.274994 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3539/7362] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:16:58 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:12.173993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.174805 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.182629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-127768238"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:12.183171 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:12.198808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:12.199295 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:12.199726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:12.200437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:12.200890 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:12.201315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:12.201934 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 41076. Aug 27 04:18:12.202842 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 41074. Aug 27 04:18:12.342701 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.network.security_group_api [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Removing security group 7740a4e0-5a74-4ce8-9a06-5fde74b3582e from port 930c3c63-93d9-47ae-a806-6cdfa5d426ea Aug 27 04:18:12.665666 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3faf8fa-6228-4e59-be00-b631dff7e0ff tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/action" status: 202 len: 0 microversion: 2.1 time: 0.495838 Aug 27 04:18:12.667664 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3824/7363] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:18:12 2022] POST /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:18:12.673425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.674232 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.678532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a76f9cf6-ed31-4eed-b771-95456c8677b8 req-4eb59283-c3c8-437a-a8f9-1be8da7e726e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c738322-0347-474f-9e32-1127d7c01d3f", "tag": "930c3c63-93d9-47ae-a806-6cdfa5d426ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:12.690202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a76f9cf6-ed31-4eed-b771-95456c8677b8 req-4eb59283-c3c8-437a-a8f9-1be8da7e726e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:12.702823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a76f9cf6-ed31-4eed-b771-95456c8677b8 req-4eb59283-c3c8-437a-a8f9-1be8da7e726e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:12.703617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a76f9cf6-ed31-4eed-b771-95456c8677b8 req-4eb59283-c3c8-437a-a8f9-1be8da7e726e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:12.730277 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a76f9cf6-ed31-4eed-b771-95456c8677b8 req-4eb59283-c3c8-437a-a8f9-1be8da7e726e service nova] Creating event network-changed:930c3c63-93d9-47ae-a806-6cdfa5d426ea for instance 6c738322-0347-474f-9e32-1127d7c01d3f on n-h2-852086-5 Aug 27 04:18:12.737313 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a76f9cf6-ed31-4eed-b771-95456c8677b8 req-4eb59283-c3c8-437a-a8f9-1be8da7e726e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065946 Aug 27 04:18:12.738245 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3540/7364] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:14.066937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:14.067501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:14.073786 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:14.074312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:14.074928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:14.075629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:14.076107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:14.076533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:14.166476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lazy-loading 'services' on Instance uuid 6c738322-0347-474f-9e32-1127d7c01d3f {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:18:14.246639 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [7dbf013d-24e1-453e-9e83-ce93cf218138] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:18:14.757959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5bc966c8-d4e7-4cbc-ba54-1334ee2e48f9 req-26b143ea-c679-4e23-8e54-91a5e88a189a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c738322-0347-474f-9e32-1127d7c01d3f", "tag": "930c3c63-93d9-47ae-a806-6cdfa5d426ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:14.768193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5bc966c8-d4e7-4cbc-ba54-1334ee2e48f9 req-26b143ea-c679-4e23-8e54-91a5e88a189a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:14.768684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5bc966c8-d4e7-4cbc-ba54-1334ee2e48f9 req-26b143ea-c679-4e23-8e54-91a5e88a189a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:14.769124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5bc966c8-d4e7-4cbc-ba54-1334ee2e48f9 req-26b143ea-c679-4e23-8e54-91a5e88a189a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:14.780655 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5bc966c8-d4e7-4cbc-ba54-1334ee2e48f9 req-26b143ea-c679-4e23-8e54-91a5e88a189a service nova] Creating event network-changed:930c3c63-93d9-47ae-a806-6cdfa5d426ea for instance 6c738322-0347-474f-9e32-1127d7c01d3f on n-h2-852086-5 Aug 27 04:18:14.787315 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5bc966c8-d4e7-4cbc-ba54-1334ee2e48f9 req-26b143ea-c679-4e23-8e54-91a5e88a189a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034735 Aug 27 04:18:14.787961 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3541/7365] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:18:15.254036 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [7dbf013d-24e1-453e-9e83-ce93cf218138] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 41106. Aug 27 04:18:15.259331 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19891e18-770c-4cdf-a6e2-3ce03f7a99aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments/1be940cf-e3d3-47bf-b053-b6284492f172" status: 202 len: 0 microversion: 2.1 time: 1.196392 Aug 27 04:18:15.259331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3825/7366] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:18:14 2022] DELETE /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments/1be940cf-e3d3-47bf-b053-b6284492f172 => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:18:15.268924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:15.271645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:15.279191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:15.280014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:15.281481 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:15.281926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:15.282452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:15.282911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:15.324895 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f2f818e-db05-4e6b-8b88-4cb4c9dbf00e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061288 Aug 27 04:18:15.325488 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3542/7367] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:18:15 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:16.341601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:16.344611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:16.350979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:16.351463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:16.351904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:16.352613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:16.353069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:16.353495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:16.386469 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0c301d7-2526-4c1c-8ed7-040c760343cc tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049956 Aug 27 04:18:16.387040 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3826/7368] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:18:16 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:17.397840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:17.400574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:17.407737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:17.408238 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:17.408731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:17.409457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:17.409925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:17.410403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:17.441972 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65113793-6789-4947-9f28-a5fbba5a8607 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048140 Aug 27 04:18:17.442648 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3543/7369] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:18:17 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:18.454909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:18.457004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:18.463884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:18.464368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:18.464844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:18.465539 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:18.465998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:18.466443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:18.498073 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34a76adf-c405-4d96-beea-fceb55ffc107 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047466 Aug 27 04:18:18.498690 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3827/7370] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:18:18 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:19.510579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:19.512995 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:19.520190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:19.520694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:19.521175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:19.521903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:19.522421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:19.522850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:19.555172 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d833c22f-e938-4fb1-a873-2b8408a8a593 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048607 Aug 27 04:18:19.555753 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3544/7371] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:18:19 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:20.568025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:20.570558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:20.577464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:20.577950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:20.578429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:20.579138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:20.579598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:20.580023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:20.609673 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ae8629e-bb9d-48ae-98fe-93269d8521a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044912 Aug 27 04:18:20.610261 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3828/7372] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:18:20 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:18:20.620801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:20.621300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:20.628398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:20.628905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:20.629355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:20.630068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:20.630565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:20.631008 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:20.711147 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] HTTP exception thrown: Instance 6c738322-0347-474f-9e32-1127d7c01d3f is not attached to volume 1be940cf-e3d3-47bf-b053-b6284492f172 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Request method failure captured: Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments/1be940cf-e3d3-47bf-b053-b6284492f172 HTTP/1.1 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZohre7WHYY8LzJRupyi1wozEEds01FyZfi32GHxhDU2sQxP2zGWSSy-3c_j-EQywzV-nZcDS68btPn1Ckw9XIGeMNyrZ3GouXjWJ-xrazxAwiVXrCvWNeVmR4TIqHa9o4gGxe2nesdFpj90UW-ab_UHs1Ld1rtXBhnCoxA1FFjrmk8 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0df527ad98f6494ebcccefd4bcc2034a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}] Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b55b863ebcc24ba583015bf4728932e1 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6c738322-0347-474f-9e32-1127d7c01d3f is not attached to volume 1be940cf-e3d3-47bf-b053-b6284492f172 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': '6c738322-0347-474f-9e32-1127d7c01d3f', 'id': '1be940cf-e3d3-47bf-b053-b6284492f172'} Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1be940cf-e3d3-47bf-b053-b6284492f172. Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c738322-0347-474f-9e32-1127d7c01d3f is not attached to volume 1be940cf-e3d3-47bf-b053-b6284492f172 Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:18:20.712834 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:18:20.718012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:18:20.718012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:18:20.718012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c738322-0347-474f-9e32-1127d7c01d3f is not attached to volume 1be940cf-e3d3-47bf-b053-b6284492f172 Aug 27 04:18:20.718012 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:20.718012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Returning 404 to user: Instance 6c738322-0347-474f-9e32-1127d7c01d3f is not attached to volume 1be940cf-e3d3-47bf-b053-b6284492f172 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:18:20.718012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebc608a1-2e18-4b69-b485-e1448bc885b6 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments/1be940cf-e3d3-47bf-b053-b6284492f172" status: 404 len: 154 microversion: 2.1 time: 0.097622 Aug 27 04:18:20.718012 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3545/7373] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:18:20 2022] DELETE /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f/os-volume_attachments/1be940cf-e3d3-47bf-b053-b6284492f172 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:18:23.967389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:23.968676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:23.975796 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:23.976291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:23.976738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:23.977458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:23.977923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:23.978378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:24.005958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:18:24.106102 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e2ba4cef-7e84-4656-ade0-6e33e0a2daa0 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 204 len: 0 microversion: 2.1 time: 0.142230 Aug 27 04:18:24.107454 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3829/7374] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:18:23 2022] DELETE /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:24.116963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:24.118601 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:24.127155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:24.127674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:24.128353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:24.129295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:24.129785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:24.130269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:24.285597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:24.294800 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8e62a42-5c93-4da4-82f9-d78a5eb03b70 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1553 microversion: 2.1 time: 0.182462 Aug 27 04:18:24.294800 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3546/7375] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:24 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:25.317839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:25.318842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:25.326514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:25.326953 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:25.327985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:25.329092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:25.329626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:25.330067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:25.471558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:25.482179 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-414de130-7b1a-404f-b48f-76a3bb7fd1f8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1553 microversion: 2.1 time: 0.168669 Aug 27 04:18:25.482791 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3830/7376] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:25 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:18:26.459119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4cc39c6b-128f-429e-be13-9d292462f3c2 req-79ad1a9c-cec2-4d0b-8d94-2faf74c4034c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c738322-0347-474f-9e32-1127d7c01d3f", "name": "network-vif-deleted", "tag": "930c3c63-93d9-47ae-a806-6cdfa5d426ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:26.472023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4cc39c6b-128f-429e-be13-9d292462f3c2 req-79ad1a9c-cec2-4d0b-8d94-2faf74c4034c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:26.472735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4cc39c6b-128f-429e-be13-9d292462f3c2 req-79ad1a9c-cec2-4d0b-8d94-2faf74c4034c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:26.473424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4cc39c6b-128f-429e-be13-9d292462f3c2 req-79ad1a9c-cec2-4d0b-8d94-2faf74c4034c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:26.489619 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4cc39c6b-128f-429e-be13-9d292462f3c2 req-79ad1a9c-cec2-4d0b-8d94-2faf74c4034c service nova] Creating event network-vif-deleted:930c3c63-93d9-47ae-a806-6cdfa5d426ea for instance 6c738322-0347-474f-9e32-1127d7c01d3f on n-h2-852086-5 Aug 27 04:18:26.495005 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4cc39c6b-128f-429e-be13-9d292462f3c2 req-79ad1a9c-cec2-4d0b-8d94-2faf74c4034c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102055 Aug 27 04:18:26.495815 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3547/7377] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:26.504685 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:26.505315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:26.512987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:26.513408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:26.513800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:26.514567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:26.515187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:26.515662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:26.552515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:26.553009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:26.553455 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:26.553915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lazy-loading 'fault' on Instance uuid 6c738322-0347-474f-9e32-1127d7c01d3f {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:18:26.596934 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:26.605020 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-37d91581-8b62-41f4-8816-9f797e40fc4f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 200 len: 1347 microversion: 2.1 time: 0.104508 Aug 27 04:18:26.605604 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3831/7378] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:26 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 1347 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:27.627612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:27.628340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 6c738322-0347-474f-9e32-1127d7c01d3f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:27.635608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:27.636122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:27.636581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:27.637300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:27.637779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:27.638255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:27.651904 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] HTTP exception thrown: Instance 6c738322-0347-474f-9e32-1127d7c01d3f could not be found. Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Request method failure captured: Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f HTTP/1.1 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZohre7WHYY8LzJRupyi1wozEEds01FyZfi32GHxhDU2sQxP2zGWSSy-3c_j-EQywzV-nZcDS68btPn1Ckw9XIGeMNyrZ3GouXjWJ-xrazxAwiVXrCvWNeVmR4TIqHa9o4gGxe2nesdFpj90UW-ab_UHs1Ld1rtXBhnCoxA1FFjrmk8 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0df527ad98f6494ebcccefd4bcc2034a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}] Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b55b863ebcc24ba583015bf4728932e1 Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 6c738322-0347-474f-9e32-1127d7c01d3f could not be found. Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '6c738322-0347-474f-9e32-1127d7c01d3f'} Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c738322-0347-474f-9e32-1127d7c01d3f could not be found. Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c738322-0347-474f-9e32-1127d7c01d3f could not be found. Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:18:27.653575 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c738322-0347-474f-9e32-1127d7c01d3f could not be found. Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Returning 404 to user: Instance 6c738322-0347-474f-9e32-1127d7c01d3f could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d27ecf9b-5e7d-4d98-ac6b-7235912668a4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f" status: 404 len: 111 microversion: 2.1 time: 0.032413 Aug 27 04:18:27.658525 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3548/7379] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:27 2022] GET /compute/v2.1/servers/6c738322-0347-474f-9e32-1127d7c01d3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:18:27.664235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-20d41d88-1757-45b9-a45c-df2a65a89be9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '.version_select at 0x7fe4579be310>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:27.689429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-20d41d88-1757-45b9-a45c-df2a65a89be9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-457139436" status: 202 len: 0 microversion: 2.1 time: 0.028932 Aug 27 04:18:27.690019 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3832/7380] 10.222.0.69 () {58 vars in 1269 bytes} [Sat Aug 27 04:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-457139436 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:18:36.477313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-062bf596-928a-424f-b519-0cffa5af04f2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'create', calling method: .version_select at 0x7fe45c7493a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1807528997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC25Ww930rcbssETa/z0d5Ir0CBxXSR3arkFe+YzGahqAS9gZjvI5sRV1GH8flUjyuOqIkDGLkHe8Q80QTylaHjcmNV3PsRfUEw8JnQQYXNznz621iyRZaT6INhzLLflog=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:36.494353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-062bf596-928a-424f-b519-0cffa5af04f2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:18:36.501247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-062bf596-928a-424f-b519-0cffa5af04f2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for user b55b863ebcc24ba583015bf4728932e1 and project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:18:36.514431 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-062bf596-928a-424f-b519-0cffa5af04f2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [e9270f90-f029-452a-ae03-543005b9fa7d] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:18:37.521717 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [None req-062bf596-928a-424f-b519-0cffa5af04f2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [e9270f90-f029-452a-ae03-543005b9fa7d] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 41238. Aug 27 04:18:37.541676 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-062bf596-928a-424f-b519-0cffa5af04f2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.068313 Aug 27 04:18:37.542334 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3549/7381] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:18:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:37.590229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:37.591496 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:18:37.591629 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:18:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.69) !!! Aug 27 04:18:37.600122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-828878035", "imageRef": "f705b665-c61e-40ea-b349-b3e59f0d6922", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1807528997", "networks": [{"uuid": "2622e9de-2e24-4379-b531-ca9038c8fcc6"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:37.654599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] validate_networks() for [('2622e9de-2e24-4379-b531-ca9038c8fcc6', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:18:38.073743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:18:38.074192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:18:38.074676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:18:38.075091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:18:38.075509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:18:38.085437 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:38.085920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:38.086401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:38.087134 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:38.087612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:38.088040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:38.105823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:18:38.111461 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Getting quotas for user b55b863ebcc24ba583015bf4728932e1 and project 0df527ad98f6494ebcccefd4bcc2034a. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:18:38.124740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:18:38.127024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f705b665-c61e-40ea-b349-b3e59f0d6922',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:18:38.174638 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c3fbf9dd-9d0d-486f-878a-dc998fcdf759 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586106 Aug 27 04:18:38.175306 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3833/7382] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:18:38.182930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=38 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:38.187545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef717e15-badd-4b9a-8a2f-4060e2687175 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:38.188182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef717e15-badd-4b9a-8a2f-4060e2687175 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:38.243898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef717e15-badd-4b9a-8a2f-4060e2687175 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:38.255574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef717e15-badd-4b9a-8a2f-4060e2687175 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1258 microversion: 2.1 time: 0.073489 Aug 27 04:18:38.256156 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3550/7383] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:38 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:39.277633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-702a6d7f-cc42-455b-9d74-78e59a7905ab tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:39.278288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-702a6d7f-cc42-455b-9d74-78e59a7905ab tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:39.334209 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-702a6d7f-cc42-455b-9d74-78e59a7905ab tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:39.341203 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-702a6d7f-cc42-455b-9d74-78e59a7905ab tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1258 microversion: 2.1 time: 0.068329 Aug 27 04:18:39.341778 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3834/7384] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:39 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:40.361673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:40.362680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:40.369649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:40.370150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:40.370633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:40.371347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:40.371821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:40.372264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:40.442949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:40.451033 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5ebf44e-7d5f-4c82-a8aa-e5f541b40dda tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1262 microversion: 2.1 time: 0.093982 Aug 27 04:18:40.451604 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3551/7385] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:40 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:41.472904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:41.473811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:41.481898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:41.482408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:41.483070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:41.484652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:41.485316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:41.486040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:42.087354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:42.098346 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f1dc1716-c320-416c-9df0-f5224472c2a9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1316 microversion: 2.1 time: 0.630951 Aug 27 04:18:42.102404 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3835/7386] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:41 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:43.121849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:43.122513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:43.125860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:43.132297 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:43.132879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:43.133756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:43.134538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:43.135185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:43.136048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:43.312484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:43.323232 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-325dcd1e-fe55-4c68-83e1-4f15f8254c94 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.205135 Aug 27 04:18:43.323835 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3552/7387] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:43 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:44.346982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:44.348807 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:44.351353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.357310 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:44.357868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:44.359198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:44.360170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:44.360702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:44.361145 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:44.502740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:44.510678 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-777c89b3-529a-4438-9a6f-f045a18153b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.170018 Aug 27 04:18:44.511260 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3836/7388] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:44 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:18:45.536683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:45.540394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:45.549430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:45.550038 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:45.550686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:45.551726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:45.552803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:45.553484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:45.729162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:45.738731 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba7d1e14-55df-400c-a4b4-297582646313 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.210325 Aug 27 04:18:45.739533 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3553/7389] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:45 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:46.760535 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:46.761249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:46.768466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:46.768959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:46.769394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:46.770101 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:46.770582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:46.771010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:46.927937 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:46.939440 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ae004f57-75b7-4ee9-ac73-052425dac7e3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.182498 Aug 27 04:18:46.940259 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3837/7390] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:46 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:47.961315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:47.961958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:47.971252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:47.971804 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:47.972266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:47.973006 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:47.975045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:47.975045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:48.113949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:48.121850 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8405c5a-8f48-427a-a268-5aa9b358d9e2 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.164685 Aug 27 04:18:48.122534 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3554/7391] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:47 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:49.144546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:49.145323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:49.149650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:49.153813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:49.154365 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:49.154792 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:49.156074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:49.156537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:49.156971 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:49.292343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:49.301108 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac122799-25bd-475c-8a1e-76d382c897c4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.160552 Aug 27 04:18:49.301694 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3838/7392] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:49 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:50.322416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:50.323386 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:50.328574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:50.332463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:50.343388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:50.344153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:50.345282 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:50.345928 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:50.346581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:50.499536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:50.514010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b0c51de-f146-45fc-b18f-4ab499bdee5d tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.195908 Aug 27 04:18:50.515342 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3555/7393] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:50 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:51.536485 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:51.537503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:51.540017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:51.548088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:51.548591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:51.549037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:51.549984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:51.551252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:51.551252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:51.691660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:51.699785 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a50f4b3b-0bb2-4790-9414-0713dbcefbcf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.167729 Aug 27 04:18:51.700362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3839/7394] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:51 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:52.017619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b8ca988b-fed6-48ff-b8e6-a5c97c039d8b req-83d1e3d3-47f0-4aad-8cd2-f30c21a98645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7455c425-451f-47e3-81f1-599b1b4c44dd", "tag": "a889d212-1bde-461a-8134-832df1e26aca"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:52.030519 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b8ca988b-fed6-48ff-b8e6-a5c97c039d8b req-83d1e3d3-47f0-4aad-8cd2-f30c21a98645 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:52.031662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b8ca988b-fed6-48ff-b8e6-a5c97c039d8b req-83d1e3d3-47f0-4aad-8cd2-f30c21a98645 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:52.032243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b8ca988b-fed6-48ff-b8e6-a5c97c039d8b req-83d1e3d3-47f0-4aad-8cd2-f30c21a98645 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:52.044002 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b8ca988b-fed6-48ff-b8e6-a5c97c039d8b req-83d1e3d3-47f0-4aad-8cd2-f30c21a98645 service nova] Creating event network-changed:a889d212-1bde-461a-8134-832df1e26aca for instance 7455c425-451f-47e3-81f1-599b1b4c44dd on n-h2-852086-5 Aug 27 04:18:52.050295 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b8ca988b-fed6-48ff-b8e6-a5c97c039d8b req-83d1e3d3-47f0-4aad-8cd2-f30c21a98645 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036509 Aug 27 04:18:52.050918 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3556/7395] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:52.721210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:52.721779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:52.728665 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:52.729165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:52.729612 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:52.730377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:52.730843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:52.731273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:52.886803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:52.895115 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-21398ebc-5265-450f-b15a-41f2e8a32cdf tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.178971 Aug 27 04:18:52.895719 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3840/7396] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:52 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:53.918072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:53.918851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:53.925644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:53.926134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:53.926604 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:53.927304 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:53.927767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:53.928202 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:54.056989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:54.064864 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf299521-f6de-45e9-86f5-fd933ccb9991 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.151983 Aug 27 04:18:54.065433 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3557/7397] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:53 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:55.086344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:55.086980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:55.093836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:55.094908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:55.095486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:55.096386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:55.096844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:55.097270 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:55.230986 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:55.239836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-add47757-cc06-49cc-96dc-b561206aaa1f tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.157366 Aug 27 04:18:55.240439 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3841/7398] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:55 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:56.264352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:56.265004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:56.273108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:56.273603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:56.274112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:56.274902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:56.275364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:56.275805 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:56.426387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:56.434294 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-351c4993-91bf-47f4-976e-e19505ba185a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.173932 Aug 27 04:18:56.434968 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3558/7399] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:56 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:57.261000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-e4e9d7ad-0c27-4d10-b881-0a5b09d8cb94 req-aa0741c6-b066-450b-b1cc-b97bf759127b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7455c425-451f-47e3-81f1-599b1b4c44dd", "name": "network-vif-plugged", "status": "completed", "tag": "a889d212-1bde-461a-8134-832df1e26aca"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:18:57.271627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e4e9d7ad-0c27-4d10-b881-0a5b09d8cb94 req-aa0741c6-b066-450b-b1cc-b97bf759127b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:57.272123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e4e9d7ad-0c27-4d10-b881-0a5b09d8cb94 req-aa0741c6-b066-450b-b1cc-b97bf759127b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:57.272533 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-e4e9d7ad-0c27-4d10-b881-0a5b09d8cb94 req-aa0741c6-b066-450b-b1cc-b97bf759127b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:57.284510 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-e4e9d7ad-0c27-4d10-b881-0a5b09d8cb94 req-aa0741c6-b066-450b-b1cc-b97bf759127b service nova] Creating event network-vif-plugged:a889d212-1bde-461a-8134-832df1e26aca for instance 7455c425-451f-47e3-81f1-599b1b4c44dd on n-h2-852086-5 Aug 27 04:18:57.293231 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-e4e9d7ad-0c27-4d10-b881-0a5b09d8cb94 req-aa0741c6-b066-450b-b1cc-b97bf759127b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096949 Aug 27 04:18:57.293231 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3842/7400] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:57.458128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:57.459082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:57.467638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:57.468391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:57.468813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:57.470310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:57.470789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:57.471288 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:57.611279 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:57.619210 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a783f0ee-8351-4e42-9b71-7d8f666be766 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1358 microversion: 2.1 time: 0.166560 Aug 27 04:18:57.619791 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3559/7401] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:57 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:58.642839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:58.643590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:58.650061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:58.650581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:58.651064 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:58.651723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:58.652180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:58.652603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:58.787777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:58.795653 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e21e939f-f73c-4efe-87fb-88b4b670da92 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1548 microversion: 2.1 time: 0.158498 Aug 27 04:18:58.796222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3843/7402] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:58 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:58.816189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:58.816819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:58.824442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:58.824923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:58.825375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:58.826093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:58.826590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:58.827033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:58.959761 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:58.967605 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01148c28-3398-4069-be76-ae2113a24d52 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1548 microversion: 2.1 time: 0.155504 Aug 27 04:18:58.968192 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3560/7403] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:58 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:58.988674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:58.993290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:58.994063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Searching by: {'deleted': False, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a'} {{(pid=122407) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 04:18:58.999484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:58.999964 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:59.000536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:59.001355 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:59.001812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:59.002272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:59.026669 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.multi_cell_list [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 04:18:59.054103 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-995baf5e-6f16-4606-8b48-7ac60964bb9b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070019 Aug 27 04:18:59.054857 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3844/7404] 10.222.0.69 () {58 vars in 1125 bytes} [Sat Aug 27 04:18:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:18:59.066051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:18:59.066716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:18:59.072992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:59.073494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:59.073951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:59.074692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:18:59.075161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:18:59.075606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:18:59.211022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:18:59.218924 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5dac31fe-b2ad-489f-b7e6-d66a7b9c69b8 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1548 microversion: 2.1 time: 0.156837 Aug 27 04:18:59.219860 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3561/7405] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:18:59 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:00.734177 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20ff1c82-b37f-4c14-8d56-b654ad672c59"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:00.738402 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:00.745577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:00.746067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:00.746548 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:00.747253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:00.747714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:00.748142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:00.991667 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6eefbe1d-952e-4130-8e6e-893cede8196b tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262582 Aug 27 04:19:00.992303 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3845/7406] 10.222.0.69 () {60 vars in 1323 bytes} [Sat Aug 27 04:19:00 2022] POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:19:11.765216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:11.766723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:11.769415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=19 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:11.770079 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=62 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:11.775773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:11.776278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:11.776931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:11.777655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:11.778263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:11.778905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:11.922281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:11.931974 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ec639d1-67bf-485e-b551-496dfed10f8a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1594 microversion: 2.1 time: 0.170634 Aug 27 04:19:11.932661 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3562/7407] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:11 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1594 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:13.600794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3861648a-3c0f-425a-843a-2e77c650167c req-b7eb33b2-4b90-4afb-9a4b-b5a05e487b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7455c425-451f-47e3-81f1-599b1b4c44dd", "tag": "a889d212-1bde-461a-8134-832df1e26aca"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:13.606654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:13.607530 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=19 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:13.607979 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:13.616032 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3861648a-3c0f-425a-843a-2e77c650167c req-b7eb33b2-4b90-4afb-9a4b-b5a05e487b3b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:13.616520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3861648a-3c0f-425a-843a-2e77c650167c req-b7eb33b2-4b90-4afb-9a4b-b5a05e487b3b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:13.616952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3861648a-3c0f-425a-843a-2e77c650167c req-b7eb33b2-4b90-4afb-9a4b-b5a05e487b3b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:13.629685 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3861648a-3c0f-425a-843a-2e77c650167c req-b7eb33b2-4b90-4afb-9a4b-b5a05e487b3b service nova] Creating event network-changed:a889d212-1bde-461a-8134-832df1e26aca for instance 7455c425-451f-47e3-81f1-599b1b4c44dd on n-h2-852086-5 Aug 27 04:19:13.634923 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3861648a-3c0f-425a-843a-2e77c650167c req-b7eb33b2-4b90-4afb-9a4b-b5a05e487b3b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038083 Aug 27 04:19:13.635677 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3846/7408] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:19:14.757191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-792118788"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:14.757764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:14.766222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:14.766842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:14.767547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:14.768356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:14.768912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:14.769431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:14.913936 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Adding security group ff6e1ed5-c488-4986-abba-56de24e7ec71 to port a889d212-1bde-461a-8134-832df1e26aca Aug 27 04:19:15.603233 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13446ada-30dc-4cb3-a523-ea29fa3bebca tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/action" status: 202 len: 0 microversion: 2.1 time: 0.850232 Aug 27 04:19:15.607719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3563/7409] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:19:14 2022] POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:19:15.614936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:15.615842 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:15.621063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-261514b8-d5ea-4c17-97be-ae0f00646d6b req-6cfe89e7-7718-42e2-9e1e-1ad999c4b1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7455c425-451f-47e3-81f1-599b1b4c44dd", "tag": "a889d212-1bde-461a-8134-832df1e26aca"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:15.631819 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-261514b8-d5ea-4c17-97be-ae0f00646d6b req-6cfe89e7-7718-42e2-9e1e-1ad999c4b1e3 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:15.632574 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-261514b8-d5ea-4c17-97be-ae0f00646d6b req-6cfe89e7-7718-42e2-9e1e-1ad999c4b1e3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:15.633117 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-261514b8-d5ea-4c17-97be-ae0f00646d6b req-6cfe89e7-7718-42e2-9e1e-1ad999c4b1e3 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:15.635550 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:15.636048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:15.636478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:15.637192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:15.638476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:15.638476 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:15.647736 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-261514b8-d5ea-4c17-97be-ae0f00646d6b req-6cfe89e7-7718-42e2-9e1e-1ad999c4b1e3 service nova] Creating event network-changed:a889d212-1bde-461a-8134-832df1e26aca for instance 7455c425-451f-47e3-81f1-599b1b4c44dd on n-h2-852086-5 Aug 27 04:19:15.654324 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-261514b8-d5ea-4c17-97be-ae0f00646d6b req-6cfe89e7-7718-42e2-9e1e-1ad999c4b1e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037287 Aug 27 04:19:15.654324 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3564/7410] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:19:15.886951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:15.897207 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2cc1b0fa-7a6e-40ac-bc4b-ed10b4b98c46 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1758 microversion: 2.1 time: 0.287902 Aug 27 04:19:15.897824 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3847/7411] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:15 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1758 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:32.939954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:32.940738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:33.006245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:33.008691 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:33.015149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:33.015651 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:33.016104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:33.017011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:33.017813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:33.018384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:33.101383 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d96e20e7-7ed7-430a-9c56-94b9125f07f5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/action" status: 202 len: 0 microversion: 2.1 time: 0.163216 Aug 27 04:19:33.101383 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3565/7412] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:19:32 2022] POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:19:33.113226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:33.113226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:33.116882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:33.118196 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:33.124079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:33.124575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:33.125011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:33.125728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:33.126508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:33.126951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:33.293985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:33.303288 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce8c421b-4cdf-499f-acb7-ffdace045653 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1750 microversion: 2.1 time: 0.196391 Aug 27 04:19:33.303882 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3848/7413] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:33 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:34.326324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:34.327048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:34.334083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:34.334623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:34.335088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:34.335814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:34.336293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:34.336737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:34.486080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:34.495044 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-078124bf-93ba-4565-96b4-70a7dd1e45e5 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.173923 Aug 27 04:19:34.495622 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3566/7414] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:34 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:35.517499 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:35.518255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:35.525185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:35.525674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:35.526114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:35.526856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:35.527333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:35.527743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:35.687122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:35.696210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38852a0d-3f0d-4897-aac6-03e54f2fb944 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.183339 Aug 27 04:19:35.696808 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3849/7415] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:35 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:36.718367 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:36.718997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:36.726184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:36.726692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:36.727140 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:36.727851 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:36.728332 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:36.728748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:36.876340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:36.885093 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1018e1c3-d49a-45c2-9725-e98e8c2ce80e tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.170736 Aug 27 04:19:36.885667 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3567/7416] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:36 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:37.907043 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:37.907849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:37.914592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:37.915079 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:37.915515 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:37.916215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:37.916676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:37.917102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:38.067228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:38.075894 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14dd3323-8c58-45be-acb9-e07d933f72aa tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.172802 Aug 27 04:19:38.076475 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3850/7417] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:37 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:39.097935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:39.098904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:39.105684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:39.106254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:39.106708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:39.107427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:39.107900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:39.108342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:39.259525 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:39.268179 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32990451-5524-4634-b73b-8d3f7fefeba7 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.174352 Aug 27 04:19:39.268760 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3568/7418] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:39 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:40.290546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:40.291168 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:40.297346 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:40.298509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:40.298969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:40.299727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:40.300213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:40.300671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:40.448430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:40.457299 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f767628b-4e3e-4d91-8225-a4b29ed68d87 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.171889 Aug 27 04:19:40.457879 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3851/7419] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:40 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:41.478544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:41.479170 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:41.486500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:41.487002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:41.487445 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:41.488151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:41.488625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:41.489057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:41.643091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:41.651408 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9613a7a7-dfbe-4695-a9ba-cd78ec63d526 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.176831 Aug 27 04:19:41.651989 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3569/7420] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:41 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:42.673927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:42.674545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:42.680517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:42.681002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:42.681447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:42.682149 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:42.682632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:42.683062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:42.832232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:42.840642 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-146a92de-a4e4-4415-848c-035e46d45e01 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.171705 Aug 27 04:19:42.841221 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3852/7421] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:42 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:43.862809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:43.863441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:43.870461 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:43.870952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:43.871395 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:43.872093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:43.872558 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:43.872989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:44.033234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:44.042017 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d77376e-d941-4df6-b6b7-11c9cd7d23db tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1755 microversion: 2.1 time: 0.183730 Aug 27 04:19:44.042653 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3570/7422] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:43 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:45.063050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:45.063687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:19:45.070917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:45.071406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:45.071848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:45.072950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:19:45.073415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:19:45.073848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:19:45.228424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:45.236773 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e463ef34-087d-498d-9633-dde79405125a tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1758 microversion: 2.1 time: 0.177703 Aug 27 04:19:45.237348 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3853/7423] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:19:45 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:17.646473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-792118788"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:17.647136 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:17.649222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:17.649896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:17.651034 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:20:17.651202 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:20:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/action (ip 10.222.0.69) !!! Aug 27 04:20:17.664635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:17.665141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:17.665599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:17.666419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:17.666895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:17.667340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:17.804356 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Removing security group ff6e1ed5-c488-4986-abba-56de24e7ec71 from port a889d212-1bde-461a-8134-832df1e26aca Aug 27 04:20:18.116666 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-490041fc-255b-410b-9a20-a9c4eee92d04 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/action" status: 202 len: 0 microversion: 2.1 time: 0.474935 Aug 27 04:20:18.117946 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3571/7424] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:20:17 2022] POST /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:20:18.124653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-823bcb1b-be43-4898-8cdc-304911b291ab req-4482e3e9-611e-4d25-bd77-70528840a631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7455c425-451f-47e3-81f1-599b1b4c44dd", "tag": "a889d212-1bde-461a-8134-832df1e26aca"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:18.131585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:18.132946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=36 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:18.141383 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-823bcb1b-be43-4898-8cdc-304911b291ab req-4482e3e9-611e-4d25-bd77-70528840a631 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:18.141711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-823bcb1b-be43-4898-8cdc-304911b291ab req-4482e3e9-611e-4d25-bd77-70528840a631 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:18.142640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-823bcb1b-be43-4898-8cdc-304911b291ab req-4482e3e9-611e-4d25-bd77-70528840a631 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:18.157248 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-823bcb1b-be43-4898-8cdc-304911b291ab req-4482e3e9-611e-4d25-bd77-70528840a631 service nova] Creating event network-changed:a889d212-1bde-461a-8134-832df1e26aca for instance 7455c425-451f-47e3-81f1-599b1b4c44dd on n-h2-852086-5 Aug 27 04:20:18.164376 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-823bcb1b-be43-4898-8cdc-304911b291ab req-4482e3e9-611e-4d25-bd77-70528840a631 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043518 Aug 27 04:20:18.165882 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3854/7425] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:19.487013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:19.487537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:19.493724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:19.494264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:19.494797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:19.495457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:19.495923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:19.496363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:19.587563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lazy-loading 'services' on Instance uuid 7455c425-451f-47e3-81f1-599b1b4c44dd {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:20:19.661755 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44367f5a-a48a-456d-b696-3205270beb95 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments/20ff1c82-b37f-4c14-8d56-b654ad672c59" status: 202 len: 0 microversion: 2.1 time: 0.179385 Aug 27 04:20:19.663209 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3572/7426] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:20:19 2022] DELETE /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments/20ff1c82-b37f-4c14-8d56-b654ad672c59 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:20:19.671605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:19.673996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:19.682621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:19.683200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:19.683862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:19.684647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:19.685215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:19.685728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:19.720064 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-86aab559-093f-4b71-9e67-5ffcfd74a221 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052621 Aug 27 04:20:19.720738 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3855/7427] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:20:19 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:20.181372 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b71d0f46-0208-4990-badb-3cd114879a9e req-e5212a66-3775-4135-a858-ea3ae1099b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7455c425-451f-47e3-81f1-599b1b4c44dd", "tag": "a889d212-1bde-461a-8134-832df1e26aca"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:20.193012 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b71d0f46-0208-4990-badb-3cd114879a9e req-e5212a66-3775-4135-a858-ea3ae1099b65 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:20.193591 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b71d0f46-0208-4990-badb-3cd114879a9e req-e5212a66-3775-4135-a858-ea3ae1099b65 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:20.194254 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b71d0f46-0208-4990-badb-3cd114879a9e req-e5212a66-3775-4135-a858-ea3ae1099b65 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:20.207321 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b71d0f46-0208-4990-badb-3cd114879a9e req-e5212a66-3775-4135-a858-ea3ae1099b65 service nova] Creating event network-changed:a889d212-1bde-461a-8134-832df1e26aca for instance 7455c425-451f-47e3-81f1-599b1b4c44dd on n-h2-852086-5 Aug 27 04:20:20.214066 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b71d0f46-0208-4990-badb-3cd114879a9e req-e5212a66-3775-4135-a858-ea3ae1099b65 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036632 Aug 27 04:20:20.219665 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3573/7428] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:20.733717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:20.735943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:20.743124 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:20.743632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:20.744074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:20.744981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:20.745506 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:20.746144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:20.781774 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ad19f999-b10d-40a0-b6a7-e1c4d5f6e181 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052544 Aug 27 04:20:20.782731 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3856/7429] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:20:20 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:21.802119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:21.804483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:21.811127 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:21.811640 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:21.812095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:21.812820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:21.813290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:21.813735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:21.848219 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19a42489-8c9a-46cf-b7de-810db27135b9 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052031 Aug 27 04:20:21.848962 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3574/7430] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:20:21 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:22.860921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:22.864022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:22.871167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:22.871652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:22.872099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:22.872800 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:22.873252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:22.873675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:22.904882 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0bd358a-298a-4607-9646-97fd1cd370f3 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048018 Aug 27 04:20:22.905453 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3857/7431] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:20:22 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:23.917453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:23.919988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:23.927910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:23.928593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:23.929049 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:23.930016 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:23.930673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:23.931111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:23.965222 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4bc699c-d634-4ada-974f-ee321d3c7c55 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051706 Aug 27 04:20:23.966478 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3575/7432] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:20:23 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:24.978809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:24.980881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:24.987870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:24.988672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:24.989132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:24.989857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:24.990362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:24.990788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:25.024189 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5b9ffbde-5dd5-430c-9ed3-b0312dc7aa47 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049380 Aug 27 04:20:25.024784 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3858/7433] 10.222.0.69 () {58 vars in 1302 bytes} [Sat Aug 27 04:20:24 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:20:25.036817 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:25.037416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:25.044586 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:25.045093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:25.045545 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:25.046296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:25.047357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:25.047357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:25.125888 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] HTTP exception thrown: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd is not attached to volume 20ff1c82-b37f-4c14-8d56-b654ad672c59 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Request method failure captured: Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments/20ff1c82-b37f-4c14-8d56-b654ad672c59 HTTP/1.1 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZohre7WHYY8LzJRupyi1wozEEds01FyZfi32GHxhDU2sQxP2zGWSSy-3c_j-EQywzV-nZcDS68btPn1Ckw9XIGeMNyrZ3GouXjWJ-xrazxAwiVXrCvWNeVmR4TIqHa9o4gGxe2nesdFpj90UW-ab_UHs1Ld1rtXBhnCoxA1FFjrmk8 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0df527ad98f6494ebcccefd4bcc2034a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}] Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b55b863ebcc24ba583015bf4728932e1 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd is not attached to volume 20ff1c82-b37f-4c14-8d56-b654ad672c59 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'server_id': '7455c425-451f-47e3-81f1-599b1b4c44dd', 'id': '20ff1c82-b37f-4c14-8d56-b654ad672c59'} Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 20ff1c82-b37f-4c14-8d56-b654ad672c59. Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd is not attached to volume 20ff1c82-b37f-4c14-8d56-b654ad672c59 Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:20:25.127595 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:20:25.133325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:20:25.133325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:20:25.133325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd is not attached to volume 20ff1c82-b37f-4c14-8d56-b654ad672c59 Aug 27 04:20:25.133325 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:25.133325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Returning 404 to user: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd is not attached to volume 20ff1c82-b37f-4c14-8d56-b654ad672c59 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:20:25.133325 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-681bbee4-250c-40e9-9b11-68dfef731555 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments/20ff1c82-b37f-4c14-8d56-b654ad672c59" status: 404 len: 154 microversion: 2.1 time: 0.098026 Aug 27 04:20:25.133325 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3576/7434] 10.222.0.69 () {58 vars in 1416 bytes} [Sat Aug 27 04:20:25 2022] DELETE /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd/os-volume_attachments/20ff1c82-b37f-4c14-8d56-b654ad672c59 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:20:28.378151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:28.378753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:28.385675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:28.386584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:28.386731 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:28.387344 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:28.387808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:28.388245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:28.414505 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:20:28.498493 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f91e78e-4743-4235-8162-080b84eb2ba4 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 204 len: 0 microversion: 2.1 time: 0.123671 Aug 27 04:20:28.499475 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3859/7435] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:20:28 2022] DELETE /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:20:28.508264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:28.508900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:28.516306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:28.516814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:28.517264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:28.517992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:28.518490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:28.518930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:28.670603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:28.680261 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ad27feb-de01-4757-bb40-83e59b582367 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1554 microversion: 2.1 time: 0.176256 Aug 27 04:20:28.680849 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3577/7436] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:28 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:29.702608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:29.703341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:29.711522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:29.712020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:29.712456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:29.713205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:29.713707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:29.714127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:29.855278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:29.864240 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4793c63e-5dd1-4323-8fa5-2162a867ba22 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1554 microversion: 2.1 time: 0.166003 Aug 27 04:20:29.864844 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3860/7437] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:29 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:30.740246 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-49c2ab4c-1d46-4fee-8269-9d7233fcadeb req-6ad04eb8-aedc-431c-87b8-c8428e7fe683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7455c425-451f-47e3-81f1-599b1b4c44dd", "name": "network-vif-deleted", "tag": "a889d212-1bde-461a-8134-832df1e26aca"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:30.757315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-49c2ab4c-1d46-4fee-8269-9d7233fcadeb req-6ad04eb8-aedc-431c-87b8-c8428e7fe683 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:30.757916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-49c2ab4c-1d46-4fee-8269-9d7233fcadeb req-6ad04eb8-aedc-431c-87b8-c8428e7fe683 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:30.758430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-49c2ab4c-1d46-4fee-8269-9d7233fcadeb req-6ad04eb8-aedc-431c-87b8-c8428e7fe683 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:30.770883 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-49c2ab4c-1d46-4fee-8269-9d7233fcadeb req-6ad04eb8-aedc-431c-87b8-c8428e7fe683 service nova] Creating event network-vif-deleted:a889d212-1bde-461a-8134-832df1e26aca for instance 7455c425-451f-47e3-81f1-599b1b4c44dd on n-h2-852086-5 Aug 27 04:20:30.776404 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-49c2ab4c-1d46-4fee-8269-9d7233fcadeb req-6ad04eb8-aedc-431c-87b8-c8428e7fe683 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 Aug 27 04:20:30.777053 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3578/7438] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:30.884846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:30.885468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:30.892472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:30.892969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:30.893412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:30.894701 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:30.895160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:30.895767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:30.928345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:30.928835 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:30.929332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:30.929744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lazy-loading 'fault' on Instance uuid 7455c425-451f-47e3-81f1-599b1b4c44dd {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:20:30.973329 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55b863ebcc24ba583015bf4728932e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df527ad98f6494ebcccefd4bcc2034a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:30.981276 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-adaccef7-8fd7-4715-9acd-f6a4b2237b66 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 200 len: 1348 microversion: 2.1 time: 0.100296 Aug 27 04:20:30.981874 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3861/7439] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:30 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:32.005299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:32.006015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] [instance: 7455c425-451f-47e3-81f1-599b1b4c44dd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:32.012224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:32.012715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:32.013166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:32.013870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:32.014359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:32.014799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:32.029715 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] HTTP exception thrown: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd could not be found. Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Request method failure captured: Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd HTTP/1.1 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZohre7WHYY8LzJRupyi1wozEEds01FyZfi32GHxhDU2sQxP2zGWSSy-3c_j-EQywzV-nZcDS68btPn1Ckw9XIGeMNyrZ3GouXjWJ-xrazxAwiVXrCvWNeVmR4TIqHa9o4gGxe2nesdFpj90UW-ab_UHs1Ld1rtXBhnCoxA1FFjrmk8 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0df527ad98f6494ebcccefd4bcc2034a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0df527ad98f6494ebcccefd4bcc2034a"}]}] Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 0df527ad98f6494ebcccefd4bcc2034a Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestMinimumBasicScenario-269808356 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: b55b863ebcc24ba583015bf4728932e1 Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestMinimumBasicScenario-269808356-project Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd could not be found. Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '7455c425-451f-47e3-81f1-599b1b4c44dd'} Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd could not be found. Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd could not be found. Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:20:32.031385 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd could not be found. Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Returning 404 to user: Instance 7455c425-451f-47e3-81f1-599b1b4c44dd could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99cdc775-3fad-4dc2-a839-725438affb07 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd" status: 404 len: 111 microversion: 2.1 time: 0.033689 Aug 27 04:20:32.036095 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3579/7440] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:31 2022] GET /compute/v2.1/servers/7455c425-451f-47e3-81f1-599b1b4c44dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:20:32.041768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e488c6f1-4e03-4182-9fdd-0553c25278d1 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] Calling method '.version_select at 0x7fe456a289d0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:32.062585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e488c6f1-4e03-4182-9fdd-0553c25278d1 tempest-TestMinimumBasicScenario-269808356 tempest-TestMinimumBasicScenario-269808356-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1807528997" status: 202 len: 0 microversion: 2.1 time: 0.024647 Aug 27 04:20:32.063162 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3862/7441] 10.222.0.69 () {58 vars in 1272 bytes} [Sat Aug 27 04:20:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1807528997 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:20:41.555754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f184f5e4-7632-43a1-a1aa-e56066ac69b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: .version_select at 0x7fe4573433a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-790105563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLT7NvEb8lngrEQzY35Au9zC61OoXMWfIbX9QM4CFSuiMGz1xJMErzdt/IloQ0Z8NemSEEe84p3YOglm7zLaN+rmhXI7/JLN72YPTy2kR2aPC3p2HDM08tH06M+Z6uw+pg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:41.573353 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f184f5e4-7632-43a1-a1aa-e56066ac69b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:20:41.578514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f184f5e4-7632-43a1-a1aa-e56066ac69b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:20:41.601909 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f184f5e4-7632-43a1-a1aa-e56066ac69b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.233858 Aug 27 04:20:41.602540 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3580/7442] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:20:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:47.601081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-491262065", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "235c6ce3-3a04-494c-8a2f-cbb0d7aff1db"}], "key_name": "tempest-TestNetworkAdvancedServerOps-790105563", "security_groups": [{"name": "tempest-secgroup-smoke-9438551"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:47.612376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:47.613057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:47.739512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] validate_networks() for [('235c6ce3-3a04-494c-8a2f-cbb0d7aff1db', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:20:48.162525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:20:48.163185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:20:48.163664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:20:48.164364 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:20:48.165189 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:20:48.175302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:48.176180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:48.176851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:48.177675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:48.178242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:48.178845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:48.199362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:20:48.205159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:20:48.220983 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:20:48.224009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:20:48.277849 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3d064f16-3c62-4538-909c-eec9abf5a0be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.682892 Aug 27 04:20:48.278699 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3863/7443] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:20:47 2022] POST /compute/v2.1/servers => generated 403 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:20:48.287487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:48.293225 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93d617d2-9fa9-4470-bf86-077b5c7d9338 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:48.293855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93d617d2-9fa9-4470-bf86-077b5c7d9338 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:48.295921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:48.371936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93d617d2-9fa9-4470-bf86-077b5c7d9338 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:48.381920 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93d617d2-9fa9-4470-bf86-077b5c7d9338 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1265 microversion: 2.1 time: 0.095533 Aug 27 04:20:48.396085 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3581/7444] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:48 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:49.404834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:49.405460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:49.413153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:49.413657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:49.414103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:49.414888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:49.415360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:49.415799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:49.482613 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:49.491742 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-158aa36a-5dd5-4585-b00f-d434c41d3169 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1317 microversion: 2.1 time: 0.091491 Aug 27 04:20:49.500979 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3864/7445] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:49 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:50.513255 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:50.513886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:50.521514 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:50.522010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:50.522505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:50.523220 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:50.523690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:50.524126 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:50.745614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:50.754224 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36da1f71-de6d-412b-b078-7eb89c43ee52 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.244872 Aug 27 04:20:50.754792 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3582/7446] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:50 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:51.088675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-659ea539-a44a-4a35-9ef9-3d4805c9a6a7 req-5c3bdd5a-aed2-4fee-898e-40d6509703e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e01788-9000-4a6b-b700-e6e58d0112f2", "tag": "095cefcb-b396-43a9-a643-67d830d432d6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:51.102419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-659ea539-a44a-4a35-9ef9-3d4805c9a6a7 req-5c3bdd5a-aed2-4fee-898e-40d6509703e1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:51.102901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-659ea539-a44a-4a35-9ef9-3d4805c9a6a7 req-5c3bdd5a-aed2-4fee-898e-40d6509703e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:51.103334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-659ea539-a44a-4a35-9ef9-3d4805c9a6a7 req-5c3bdd5a-aed2-4fee-898e-40d6509703e1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:51.116295 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-659ea539-a44a-4a35-9ef9-3d4805c9a6a7 req-5c3bdd5a-aed2-4fee-898e-40d6509703e1 service nova] Creating event network-changed:095cefcb-b396-43a9-a643-67d830d432d6 for instance 45e01788-9000-4a6b-b700-e6e58d0112f2 on n-h2-852086-5 Aug 27 04:20:51.121340 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-659ea539-a44a-4a35-9ef9-3d4805c9a6a7 req-5c3bdd5a-aed2-4fee-898e-40d6509703e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039919 Aug 27 04:20:51.122265 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3865/7447] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:51.775448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:51.776329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:51.783506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:51.784561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:51.785401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:51.785968 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:51.786470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:51.787062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:51.934807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:51.943202 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19f8b945-669c-4c76-a17a-8cb7ff780dc2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.171611 Aug 27 04:20:51.943805 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3583/7448] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:51 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:52.965712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:52.966374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:52.974213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:52.974703 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:52.975137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:52.976096 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:52.976551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:52.976997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:53.110001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:53.118836 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dfb61213-780b-48de-ad56-241697f11007 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.157190 Aug 27 04:20:53.119418 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3866/7449] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:52 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:54.140623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:54.141256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:54.148777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:54.149281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:54.149731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:54.150475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:54.151070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:54.151387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:54.288388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:54.296085 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5df6dad4-fcb0-4390-b0bd-1f1a8eb2d1d3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.159439 Aug 27 04:20:54.296679 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3584/7450] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:54 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:55.317732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:55.318375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:55.325450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:55.325933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:55.326405 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:55.327097 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:55.327549 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:55.327970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:55.464198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:55.472802 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8736fe6e-198d-4631-bb48-48e08b1f4c0c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.158534 Aug 27 04:20:55.473384 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3867/7451] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:55 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:56.493467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:56.494201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:56.501399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:56.501908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:56.502409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:56.503301 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:56.503777 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:56.504224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:56.637450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:56.645579 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06bb507c-fddb-4063-b692-91a9b28721b1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.156038 Aug 27 04:20:56.646199 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3585/7452] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:56 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:57.666085 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:57.666700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:57.673716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:57.674247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:57.674758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:57.675494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:57.675949 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:57.676382 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:57.842397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3769e7a4-c146-4ee5-a294-52b268c4cdd7 req-e3d865a3-db1e-4996-ab55-f8561266a1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e01788-9000-4a6b-b700-e6e58d0112f2", "name": "network-vif-plugged", "status": "completed", "tag": "095cefcb-b396-43a9-a643-67d830d432d6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:57.855091 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:57.864362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3769e7a4-c146-4ee5-a294-52b268c4cdd7 req-e3d865a3-db1e-4996-ab55-f8561266a1bf service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:57.864866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3769e7a4-c146-4ee5-a294-52b268c4cdd7 req-e3d865a3-db1e-4996-ab55-f8561266a1bf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:57.865313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3769e7a4-c146-4ee5-a294-52b268c4cdd7 req-e3d865a3-db1e-4996-ab55-f8561266a1bf service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:57.874048 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-14979afb-8e10-4909-9963-daf3c01b7a42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.211805 Aug 27 04:20:57.874689 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3868/7453] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:57 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:57.884032 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3769e7a4-c146-4ee5-a294-52b268c4cdd7 req-e3d865a3-db1e-4996-ab55-f8561266a1bf service nova] Creating event network-vif-plugged:095cefcb-b396-43a9-a643-67d830d432d6 for instance 45e01788-9000-4a6b-b700-e6e58d0112f2 on n-h2-852086-5 Aug 27 04:20:57.889728 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3769e7a4-c146-4ee5-a294-52b268c4cdd7 req-e3d865a3-db1e-4996-ab55-f8561266a1bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051213 Aug 27 04:20:57.890717 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3586/7454] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:20:58.897514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:58.898122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:20:58.900092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:58.900787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:58.907929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:58.908411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:58.908840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:58.910635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:20:58.911099 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:20:58.911523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:20:59.063634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:59.072371 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5316105e-c09e-4696-9569-b169f9c4db8f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1388 microversion: 2.1 time: 0.179619 Aug 27 04:20:59.072888 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3869/7455] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:20:58 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1388 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:00.090258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:00.095882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:00.097754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:00.104913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:00.105409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:00.105862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:00.106589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:00.107057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:00.107495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:00.242871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:00.250860 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d530616d-f037-49b3-8614-5b89a153c69d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1561 microversion: 2.1 time: 0.161584 Aug 27 04:21:00.251434 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3587/7456] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:00 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:00.271664 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:00.272284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:00.279227 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:00.279715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:00.280155 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:00.280858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:00.281322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:00.281756 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:00.714739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:00.722486 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4e2b7ebb-07d7-493f-8bf7-bee024b9ce76 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1561 microversion: 2.1 time: 0.455315 Aug 27 04:21:00.723065 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3870/7457] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:00 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1561 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:02.326039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:02.326748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:02.335300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:02.335926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:02.336789 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:02.337402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:02.337881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:02.338443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:02.394570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-585b2c15-d293-40ae-87bd-1c8060ee84eb req-ec7781fc-ec54-4e35-84b0-d55e11cb812e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e01788-9000-4a6b-b700-e6e58d0112f2", "tag": "095cefcb-b396-43a9-a643-67d830d432d6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:02.405184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-585b2c15-d293-40ae-87bd-1c8060ee84eb req-ec7781fc-ec54-4e35-84b0-d55e11cb812e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:02.405882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-585b2c15-d293-40ae-87bd-1c8060ee84eb req-ec7781fc-ec54-4e35-84b0-d55e11cb812e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:02.406518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-585b2c15-d293-40ae-87bd-1c8060ee84eb req-ec7781fc-ec54-4e35-84b0-d55e11cb812e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:02.418366 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-585b2c15-d293-40ae-87bd-1c8060ee84eb req-ec7781fc-ec54-4e35-84b0-d55e11cb812e service nova] Creating event network-changed:095cefcb-b396-43a9-a643-67d830d432d6 for instance 45e01788-9000-4a6b-b700-e6e58d0112f2 on n-h2-852086-5 Aug 27 04:21:02.424045 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-585b2c15-d293-40ae-87bd-1c8060ee84eb req-ec7781fc-ec54-4e35-84b0-d55e11cb812e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099220 Aug 27 04:21:02.425274 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3871/7458] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:21:02.530023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:02.540605 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9b60f42-ff2a-431c-b6d7-0b6fe8131762 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1561 microversion: 2.1 time: 0.218860 Aug 27 04:21:02.541644 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3588/7459] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:02 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1561 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:23.801836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:23.803018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=42 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:23.809335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:23.812343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:23.822797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:23.823404 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:23.823850 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:23.824590 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:23.825042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:23.825462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:23.881912 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1db91940-5926-4fc6-845d-33bd408797fd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action" status: 200 len: 24564 microversion: 2.1 time: 0.083131 Aug 27 04:21:23.882888 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3872/7460] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:21:23 2022] POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action => generated 24564 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:34.591934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:34.592541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:34.594597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=17 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:34.595265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=38 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:34.601872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:34.602394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:34.602846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:34.603567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:34.604120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:34.604541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:34.675913 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a097352f-605b-482c-b6ca-be889912066c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action" status: 202 len: 0 microversion: 2.1 time: 0.087430 Aug 27 04:21:34.676882 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3589/7461] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:21:34 2022] POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:21:34.686135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:34.686825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:34.689697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:34.690524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:34.697980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:34.698500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:34.698946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:34.699671 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:34.700122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:34.700555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:34.853490 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:34.862027 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-224f5d8d-68e1-47d6-8469-8b7b80b63dbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1685 microversion: 2.1 time: 0.180479 Aug 27 04:21:34.863692 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3873/7462] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:34 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1685 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:35.886082 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:35.886738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:35.893002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:35.893494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:35.894247 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:35.895045 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:35.895513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:35.895953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:36.035731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:36.044211 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a1eebfd-6c62-4375-94ca-9b054925d588 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1665 microversion: 2.1 time: 0.163335 Aug 27 04:21:36.044789 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3590/7463] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:35 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:37.140757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:37.143011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:37.151417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:37.151915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:37.152452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:37.153159 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:37.153621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:37.154053 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:37.204524 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-73e904ef-0a8e-4a4f-ae49-5c3b60e16c02 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action" status: 200 len: 32632 microversion: 2.1 time: 0.067512 Aug 27 04:21:37.205220 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3874/7464] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:21:37 2022] POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action => generated 32632 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:37.218078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:37.218653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:37.226139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:37.226665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:37.227114 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:37.227849 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:37.228313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:37.228747 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:37.296089 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e686d51b-2f94-4e95-b960-c864d7216c7b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action" status: 202 len: 0 microversion: 2.1 time: 0.081640 Aug 27 04:21:37.296704 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3591/7465] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:21:37 2022] POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:21:37.307279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:37.307981 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:37.315484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:37.316182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:37.316643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:37.317896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:37.318401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:37.319067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:37.467995 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:37.482206 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-58db6b74-4926-4c86-8f80-0b2acbffb923 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1672 microversion: 2.1 time: 0.179279 Aug 27 04:21:37.483587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3875/7466] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:37 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:38.510734 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:38.511452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:38.517974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:38.518518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:38.518977 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:38.519708 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:38.520211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:38.520649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:38.665042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:38.673309 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69f1fb72-2e6b-49bf-9d62-69db7a5fd6a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1680 microversion: 2.1 time: 0.167741 Aug 27 04:21:38.673895 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3592/7467] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:38 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:38.772022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:38.774256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:38.782054 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:38.782578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:38.783026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:38.783741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:38.784206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:38.784834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:38.843729 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7c8a7300-8275-4727-8c8a-f03837d4d601 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action" status: 200 len: 38451 microversion: 2.1 time: 0.076296 Aug 27 04:21:38.844416 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3876/7468] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:21:38 2022] POST /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2/action => generated 38451 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:39.844290 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:39.844940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:39.848182 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-18091fdb-58b5-4dff-9dc9-68926abaff8a req-2392b95b-271b-47f0-be9b-a4017b28acc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e01788-9000-4a6b-b700-e6e58d0112f2", "tag": "095cefcb-b396-43a9-a643-67d830d432d6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:39.852530 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:39.853259 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:39.853715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:39.854470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:39.855300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:39.855753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:39.860957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-18091fdb-58b5-4dff-9dc9-68926abaff8a req-2392b95b-271b-47f0-be9b-a4017b28acc7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:39.861440 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-18091fdb-58b5-4dff-9dc9-68926abaff8a req-2392b95b-271b-47f0-be9b-a4017b28acc7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:39.861870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-18091fdb-58b5-4dff-9dc9-68926abaff8a req-2392b95b-271b-47f0-be9b-a4017b28acc7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:39.874656 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-18091fdb-58b5-4dff-9dc9-68926abaff8a req-2392b95b-271b-47f0-be9b-a4017b28acc7 service nova] Creating event network-changed:095cefcb-b396-43a9-a643-67d830d432d6 for instance 45e01788-9000-4a6b-b700-e6e58d0112f2 on n-h2-852086-5 Aug 27 04:21:39.886108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:21:39.891693 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-18091fdb-58b5-4dff-9dc9-68926abaff8a req-2392b95b-271b-47f0-be9b-a4017b28acc7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048524 Aug 27 04:21:39.892544 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3877/7469] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:39.990848 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-582fcb5c-7446-42e2-8cd8-132a216d4b39 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 204 len: 0 microversion: 2.1 time: 0.150140 Aug 27 04:21:39.991932 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3593/7470] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:21:39 2022] DELETE /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:21:40.012167 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:40.023575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:40.039449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:40.039948 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:40.040398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:40.041102 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:40.041560 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:40.042989 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:40.189319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:40.199899 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7679e067-c808-4ce9-b8f3-1a3872d0e08f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1686 microversion: 2.1 time: 0.201324 Aug 27 04:21:40.200433 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3878/7471] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:39 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1686 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:41.223934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:41.224564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:41.231590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:41.232090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:41.232571 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:41.233293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:41.233766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:41.234230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:41.386330 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:41.394806 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5789a273-d671-4db4-8833-8b44c7e45fe0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1686 microversion: 2.1 time: 0.175248 Aug 27 04:21:41.395831 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3594/7472] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:41 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:42.299139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-06c626b3-82f5-4216-89d9-15b4cf9a297c req-9350f4eb-9274-4e88-b19b-7d04df312ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e01788-9000-4a6b-b700-e6e58d0112f2", "name": "network-vif-deleted", "tag": "095cefcb-b396-43a9-a643-67d830d432d6"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:42.312791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06c626b3-82f5-4216-89d9-15b4cf9a297c req-9350f4eb-9274-4e88-b19b-7d04df312ecd service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:42.312791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06c626b3-82f5-4216-89d9-15b4cf9a297c req-9350f4eb-9274-4e88-b19b-7d04df312ecd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:42.312791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-06c626b3-82f5-4216-89d9-15b4cf9a297c req-9350f4eb-9274-4e88-b19b-7d04df312ecd service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:42.324430 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-06c626b3-82f5-4216-89d9-15b4cf9a297c req-9350f4eb-9274-4e88-b19b-7d04df312ecd service nova] Creating event network-vif-deleted:095cefcb-b396-43a9-a643-67d830d432d6 for instance 45e01788-9000-4a6b-b700-e6e58d0112f2 on n-h2-852086-5 Aug 27 04:21:42.329747 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-06c626b3-82f5-4216-89d9-15b4cf9a297c req-9350f4eb-9274-4e88-b19b-7d04df312ecd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034463 Aug 27 04:21:42.330408 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3879/7473] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:42.416506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:42.417134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:42.426465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:42.431438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:42.432378 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:42.433141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:42.433615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:42.434053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:42.472744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:42.473245 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:42.473701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:42.474182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lazy-loading 'fault' on Instance uuid 45e01788-9000-4a6b-b700-e6e58d0112f2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:21:42.516084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:42.524533 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41606886-3cd8-4a8e-a03b-16c7738db1ee tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 200 len: 1355 microversion: 2.1 time: 0.111902 Aug 27 04:21:42.525200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3595/7474] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:42 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 1355 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:43.552963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:43.553683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 45e01788-9000-4a6b-b700-e6e58d0112f2] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:43.560033 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:43.560523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:43.560966 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:43.561670 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:43.562125 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:43.562586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:43.576572 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] HTTP exception thrown: Instance 45e01788-9000-4a6b-b700-e6e58d0112f2 could not be found. Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Request method failure captured: Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 HTTP/1.1 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZuYOza7Jc9OC5f_06Mliz7hha61ic4M-4zGFc8F7J_8Qzlqbdr0peVnrpAlKJi4V1PLnesNCIQYBdIPrFgkoQfwPvfltg2D1_yV0OYe5QswnMEL_b6UbDXGKEwI2dXrBOWSxV4VJw7i__9duokYzmFqXuEUZHHLmIOdF-kM65NLWWc Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9eb70a35cfa545b0b5ae86ca79a632a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}] Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 971282f7495e4a9ab00e8d11c16f73c2 Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 45e01788-9000-4a6b-b700-e6e58d0112f2 could not be found. Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '45e01788-9000-4a6b-b700-e6e58d0112f2'} Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e01788-9000-4a6b-b700-e6e58d0112f2 could not be found. Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e01788-9000-4a6b-b700-e6e58d0112f2 could not be found. Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:21:43.578268 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e01788-9000-4a6b-b700-e6e58d0112f2 could not be found. Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Returning 404 to user: Instance 45e01788-9000-4a6b-b700-e6e58d0112f2 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a36c77f5-ba1b-46ca-b269-c3506dae1542 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2" status: 404 len: 111 microversion: 2.1 time: 0.035916 Aug 27 04:21:43.583532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3880/7475] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:43 2022] GET /compute/v2.1/servers/45e01788-9000-4a6b-b700-e6e58d0112f2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:21:46.928413 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25babfcc-de39-455c-b119-9aa3cabaf612 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '.version_select at 0x7fe4573a8a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:46.955596 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25babfcc-de39-455c-b119-9aa3cabaf612 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-790105563" status: 202 len: 0 microversion: 2.1 time: 0.032129 Aug 27 04:21:46.961233 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3596/7476] 10.222.0.69 () {58 vars in 1281 bytes} [Sat Aug 27 04:21:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-790105563 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:21:46.985244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4cf2ffe3-7564-4ba9-9dbf-322b895b8a4c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: .version_select at 0x7fe457c5fe50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1399432829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKz2qQ2wXFuh4wdPOuLz5UlMkmKiHexI9/WFBg+WcEbNBm/bZwAW3w7kRsbeMBdJ3jN9LG39rkGNIM+nEGM/+VB4Q1tfdovPv/+yarJ2swtzQgdihOBOc62d1nCrwuFGuw=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:47.003741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4cf2ffe3-7564-4ba9-9dbf-322b895b8a4c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:21:47.009408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-4cf2ffe3-7564-4ba9-9dbf-322b895b8a4c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:21:47.033749 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4cf2ffe3-7564-4ba9-9dbf-322b895b8a4c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052444 Aug 27 04:21:47.035077 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3881/7477] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:21:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:53.016618 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:53.022188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-34456997", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "944fd1f4-3f40-49ad-ae79-2c0bea947212"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1399432829", "security_groups": [{"name": "tempest-secgroup-smoke-1674268388"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:53.147495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] validate_networks() for [('944fd1f4-3f40-49ad-ae79-2c0bea947212', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:21:53.633826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:21:53.634306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:21:53.635099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:21:53.635541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:21:53.635985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:21:53.645289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:53.645491 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:53.645833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:53.646626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:53.647103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:53.647553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:53.664743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:21:53.670087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:21:53.683485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:21:53.685840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:21:53.735829 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f50cb045-eb38-48d4-a573-2792dc3f435e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721291 Aug 27 04:21:53.743123 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3597/7478] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:21:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:21:53.747356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=32 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:53.751812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-34a591e5-5e3c-4c26-acb5-6a0a2ab2bb04 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:53.752433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-34a591e5-5e3c-4c26-acb5-6a0a2ab2bb04 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:53.836315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-34a591e5-5e3c-4c26-acb5-6a0a2ab2bb04 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:53.844234 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-34a591e5-5e3c-4c26-acb5-6a0a2ab2bb04 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1265 microversion: 2.1 time: 0.099675 Aug 27 04:21:53.844812 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3882/7479] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:53 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:54.866093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:54.866887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:54.877046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:54.877603 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:54.878655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:54.879616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:54.880563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:54.881415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:55.010375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:55.032038 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45549ec6-8df3-48f4-8372-4e9cee0e827a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1325 microversion: 2.1 time: 0.170889 Aug 27 04:21:55.032991 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3598/7480] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:54 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:56.054597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:56.055205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:56.063318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:56.063837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:56.064276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:56.065014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:56.065466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:56.066014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:56.208210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:56.217964 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-414784f4-9260-4350-8b43-a40c25f6ad1e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1391 microversion: 2.1 time: 0.168648 Aug 27 04:21:56.219075 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3883/7481] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:56 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:56.443729 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-63ee184d-7cd9-4c33-8ec6-a16e28d5ec09 req-8f18c39a-df78-4ab5-b7d8-65f798c2091c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8ae02f-4d38-40e3-981e-2adc382a4409", "tag": "a0240ab2-e7fc-4215-9857-4de4cdb46527"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:56.455347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-63ee184d-7cd9-4c33-8ec6-a16e28d5ec09 req-8f18c39a-df78-4ab5-b7d8-65f798c2091c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:56.456066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-63ee184d-7cd9-4c33-8ec6-a16e28d5ec09 req-8f18c39a-df78-4ab5-b7d8-65f798c2091c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:56.456585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-63ee184d-7cd9-4c33-8ec6-a16e28d5ec09 req-8f18c39a-df78-4ab5-b7d8-65f798c2091c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:56.468895 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-63ee184d-7cd9-4c33-8ec6-a16e28d5ec09 req-8f18c39a-df78-4ab5-b7d8-65f798c2091c service nova] Creating event network-changed:a0240ab2-e7fc-4215-9857-4de4cdb46527 for instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 on n-h2-852086-5 Aug 27 04:21:56.475170 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-63ee184d-7cd9-4c33-8ec6-a16e28d5ec09 req-8f18c39a-df78-4ab5-b7d8-65f798c2091c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035865 Aug 27 04:21:56.476002 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3599/7482] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:57.241037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:57.241580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:57.248987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:57.249509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:57.249962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:57.250722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:57.251184 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:57.251615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:57.460222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:57.468285 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e9ba1bf9-6d8e-4aee-8c62-04bb0b94f686 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1391 microversion: 2.1 time: 0.232041 Aug 27 04:21:57.468887 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3884/7483] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:57 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:58.491010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:58.491653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:58.498469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:58.499015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:58.499665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:58.500396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:58.500868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:58.501311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:58.725032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:58.733554 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ead5642-db64-4add-b9bf-59cb6202d2db tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1391 microversion: 2.1 time: 0.248831 Aug 27 04:21:58.734473 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3600/7484] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:58 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:59.756775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:59.757393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:21:59.764886 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:59.765373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:59.765817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:59.766556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:21:59.767023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:21:59.767462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:21:59.906952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:59.916463 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e54902e5-86bd-4813-86a5-4b2db2fba146 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1391 microversion: 2.1 time: 0.164261 Aug 27 04:21:59.917049 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3885/7485] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:21:59 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:00.938352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:00.938983 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:00.947132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:00.947636 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:00.948089 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:00.948806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:00.949285 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:00.949718 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:01.082399 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:01.090197 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2326ee42-4bd5-41a1-8e89-a3a729fd1760 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1391 microversion: 2.1 time: 0.155872 Aug 27 04:22:01.090767 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3601/7486] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:00 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:02.112897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:02.113691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:02.120272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:02.121030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:02.122354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:02.123088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:02.123556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:02.123994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:02.226910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a3b67026-09e8-490c-a79f-2e2bc0a1c25a req-148d6357-c879-4f5b-9075-e8836169c8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8ae02f-4d38-40e3-981e-2adc382a4409", "name": "network-vif-plugged", "status": "completed", "tag": "a0240ab2-e7fc-4215-9857-4de4cdb46527"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:02.239643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a3b67026-09e8-490c-a79f-2e2bc0a1c25a req-148d6357-c879-4f5b-9075-e8836169c8d7 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:02.240150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a3b67026-09e8-490c-a79f-2e2bc0a1c25a req-148d6357-c879-4f5b-9075-e8836169c8d7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:02.240902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a3b67026-09e8-490c-a79f-2e2bc0a1c25a req-148d6357-c879-4f5b-9075-e8836169c8d7 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:02.252670 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a3b67026-09e8-490c-a79f-2e2bc0a1c25a req-148d6357-c879-4f5b-9075-e8836169c8d7 service nova] Creating event network-vif-plugged:a0240ab2-e7fc-4215-9857-4de4cdb46527 for instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 on n-h2-852086-5 Aug 27 04:22:02.258144 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a3b67026-09e8-490c-a79f-2e2bc0a1c25a req-148d6357-c879-4f5b-9075-e8836169c8d7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035000 Aug 27 04:22:02.259172 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3602/7487] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:22:02.269002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:02.277010 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-02a90091-3136-4080-9697-997306c0c0f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1391 microversion: 2.1 time: 0.169534 Aug 27 04:22:02.277599 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3886/7488] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:02 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:03.300724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:03.301484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:03.308057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:03.308554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:03.309004 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:03.309726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:03.310224 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:03.310685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:03.449785 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:03.458299 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37bc9aca-c92d-4603-a98b-a655776a1f29 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1391 microversion: 2.1 time: 0.162695 Aug 27 04:22:03.458893 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3603/7489] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:03 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:22:04.480481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:04.481640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:04.484429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:04.491517 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:04.492012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:04.492458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:04.493213 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:04.494046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:04.494858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:04.634489 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:04.642330 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81b2fedc-8353-4c84-860d-022ce8c34fdf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1562 microversion: 2.1 time: 0.166333 Aug 27 04:22:04.642911 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3887/7490] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:04 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:04.663742 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:04.664377 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:04.666420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:04.667217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:04.668940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:04.676771 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:04.677315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:04.677775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:04.678535 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:04.679011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:04.679457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:04.821989 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:04.829965 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9aeacbc8-0b07-4830-b5b7-edeafc1f076d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1562 microversion: 2.1 time: 0.170199 Aug 27 04:22:04.830589 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3604/7491] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:04 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:06.447093 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:06.447718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:06.449440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fb589cee-ec86-4340-95cf-ca2390eb7024 req-03b1200f-f957-4108-80bd-94dc41bc7d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8ae02f-4d38-40e3-981e-2adc382a4409", "tag": "a0240ab2-e7fc-4215-9857-4de4cdb46527"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:06.452462 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:06.457415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:06.457917 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:06.458388 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:06.459354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:06.460031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:06.460470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:06.462886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb589cee-ec86-4340-95cf-ca2390eb7024 req-03b1200f-f957-4108-80bd-94dc41bc7d4a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:06.463532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb589cee-ec86-4340-95cf-ca2390eb7024 req-03b1200f-f957-4108-80bd-94dc41bc7d4a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:06.464153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb589cee-ec86-4340-95cf-ca2390eb7024 req-03b1200f-f957-4108-80bd-94dc41bc7d4a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:06.477363 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fb589cee-ec86-4340-95cf-ca2390eb7024 req-03b1200f-f957-4108-80bd-94dc41bc7d4a service nova] Creating event network-changed:a0240ab2-e7fc-4215-9857-4de4cdb46527 for instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 on n-h2-852086-5 Aug 27 04:22:06.483366 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fb589cee-ec86-4340-95cf-ca2390eb7024 req-03b1200f-f957-4108-80bd-94dc41bc7d4a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037619 Aug 27 04:22:06.483820 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3605/7492] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:06.642482 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:06.651204 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fc7053d4-15b6-446b-a1d8-185c849691a5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1562 microversion: 2.1 time: 0.208452 Aug 27 04:22:06.652263 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3888/7493] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:06 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1562 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:27.942739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:27.945328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=38 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:27.949182 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:27.951541 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:27.958787 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:27.959464 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:27.959959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:27.960833 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:27.961339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:27.962389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:28.097025 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c3ce9c8-57c9-4d34-bcb6-1bcb91952016 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409/action" status: 200 len: 24572 microversion: 2.1 time: 0.156234 Aug 27 04:22:28.099124 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3606/7494] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:22:27 2022] POST /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409/action => generated 24572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:39.110441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:39.112787 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:39.114911 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:39.115575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=36 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:39.121973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:39.122494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:39.122931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:39.123634 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:39.124088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:39.125041 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:39.205501 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3a5084d5-e029-4032-8b2c-0915d24c954d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409/action" status: 202 len: 0 microversion: 2.1 time: 0.099207 Aug 27 04:22:39.206142 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3889/7495] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:22:39 2022] POST /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:22:39.215725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:39.216446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:39.219655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:39.220408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:22:39.225899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:39.227485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:39.227840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:39.228599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:39.229071 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:39.229522 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:39.463417 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:39.471627 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d6141ff-c6cd-4782-b97b-cf047035cd2a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1673 microversion: 2.1 time: 0.260726 Aug 27 04:22:39.472308 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3607/7496] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:39 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1673 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:40.497077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:40.497699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:40.503879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:40.504389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:40.504847 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:40.505545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:40.506000 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:40.506454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:40.642291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:40.650374 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b8244923-689f-41a9-817d-083b6ff0ee55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.159042 Aug 27 04:22:40.650961 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3890/7497] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:40 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:41.673111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:41.673766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:41.681997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:41.682533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:41.682982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:41.683692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:41.684161 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:41.684596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:41.832421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:41.840630 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-736577ac-113e-41d9-8e8b-62b70a9f0a2e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.171505 Aug 27 04:22:41.841202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3608/7498] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:41 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:42.862111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:42.862744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:42.869730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:42.870251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:42.870692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:42.871406 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:42.871865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:42.872297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:43.007337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:43.015247 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-53b3b466-936d-4e14-b447-9f15be8a6283 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.157216 Aug 27 04:22:43.015825 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3891/7499] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:42 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:44.035740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:44.036381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:44.043387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:44.043904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:44.044363 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:44.045083 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:44.045595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:44.046050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:44.180588 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:44.188437 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-408adbab-994f-4a4f-b5ec-77032dec2cf0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.156811 Aug 27 04:22:44.189024 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3609/7500] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:44 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:45.210436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:45.211832 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:45.218687 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:45.219150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:45.219584 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:45.220289 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:45.220757 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:45.221179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:45.358057 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:45.366071 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d0d73a54-4166-4721-8fce-a7448bdcabeb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.159756 Aug 27 04:22:45.366864 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3892/7501] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:45 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:46.388692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:46.389248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:46.396031 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:46.396624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:46.397066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:46.397794 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:46.398824 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:46.399307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:46.536276 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:46.545301 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3c5bdab-ffc8-4a99-9808-95f7a5289d17 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.160595 Aug 27 04:22:46.545880 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3610/7502] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:46 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:47.566788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:47.567397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:47.575164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:47.575673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:47.576107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:47.576798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:47.577251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:47.577673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:47.712858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:47.720543 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1507f4ec-f9fa-4b6c-9af0-a673515fdde2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.157653 Aug 27 04:22:47.721119 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3893/7503] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:47 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:48.744653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:48.745305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:48.752191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:48.752686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:48.753157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:48.753864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:48.754359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:48.754795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:48.885882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:48.893742 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-615d3e1f-4579-4cd8-97af-0de99e1b81b4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.153821 Aug 27 04:22:48.894333 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3611/7504] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:48 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:49.915708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:49.916266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:49.923217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:49.923707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:49.924144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:49.924845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:49.925304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:49.925732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:50.065047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:50.073429 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2fb2482b-b754-4452-8642-390870d62962 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.161770 Aug 27 04:22:50.074008 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3894/7505] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:49 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:51.095153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:51.095763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:51.103431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:51.103937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:51.104396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:51.105121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:51.105596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:51.106041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:51.246792 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:51.254750 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0fcdf5a-717b-484a-93fe-3204f6a0369a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.163647 Aug 27 04:22:51.255365 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3612/7506] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:51 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:52.277072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:52.277680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:52.284556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:52.284982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:52.285424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:52.286132 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:52.286624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:52.287056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:52.419609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:52.427318 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-992133c3-7d2f-482f-b8bd-7b666521a425 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.155011 Aug 27 04:22:52.428128 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3895/7507] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:52 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:53.448656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:53.449281 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:53.456440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:53.456945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:53.457402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:53.458119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:53.458619 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:53.459072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:53.597470 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:53.605748 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e13ed7e-47ed-463a-bf6c-d0a87bb008b2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.161785 Aug 27 04:22:53.606345 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3613/7508] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:53 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:54.626702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:54.627319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:54.634472 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:54.634990 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:54.635428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:54.636127 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:54.636583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:54.637009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:54.776750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:54.784529 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fd08c895-8e8e-47f9-b216-f8f74c07aeaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1678 microversion: 2.1 time: 0.161642 Aug 27 04:22:54.785057 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3896/7509] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:54 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:22:55.807003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:55.807567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:22:55.815633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:55.816146 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:55.816659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:55.817400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:22:55.817868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:22:55.818338 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:22:55.951200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:22:55.958979 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a41e757c-8404-42a3-957b-42713225c2e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1681 microversion: 2.1 time: 0.156390 Aug 27 04:22:55.959558 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3614/7510] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:22:55 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:20.168629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:20.170854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:20.173180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=16 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:20.173840 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:20.179649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:20.180137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:20.180572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:20.181923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:20.183008 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:20.183441 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:20.244840 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b0cfab2e-f3a0-4b84-b0f1-b686a072a845 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409/action" status: 200 len: 69152 microversion: 2.1 time: 0.079992 Aug 27 04:23:20.246991 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3897/7511] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:23:20 2022] POST /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409/action => generated 69152 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:27.361119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:27.361684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:27.364341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:27.365751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=48 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:27.372722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:27.373263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:27.374119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:27.374888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:27.375388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:27.375835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:27.406374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:23:27.426117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7368c39e-e7f2-401b-b020-6f9ac7661470 req-f67c30cc-93e4-461a-8037-1845cc840841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8ae02f-4d38-40e3-981e-2adc382a4409", "tag": "a0240ab2-e7fc-4215-9857-4de4cdb46527"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:27.438925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7368c39e-e7f2-401b-b020-6f9ac7661470 req-f67c30cc-93e4-461a-8037-1845cc840841 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:27.439416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7368c39e-e7f2-401b-b020-6f9ac7661470 req-f67c30cc-93e4-461a-8037-1845cc840841 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:27.439859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7368c39e-e7f2-401b-b020-6f9ac7661470 req-f67c30cc-93e4-461a-8037-1845cc840841 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:27.451638 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7368c39e-e7f2-401b-b020-6f9ac7661470 req-f67c30cc-93e4-461a-8037-1845cc840841 service nova] Creating event network-changed:a0240ab2-e7fc-4215-9857-4de4cdb46527 for instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 on n-h2-852086-5 Aug 27 04:23:27.457130 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7368c39e-e7f2-401b-b020-6f9ac7661470 req-f67c30cc-93e4-461a-8037-1845cc840841 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097663 Aug 27 04:23:27.458195 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3898/7512] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:27.500368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91cffd9c-4712-43fa-a9a8-750ef7265c1f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 204 len: 0 microversion: 2.1 time: 0.142875 Aug 27 04:23:27.501538 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3615/7513] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:23:27 2022] DELETE /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:23:27.512123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:27.512846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:27.519758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:27.520271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:27.520715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:27.521448 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:27.521919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:27.522395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:27.678038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:27.688739 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c06e795d-e535-49f0-8732-93fa57efc674 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1687 microversion: 2.1 time: 0.181928 Aug 27 04:23:27.689348 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3899/7514] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:27 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:28.713104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:28.713754 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:28.721142 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:28.721682 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:28.722139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:28.722910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:28.723385 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:28.723831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:28.884271 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:28.897778 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dababda5-cd6e-4205-ab8b-f741ee036afa tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1687 microversion: 2.1 time: 0.186117 Aug 27 04:23:28.899177 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3616/7515] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:28 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:29.920726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:29.921343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:29.928302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:29.928799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:29.929245 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:29.929967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:29.930458 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:29.930893 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:30.082529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:30.091254 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a966824b-f0e8-467f-9f6d-b54d9d2d9f26 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 200 len: 1687 microversion: 2.1 time: 0.174410 Aug 27 04:23:30.105685 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3900/7516] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:29 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:30.238244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-853dea61-3feb-4cb6-9736-b37cdd4a2d1d req-dab433b6-6b0e-4ff3-877a-754da4fb9e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8ae02f-4d38-40e3-981e-2adc382a4409", "name": "network-vif-deleted", "tag": "a0240ab2-e7fc-4215-9857-4de4cdb46527"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:30.250229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-853dea61-3feb-4cb6-9736-b37cdd4a2d1d req-dab433b6-6b0e-4ff3-877a-754da4fb9e16 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:30.250741 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-853dea61-3feb-4cb6-9736-b37cdd4a2d1d req-dab433b6-6b0e-4ff3-877a-754da4fb9e16 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:30.251183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-853dea61-3feb-4cb6-9736-b37cdd4a2d1d req-dab433b6-6b0e-4ff3-877a-754da4fb9e16 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:30.264779 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-853dea61-3feb-4cb6-9736-b37cdd4a2d1d req-dab433b6-6b0e-4ff3-877a-754da4fb9e16 service nova] Creating event network-vif-deleted:a0240ab2-e7fc-4215-9857-4de4cdb46527 for instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 on n-h2-852086-5 Aug 27 04:23:30.270458 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-853dea61-3feb-4cb6-9736-b37cdd4a2d1d req-dab433b6-6b0e-4ff3-877a-754da4fb9e16 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035934 Aug 27 04:23:30.271072 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3617/7517] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:31.113016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:31.113628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 6d8ae02f-4d38-40e3-981e-2adc382a4409] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:31.121107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:31.121589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:31.122025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:31.122753 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:31.123211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:31.123638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:31.138369 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] HTTP exception thrown: Instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 could not be found. Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Request method failure captured: Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 HTTP/1.1 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZuYOza7Jc9OC5f_06Mliz7hha61ic4M-4zGFc8F7J_8Qzlqbdr0peVnrpAlKJi4V1PLnesNCIQYBdIPrFgkoQfwPvfltg2D1_yV0OYe5QswnMEL_b6UbDXGKEwI2dXrBOWSxV4VJw7i__9duokYzmFqXuEUZHHLmIOdF-kM65NLWWc Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9eb70a35cfa545b0b5ae86ca79a632a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}] Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 971282f7495e4a9ab00e8d11c16f73c2 Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 could not be found. Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '6d8ae02f-4d38-40e3-981e-2adc382a4409'} Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 could not be found. Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 could not be found. Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:23:31.140031 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 could not be found. Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Returning 404 to user: Instance 6d8ae02f-4d38-40e3-981e-2adc382a4409 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-225ca4ae-826e-4a88-b0c7-caf1db514cd4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409" status: 404 len: 111 microversion: 2.1 time: 0.032405 Aug 27 04:23:31.144663 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3901/7518] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:31 2022] GET /compute/v2.1/servers/6d8ae02f-4d38-40e3-981e-2adc382a4409 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:23:34.512475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40740d9f-8c35-4869-ad90-3f221f9cba55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '.version_select at 0x7fe4601aff70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:34.542879 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40740d9f-8c35-4869-ad90-3f221f9cba55 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1399432829" status: 202 len: 0 microversion: 2.1 time: 0.035251 Aug 27 04:23:34.543514 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3618/7519] 10.222.0.69 () {58 vars in 1284 bytes} [Sat Aug 27 04:23:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1399432829 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:23:34.579566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2dc773a1-ee1e-4e30-845a-3e4f14129c6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: .version_select at 0x7fe460214f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-860363006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx8toq9kUJrp/HdqZGNPVA0ACkehLMaRYbcW4BfC+EPkIRazz8R6GARI/py4rSouVRerO71oNBajZHGcP2gvo2GAVFIOgiE9XN/EYdIEkMrKW5CMFQOE8bblL47qArrhA=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:34.599061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2dc773a1-ee1e-4e30-845a-3e4f14129c6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:23:34.605821 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2dc773a1-ee1e-4e30-845a-3e4f14129c6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:23:34.630250 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2dc773a1-ee1e-4e30-845a-3e4f14129c6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054554 Aug 27 04:23:34.630863 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3902/7520] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:23:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:40.265951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:40.270814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-889547765", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "b565317f-dae5-4165-86f7-de8a63dcbfec"}], "key_name": "tempest-TestNetworkAdvancedServerOps-860363006", "security_groups": [{"name": "tempest-secgroup-smoke-1142648555"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:40.394738 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] validate_networks() for [('b565317f-dae5-4165-86f7-de8a63dcbfec', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:23:40.827261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:23:40.827700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:23:40.828193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:23:40.828620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:23:40.829053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:23:40.839852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:40.840441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:40.841100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:40.842080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:40.842806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:40.843261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:40.871760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:23:40.878957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:23:40.904953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:23:40.911645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:23:40.969102 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e679116-c62e-4fc0-8a24-5decb3888eab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705851 Aug 27 04:23:40.976047 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3619/7521] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:23:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:23:40.980584 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:23:40.981181 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 (ip 10.222.0.69) !!! Aug 27 04:23:40.986238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-61083b85-77cb-467a-ba03-788a2a420cc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:40.987160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-61083b85-77cb-467a-ba03-788a2a420cc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:41.071316 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-61083b85-77cb-467a-ba03-788a2a420cc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:41.079593 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-61083b85-77cb-467a-ba03-788a2a420cc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1265 microversion: 2.1 time: 0.102304 Aug 27 04:23:41.080541 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3903/7522] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:40 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:42.101643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4c66656-f976-4396-aaf1-1b533fdb4fc0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:42.102527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4c66656-f976-4396-aaf1-1b533fdb4fc0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:42.176062 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4c66656-f976-4396-aaf1-1b533fdb4fc0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:42.183798 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4c66656-f976-4396-aaf1-1b533fdb4fc0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1265 microversion: 2.1 time: 0.086824 Aug 27 04:23:42.186202 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3620/7523] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:42 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:43.205398 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-de21202f-9a72-40f9-a16b-8b293a7bde88 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:43.206088 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-de21202f-9a72-40f9-a16b-8b293a7bde88 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:43.208682 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=20 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:43.267601 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-de21202f-9a72-40f9-a16b-8b293a7bde88 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:43.274884 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-de21202f-9a72-40f9-a16b-8b293a7bde88 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1265 microversion: 2.1 time: 0.073449 Aug 27 04:23:43.275515 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3904/7524] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:43 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:44.306850 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a2d4853-cf8a-4ace-a15d-4765f63d21ec tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:44.307645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a2d4853-cf8a-4ace-a15d-4765f63d21ec tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:44.378517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a2d4853-cf8a-4ace-a15d-4765f63d21ec tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:44.386399 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a2d4853-cf8a-4ace-a15d-4765f63d21ec tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1265 microversion: 2.1 time: 0.086140 Aug 27 04:23:44.386982 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3621/7525] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:44 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:45.407255 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:45.407866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:45.415417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:45.415933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:45.416567 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:45.417264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:45.417718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:45.418141 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:45.483463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:45.491751 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c749088d-dbb6-4823-921d-5860fa1dbcd6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1269 microversion: 2.1 time: 0.088308 Aug 27 04:23:45.492361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3905/7526] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:45 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:46.514444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:46.515078 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:46.522369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:46.523014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:46.523468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:46.524196 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:46.524670 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:46.525116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:46.631066 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:46.639481 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61b99f33-ea12-4980-9b1a-ee9d068ca4f6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1323 microversion: 2.1 time: 0.130279 Aug 27 04:23:46.640006 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3622/7527] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:46 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1323 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:47.468240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-894ed57e-0b25-43ee-942a-d5fc37f8c447 req-3bed589e-20e0-43d9-91fa-eded69ecea6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:47.487262 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-894ed57e-0b25-43ee-942a-d5fc37f8c447 req-3bed589e-20e0-43d9-91fa-eded69ecea6e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:47.487838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-894ed57e-0b25-43ee-942a-d5fc37f8c447 req-3bed589e-20e0-43d9-91fa-eded69ecea6e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:47.488486 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-894ed57e-0b25-43ee-942a-d5fc37f8c447 req-3bed589e-20e0-43d9-91fa-eded69ecea6e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:47.505558 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-894ed57e-0b25-43ee-942a-d5fc37f8c447 req-3bed589e-20e0-43d9-91fa-eded69ecea6e service nova] Creating event network-changed:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h2-852086-5 Aug 27 04:23:47.511479 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-894ed57e-0b25-43ee-942a-d5fc37f8c447 req-3bed589e-20e0-43d9-91fa-eded69ecea6e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050069 Aug 27 04:23:47.512513 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3906/7528] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:47.661427 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:47.662056 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:47.670474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:47.670976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:47.671460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:47.672176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:47.672645 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:47.673100 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:47.879441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:47.887960 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f45e803-3898-492e-8638-9238959928d0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1391 microversion: 2.1 time: 0.230802 Aug 27 04:23:47.888551 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3623/7529] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:47 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:48.910423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:48.911126 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:48.917851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:48.918361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:48.918801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:48.919501 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:48.919958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:48.920384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:49.062214 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:49.070270 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9c7e262b-1a56-4b47-9e50-05a0b6f51330 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1391 microversion: 2.1 time: 0.164924 Aug 27 04:23:49.070862 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3907/7530] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:48 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:50.092716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:50.093352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:50.100336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:50.100838 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:50.101294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:50.102002 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:50.102507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:50.102949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:50.234643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:50.243927 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3423f8d-59a9-417d-8dd5-ddbfc8e12c38 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1391 microversion: 2.1 time: 0.155437 Aug 27 04:23:50.244919 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3624/7531] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:50 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:51.267254 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:51.267877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:51.270700 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:51.276396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:51.276904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:51.277343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:51.278074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:51.278596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:51.279029 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:51.421811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:51.429954 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f9b09f34-4ea4-4d31-af38-e557ac8d1c42 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1391 microversion: 2.1 time: 0.166597 Aug 27 04:23:51.430598 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3908/7532] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:51 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:23:52.451625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:52.452173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:52.454085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:52.460695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:52.461195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:52.461649 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:52.462393 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:52.463492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:52.463993 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:52.602384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:52.610588 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa83316f-d45c-4603-8c3e-30d3d2b6c592 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1391 microversion: 2.1 time: 0.163983 Aug 27 04:23:52.611183 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3625/7533] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:52 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:52.756715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-8222c736-e016-4809-8b7c-7d0198c816e6 req-edf60b59-a366-4f72-99b7-6d5bc294cc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "name": "network-vif-plugged", "status": "completed", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:52.768436 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8222c736-e016-4809-8b7c-7d0198c816e6 req-edf60b59-a366-4f72-99b7-6d5bc294cc7e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:52.768998 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8222c736-e016-4809-8b7c-7d0198c816e6 req-edf60b59-a366-4f72-99b7-6d5bc294cc7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:52.769460 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-8222c736-e016-4809-8b7c-7d0198c816e6 req-edf60b59-a366-4f72-99b7-6d5bc294cc7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:52.781477 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-8222c736-e016-4809-8b7c-7d0198c816e6 req-edf60b59-a366-4f72-99b7-6d5bc294cc7e service nova] Creating event network-vif-plugged:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h2-852086-5 Aug 27 04:23:52.786656 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-8222c736-e016-4809-8b7c-7d0198c816e6 req-edf60b59-a366-4f72-99b7-6d5bc294cc7e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Aug 27 04:23:52.787368 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3909/7534] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:53.631810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:53.632430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:53.641387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:53.641888 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:53.642554 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:53.647515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:53.647515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:53.647515 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:53.795897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:53.803883 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d88812a9-3e4f-4167-9bb5-e4b23d39f02f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1391 microversion: 2.1 time: 0.176102 Aug 27 04:23:53.804464 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3626/7535] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:53 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:54.824336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:54.829306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:54.830006 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:54.836443 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:54.836922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:54.837362 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:54.838750 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:54.839206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:54.839654 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:54.975956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:54.983771 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-750b4215-f1de-4c85-9d4b-2ef85e25dec7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1563 microversion: 2.1 time: 0.160522 Aug 27 04:23:54.984361 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3910/7536] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:54 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:55.004095 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:55.004723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:55.006723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:23:55.013745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:55.014278 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:55.014724 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:55.015440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:55.015905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:55.016384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:55.155155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:55.162871 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1f577e7-0200-4fee-a748-9d3fa09587bd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1563 microversion: 2.1 time: 0.162828 Aug 27 04:23:55.163446 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3627/7537] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:54 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:57.089591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:57.090211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:23:57.092706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5a68266d-87d8-4b3f-8975-576e34697719 req-9f057fd4-970b-4edb-b0f5-e7e7af6a3a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:57.097179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:57.097677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:57.098119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:57.099119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:57.099586 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:57.100020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:57.107568 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5a68266d-87d8-4b3f-8975-576e34697719 req-9f057fd4-970b-4edb-b0f5-e7e7af6a3a3c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:23:57.108072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5a68266d-87d8-4b3f-8975-576e34697719 req-9f057fd4-970b-4edb-b0f5-e7e7af6a3a3c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:23:57.108523 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5a68266d-87d8-4b3f-8975-576e34697719 req-9f057fd4-970b-4edb-b0f5-e7e7af6a3a3c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:23:57.122463 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5a68266d-87d8-4b3f-8975-576e34697719 req-9f057fd4-970b-4edb-b0f5-e7e7af6a3a3c service nova] Creating event network-changed:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h2-852086-5 Aug 27 04:23:57.128092 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5a68266d-87d8-4b3f-8975-576e34697719 req-9f057fd4-970b-4edb-b0f5-e7e7af6a3a3c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040390 Aug 27 04:23:57.128698 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3628/7538] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:57.248390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:57.256555 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce799522-072b-47b1-aa1c-e31ee47e605e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1563 microversion: 2.1 time: 0.171706 Aug 27 04:23:57.270030 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3911/7539] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:23:57 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:18.499537 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:18.501783 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:18.504296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:18.504955 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:18.511676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:18.512179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:18.512627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:18.513349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:18.513812 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:18.514277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:18.574650 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b73f4ba6-ecfd-458b-91f6-23ad1a35a1fb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action" status: 200 len: 24574 microversion: 2.1 time: 0.079823 Aug 27 04:24:18.575320 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3629/7540] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:24:18 2022] POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action => generated 24574 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:24:29.578950 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:29.581165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:29.583363 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:29.584016 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=34 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:29.589872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:29.590394 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:29.590830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:29.592049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:29.592503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:29.592921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:29.680546 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:29.687121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Old instance type m1.heat2, new instance type m1.heat {{(pid=122407) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 04:24:29.693740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:24:29.694194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:24:29.694668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:24:29.695080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:24:29.695522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:24:29.761166 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-36df0d7f-3411-4bb1-8c09-74a315e5859c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action" status: 202 len: 0 microversion: 2.1 time: 0.186283 Aug 27 04:24:29.761795 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3912/7541] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:24:29 2022] POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:24:29.771663 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:29.773033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:29.776679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:29.777544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:24:29.783087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:29.783613 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:29.784001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:29.784726 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:29.785189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:29.785628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:29.949158 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:29.958358 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5d6593e6-dfbb-4f6e-b427-8de9c7fec9f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1691 microversion: 2.1 time: 0.191294 Aug 27 04:24:29.958954 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3630/7542] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:29 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:30.981265 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:30.981992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:30.988426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:30.988915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:30.989350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:30.990047 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:30.990531 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:30.990955 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:31.132023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:31.139843 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-13a83237-65d8-41bf-aa9a-6a5bc49fbfaf tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1691 microversion: 2.1 time: 0.163438 Aug 27 04:24:31.140415 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3913/7543] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:30 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:32.162084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:32.162764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:32.171710 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:32.172223 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:32.172686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:32.173412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:32.173890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:32.174375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:32.309200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:32.317903 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f861ce7b-7fbc-4d2a-bae1-5131f517006b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.159841 Aug 27 04:24:32.318526 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3631/7544] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:32 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:33.339836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:33.340445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:33.348872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:33.349358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:33.349795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:33.350537 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:33.350994 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:33.351420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:33.489596 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:33.499002 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-449ef52b-0efe-416d-b92b-84b87d994294 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.163089 Aug 27 04:24:33.499588 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3914/7545] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:33 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:34.519952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:34.520620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:34.527915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:34.528467 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:34.528978 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:34.529803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:34.530305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:34.530759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:34.673643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:34.681488 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0dbe39e-b533-484a-8c0b-a95ec2bc2947 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.165468 Aug 27 04:24:34.682069 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3632/7546] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:34 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:35.704143 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:35.704755 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:35.711592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:35.712074 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:35.712508 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:35.713210 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:35.713663 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:35.714082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:35.850970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:35.859230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-add8f925-c7ff-402b-b5cb-58480f86fcf6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.159656 Aug 27 04:24:35.859810 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3915/7547] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:35 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:36.881131 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.881672 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:36.889206 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:36.889704 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:36.890151 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:36.890879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:36.891345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:36.891781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:37.023388 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:37.031926 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f3d4049-6cab-4766-96eb-38cfc00bfb2f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.154852 Aug 27 04:24:37.032503 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3633/7548] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:36 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:38.053536 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:38.054146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:38.061061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:38.061547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:38.061988 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:38.062727 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:38.063187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:38.063692 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:38.193954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:38.202777 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-45ef5915-af3d-4f50-9c7c-6a4eaa44e36c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.153238 Aug 27 04:24:38.203347 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3916/7549] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:38 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:39.225163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:39.225716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:39.233567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:39.234069 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:39.234552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:39.235265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:39.235743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:39.236190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:39.380243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:39.391494 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53aff7e1-6bea-4846-b5ee-f939d4d22bc3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.170235 Aug 27 04:24:39.392274 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3634/7550] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:39 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:24:40.412920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:40.413579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:40.421419 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:40.421913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:40.422395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:40.423115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:40.423577 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:40.424010 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:40.570929 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:40.580284 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dc5ecb32-3701-4850-8403-fab46478340d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.171289 Aug 27 04:24:40.580863 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3917/7551] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:40 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:41.602210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:41.602935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:41.610807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:41.611316 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:41.611774 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:41.612508 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:41.612980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:41.613593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:41.753902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:41.762061 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23239acf-d9b6-4b7c-b5f8-de49da0545f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.163780 Aug 27 04:24:41.762671 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3635/7552] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:41 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:42.784653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:42.785376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:42.791377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:42.791875 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:42.792341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:42.793040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:42.793496 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:42.793922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:42.931583 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:42.940093 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3bd28621-a2fc-4379-aeb9-664415a43347 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.159963 Aug 27 04:24:42.940668 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3918/7553] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:42 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:43.962752 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:43.963374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:43.971387 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:43.971886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:43.972334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:43.973130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:43.973600 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:43.974042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:44.108706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:44.116476 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-527a2717-552d-491a-98fa-431295e17209 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.157699 Aug 27 04:24:44.117052 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3636/7554] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:43 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:45.138627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:45.139290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:45.146187 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:45.146697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:45.147142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:45.147854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:45.148315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:45.148744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:45.283862 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:45.292052 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c0398c45-34d4-4837-8c98-9fad4af306a4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.157355 Aug 27 04:24:45.292643 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3919/7555] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:45 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:46.314103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:46.314803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:46.321666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:46.322201 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:46.322654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:46.323653 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:46.324116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:46.324553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:46.461986 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:46.469871 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-243d1d86-882b-4594-b573-0c7fa7550859 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.160680 Aug 27 04:24:46.470475 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3637/7556] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:46 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:47.492417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:47.493165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:47.500927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:47.501424 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:47.501872 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:47.502626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:47.503090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:47.503523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:47.646915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:47.654866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-19411aca-01b8-4a5c-adde-fe99bb688b85 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.167220 Aug 27 04:24:47.655510 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3920/7557] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:47 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:48.678249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:48.678879 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:48.686013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:48.686868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:48.687320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:48.688043 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:48.688510 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:48.688949 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:48.833457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:48.841551 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf9dcf58-81fa-442a-aa82-8ba561224495 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1696 microversion: 2.1 time: 0.167346 Aug 27 04:24:48.842149 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3638/7558] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:48 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:24:49.529447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d0ba8215-0a74-4aa1-abdd-fd8f629b04c3 req-226790ce-f2d7-47f1-9a10-0868d877bc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "name": "network-vif-unplugged", "status": "completed", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:49.540589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d0ba8215-0a74-4aa1-abdd-fd8f629b04c3 req-226790ce-f2d7-47f1-9a10-0868d877bc67 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:49.541073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d0ba8215-0a74-4aa1-abdd-fd8f629b04c3 req-226790ce-f2d7-47f1-9a10-0868d877bc67 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:49.541494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d0ba8215-0a74-4aa1-abdd-fd8f629b04c3 req-226790ce-f2d7-47f1-9a10-0868d877bc67 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:49.554322 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d0ba8215-0a74-4aa1-abdd-fd8f629b04c3 req-226790ce-f2d7-47f1-9a10-0868d877bc67 service nova] Creating event network-vif-unplugged:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h1-852086-5 Aug 27 04:24:49.559873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [req-d0ba8215-0a74-4aa1-abdd-fd8f629b04c3 req-226790ce-f2d7-47f1-9a10-0868d877bc67 service nova] Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:24:49.572205 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d0ba8215-0a74-4aa1-abdd-fd8f629b04c3 req-226790ce-f2d7-47f1-9a10-0868d877bc67 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046412 Aug 27 04:24:49.573143 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3921/7559] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:49.863895 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:49.864423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:49.871357 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:49.871860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:49.872313 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:49.873034 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:49.873675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:49.874315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:50.131105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:50.139080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4606dffa-b0d6-4a00-b850-2dffb9ecdbfc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1695 microversion: 2.1 time: 0.279474 Aug 27 04:24:50.139860 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3639/7560] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:49 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1695 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:51.161679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:51.162628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:51.169632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:51.170115 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:51.170691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:51.171718 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:51.172176 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:51.172604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:51.306553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:51.314607 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ce4aec96-57e7-48e3-bdc7-9e6de575ba3f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1693 microversion: 2.1 time: 0.157134 Aug 27 04:24:51.315188 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3922/7561] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:51 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:51.616218 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a5654281-82f6-418e-91ef-835ab86f4a49 req-37af881a-0550-4672-b6ff-b28e82baf282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:51.627425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a5654281-82f6-418e-91ef-835ab86f4a49 req-37af881a-0550-4672-b6ff-b28e82baf282 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:51.627915 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a5654281-82f6-418e-91ef-835ab86f4a49 req-37af881a-0550-4672-b6ff-b28e82baf282 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:51.628358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a5654281-82f6-418e-91ef-835ab86f4a49 req-37af881a-0550-4672-b6ff-b28e82baf282 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:51.640638 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a5654281-82f6-418e-91ef-835ab86f4a49 req-37af881a-0550-4672-b6ff-b28e82baf282 service nova] Creating event network-changed:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h1-852086-5 Aug 27 04:24:51.645913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-a5654281-82f6-418e-91ef-835ab86f4a49 req-37af881a-0550-4672-b6ff-b28e82baf282 service nova] Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852086-5', 'n-h2-852086-5'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 04:24:51.657388 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a5654281-82f6-418e-91ef-835ab86f4a49 req-37af881a-0550-4672-b6ff-b28e82baf282 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044936 Aug 27 04:24:51.658041 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3640/7562] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:52.336888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:52.337504 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:52.346218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:52.346959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:52.347696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:52.348588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:52.349273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:52.349871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:52.495823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:52.503855 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dfa9a612-5008-4a50-bd0b-bf53d520de96 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1693 microversion: 2.1 time: 0.170924 Aug 27 04:24:52.504572 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3923/7563] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:52 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:53.526855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:53.527579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:53.534454 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:53.534970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:53.535434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:53.536186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:53.536658 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:53.537102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:53.676116 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:53.684267 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbca9be7-4994-43df-a01f-d61e0004900c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1690 microversion: 2.1 time: 0.162545 Aug 27 04:24:53.684936 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3641/7564] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:53 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:53.706140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:53.706749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:53.714579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:53.715073 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:53.715522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:53.716260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:53.716704 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:53.717138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:53.777897 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3dd4e740-1f1f-4bb8-bf67-b953148879a7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action" status: 204 len: 0 microversion: 2.1 time: 0.075758 Aug 27 04:24:53.778500 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3924/7565] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:24:53 2022] POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:24:53.787585 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:53.788193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:53.795344 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:53.796073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:53.796391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:53.797219 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:53.797935 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:53.798505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:54.372595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:54.380842 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-373963e3-31b6-4def-9d1f-e8901f0885d5 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1690 microversion: 2.1 time: 0.597305 Aug 27 04:24:54.381443 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3642/7566] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:53 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1690 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:54.402228 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:54.403269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:54.410620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:54.411110 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:54.411547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:54.412266 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:54.412723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:54.413318 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:54.565497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:54.574544 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b0c98721-358a-464b-ae4a-9b5301f18ecb tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1690 microversion: 2.1 time: 0.176581 Aug 27 04:24:54.575155 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3925/7567] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:54 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:24:55.598368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:55.599501 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:24:55.607512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:55.608084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:55.608694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:55.609581 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:55.610085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:55.610559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:55.750009 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:55.757886 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e8df1e4-ec43-47b9-8360-b583c49c3fa6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1682 microversion: 2.1 time: 0.164027 Aug 27 04:24:55.758685 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3643/7568] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:24:55 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:55.871540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f6915482-4baa-4b09-abfc-d94cbbb4bcd4 req-01889e8a-7c6e-4d6c-9698-f28e1ed5eb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "name": "network-vif-plugged", "status": "completed", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:55.881959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6915482-4baa-4b09-abfc-d94cbbb4bcd4 req-01889e8a-7c6e-4d6c-9698-f28e1ed5eb61 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:24:55.882483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6915482-4baa-4b09-abfc-d94cbbb4bcd4 req-01889e8a-7c6e-4d6c-9698-f28e1ed5eb61 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:24:55.882888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f6915482-4baa-4b09-abfc-d94cbbb4bcd4 req-01889e8a-7c6e-4d6c-9698-f28e1ed5eb61 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:24:55.894573 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f6915482-4baa-4b09-abfc-d94cbbb4bcd4 req-01889e8a-7c6e-4d6c-9698-f28e1ed5eb61 service nova] Creating event network-vif-plugged:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h1-852086-5 Aug 27 04:24:55.899681 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f6915482-4baa-4b09-abfc-d94cbbb4bcd4 req-01889e8a-7c6e-4d6c-9698-f28e1ed5eb61 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104377 Aug 27 04:24:55.900264 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3926/7569] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:21.962689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:21.964857 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:21.967133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=28 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:21.967803 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=82 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:21.975315 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:21.975815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:21.976260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:21.976976 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:21.977440 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:21.977874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:22.029705 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7ead3d9d-c4a1-4666-92b8-646de16ef0f4 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action" status: 200 len: 24568 microversion: 2.1 time: 0.071167 Aug 27 04:25:22.030386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3644/7570] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:25:21 2022] POST /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:25:29.285880 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=34 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:29.287251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:29.293632 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f6688c3f-0a76-4cb2-93be-4a1e1b9ef891 req-fcdc062a-74ed-4e64-95c6-809f17e827c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:29.294396 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:29.294631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:29.304303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:29.304877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:29.305325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:29.305480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6688c3f-0a76-4cb2-93be-4a1e1b9ef891 req-fcdc062a-74ed-4e64-95c6-809f17e827c2 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:29.305970 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6688c3f-0a76-4cb2-93be-4a1e1b9ef891 req-fcdc062a-74ed-4e64-95c6-809f17e827c2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:29.306119 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:29.306528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:29.306683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6688c3f-0a76-4cb2-93be-4a1e1b9ef891 req-fcdc062a-74ed-4e64-95c6-809f17e827c2 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:29.306963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:29.319955 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f6688c3f-0a76-4cb2-93be-4a1e1b9ef891 req-fcdc062a-74ed-4e64-95c6-809f17e827c2 service nova] Creating event network-changed:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h1-852086-5 Aug 27 04:25:29.326236 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f6688c3f-0a76-4cb2-93be-4a1e1b9ef891 req-fcdc062a-74ed-4e64-95c6-809f17e827c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038225 Aug 27 04:25:29.328727 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3645/7571] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:29.337040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:25:29.436866 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a41ecc12-187b-4843-a8b8-f1eebc707e54 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 204 len: 0 microversion: 2.1 time: 0.152993 Aug 27 04:25:29.439161 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3927/7572] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:25:29 2022] DELETE /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:25:29.451347 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:29.452583 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:29.462432 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:29.463683 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:29.464397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:29.465456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:29.468607 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:29.469128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:29.624580 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:29.633663 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-224f0adb-6433-4899-83d1-da8f8dc69866 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1688 microversion: 2.1 time: 0.189699 Aug 27 04:25:29.634383 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3646/7573] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:29 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:30.655721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:30.656429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:30.664084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:30.664588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:30.665028 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:30.665740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:30.666230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:30.666679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:30.812878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:30.822700 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-93d7cdd6-d2f9-4292-a4c1-48fee4443785 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 200 len: 1688 microversion: 2.1 time: 0.171015 Aug 27 04:25:30.823435 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3928/7574] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:30 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:31.492940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ce3e8949-3086-4a7f-a48f-ac0dc77d0ca7 req-8e77f95a-a8fd-4f87-bc54-dee0917db833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6f6a4c-92e0-4bb1-b56f-861caa9253c5", "name": "network-vif-deleted", "tag": "fadacff9-2667-4ac5-a13a-7a91e5116a6b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:31.504890 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce3e8949-3086-4a7f-a48f-ac0dc77d0ca7 req-8e77f95a-a8fd-4f87-bc54-dee0917db833 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:31.505390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce3e8949-3086-4a7f-a48f-ac0dc77d0ca7 req-8e77f95a-a8fd-4f87-bc54-dee0917db833 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:31.505971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce3e8949-3086-4a7f-a48f-ac0dc77d0ca7 req-8e77f95a-a8fd-4f87-bc54-dee0917db833 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:31.518699 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ce3e8949-3086-4a7f-a48f-ac0dc77d0ca7 req-8e77f95a-a8fd-4f87-bc54-dee0917db833 service nova] Creating event network-vif-deleted:fadacff9-2667-4ac5-a13a-7a91e5116a6b for instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 on n-h1-852086-5 Aug 27 04:25:31.524274 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ce3e8949-3086-4a7f-a48f-ac0dc77d0ca7 req-8e77f95a-a8fd-4f87-bc54-dee0917db833 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035197 Aug 27 04:25:31.524874 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3647/7575] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:31.845322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:31.846004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:31.854190 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:31.854785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:31.855222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:31.855935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:31.856384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:31.856809 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:31.871934 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] HTTP exception thrown: Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 could not be found. Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Request method failure captured: Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 HTTP/1.1 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZuYOza7Jc9OC5f_06Mliz7hha61ic4M-4zGFc8F7J_8Qzlqbdr0peVnrpAlKJi4V1PLnesNCIQYBdIPrFgkoQfwPvfltg2D1_yV0OYe5QswnMEL_b6UbDXGKEwI2dXrBOWSxV4VJw7i__9duokYzmFqXuEUZHHLmIOdF-kM65NLWWc Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9eb70a35cfa545b0b5ae86ca79a632a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}] Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: 971282f7495e4a9ab00e8d11c16f73c2 Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 could not be found. Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '1a6f6a4c-92e0-4bb1-b56f-861caa9253c5'} Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 could not be found. Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 could not be found. Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:25:31.873691 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 could not be found. Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Returning 404 to user: Instance 1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-90c342c1-855a-4dc2-8b0e-355031c791e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5" status: 404 len: 111 microversion: 2.1 time: 0.033835 Aug 27 04:25:31.878942 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3929/7576] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:31 2022] GET /compute/v2.1/servers/1a6f6a4c-92e0-4bb1-b56f-861caa9253c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:25:35.203295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-168edeaf-cc54-4a97-85e9-d6dad91ffbd3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '.version_select at 0x7fe4572ccca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:35.227226 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-168edeaf-cc54-4a97-85e9-d6dad91ffbd3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-860363006" status: 202 len: 0 microversion: 2.1 time: 0.029446 Aug 27 04:25:35.227708 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3648/7577] 10.222.0.69 () {58 vars in 1281 bytes} [Sat Aug 27 04:25:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-860363006 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:25:35.256849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2e8a919e-2b1f-4e5c-82ad-925fe577e43e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: .version_select at 0x7fe45712e790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-243130964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6EP2G4bOh10ax+KgFbWojISPtawlaXWVilkI1HqL8vahX1caQ7gN5XN4mMN0S0JVJX2opEtMlHL2UDpK9HRV0RpbSdMtqdum0QOaK113zZs9He1/4O61QmGWmPfrE2Ng=="}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:35.275487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2e8a919e-2b1f-4e5c-82ad-925fe577e43e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:25:35.281002 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-2e8a919e-2b1f-4e5c-82ad-925fe577e43e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:25:35.308240 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2e8a919e-2b1f-4e5c-82ad-925fe577e43e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055889 Aug 27 04:25:35.308845 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3930/7578] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:25:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:41.013815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-855973494", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "a57136a4-2047-4fc8-9e5b-d9c4e408dd97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-243130964", "security_groups": [{"name": "tempest-secgroup-smoke-2011442173"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:41.140312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] validate_networks() for [('a57136a4-2047-4fc8-9e5b-d9c4e408dd97', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:25:41.511168 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:41.923420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:25:41.923860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:25:41.924411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:25:41.924847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:25:41.925307 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:25:41.935374 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:41.935859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:41.936317 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:41.937214 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:41.937865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:41.938518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:41.960122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:25:41.966743 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:25:41.983039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:25:41.988352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:25:42.039713 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a4a9993-0da0-43e5-9567-d8659264dd46 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.084313 Aug 27 04:25:42.046977 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3649/7579] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:25:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:25:42.051957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:42.057976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5dcd86c2-719e-410a-9162-c15e27b29541 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:42.062614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5dcd86c2-719e-410a-9162-c15e27b29541 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:42.155844 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5dcd86c2-719e-410a-9162-c15e27b29541 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:42.165462 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5dcd86c2-719e-410a-9162-c15e27b29541 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1265 microversion: 2.1 time: 0.116549 Aug 27 04:25:42.179669 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3931/7580] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:42 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:43.190823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:43.192958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:43.204684 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:43.206128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:43.207036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:43.207893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:43.208448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:43.209139 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:43.297846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:43.311634 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e88a80f-07d5-42e7-ad50-b31ecee1145f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1325 microversion: 2.1 time: 0.125842 Aug 27 04:25:43.312893 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3650/7581] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:43 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1325 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:44.339848 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:44.340865 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:44.347393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:44.348009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:44.348652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:44.349876 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:44.350371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:44.351004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:44.493375 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:44.501423 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-689c63e0-88f4-4799-86fb-c2a78ca0594c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1391 microversion: 2.1 time: 0.166859 Aug 27 04:25:44.502320 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3932/7582] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:44 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:44.650336 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0c9f38be-9555-4bca-9380-4ab05f18133b req-e44d76c5-9afd-43b5-a2f9-9c4841474a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3541ba56-07a1-42c5-b8cf-683df0220310", "tag": "a796bed4-ea91-4b67-9c99-c06d55a5bdf9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:44.662452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c9f38be-9555-4bca-9380-4ab05f18133b req-e44d76c5-9afd-43b5-a2f9-9c4841474a35 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:44.662956 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c9f38be-9555-4bca-9380-4ab05f18133b req-e44d76c5-9afd-43b5-a2f9-9c4841474a35 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:44.663410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c9f38be-9555-4bca-9380-4ab05f18133b req-e44d76c5-9afd-43b5-a2f9-9c4841474a35 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:44.685689 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0c9f38be-9555-4bca-9380-4ab05f18133b req-e44d76c5-9afd-43b5-a2f9-9c4841474a35 service nova] Creating event network-changed:a796bed4-ea91-4b67-9c99-c06d55a5bdf9 for instance 3541ba56-07a1-42c5-b8cf-683df0220310 on n-h2-852086-5 Aug 27 04:25:44.691506 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0c9f38be-9555-4bca-9380-4ab05f18133b req-e44d76c5-9afd-43b5-a2f9-9c4841474a35 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045056 Aug 27 04:25:44.692133 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3651/7583] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:45.522895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:45.523522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:45.530677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:45.531175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:45.531615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:45.532330 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:45.532788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:45.533263 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:45.681202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:45.689107 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ea6f355c-3860-4e05-be8f-9b259835c20d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1391 microversion: 2.1 time: 0.170133 Aug 27 04:25:45.690698 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3933/7584] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:45 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:46.713494 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:46.714119 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:46.720479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:46.720982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:46.721436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:46.722147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:46.722643 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:46.723088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:46.858426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:46.867012 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-499184db-90c7-4290-9e0c-69738e86be13 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1391 microversion: 2.1 time: 0.158546 Aug 27 04:25:46.867340 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3652/7585] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:46 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:47.888912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:47.889463 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:47.897357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:47.897857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:47.898417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:47.899133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:47.899598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:47.901036 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:48.041077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:48.056961 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2c70845-4645-4db8-aaf6-31e9aeb808be tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1391 microversion: 2.1 time: 0.171987 Aug 27 04:25:48.057584 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3934/7586] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:47 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:49.078788 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:49.079419 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:49.086356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:49.086944 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:49.087284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:49.088005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:49.088475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:49.088919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:49.232042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:49.240919 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70f6fb15-a40e-433f-8671-170146ab54c1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1391 microversion: 2.1 time: 0.166259 Aug 27 04:25:49.248166 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3653/7587] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:49 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:49.320591 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-6086c481-93a5-4270-8c44-4ec10e55080c req-5cc4d38e-d186-400f-82fe-aa23b3063af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3541ba56-07a1-42c5-b8cf-683df0220310", "name": "network-vif-plugged", "status": "completed", "tag": "a796bed4-ea91-4b67-9c99-c06d55a5bdf9"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:49.332377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6086c481-93a5-4270-8c44-4ec10e55080c req-5cc4d38e-d186-400f-82fe-aa23b3063af8 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:49.333034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6086c481-93a5-4270-8c44-4ec10e55080c req-5cc4d38e-d186-400f-82fe-aa23b3063af8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:49.333478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-6086c481-93a5-4270-8c44-4ec10e55080c req-5cc4d38e-d186-400f-82fe-aa23b3063af8 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:49.345061 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-6086c481-93a5-4270-8c44-4ec10e55080c req-5cc4d38e-d186-400f-82fe-aa23b3063af8 service nova] Creating event network-vif-plugged:a796bed4-ea91-4b67-9c99-c06d55a5bdf9 for instance 3541ba56-07a1-42c5-b8cf-683df0220310 on n-h2-852086-5 Aug 27 04:25:49.350833 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-6086c481-93a5-4270-8c44-4ec10e55080c req-5cc4d38e-d186-400f-82fe-aa23b3063af8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034182 Aug 27 04:25:49.352070 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3935/7588] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:25:50.263129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:50.263836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:50.274040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:50.274584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:50.275055 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:50.275776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:50.276250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:50.276902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:50.429897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:50.437957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9707eafa-08ff-43c6-b139-0d15ae2aa316 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1391 microversion: 2.1 time: 0.179033 Aug 27 04:25:50.439266 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3654/7589] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:50 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:51.461083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:51.461795 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:51.468857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:51.469339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:51.469774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:51.470497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:51.470957 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:51.472260 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:51.612117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:51.619884 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-abe8c1d1-a997-4e7e-929e-0528a6c8f45a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1564 microversion: 2.1 time: 0.163341 Aug 27 04:25:51.620467 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3936/7590] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:51 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:51.641133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:51.641766 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:51.649709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:51.650251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:51.650714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:51.651438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:51.651914 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:51.652362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:51.788945 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:51.796846 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82189d05-e929-4c43-ad80-59b2e725b53a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1564 microversion: 2.1 time: 0.159640 Aug 27 04:25:51.797426 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3655/7591] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:51 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:53.460191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:53.460804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:25:53.463069 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:53.463421 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-109b77dc-d6ce-4d7a-a5b6-3c937a7e6ef9 req-3b7cc3f2-7b37-4619-a679-fd543e5a64cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3541ba56-07a1-42c5-b8cf-683df0220310", "tag": "a796bed4-ea91-4b67-9c99-c06d55a5bdf9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:53.469859 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:53.470617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:53.471076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:53.472420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:53.472884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:53.473304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:53.474624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:53.475438 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:53.477443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:25:53.481502 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-109b77dc-d6ce-4d7a-a5b6-3c937a7e6ef9 req-3b7cc3f2-7b37-4619-a679-fd543e5a64cb service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:25:53.482166 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-109b77dc-d6ce-4d7a-a5b6-3c937a7e6ef9 req-3b7cc3f2-7b37-4619-a679-fd543e5a64cb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:25:53.482629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-109b77dc-d6ce-4d7a-a5b6-3c937a7e6ef9 req-3b7cc3f2-7b37-4619-a679-fd543e5a64cb service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:25:53.497855 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-109b77dc-d6ce-4d7a-a5b6-3c937a7e6ef9 req-3b7cc3f2-7b37-4619-a679-fd543e5a64cb service nova] Creating event network-changed:a796bed4-ea91-4b67-9c99-c06d55a5bdf9 for instance 3541ba56-07a1-42c5-b8cf-683df0220310 on n-h2-852086-5 Aug 27 04:25:53.503405 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-109b77dc-d6ce-4d7a-a5b6-3c937a7e6ef9 req-3b7cc3f2-7b37-4619-a679-fd543e5a64cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044187 Aug 27 04:25:53.504358 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3656/7592] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:53.620317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:53.629254 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2a54c503-73c8-4ee1-b807-1c252da26db0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1564 microversion: 2.1 time: 0.173518 Aug 27 04:25:53.629836 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3937/7593] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:25:53 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:16.879021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=36 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:26:16.884496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:16.886938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:16.894675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:16.895322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:16.896109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:16.897365 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:16.898046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:16.898555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:16.953251 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a61f51b2-8807-4bb2-ae4b-c2f6e06b25f7 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action" status: 200 len: 24571 microversion: 2.1 time: 0.076026 Aug 27 04:26:16.954384 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3657/7594] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:26:16 2022] POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:26:23.367459 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-747ea5ff-f02b-439d-a349-6ebb1b0bce98 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:23.369637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:26:23.370371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=32 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:26:23.376082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-747ea5ff-f02b-439d-a349-6ebb1b0bce98 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:23.376580 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-747ea5ff-f02b-439d-a349-6ebb1b0bce98 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:23.377020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-747ea5ff-f02b-439d-a349-6ebb1b0bce98 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:23.402615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-747ea5ff-f02b-439d-a349-6ebb1b0bce98 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Going to try to stop instance {{(pid=122407) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 04:26:23.455656 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-747ea5ff-f02b-439d-a349-6ebb1b0bce98 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action" status: 202 len: 0 microversion: 2.1 time: 0.092882 Aug 27 04:26:23.456281 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3938/7595] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:26:23 2022] POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:26:23.466498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:23.467331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:23.476007 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:23.476644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:23.477186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:23.477934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:23.478439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:23.478891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:23.636544 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:23.644633 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e2e3580-1567-419d-ac3f-eca12ec6f5e3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.182472 Aug 27 04:26:23.645780 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3658/7596] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:23 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:26:24.671408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:24.672240 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:24.679252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:24.679754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:24.680188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:24.680965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:24.681426 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:24.681853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:24.829378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:24.837974 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-df058175-2917-463d-9d39-75349e9b3b7e tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.171646 Aug 27 04:26:24.838587 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3939/7597] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:24 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:25.859533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:25.860147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:25.868534 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:25.869033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:25.869483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:25.870221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:25.870723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:25.871160 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:26.011720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:26.019581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-734dbedb-0f35-4d42-bb9b-50b8366a3ff6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.164001 Aug 27 04:26:26.020776 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3659/7598] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:25 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:27.042967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:27.043683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:27.050693 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:27.051868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:27.052432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:27.053146 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:27.053604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:27.054034 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:27.190689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:27.198550 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c99f24da-01df-4710-9b5d-77311913a496 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.159531 Aug 27 04:26:27.199138 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3940/7599] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:27 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:28.220228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:28.220860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:28.228624 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:28.229133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:28.229593 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:28.230354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:28.230829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:28.231275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:28.365477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:28.373327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d79cea9d-d752-4226-bb42-4030c18098d6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.157226 Aug 27 04:26:28.373897 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3660/7600] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:28 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:29.396178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:29.396895 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:29.404117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:29.404605 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:29.405039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:29.405741 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:29.406215 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:29.406646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:29.545269 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:29.553271 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d053097d-73b3-484e-9efc-67dc3bd2adb6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.161909 Aug 27 04:26:29.553863 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3941/7601] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:29 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:30.576922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:30.577587 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:30.585235 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:30.585736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:30.586210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:30.586927 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:30.587397 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:30.587841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:30.724982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:30.732715 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62c64958-c2ef-4b99-ac55-1a3337f19694 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.160049 Aug 27 04:26:30.733294 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3661/7602] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:30 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:31.754963 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:31.756313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:31.763151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:31.763662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:31.764098 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:31.764798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:31.765252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:31.765675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:31.903615 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:31.911731 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f5e03c14-c6dd-4980-afd3-de00e5afee5a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.161404 Aug 27 04:26:31.912304 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3942/7603] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:31 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:32.933597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:32.934184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:32.941320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:32.942356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:32.943106 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:32.943938 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:32.944412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:32.944853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:33.084434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:33.096463 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f13d9c11-925f-497a-a96d-994c6e345e08 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1693 microversion: 2.1 time: 0.167019 Aug 27 04:26:33.097139 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3662/7604] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:32 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:34.118500 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:34.119122 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:34.126252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:34.126739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:34.127175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:34.127866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:34.128322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:34.128745 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:34.265863 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:34.273982 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8436f57e-e1e3-4ac2-a7c9-3205b2e3239b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1670 microversion: 2.1 time: 0.159412 Aug 27 04:26:34.274583 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3943/7605] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:34 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:35.369642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:35.371932 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:35.378897 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:35.379874 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:35.380389 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:35.381211 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:35.381693 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:35.382141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:35.437530 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-484bb7ba-7e2e-41a7-8379-5899aedcf665 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action" status: 200 len: 35617 microversion: 2.1 time: 0.071652 Aug 27 04:26:35.438486 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3663/7606] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:26:35 2022] POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action => generated 35617 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:26:35.451046 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f56c5af5-b25e-46ea-a31a-cc68617b2bcd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:35.458527 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f56c5af5-b25e-46ea-a31a-cc68617b2bcd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:35.459011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f56c5af5-b25e-46ea-a31a-cc68617b2bcd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:35.459450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f56c5af5-b25e-46ea-a31a-cc68617b2bcd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:35.481502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f56c5af5-b25e-46ea-a31a-cc68617b2bcd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Going to try to start instance {{(pid=122407) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 04:26:35.524685 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f56c5af5-b25e-46ea-a31a-cc68617b2bcd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action" status: 202 len: 0 microversion: 2.1 time: 0.077331 Aug 27 04:26:35.525353 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3944/7607] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:26:35 2022] POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:26:35.534261 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:35.535040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:35.543431 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:35.544390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:35.544922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:35.545686 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:35.546275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:35.546723 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:36.110813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:36.119933 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5329321-17bc-4b61-b70a-d7ea9c072a78 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1679 microversion: 2.1 time: 0.589875 Aug 27 04:26:36.120519 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3664/7608] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:35 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1679 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:26:37.143866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:37.144558 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:26:37.152667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:37.153148 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:37.153618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:37.154374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:26:37.154830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:26:37.155253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:26:37.299888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:37.307876 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-837f3bfb-f56e-4408-813a-c82097d9e05f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1683 microversion: 2.1 time: 0.168393 Aug 27 04:26:37.308455 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3945/7609] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:26:37 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:01.501403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:01.503973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:01.507086 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=17 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:01.507868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=44 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:01.515099 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:01.515605 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:01.516063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:01.516784 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:01.517262 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:01.517703 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:01.575542 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99a0e230-6d44-4246-9b47-30061287b23f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action" status: 200 len: 60174 microversion: 2.1 time: 0.078072 Aug 27 04:27:01.576239 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3665/7610] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:27:01 2022] POST /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310/action => generated 60174 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:27:08.652084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:08.652853 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:08.653195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1b2b1178-bd11-4240-a590-c90669809a3c req-ccf99b9e-d195-48a2-a91e-5c803cf3ed83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3541ba56-07a1-42c5-b8cf-683df0220310", "tag": "a796bed4-ea91-4b67-9c99-c06d55a5bdf9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:08.655005 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=16 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:08.655689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:08.665103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:08.665617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:08.666062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:08.666817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:08.667278 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:08.667415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1b2b1178-bd11-4240-a590-c90669809a3c req-ccf99b9e-d195-48a2-a91e-5c803cf3ed83 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:08.667710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:08.667884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1b2b1178-bd11-4240-a590-c90669809a3c req-ccf99b9e-d195-48a2-a91e-5c803cf3ed83 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:08.668549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1b2b1178-bd11-4240-a590-c90669809a3c req-ccf99b9e-d195-48a2-a91e-5c803cf3ed83 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:08.680767 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1b2b1178-bd11-4240-a590-c90669809a3c req-ccf99b9e-d195-48a2-a91e-5c803cf3ed83 service nova] Creating event network-changed:a796bed4-ea91-4b67-9c99-c06d55a5bdf9 for instance 3541ba56-07a1-42c5-b8cf-683df0220310 on n-h2-852086-5 Aug 27 04:27:08.688064 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1b2b1178-bd11-4240-a590-c90669809a3c req-ccf99b9e-d195-48a2-a91e-5c803cf3ed83 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037121 Aug 27 04:27:08.688064 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3666/7611] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:27:08.702925 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:27:08.803051 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8c0757d5-3668-4553-b3c9-0beb888547f0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 204 len: 0 microversion: 2.1 time: 0.154548 Aug 27 04:27:08.806255 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3946/7612] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:27:08 2022] DELETE /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:27:08.816740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:08.817921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:08.825714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:08.826256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:08.826714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:08.827745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:08.828275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:08.828671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:09.077077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:09.086912 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd076818-f475-4a6c-867d-fd8480012d34 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1689 microversion: 2.1 time: 0.275863 Aug 27 04:27:09.087940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3667/7613] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:08 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:10.110681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:10.111385 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:10.114558 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:27:10.114785 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:27:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 (ip 10.222.0.69) !!! Aug 27 04:27:10.121037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:10.121528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:10.121967 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:10.122714 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:10.123173 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:10.123604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:10.325678 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:10.343847 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5702254f-66a8-44a1-9348-fd70ee28bf23 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1689 microversion: 2.1 time: 0.237415 Aug 27 04:27:10.345102 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3947/7614] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:10 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:11.103776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-15316829-d402-4158-9bb2-e4ee5f31eac8 req-5b31eca4-4764-4324-9c49-3f861dc9f6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3541ba56-07a1-42c5-b8cf-683df0220310", "name": "network-vif-deleted", "tag": "a796bed4-ea91-4b67-9c99-c06d55a5bdf9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:11.116822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15316829-d402-4158-9bb2-e4ee5f31eac8 req-5b31eca4-4764-4324-9c49-3f861dc9f6ad service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:11.117334 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15316829-d402-4158-9bb2-e4ee5f31eac8 req-5b31eca4-4764-4324-9c49-3f861dc9f6ad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:11.118453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15316829-d402-4158-9bb2-e4ee5f31eac8 req-5b31eca4-4764-4324-9c49-3f861dc9f6ad service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:11.130592 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-15316829-d402-4158-9bb2-e4ee5f31eac8 req-5b31eca4-4764-4324-9c49-3f861dc9f6ad service nova] Creating event network-vif-deleted:a796bed4-ea91-4b67-9c99-c06d55a5bdf9 for instance 3541ba56-07a1-42c5-b8cf-683df0220310 on n-h2-852086-5 Aug 27 04:27:11.136270 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-15316829-d402-4158-9bb2-e4ee5f31eac8 req-5b31eca4-4764-4324-9c49-3f861dc9f6ad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037076 Aug 27 04:27:11.136974 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3668/7615] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:27:11.370100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:11.370944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:11.378400 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:11.378904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:11.379415 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:11.380063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:11.380528 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:11.380962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:11.416445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:11.416951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:11.417395 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:11.417858 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lazy-loading 'fault' on Instance uuid 3541ba56-07a1-42c5-b8cf-683df0220310 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:27:11.470271 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:11.480768 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b948fdf4-157a-4c85-bbe2-80e89ee84ec3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 200 len: 1355 microversion: 2.1 time: 0.114968 Aug 27 04:27:11.481598 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3948/7616] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:11 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 1355 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:27:12.505001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:12.506480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 3541ba56-07a1-42c5-b8cf-683df0220310] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:12.514109 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:12.514362 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:12.514853 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:12.515576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:12.516044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:12.516485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:12.531883 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] HTTP exception thrown: Instance 3541ba56-07a1-42c5-b8cf-683df0220310 could not be found. Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Request method failure captured: Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 HTTP/1.1 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZuYOza7Jc9OC5f_06Mliz7hha61ic4M-4zGFc8F7J_8Qzlqbdr0peVnrpAlKJi4V1PLnesNCIQYBdIPrFgkoQfwPvfltg2D1_yV0OYe5QswnMEL_b6UbDXGKEwI2dXrBOWSxV4VJw7i__9duokYzmFqXuEUZHHLmIOdF-kM65NLWWc Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9eb70a35cfa545b0b5ae86ca79a632a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}] Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 971282f7495e4a9ab00e8d11c16f73c2 Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 3541ba56-07a1-42c5-b8cf-683df0220310 could not be found. Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '3541ba56-07a1-42c5-b8cf-683df0220310'} Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3541ba56-07a1-42c5-b8cf-683df0220310 could not be found. Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3541ba56-07a1-42c5-b8cf-683df0220310 could not be found. Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:27:12.533564 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3541ba56-07a1-42c5-b8cf-683df0220310 could not be found. Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Returning 404 to user: Instance 3541ba56-07a1-42c5-b8cf-683df0220310 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d88c9bb-05ec-4ed5-9b06-4e8a0cee816d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310" status: 404 len: 111 microversion: 2.1 time: 0.035417 Aug 27 04:27:12.538287 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3669/7617] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:12 2022] GET /compute/v2.1/servers/3541ba56-07a1-42c5-b8cf-683df0220310 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:27:15.931547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2edb17e2-f5c4-414f-aeef-137e73553f66 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '.version_select at 0x7fe456968dc0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:15.960943 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2edb17e2-f5c4-414f-aeef-137e73553f66 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-243130964" status: 202 len: 0 microversion: 2.1 time: 0.033903 Aug 27 04:27:15.963152 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3949/7618] 10.222.0.69 () {58 vars in 1281 bytes} [Sat Aug 27 04:27:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-243130964 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:27:15.995988 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40228cd9-b0c3-46b2-b419-e4e131a5b6ac tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: .version_select at 0x7fe45740cf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-663392456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKmSNHtVzKbgg4Zm++YQ/9hUA0W8+RoijNGCviWePeKOfyti+WwqdycswV1PZoaRNVaa/J2mHlltfY+m/WW11r6F/LUDaVu+NN2dTNBHdM2l/iiQ70x17AkN8CbJYbf0A=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:16.013786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-40228cd9-b0c3-46b2-b419-e4e131a5b6ac tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:27:16.019923 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-40228cd9-b0c3-46b2-b419-e4e131a5b6ac tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:27:16.044464 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40228cd9-b0c3-46b2-b419-e4e131a5b6ac tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052460 Aug 27 04:27:16.045074 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3670/7619] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:27:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:27:21.615672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:21.624738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1013004424", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "networks": [{"uuid": "0ea5c6df-cdc0-4ee1-bed7-13b72dd358e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-663392456", "security_groups": [{"name": "tempest-secgroup-smoke-1772140399"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:21.753399 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] validate_networks() for [('0ea5c6df-cdc0-4ee1-bed7-13b72dd358e5', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:27:22.231614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:27:22.231614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:27:22.231614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:27:22.231614 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:27:22.232026 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:27:22.240806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:22.241551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:22.242019 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:22.242930 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:22.243345 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:22.243976 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:22.272582 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:27:22.280121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Getting quotas for user 971282f7495e4a9ab00e8d11c16f73c2 and project 9eb70a35cfa545b0b5ae86ca79a632a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:27:22.296729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:27:22.299353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:27:22.354756 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-31570041-9fea-477a-8259-58fa466d9d8a tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740765 Aug 27 04:27:22.355532 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3950/7620] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:27:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:27:22.369205 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd555e5a-59ec-48db-931e-1eaf07de3b51 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:22.370840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd555e5a-59ec-48db-931e-1eaf07de3b51 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:22.445751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd555e5a-59ec-48db-931e-1eaf07de3b51 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:22.456010 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd555e5a-59ec-48db-931e-1eaf07de3b51 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1266 microversion: 2.1 time: 0.093362 Aug 27 04:27:22.457142 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3671/7621] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:22 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:23.479746 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:23.481185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:23.494356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:23.497200 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:23.497887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:23.498856 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:23.499484 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:23.501729 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:23.593128 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:23.602090 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4f29ae3-09a4-4d1b-b94e-0ddf835a2fc6 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1326 microversion: 2.1 time: 0.127762 Aug 27 04:27:23.606727 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3951/7622] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:23 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:24.630135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:24.635076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:24.637284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:24.653661 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:24.654212 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:24.654679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:24.655424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:24.655929 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:24.656381 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:24.879233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:24.888602 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c9b698f8-ba6c-4cb0-b7e4-f45aadd07a3b tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1392 microversion: 2.1 time: 0.267733 Aug 27 04:27:24.889200 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3672/7623] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:24 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:25.095625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f7dc8fda-3bc6-4f5c-8e17-f389f884a665 req-81e15d8f-917d-4ac4-b5a7-0548df7cea0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226a82c4-ba42-455d-b12b-177bfc4e9a63", "tag": "b133d8e4-c0b8-461c-a8e0-c20a9d6becbb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:25.108689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f7dc8fda-3bc6-4f5c-8e17-f389f884a665 req-81e15d8f-917d-4ac4-b5a7-0548df7cea0c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:25.109274 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f7dc8fda-3bc6-4f5c-8e17-f389f884a665 req-81e15d8f-917d-4ac4-b5a7-0548df7cea0c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:25.109781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f7dc8fda-3bc6-4f5c-8e17-f389f884a665 req-81e15d8f-917d-4ac4-b5a7-0548df7cea0c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:25.123728 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f7dc8fda-3bc6-4f5c-8e17-f389f884a665 req-81e15d8f-917d-4ac4-b5a7-0548df7cea0c service nova] Creating event network-changed:b133d8e4-c0b8-461c-a8e0-c20a9d6becbb for instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 on n-h2-852086-5 Aug 27 04:27:25.128988 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f7dc8fda-3bc6-4f5c-8e17-f389f884a665 req-81e15d8f-917d-4ac4-b5a7-0548df7cea0c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036875 Aug 27 04:27:25.129655 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3952/7624] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:27:25.911690 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:25.912668 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:25.920193 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:25.920696 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:25.921147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:25.921862 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:25.922366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:25.922806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:26.063917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:26.072542 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2ac818a-764b-46cf-b4e8-75b166570b6d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1392 microversion: 2.1 time: 0.165565 Aug 27 04:27:26.073114 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3673/7625] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:25 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:27.094910 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:27.095609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:27.101738 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:27.102919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:27.103751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:27.104286 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:27.104740 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:27.105165 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:27.243579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:27.251357 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0ccfd8c5-89aa-4757-bcce-07b3a134ebbd tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1392 microversion: 2.1 time: 0.161590 Aug 27 04:27:27.251933 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3953/7626] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:27 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:28.271840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:28.272498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:28.279335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:28.283844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:28.283844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:28.283844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:28.283844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:28.283844 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:28.427267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:28.436126 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bec70cd-f2dc-4c54-9816-5814523b6b44 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1392 microversion: 2.1 time: 0.168324 Aug 27 04:27:28.436719 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3674/7627] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:28 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:29.456954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:29.457572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:29.465153 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:29.465637 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:29.466077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:29.466804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:29.467258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:29.467680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:29.603891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:29.613098 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0eca5389-9007-4ab7-b6a3-9655fa5ba52c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1392 microversion: 2.1 time: 0.160193 Aug 27 04:27:29.613931 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3954/7628] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:29 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:29.774899 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-cec2348f-4a72-4d28-a793-649876256661 req-c1cfde6e-bd40-4351-b399-78770b2ebbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226a82c4-ba42-455d-b12b-177bfc4e9a63", "name": "network-vif-plugged", "status": "completed", "tag": "b133d8e4-c0b8-461c-a8e0-c20a9d6becbb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:29.786118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cec2348f-4a72-4d28-a793-649876256661 req-c1cfde6e-bd40-4351-b399-78770b2ebbb1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:29.787776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cec2348f-4a72-4d28-a793-649876256661 req-c1cfde6e-bd40-4351-b399-78770b2ebbb1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:29.787776 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cec2348f-4a72-4d28-a793-649876256661 req-c1cfde6e-bd40-4351-b399-78770b2ebbb1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:29.799174 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-cec2348f-4a72-4d28-a793-649876256661 req-c1cfde6e-bd40-4351-b399-78770b2ebbb1 service nova] Creating event network-vif-plugged:b133d8e4-c0b8-461c-a8e0-c20a9d6becbb for instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 on n-h2-852086-5 Aug 27 04:27:29.804327 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-cec2348f-4a72-4d28-a793-649876256661 req-c1cfde6e-bd40-4351-b399-78770b2ebbb1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Aug 27 04:27:29.805063 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3675/7629] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:27:30.635302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:30.635954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:30.643038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:30.643534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:30.643977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:30.644688 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:30.645154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:30.645576 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:30.792325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:30.802753 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3ab6aff4-3acf-44a7-be19-54737e1376c3 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1392 microversion: 2.1 time: 0.172166 Aug 27 04:27:30.803337 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3955/7630] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:30 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:31.825673 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:31.826425 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:31.828662 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:31.843975 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:31.844517 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:31.845122 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:31.845814 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:31.846329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:31.846773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:31.986612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:31.994702 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13e1874c-5964-4af3-b207-9bbb3f0bbe49 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1563 microversion: 2.1 time: 0.174420 Aug 27 04:27:31.995298 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3676/7631] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:31 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:27:32.015947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:32.016707 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:32.023732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:32.024861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:32.025303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:32.026175 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:32.026661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:32.027089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:32.164452 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:32.172714 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d08f4f7e-7481-46cb-824c-f565722df714 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1563 microversion: 2.1 time: 0.160493 Aug 27 04:27:32.173306 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3956/7632] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:32 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:33.768264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:33.768893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:33.770818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:33.772082 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:33.773337 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:33.779167 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:33.779675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:33.780120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:33.780865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:33.781411 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:33.781910 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:33.830559 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-ca5baf42-e89c-4c80-a81e-656507fed5e4 req-b35b49d9-2115-4fd3-995e-f399e99e1bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226a82c4-ba42-455d-b12b-177bfc4e9a63", "tag": "b133d8e4-c0b8-461c-a8e0-c20a9d6becbb"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:33.840904 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ca5baf42-e89c-4c80-a81e-656507fed5e4 req-b35b49d9-2115-4fd3-995e-f399e99e1bb1 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:33.841392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ca5baf42-e89c-4c80-a81e-656507fed5e4 req-b35b49d9-2115-4fd3-995e-f399e99e1bb1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:33.841825 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-ca5baf42-e89c-4c80-a81e-656507fed5e4 req-b35b49d9-2115-4fd3-995e-f399e99e1bb1 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:33.853298 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-ca5baf42-e89c-4c80-a81e-656507fed5e4 req-b35b49d9-2115-4fd3-995e-f399e99e1bb1 service nova] Creating event network-changed:b133d8e4-c0b8-461c-a8e0-c20a9d6becbb for instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 on n-h2-852086-5 Aug 27 04:27:33.858984 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-ca5baf42-e89c-4c80-a81e-656507fed5e4 req-b35b49d9-2115-4fd3-995e-f399e99e1bb1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092728 Aug 27 04:27:33.859586 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3957/7633] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:27:33.964907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:27:33.973875 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5877fac6-0cb8-4947-980a-f45f91e06cab tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1563 microversion: 2.1 time: 0.210013 Aug 27 04:27:33.983722 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3677/7634] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:27:33 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:27:55.225416 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:55.226302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=36 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:55.231403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:27:55.233712 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:27:55.241376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:55.241762 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:55.242205 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:55.242906 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:27:55.243358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:27:55.243791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:27:55.300772 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8f29261c-d38a-4dce-9217-58288070c8b9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action" status: 200 len: 24569 microversion: 2.1 time: 0.077076 Aug 27 04:27:55.301438 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3958/7635] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:27:55 2022] POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action => generated 24569 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:28:06.016699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:06.018391 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:06.021578 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:06.022306 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:06.025860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:06.026401 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:06.027426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:06.028450 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:06.028918 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:06.029394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:06.054896 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lazy-loading 'flavor' on Instance uuid 226a82c4-ba42-455d-b12b-177bfc4e9a63 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:28:06.136952 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80c4ac87-10ae-4793-badd-742ddcafd61c tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action" status: 202 len: 0 microversion: 2.1 time: 0.125788 Aug 27 04:28:06.137650 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3678/7636] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:28:06 2022] POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:28:06.146706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:06.147475 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:06.150775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=4 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:06.151039 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:06.157767 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:06.158319 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:06.158764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:06.159487 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:06.159947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:06.160377 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:06.324672 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:06.337798 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9b3c4c9e-e0db-4775-a7af-95d491b8267d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1690 microversion: 2.1 time: 0.195143 Aug 27 04:28:06.338746 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3959/7637] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:06 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:07.362598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:07.363312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:07.369597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:07.370096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:07.371424 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:07.372121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:07.372596 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:07.373098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:07.505954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:07.514296 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-196795dc-1341-45be-b7c0-d58b7864a9d9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1673 microversion: 2.1 time: 0.156825 Aug 27 04:28:07.514865 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3679/7638] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:07 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:08.612226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:08.614503 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:08.623108 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:08.623592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:08.624086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:08.624783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:08.625238 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:08.625660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:08.680871 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f904a002-3d7f-4219-b770-03c88be836f9 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action" status: 200 len: 38390 microversion: 2.1 time: 0.072370 Aug 27 04:28:08.681569 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3960/7639] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:28:08 2022] POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action => generated 38390 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:28:08.694442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:08.695026 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:08.701939 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:08.702473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:08.702925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:08.703635 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:08.704369 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:08.704809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:08.772550 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4f492ae-c400-40aa-961c-e2ceaf7ed796 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action" status: 202 len: 0 microversion: 2.1 time: 0.081825 Aug 27 04:28:08.776313 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3680/7640] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:28:08 2022] POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:28:08.782256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:08.782965 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:08.790050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:08.790509 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:08.790954 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:08.791667 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:08.792129 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:08.793315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:08.942640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:08.951848 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b3844486-4ee1-4938-ad4a-16ed2c34ed75 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1679 microversion: 2.1 time: 0.173975 Aug 27 04:28:08.952441 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3961/7641] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:08 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:09.976403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:09.977125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:09.983719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:09.984222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:09.984679 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:09.985398 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:09.985872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:09.986355 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:10.151689 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:10.160443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1894d82f-4616-492d-bd51-043021e9d7af tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1679 microversion: 2.1 time: 0.189126 Aug 27 04:28:10.161053 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3681/7642] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:09 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:11.192946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:11.193544 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:11.201268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:11.201759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:11.202219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:11.202931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:11.203389 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:11.203817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:11.349565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:11.358810 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9b6adcaa-5426-4f1e-a76d-2f898ad25af0 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1682 microversion: 2.1 time: 0.169757 Aug 27 04:28:11.360219 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3962/7643] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:11 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:11.459486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:11.461822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:11.470303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:11.470842 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:11.471266 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:11.472175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:11.472642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:11.473104 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:11.520613 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1942935-1a67-49e4-9fd7-7c9f481dbb95 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action" status: 200 len: 38390 microversion: 2.1 time: 0.064987 Aug 27 04:28:11.521288 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3682/7644] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:28:11 2022] POST /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63/action => generated 38390 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:28:12.578631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:12.579435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:12.583714 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-630f47d6-b737-4b19-b2a7-91c45e6a2751 req-2d5abfa2-954f-4931-bf62-2b8b418d241a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226a82c4-ba42-455d-b12b-177bfc4e9a63", "tag": "b133d8e4-c0b8-461c-a8e0-c20a9d6becbb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:12.589752 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:12.590298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:12.590749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:12.592123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:12.592123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:12.592410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:12.610967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-630f47d6-b737-4b19-b2a7-91c45e6a2751 req-2d5abfa2-954f-4931-bf62-2b8b418d241a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:12.611480 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-630f47d6-b737-4b19-b2a7-91c45e6a2751 req-2d5abfa2-954f-4931-bf62-2b8b418d241a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:12.611931 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-630f47d6-b737-4b19-b2a7-91c45e6a2751 req-2d5abfa2-954f-4931-bf62-2b8b418d241a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:12.619860 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:28:12.625574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-630f47d6-b737-4b19-b2a7-91c45e6a2751 req-2d5abfa2-954f-4931-bf62-2b8b418d241a service nova] Creating event network-changed:b133d8e4-c0b8-461c-a8e0-c20a9d6becbb for instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 on n-h2-852086-5 Aug 27 04:28:12.634571 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-630f47d6-b737-4b19-b2a7-91c45e6a2751 req-2d5abfa2-954f-4931-bf62-2b8b418d241a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053094 Aug 27 04:28:12.634571 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3683/7645] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:28:12.711910 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ca6245f5-9c9a-490c-ac30-f846e50a81bc tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 204 len: 0 microversion: 2.1 time: 0.137811 Aug 27 04:28:12.719825 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3963/7646] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:28:12 2022] DELETE /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:28:12.727490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:12.727490 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:12.735186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:12.735719 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:12.736179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:12.737345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:12.737449 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:12.737810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:13.261081 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:13.269332 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a55b6597-372c-4e83-9bbf-e10d9d1976e1 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1688 microversion: 2.1 time: 0.549458 Aug 27 04:28:13.269922 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3684/7647] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:12 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1688 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:14.293758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:14.294538 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:14.302076 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:14.302775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:14.303302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:14.303973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:14.304428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:14.304854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:14.460997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:14.470193 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4916efa8-c9a6-4134-84fe-4e31f15676a2 tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1688 microversion: 2.1 time: 0.181531 Aug 27 04:28:14.470878 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3964/7648] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:14 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:15.090441 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-95e731cb-31b0-4aca-bdbe-8df6ea1babda req-5e61afa0-193e-44d1-b78e-3e55764ee367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226a82c4-ba42-455d-b12b-177bfc4e9a63", "name": "network-vif-deleted", "tag": "b133d8e4-c0b8-461c-a8e0-c20a9d6becbb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:15.102863 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-95e731cb-31b0-4aca-bdbe-8df6ea1babda req-5e61afa0-193e-44d1-b78e-3e55764ee367 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:15.103405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-95e731cb-31b0-4aca-bdbe-8df6ea1babda req-5e61afa0-193e-44d1-b78e-3e55764ee367 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:15.103859 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-95e731cb-31b0-4aca-bdbe-8df6ea1babda req-5e61afa0-193e-44d1-b78e-3e55764ee367 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:15.115636 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-95e731cb-31b0-4aca-bdbe-8df6ea1babda req-5e61afa0-193e-44d1-b78e-3e55764ee367 service nova] Creating event network-vif-deleted:b133d8e4-c0b8-461c-a8e0-c20a9d6becbb for instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 on n-h2-852086-5 Aug 27 04:28:15.123263 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-95e731cb-31b0-4aca-bdbe-8df6ea1babda req-5e61afa0-193e-44d1-b78e-3e55764ee367 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038444 Aug 27 04:28:15.123912 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3685/7649] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:28:15.493156 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:15.493901 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:15.501514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:15.502001 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:15.502481 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:15.503195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:15.503647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:15.504072 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:15.543794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:15.548197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:15.548197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:15.548197 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lazy-loading 'fault' on Instance uuid 226a82c4-ba42-455d-b12b-177bfc4e9a63 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:28:15.590932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971282f7495e4a9ab00e8d11c16f73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb70a35cfa545b0b5ae86ca79a632a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:15.598650 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-98f9951b-f009-4ab0-a4fb-e86a6b041cef tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 200 len: 1356 microversion: 2.1 time: 0.109790 Aug 27 04:28:15.599226 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3965/7650] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:15 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:16.623200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:16.623921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] [instance: 226a82c4-ba42-455d-b12b-177bfc4e9a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:16.630448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:16.630952 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:16.631407 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:16.632124 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:16.632597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:16.633042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:16.647487 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] HTTP exception thrown: Instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 could not be found. Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Request method failure captured: Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 HTTP/1.1 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZuYOza7Jc9OC5f_06Mliz7hha61ic4M-4zGFc8F7J_8Qzlqbdr0peVnrpAlKJi4V1PLnesNCIQYBdIPrFgkoQfwPvfltg2D1_yV0OYe5QswnMEL_b6UbDXGKEwI2dXrBOWSxV4VJw7i__9duokYzmFqXuEUZHHLmIOdF-kM65NLWWc Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9eb70a35cfa545b0b5ae86ca79a632a5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9eb70a35cfa545b0b5ae86ca79a632a5"}]}] Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 9eb70a35cfa545b0b5ae86ca79a632a5 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2018629606 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 971282f7495e4a9ab00e8d11c16f73c2 Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2018629606-project Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 could not be found. Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '226a82c4-ba42-455d-b12b-177bfc4e9a63'} Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 could not be found. Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 could not be found. Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:28:16.649156 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 could not be found. Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Returning 404 to user: Instance 226a82c4-ba42-455d-b12b-177bfc4e9a63 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e06ea936-2fcb-42c3-b4b5-e145a37e2e0d tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63" status: 404 len: 111 microversion: 2.1 time: 0.033293 Aug 27 04:28:16.654011 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3686/7651] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:16 2022] GET /compute/v2.1/servers/226a82c4-ba42-455d-b12b-177bfc4e9a63 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:28:19.682628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f4efe7cf-635e-4e6a-957b-ba29f8788f0f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] Calling method '.version_select at 0x7fe4578ccd30>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:19.711180 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f4efe7cf-635e-4e6a-957b-ba29f8788f0f tempest-TestNetworkAdvancedServerOps-2018629606 tempest-TestNetworkAdvancedServerOps-2018629606-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-663392456" status: 202 len: 0 microversion: 2.1 time: 0.033477 Aug 27 04:28:19.711782 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3966/7652] 10.222.0.69 () {58 vars in 1281 bytes} [Sat Aug 27 04:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-663392456 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:28:31.237273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=18 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:31.238033 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:31.435951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b16b62c5-3a16-42e9-bf71-66d89fec4e89 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'create', calling method: .version_select at 0x7fe43c739f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-87930893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFnbRPSnRspDhNc362PWj8ZtXU2ySwMRwl0VRJE0mnXyoNXo6gGLqMJyshHO5aiOVMSdbYzKsYj/amkcJ3jaajitvIgqgxGoC4WYg0X0IqItYoxUV8YRGg2anEWNe2a7w=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:31.455073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b16b62c5-3a16-42e9-bf71-66d89fec4e89 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:28:31.460815 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b16b62c5-3a16-42e9-bf71-66d89fec4e89 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for user 927ff4f71f684cf7ae50a9b345b2645b and project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:28:31.488850 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b16b62c5-3a16-42e9-bf71-66d89fec4e89 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.258823 Aug 27 04:28:31.489461 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3687/7653] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:28:31 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:28:32.532631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:32.535180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:32.540284 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1835286341", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-87930893", "security_groups": [{"name": "tempest-secgroup-smoke-912924105"}], "networks": [{"uuid": "1f2d7523-4003-4c1c-b41f-7780a11d8d57"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:32.663059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] validate_networks() for [('1f2d7523-4003-4c1c-b41f-7780a11d8d57', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:28:33.079372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:28:33.080178 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:28:33.080717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:28:33.081193 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:28:33.081674 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:28:33.091158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:33.091642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:33.092084 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:33.093514 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:33.093894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:33.094373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:33.113980 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:28:33.119956 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for user 927ff4f71f684cf7ae50a9b345b2645b and project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:28:33.133320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:28:33.135711 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:28:33.186065 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-91be49b6-ca7c-41e3-aa8c-cbd6ce689cee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.655448 Aug 27 04:28:33.186965 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3967/7654] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:28:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:28:33.199608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4543cdba-c1d3-448c-a85d-e103bef9538a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:33.200346 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4543cdba-c1d3-448c-a85d-e103bef9538a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:33.276058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4543cdba-c1d3-448c-a85d-e103bef9538a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:33.283920 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4543cdba-c1d3-448c-a85d-e103bef9538a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1245 microversion: 2.1 time: 0.089629 Aug 27 04:28:33.284487 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3688/7655] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:33 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:34.304826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-caff5d4f-44b6-4d5b-92e1-f0dfa2125a8a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:34.305445 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-caff5d4f-44b6-4d5b-92e1-f0dfa2125a8a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:34.372063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-caff5d4f-44b6-4d5b-92e1-f0dfa2125a8a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:34.379630 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-caff5d4f-44b6-4d5b-92e1-f0dfa2125a8a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1245 microversion: 2.1 time: 0.078710 Aug 27 04:28:34.380255 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3968/7656] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:34 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:35.401264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-892e8233-ce2e-438f-9d85-6bdc6611d74d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:35.401919 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-892e8233-ce2e-438f-9d85-6bdc6611d74d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:35.458837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-892e8233-ce2e-438f-9d85-6bdc6611d74d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:35.466250 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-892e8233-ce2e-438f-9d85-6bdc6611d74d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1245 microversion: 2.1 time: 0.068986 Aug 27 04:28:35.467444 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3689/7657] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:35 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:36.488397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:36.489715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:36.497730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:36.498324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:36.498747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:36.499730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:36.500456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:36.501063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:36.576320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:36.584932 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d4de25f0-af03-4a00-afb6-63b14f15a8b9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1315 microversion: 2.1 time: 0.101090 Aug 27 04:28:36.586197 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3969/7658] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:36 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1315 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:37.607621 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:37.608253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:37.615228 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:37.615722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:37.616299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:37.617014 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:37.617478 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:37.617911 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:37.862135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:37.870116 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-130d19b7-23ad-422f-b088-6bc020f190ae tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1370 microversion: 2.1 time: 0.267548 Aug 27 04:28:37.871070 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3690/7659] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:37 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:38.035456 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-3eee8064-1559-4ba5-a281-2858180975ad req-c6b5eb7e-bfd0-4a7f-a2a0-426c29b4418d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:38.046137 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3eee8064-1559-4ba5-a281-2858180975ad req-c6b5eb7e-bfd0-4a7f-a2a0-426c29b4418d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:38.046656 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3eee8064-1559-4ba5-a281-2858180975ad req-c6b5eb7e-bfd0-4a7f-a2a0-426c29b4418d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:38.047094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-3eee8064-1559-4ba5-a281-2858180975ad req-c6b5eb7e-bfd0-4a7f-a2a0-426c29b4418d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:38.058768 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-3eee8064-1559-4ba5-a281-2858180975ad req-c6b5eb7e-bfd0-4a7f-a2a0-426c29b4418d service nova] Creating event network-changed:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:28:38.063925 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-3eee8064-1559-4ba5-a281-2858180975ad req-c6b5eb7e-bfd0-4a7f-a2a0-426c29b4418d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110372 Aug 27 04:28:38.064738 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3970/7660] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:28:38.891579 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:38.892676 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:38.899275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:38.899786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:38.900236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:38.900974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:38.901442 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:38.902678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:39.049237 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:39.057246 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6bdd13fa-b0dc-4ac1-a289-07ca6566e1f3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1370 microversion: 2.1 time: 0.169482 Aug 27 04:28:39.057829 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3691/7661] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:38 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:40.080922 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:40.085864 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:40.095261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:40.096131 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:40.097048 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:40.098080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:40.099077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:40.099851 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:40.244564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:40.252738 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a190e337-5788-49fc-899c-b3d72ba50586 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1370 microversion: 2.1 time: 0.176876 Aug 27 04:28:40.253471 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3971/7662] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:40 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:41.274076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:41.274722 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:41.282930 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:41.283436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:41.283889 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:41.284634 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:41.285108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:41.285553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:41.421379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:41.429153 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03d4bebd-50c8-43ef-9493-1e5ccb472836 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1370 microversion: 2.1 time: 0.159016 Aug 27 04:28:41.429738 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3692/7663] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:41 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:42.067781 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-575dc8c4-108f-4eae-bd5a-f0aca43327a5 req-e1e671bb-9e2b-4aeb-b352-fd222d22139a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "name": "network-vif-plugged", "status": "completed", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:42.079208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-575dc8c4-108f-4eae-bd5a-f0aca43327a5 req-e1e671bb-9e2b-4aeb-b352-fd222d22139a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:42.079855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-575dc8c4-108f-4eae-bd5a-f0aca43327a5 req-e1e671bb-9e2b-4aeb-b352-fd222d22139a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:42.080543 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-575dc8c4-108f-4eae-bd5a-f0aca43327a5 req-e1e671bb-9e2b-4aeb-b352-fd222d22139a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:42.092391 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-575dc8c4-108f-4eae-bd5a-f0aca43327a5 req-e1e671bb-9e2b-4aeb-b352-fd222d22139a service nova] Creating event network-vif-plugged:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:28:42.097471 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-575dc8c4-108f-4eae-bd5a-f0aca43327a5 req-e1e671bb-9e2b-4aeb-b352-fd222d22139a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Aug 27 04:28:42.098094 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3972/7664] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:28:42.452051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:42.454187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:42.464516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:42.465084 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:42.465576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:42.466339 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:42.466847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:42.467294 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:42.614893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:42.624434 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-354c3e5e-1819-48f9-b346-0a241e28e32e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1370 microversion: 2.1 time: 0.176653 Aug 27 04:28:42.625021 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3693/7665] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:42 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:43.644569 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:43.648854 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:43.649547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:43.656557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:43.657038 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:43.657471 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:43.658188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:43.658640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:43.659062 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:43.794973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:43.802814 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-36b819ca-601b-4d0e-b4f4-370184832a59 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1554 microversion: 2.1 time: 0.160245 Aug 27 04:28:43.803406 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3973/7666] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:43 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:43.827538 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:43.828216 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:28:43.836716 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:43.837287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:43.837749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:43.838713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:43.839310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:43.839987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:43.973373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:28:43.981231 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46974235-4f1f-42e4-9539-f077ff259521 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1554 microversion: 2.1 time: 0.161481 Aug 27 04:28:43.981815 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3694/7667] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:28:43 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:28:45.997051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-4dcc7921-88f1-4fbe-a110-698faac5c21b req-eb5ca903-cbac-4c43-8a9f-b62cb5e0975a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:28:46.001820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:46.008630 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4dcc7921-88f1-4fbe-a110-698faac5c21b req-eb5ca903-cbac-4c43-8a9f-b62cb5e0975a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:28:46.009120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4dcc7921-88f1-4fbe-a110-698faac5c21b req-eb5ca903-cbac-4c43-8a9f-b62cb5e0975a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:28:46.009561 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-4dcc7921-88f1-4fbe-a110-698faac5c21b req-eb5ca903-cbac-4c43-8a9f-b62cb5e0975a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:28:46.021911 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-4dcc7921-88f1-4fbe-a110-698faac5c21b req-eb5ca903-cbac-4c43-8a9f-b62cb5e0975a service nova] Creating event network-changed:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:28:46.027345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-4dcc7921-88f1-4fbe-a110-698faac5c21b req-eb5ca903-cbac-4c43-8a9f-b62cb5e0975a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034410 Aug 27 04:28:46.029135 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3974/7668] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:43.631111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:43.632220 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:30:43.632381 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036/action (ip 10.222.0.69) !!! Aug 27 04:30:43.633561 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:30:43.633684 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036/action (ip 10.222.0.69) !!! Aug 27 04:30:43.634608 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:30:43.634730 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036/action (ip 10.222.0.69) !!! Aug 27 04:30:43.635638 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:43.636320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=30 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:43.640942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:43.641489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:43.656797 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:43.657289 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:43.657735 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:43.658485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:43.658946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:43.659379 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:43.685373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lazy-loading 'flavor' on Instance uuid 0a806f92-59ad-490c-9ad4-c1633d477036 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:30:43.869872 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-922c57e1-3443-4d3c-9ca6-aedbbe0e2b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036/action" status: 202 len: 0 microversion: 2.1 time: 0.241243 Aug 27 04:30:43.870588 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3695/7669] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:30:43 2022] POST /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:30:43.877218 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:30:43.879288 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:43.880116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=26 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:43.885725 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:43.886570 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:43.894138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:43.894657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:43.895095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:43.895812 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:43.896277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:43.896696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:44.047961 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:44.056748 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-10408768-4ee2-4521-b1d0-6b6a521c0ad6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.181395 Aug 27 04:30:44.057351 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3975/7670] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:43 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:45.080190 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:45.080912 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:45.088767 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:45.089275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:45.089733 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:45.090496 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:45.090972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:45.091418 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:45.225135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:45.233638 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06b57f39-2644-4662-a97f-3c06c91b7265 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.158752 Aug 27 04:30:45.234251 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3696/7671] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:45 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:46.255009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:46.256264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:46.264335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:46.264819 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:46.265253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:46.265951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:46.266428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:46.266849 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:46.284109 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 42850. Aug 27 04:30:46.413230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:46.421219 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2dd493ea-ab74-40ca-8ae3-3c54c99cb2c2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.170104 Aug 27 04:30:46.421789 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3976/7672] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:46 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:47.443080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:47.443748 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:47.451296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:47.451798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:47.452243 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:47.452946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:47.453412 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:47.453866 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:47.596474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:47.604347 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ffe7ff6-7e92-4372-bc08-c44fa4bae80a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.165181 Aug 27 04:30:47.604926 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3697/7673] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:47 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:48.625743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:48.626387 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:48.633468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:48.633942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:48.634411 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:48.635114 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:48.635571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:48.635996 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:48.775497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:48.783723 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7b489743-95f6-439b-be9b-1fbb4532a437 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.161860 Aug 27 04:30:48.784245 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3977/7674] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:48 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:49.806832 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:49.807428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:49.814500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:49.814996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:49.815444 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:49.816150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:49.816616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:49.817052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:49.955132 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:49.963384 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cec8a5b2-cd24-407c-9d8d-52cf09e54ea2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.160929 Aug 27 04:30:49.963959 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3698/7675] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:49 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:50.984322 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:50.984940 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:50.991732 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:50.992222 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:50.992668 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:50.993431 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:50.993888 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:50.994350 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:51.124721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:51.132427 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1923441d-de5c-457c-ac79-779be16fea79 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.152052 Aug 27 04:30:51.133711 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3978/7676] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:50 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:52.154329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:52.154886 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:52.161685 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:52.162203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:52.162655 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:52.163359 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:52.163825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:52.164958 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:52.301870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:52.310745 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-92e47b43-799c-47f4-a2cb-5623fc7e86d6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.160429 Aug 27 04:30:52.311323 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3699/7677] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:52 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:53.332164 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:53.332839 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:53.340777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:53.341261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:53.341698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:53.342429 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:53.342887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:53.343313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:53.480892 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:53.488769 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-465d029c-3764-4962-9660-db1b77f38458 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.160475 Aug 27 04:30:53.489349 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3979/7678] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:53 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:54.511000 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:54.511652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:54.519786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:54.520291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:54.520739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:54.521465 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:54.521933 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:54.522486 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:54.664416 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:54.673066 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e81c067e-0256-4c84-bd70-8ea405ad3934 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1699 microversion: 2.1 time: 0.167056 Aug 27 04:30:54.673665 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3700/7679] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:54 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:55.695384 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:55.696642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:55.704747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:55.705242 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:55.705679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:55.706905 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:55.707498 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:55.707927 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:55.863412 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:55.872292 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e50d3bdc-d26b-49da-889d-052c729b49f8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1699 microversion: 2.1 time: 0.180793 Aug 27 04:30:55.872877 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3980/7680] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:55 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1699 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:56.893881 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:56.894825 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:56.904755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:56.905536 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:56.906134 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:56.907203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:56.907795 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:56.908400 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:57.068312 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:57.078581 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9094e87-ccfc-4f47-9857-fb6dbcc25b8c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.188653 Aug 27 04:30:57.094137 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3701/7681] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:56 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:58.101294 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:58.102936 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:58.110321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:58.111081 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:58.111763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:58.112616 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:58.116626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:58.116626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:58.281313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:58.291210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2cff010-3b20-4b4d-9d5b-f1f226cc18e6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.193655 Aug 27 04:30:58.294502 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3981/7682] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:58 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:30:58.894877 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e79f3191-1583-4919-a96f-0e6f9cabec93 req-5f0f7830-fdaa-4192-9473-3bf2dcc7b364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "name": "network-vif-plugged", "status": "completed", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:58.910185 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e79f3191-1583-4919-a96f-0e6f9cabec93 req-5f0f7830-fdaa-4192-9473-3bf2dcc7b364 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:58.910982 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e79f3191-1583-4919-a96f-0e6f9cabec93 req-5f0f7830-fdaa-4192-9473-3bf2dcc7b364 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:58.911921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e79f3191-1583-4919-a96f-0e6f9cabec93 req-5f0f7830-fdaa-4192-9473-3bf2dcc7b364 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:58.924607 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e79f3191-1583-4919-a96f-0e6f9cabec93 req-5f0f7830-fdaa-4192-9473-3bf2dcc7b364 service nova] Creating event network-vif-plugged:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:30:58.931655 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e79f3191-1583-4919-a96f-0e6f9cabec93 req-5f0f7830-fdaa-4192-9473-3bf2dcc7b364 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132694 Aug 27 04:30:58.932279 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3702/7683] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:59.316982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:59.317638 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:30:59.325303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:59.326121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:59.326589 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:59.327312 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:30:59.327773 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:30:59.328203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:30:59.484881 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:59.493183 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a04be2f-2268-4900-8942-d8d0bf6f172a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.180295 Aug 27 04:30:59.493932 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3982/7684] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:30:59 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:00.515753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:00.517549 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:00.526505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:00.527487 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:00.528023 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:00.528816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:00.529352 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:00.529917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:00.687199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:00.695179 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3016c7e-fff9-4d0e-ade8-6df5577f0679 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.183531 Aug 27 04:31:00.696283 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3703/7685] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:00 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:01.721575 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:01.722407 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:01.730135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:01.730694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:01.731199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:01.732627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:01.732627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:01.733243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:01.901206 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:01.911050 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-32d3b5c8-f65f-4a71-81f2-e0786ab31612 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.193114 Aug 27 04:31:01.926370 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3983/7686] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:01 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:02.935553 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:02.936920 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:02.943864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:02.947311 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:02.947831 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:02.949335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:02.949335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:02.949769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:03.111173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:03.120942 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea2ef4ad-9a07-4dd7-a42f-f186439b0446 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.189267 Aug 27 04:31:03.126226 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3704/7687] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:02 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:04.143320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:04.147233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:04.155915 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:04.156413 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:04.156852 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:04.157568 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:04.158056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:04.158564 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:04.319348 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:04.328298 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4f47aabe-66b5-4a99-828c-9192ef5a26ef tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.188685 Aug 27 04:31:04.329592 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3984/7688] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:04 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:05.351423 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:05.353745 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:05.363826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:05.365408 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:05.365870 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:05.366664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:05.367402 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:05.368575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:05.519971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:05.535453 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f288258-ac23-4af2-8236-836d0e583a4e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1694 microversion: 2.1 time: 0.188255 Aug 27 04:31:05.546805 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3705/7689] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:05 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:06.558939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:06.559571 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:06.567696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:06.568609 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:06.569162 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:06.569873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:06.570631 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:06.571338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:06.733024 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:06.742179 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-94018356-a87c-4a51-a73c-c9cf1481dfd8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1676 microversion: 2.1 time: 0.189086 Aug 27 04:31:06.743578 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3985/7690] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:06 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:07.765287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:07.765924 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:07.773053 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:07.774284 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:07.774855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:07.775617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:07.776090 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:07.776533 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:07.921248 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:07.929195 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a8ba7fe-6a2d-4d59-8893-440ebbac125f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1676 microversion: 2.1 time: 0.167937 Aug 27 04:31:07.929794 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3706/7691] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:07 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:08.951855 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:08.952592 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:08.960229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:08.960764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:08.961324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:08.962808 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:08.963325 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:08.963775 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:09.101684 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:09.109551 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fa22c04-fe2f-4a3e-bdad-bc1796bd579d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1619 microversion: 2.1 time: 0.161918 Aug 27 04:31:09.110128 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3986/7692] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:08 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1619 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:09.129865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:09.130706 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:09.139110 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:09.139626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:09.140088 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:09.140957 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:09.141551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:09.142001 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:09.233674 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122408) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 04:31:09.301703 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4fa48522-fa8d-41a4-a86a-0a8bbd06ca27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036/action" status: 202 len: 0 microversion: 2.1 time: 0.175898 Aug 27 04:31:09.302335 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3707/7693] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:31:09 2022] POST /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:09.310606 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:09.311223 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:09.317276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:09.317772 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:09.318224 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:09.318935 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:09.319390 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:09.319817 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:09.457401 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:09.466204 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-94045d2e-cb8b-463b-ab68-d3e482ad9bd5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1627 microversion: 2.1 time: 0.159431 Aug 27 04:31:09.466888 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3987/7694] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:09 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1627 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:10.489428 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:10.490010 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:10.496589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:10.497096 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:10.497546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:10.498296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:10.498764 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:10.499244 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:10.672189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:10.680248 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf88d7e2-8dde-4b49-bcb4-05e0125fce9e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.195701 Aug 27 04:31:10.680943 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3708/7695] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:10 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:10.983314 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b79ea462-97dd-40f5-bf37-a51c299081a7 req-00904cb5-2d0b-4ae1-b7d7-ee447119eb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "name": "network-vif-unplugged", "status": "completed", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:10.997541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b79ea462-97dd-40f5-bf37-a51c299081a7 req-00904cb5-2d0b-4ae1-b7d7-ee447119eb7d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:10.998037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b79ea462-97dd-40f5-bf37-a51c299081a7 req-00904cb5-2d0b-4ae1-b7d7-ee447119eb7d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:10.998494 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b79ea462-97dd-40f5-bf37-a51c299081a7 req-00904cb5-2d0b-4ae1-b7d7-ee447119eb7d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:11.011998 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b79ea462-97dd-40f5-bf37-a51c299081a7 req-00904cb5-2d0b-4ae1-b7d7-ee447119eb7d service nova] Creating event network-vif-unplugged:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:31:11.019434 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b79ea462-97dd-40f5-bf37-a51c299081a7 req-00904cb5-2d0b-4ae1-b7d7-ee447119eb7d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040262 Aug 27 04:31:11.020753 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3988/7696] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:11.702350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:11.703021 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:11.712324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:11.713107 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:11.713829 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:11.714820 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:11.715518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:11.716436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:11.748546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:11.919498 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:11.928478 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4046d062-b2c1-49d0-b341-502d624ea9c3 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.230563 Aug 27 04:31:11.931263 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3709/7697] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:11 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:12.953356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:12.954070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:12.964604 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:12.965103 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:12.965747 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:12.966520 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:12.966977 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:12.967403 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:13.124025 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:13.133027 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c22da8a9-0348-49e9-9356-9569ad543f29 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.184915 Aug 27 04:31:13.134452 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3989/7698] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:12 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:14.155561 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:14.158296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:14.163443 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:14.170091 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:14.170644 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:14.171101 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:14.171841 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:14.172320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:14.172773 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:14.337457 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:14.347149 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-428a2f52-563e-4648-b858-1d88db76f54d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.195584 Aug 27 04:31:14.347761 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3710/7699] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:14 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:15.387676 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:15.388393 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:15.391166 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=31 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:15.408902 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:15.409450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:15.409913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:15.411100 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:15.412050 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:15.412366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:15.416347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=87 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:15.589368 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:15.598301 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-38497929-0b16-4681-bf83-a1d21d75ab9c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.219273 Aug 27 04:31:15.599011 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3990/7700] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:15 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:16.621570 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:16.622291 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:16.629786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:16.629786 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:16.630434 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:16.631469 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:16.632173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:16.632800 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:16.784155 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:16.792804 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66619e5d-61dc-447f-8a81-3094ac01284c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.175391 Aug 27 04:31:16.793394 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3711/7701] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:16 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:17.819879 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:17.820532 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:17.828435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:17.829158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:17.829623 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:17.830488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:17.830947 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:17.831376 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:18.018151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:18.028779 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d994cff6-2d20-4f52-b6e8-1a7dc609faf9 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.214059 Aug 27 04:31:18.029806 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3991/7702] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:17 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:19.052576 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:19.053221 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:19.060898 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:19.061403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:19.061916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:19.062675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:19.063203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:19.063650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:19.216129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:19.224482 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68dfda0e-0684-487e-a4e6-260cae38da14 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.176056 Aug 27 04:31:19.225129 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3712/7703] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:19 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:20.249997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:20.250878 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:20.256713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:20.257279 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:20.257870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:20.258679 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:20.259219 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:20.260409 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:20.404425 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:20.412359 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c13ec7b0-ee4e-4f78-a9a8-e5f02519b328 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.168416 Aug 27 04:31:20.412949 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3992/7704] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:20 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:21.434518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:21.435013 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:21.445543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:21.446080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:21.446529 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:21.447258 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:21.447856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:21.448173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:21.608324 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:21.618797 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-087d71e2-8e28-470e-8c79-e74c4d61db1c tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1685 microversion: 2.1 time: 0.187540 Aug 27 04:31:21.620306 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3713/7705] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:21 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:22.641320 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:22.641891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:31:22.649158 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:22.649653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:22.650095 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:22.650923 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:22.651397 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:22.651837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:22.796913 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:22.804831 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-89b864cc-0f14-409b-a33a-1d4801970999 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1672 microversion: 2.1 time: 0.167511 Aug 27 04:31:22.805423 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3993/7706] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:31:22 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:22.993040 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a973f390-41d5-4bd2-bd41-a99b631d33c1 req-21a794f9-d341-4159-a4ff-f2dfa3129ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "name": "network-vif-plugged", "status": "completed", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:23.005087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a973f390-41d5-4bd2-bd41-a99b631d33c1 req-21a794f9-d341-4159-a4ff-f2dfa3129ee5 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:31:23.005269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a973f390-41d5-4bd2-bd41-a99b631d33c1 req-21a794f9-d341-4159-a4ff-f2dfa3129ee5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:31:23.007626 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a973f390-41d5-4bd2-bd41-a99b631d33c1 req-21a794f9-d341-4159-a4ff-f2dfa3129ee5 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:31:23.018188 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a973f390-41d5-4bd2-bd41-a99b631d33c1 req-21a794f9-d341-4159-a4ff-f2dfa3129ee5 service nova] Creating event network-vif-plugged:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:31:23.023324 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a973f390-41d5-4bd2-bd41-a99b631d33c1 req-21a794f9-d341-4159-a4ff-f2dfa3129ee5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Aug 27 04:31:23.024101 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3714/7707] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:36.679243 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:36.679824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:36.680384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:36.681482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=30 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:36.682588 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=7 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:36.683470 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=23 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:36.684352 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:32:36.684561 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 (ip 10.222.0.69) !!! Aug 27 04:32:36.687155 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:32:36.687301 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 (ip 10.222.0.69) !!! Aug 27 04:32:36.706534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:36.707023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:36.707492 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:36.708202 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:36.708661 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:36.709089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:36.741478 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:32:36.763871 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0d19b99a-f145-45b5-9a0a-3d53cbd4419b req-3e8da9e5-203e-4f7d-b85f-36f7f9ff180e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:36.774483 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0d19b99a-f145-45b5-9a0a-3d53cbd4419b req-3e8da9e5-203e-4f7d-b85f-36f7f9ff180e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:36.775035 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0d19b99a-f145-45b5-9a0a-3d53cbd4419b req-3e8da9e5-203e-4f7d-b85f-36f7f9ff180e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:36.775492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0d19b99a-f145-45b5-9a0a-3d53cbd4419b req-3e8da9e5-203e-4f7d-b85f-36f7f9ff180e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:36.788978 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0d19b99a-f145-45b5-9a0a-3d53cbd4419b req-3e8da9e5-203e-4f7d-b85f-36f7f9ff180e service nova] Creating event network-changed:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:32:36.794338 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0d19b99a-f145-45b5-9a0a-3d53cbd4419b req-3e8da9e5-203e-4f7d-b85f-36f7f9ff180e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118142 Aug 27 04:32:36.795990 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3715/7708] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:36.836945 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-adfeb54f-4bcd-411b-98b4-89bb7e42247b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "DELETE /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 204 len: 0 microversion: 2.1 time: 0.163124 Aug 27 04:32:36.837594 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3994/7709] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:32:36 2022] DELETE /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:32:36.852236 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:36.853728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:36.861974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:36.864436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:36.864900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:36.865628 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:36.866341 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:36.866791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:37.080818 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:37.091165 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3badf0fa-151c-4dca-bb9d-f08ad7b4448f tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.247680 Aug 27 04:32:37.091935 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3716/7710] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:36 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:38.114523 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:38.115235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:38.122633 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:38.123135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:38.123579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:38.124335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:38.124801 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:38.125234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:38.328898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:38.339025 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c05dd2b4-31f8-4dc6-8c01-220b96edbbe0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1678 microversion: 2.1 time: 0.228825 Aug 27 04:32:38.339623 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3995/7711] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:38 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:39.149836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-720581bc-5e69-48dd-992e-ab2d15b46aa6 req-a8c49bf1-c777-408d-b2f3-0260ba40df7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a806f92-59ad-490c-9ad4-c1633d477036", "name": "network-vif-deleted", "tag": "2f4e3555-6b52-44c3-a903-51cca5bc2bd0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:39.164299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-720581bc-5e69-48dd-992e-ab2d15b46aa6 req-a8c49bf1-c777-408d-b2f3-0260ba40df7b service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:39.165074 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-720581bc-5e69-48dd-992e-ab2d15b46aa6 req-a8c49bf1-c777-408d-b2f3-0260ba40df7b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:39.165680 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-720581bc-5e69-48dd-992e-ab2d15b46aa6 req-a8c49bf1-c777-408d-b2f3-0260ba40df7b service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:39.180862 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-720581bc-5e69-48dd-992e-ab2d15b46aa6 req-a8c49bf1-c777-408d-b2f3-0260ba40df7b service nova] Creating event network-vif-deleted:2f4e3555-6b52-44c3-a903-51cca5bc2bd0 for instance 0a806f92-59ad-490c-9ad4-c1633d477036 on n-h2-852086-5 Aug 27 04:32:39.187658 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-720581bc-5e69-48dd-992e-ab2d15b46aa6 req-a8c49bf1-c777-408d-b2f3-0260ba40df7b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041622 Aug 27 04:32:39.188582 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3717/7712] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:39.365735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:39.366339 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:39.373454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:39.374120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:39.374598 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:39.375302 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:39.375764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:39.376194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:39.410562 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:39.411063 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:39.411502 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:39.411959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lazy-loading 'fault' on Instance uuid 0a806f92-59ad-490c-9ad4-c1633d477036 {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:32:39.455563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:39.464276 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c888519f-6b92-4827-a772-b2682a793448 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 200 len: 1335 microversion: 2.1 time: 0.102567 Aug 27 04:32:39.464880 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3996/7713] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:39 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:40.488300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:40.489060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: 0a806f92-59ad-490c-9ad4-c1633d477036] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:40.496267 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:40.496759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:40.497215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:40.497987 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:40.498572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:40.499020 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:40.515698 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] HTTP exception thrown: Instance 0a806f92-59ad-490c-9ad4-c1633d477036 could not be found. Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Request method failure captured: Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 HTTP/1.1 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZ1qcrzapEf8tw6L9HdnUNDxAsEehshrIJ6tVIyqZ1zr-ID1XY1_FNi1wTgsB6_34iZ2DXptxqoTRi5j3u6s6sZYHopHl1-iqG-7KYr201AvY33xgdA8UrlUsOIUHMvvbeyri4Rh5NG81GvZb5QZWsjCf6DQdYOLpBmnQ2qP39fMPIk Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90e17fff0e774e21b2ecf2f9b4cc8e67 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestShelveInstance-222176455 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90e17fff0e774e21b2ecf2f9b4cc8e67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90e17fff0e774e21b2ecf2f9b4cc8e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90e17fff0e774e21b2ecf2f9b4cc8e67", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90e17fff0e774e21b2ecf2f9b4cc8e67"}]}] Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestShelveInstance-222176455 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90e17fff0e774e21b2ecf2f9b4cc8e67 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestShelveInstance-222176455 Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestShelveInstance-222176455-project Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 927ff4f71f684cf7ae50a9b345b2645b Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestShelveInstance-222176455-project Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 0a806f92-59ad-490c-9ad4-c1633d477036 could not be found. Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '0a806f92-59ad-490c-9ad4-c1633d477036'} Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a806f92-59ad-490c-9ad4-c1633d477036 could not be found. Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a806f92-59ad-490c-9ad4-c1633d477036 could not be found. Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:32:40.517370 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a806f92-59ad-490c-9ad4-c1633d477036 could not be found. Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Returning 404 to user: Instance 0a806f92-59ad-490c-9ad4-c1633d477036 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b8e12f5-a2e2-496a-a459-33fe79ab5c34 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036" status: 404 len: 111 microversion: 2.1 time: 0.035049 Aug 27 04:32:40.522584 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3718/7714] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:40 2022] GET /compute/v2.1/servers/0a806f92-59ad-490c-9ad4-c1633d477036 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:32:40.688696 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d30025bd-f2ed-4332-9f36-99d99f88580d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '.version_select at 0x7fe4569f9ee0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:40.717075 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d30025bd-f2ed-4332-9f36-99d99f88580d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-87930893" status: 202 len: 0 microversion: 2.1 time: 0.033990 Aug 27 04:32:40.721377 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3997/7715] 10.222.0.69 () {58 vars in 1248 bytes} [Sat Aug 27 04:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-87930893 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:40.739904 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-465f410d-ab22-48f9-8d0f-c0e722ae7bc1 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'create', calling method: .version_select at 0x7fe4573a8940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1338462986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpFvBWZ6euz06nfyiAqc1mL2Oe+K/APddpNLfSCscQ0mFnnW48kkcaCsWBd9clQ1BUuF7rScmKk9E/j82WN6T24Z51r6DkqIJ0hBTgp1y53+16m22/ppeJzPVGZKIFNPg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:40.756150 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-465f410d-ab22-48f9-8d0f-c0e722ae7bc1 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:40.761506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-465f410d-ab22-48f9-8d0f-c0e722ae7bc1 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for user 927ff4f71f684cf7ae50a9b345b2645b and project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:40.788791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-465f410d-ab22-48f9-8d0f-c0e722ae7bc1 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053373 Aug 27 04:32:40.789386 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3719/7716] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:32:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:56.957991 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:56.958868 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:56.962992 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-739035644", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1338462986", "security_groups": [{"name": "tempest-secgroup-smoke-321720941"}], "networks": [{"uuid": "1f2d7523-4003-4c1c-b41f-7780a11d8d57"}], "block_device_mapping_v2": [{"uuid": "f4137961-34fc-414c-9bd2-b05057ea3c33", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:57.081900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] validate_networks() for [('1f2d7523-4003-4c1c-b41f-7780a11d8d57', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:32:57.495326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:57.495754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:57.496234 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:57.496645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:57.497066 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:57.506335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.506828 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.507268 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.508003 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:57.508466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:57.508898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:57.526657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:32:57.532697 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Getting quotas for user 927ff4f71f684cf7ae50a9b345b2645b and project 90e17fff0e774e21b2ecf2f9b4cc8e67. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:32:57.591107 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:32:57.593877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4137961-34fc-414c-9bd2-b05057ea3c33',volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:32:57.727356 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-821f7c47-f2f9-4c4f-99b1-bcb25c975f28 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.771267 Aug 27 04:32:57.728047 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3998/7717] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:32:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:57.737880 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:57.739759 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:57.740667 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:57.745199 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4aa705e6-b8f5-49f3-9eac-a898bece94a7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:57.745828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4aa705e6-b8f5-49f3-9eac-a898bece94a7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:57.805998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4aa705e6-b8f5-49f3-9eac-a898bece94a7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:57.813415 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4aa705e6-b8f5-49f3-9eac-a898bece94a7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1088 microversion: 2.1 time: 0.077774 Aug 27 04:32:57.813984 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3720/7718] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:57 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:58.833894 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f0bf8abb-de3e-49d5-8bed-8f482a2b7cb7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:58.834635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f0bf8abb-de3e-49d5-8bed-8f482a2b7cb7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:58.891201 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f0bf8abb-de3e-49d5-8bed-8f482a2b7cb7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:58.898556 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f0bf8abb-de3e-49d5-8bed-8f482a2b7cb7 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1088 microversion: 2.1 time: 0.069003 Aug 27 04:32:58.899341 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 3999/7719] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:58 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:59.924420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.925051 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:32:59.931555 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.932052 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.932504 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:32:59.933210 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:32:59.933675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:32:59.934111 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:00.343234 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:00.352337 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a2c1877-f3ff-4590-b014-a4c5c87ab27b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1138 microversion: 2.1 time: 0.432500 Aug 27 04:33:00.352940 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3721/7720] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:32:59 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1138 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:01.373450 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:01.374067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:01.381525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:01.382014 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:01.382483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:01.383192 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:01.383650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:01.384075 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:01.552721 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:01.567268 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-331e64c7-1151-4b5e-92ac-eef49a25bf72 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1271 microversion: 2.1 time: 0.197789 Aug 27 04:33:01.568995 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4000/7721] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:01 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:02.147373 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4589135f-9454-4411-9158-60b3e4041d57 req-fe5de6df-d707-4cc6-98ad-9c5cd1e35a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd94558d-8f3d-4083-9088-6acb16b0de4e", "tag": "50417a65-e6f9-4910-9ec1-2842595dd62f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:02.163821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4589135f-9454-4411-9158-60b3e4041d57 req-fe5de6df-d707-4cc6-98ad-9c5cd1e35a94 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:02.164612 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4589135f-9454-4411-9158-60b3e4041d57 req-fe5de6df-d707-4cc6-98ad-9c5cd1e35a94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:02.165287 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4589135f-9454-4411-9158-60b3e4041d57 req-fe5de6df-d707-4cc6-98ad-9c5cd1e35a94 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:02.178238 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4589135f-9454-4411-9158-60b3e4041d57 req-fe5de6df-d707-4cc6-98ad-9c5cd1e35a94 service nova] Creating event network-changed:50417a65-e6f9-4910-9ec1-2842595dd62f for instance cd94558d-8f3d-4083-9088-6acb16b0de4e on n-h2-852086-5 Aug 27 04:33:02.185402 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4589135f-9454-4411-9158-60b3e4041d57 req-fe5de6df-d707-4cc6-98ad-9c5cd1e35a94 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041842 Aug 27 04:33:02.186265 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3722/7722] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:02.589180 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:02.589884 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:02.597806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:02.598334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:02.598774 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:02.599744 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:02.600430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:02.600932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:02.758681 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:02.769420 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1e37fa6c-3ca6-4df6-9db4-558d7c582d70 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1271 microversion: 2.1 time: 0.184329 Aug 27 04:33:02.770022 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4001/7723] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:02 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:03.791971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:03.792599 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:03.799540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:03.800048 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:03.800506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:03.801229 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:03.801700 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:03.802144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:03.937677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:03.946070 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c62d99ec-9935-479a-8513-e04bfe050ab4 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1271 microversion: 2.1 time: 0.159170 Aug 27 04:33:03.946727 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3723/7724] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:03 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:04.967710 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:04.968374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:04.975420 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:04.975914 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:04.976374 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:04.977261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:04.977722 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:04.978144 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:05.125356 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:05.133233 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-887ff7ae-256c-47d0-b760-d58034401e8d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1271 microversion: 2.1 time: 0.170051 Aug 27 04:33:05.133816 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4002/7725] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:04 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:06.154473 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:06.155137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:06.162563 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:06.163120 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:06.163736 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:06.164598 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:06.165073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:06.165518 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:06.310606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:06.318536 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-889dca7a-ce64-4d39-bc4e-198698e1defd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.168177 Aug 27 04:33:06.319113 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3724/7726] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:06 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:07.340013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:07.340628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:07.347694 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:07.348185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:07.348624 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:07.349324 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:07.349782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:07.350249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:07.486897 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:07.494585 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fa677588-3920-41a7-830d-09d46e1d5a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.158711 Aug 27 04:33:07.495162 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4003/7727] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:07 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:08.515200 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:08.515756 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:08.518657 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:08.524410 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.524907 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.525354 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:08.526060 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:08.526552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:08.526992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:08.662305 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:08.671241 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-450b3c46-3518-4a86-99a4-32f6eaa6d50d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.160690 Aug 27 04:33:08.671818 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3725/7728] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:08 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:09.692788 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:09.693408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:09.695338 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:09.696887 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=8 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:33:09.703968 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:09.704465 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:09.704909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:09.705621 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:09.706083 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:09.706540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:09.846139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:09.853788 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4eae9ab3-35db-45a7-bcd7-4817685beefa tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.164970 Aug 27 04:33:09.854397 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4004/7729] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:09 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:10.875516 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.876195 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:10.883215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.883713 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.884157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:10.884865 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:10.885329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:10.885772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:11.025656 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:11.037414 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7ef1de7c-345b-4df7-87c0-494a1d4f7c75 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.166325 Aug 27 04:33:11.038023 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3726/7730] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:10 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:12.058022 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:12.058673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:12.066617 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.067104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.067578 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.068349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:12.069037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:12.069244 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:12.204610 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:12.212719 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a9dff8d-af1f-4044-9fd1-69dcf62a7f84 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.158604 Aug 27 04:33:12.213331 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4005/7731] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:12 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:13.233892 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.234551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:13.241485 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.241985 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.242463 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.243179 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:13.243650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:13.244092 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:13.379922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:13.387781 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db65e53b-eff9-49ac-aa85-52773846ca1a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.157955 Aug 27 04:33:13.388462 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3727/7732] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:13 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:14.408297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:14.408909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:14.415529 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.416015 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.416454 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.417151 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:14.417608 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:14.418037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:14.549799 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:14.557589 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-6575a54c-3568-4d6d-bfe9-5d822c3a53fc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.153181 Aug 27 04:33:14.558222 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4006/7733] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:14 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:15.528823 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7b208cce-cd03-4670-8a5b-aa11c06ebb6e req-8bd41aa1-068d-4d18-905f-077834b394da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd94558d-8f3d-4083-9088-6acb16b0de4e", "name": "network-vif-plugged", "status": "completed", "tag": "50417a65-e6f9-4910-9ec1-2842595dd62f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:15.541375 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b208cce-cd03-4670-8a5b-aa11c06ebb6e req-8bd41aa1-068d-4d18-905f-077834b394da service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:15.542184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b208cce-cd03-4670-8a5b-aa11c06ebb6e req-8bd41aa1-068d-4d18-905f-077834b394da service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:15.542405 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7b208cce-cd03-4670-8a5b-aa11c06ebb6e req-8bd41aa1-068d-4d18-905f-077834b394da service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:15.556391 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7b208cce-cd03-4670-8a5b-aa11c06ebb6e req-8bd41aa1-068d-4d18-905f-077834b394da service nova] Creating event network-vif-plugged:50417a65-e6f9-4910-9ec1-2842595dd62f for instance cd94558d-8f3d-4083-9088-6acb16b0de4e on n-h2-852086-5 Aug 27 04:33:15.562354 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7b208cce-cd03-4670-8a5b-aa11c06ebb6e req-8bd41aa1-068d-4d18-905f-077834b394da service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037335 Aug 27 04:33:15.562969 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3728/7734] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:33:15.578803 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:15.579423 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:15.589806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:15.590336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:15.590985 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:15.591713 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:15.593042 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:15.593428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:15.745585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:15.760401 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-690a6d87-c952-4841-bf1c-8db64df423c5 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1259 microversion: 2.1 time: 0.185329 Aug 27 04:33:15.761474 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4007/7735] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:15 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:16.787256 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:16.787974 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:16.794430 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.794967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.795462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.796178 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.796664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.797102 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.947715 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:16.956235 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74c0a73d-2fb2-4ea7-89ff-c36d0a43d104 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1443 microversion: 2.1 time: 0.174333 Aug 27 04:33:16.956812 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3729/7736] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:16 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:16.977367 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:16.977984 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:33:16.984782 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.985264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.985699 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:16.986422 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:16.986882 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:16.987306 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:17.120469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:17.128370 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-699f1387-dc22-4702-93b0-41486123e404 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1443 microversion: 2.1 time: 0.154997 Aug 27 04:33:17.128948 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4008/7737] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:33:16 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:18.716275 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3b88db0d-5667-49b7-bbd9-009b6fc4a84d req-b9fac55c-9125-4da5-8344-a9e9f5eace5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd94558d-8f3d-4083-9088-6acb16b0de4e", "tag": "50417a65-e6f9-4910-9ec1-2842595dd62f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:18.727482 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3b88db0d-5667-49b7-bbd9-009b6fc4a84d req-b9fac55c-9125-4da5-8344-a9e9f5eace5c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:33:18.728080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3b88db0d-5667-49b7-bbd9-009b6fc4a84d req-b9fac55c-9125-4da5-8344-a9e9f5eace5c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:33:18.728620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3b88db0d-5667-49b7-bbd9-009b6fc4a84d req-b9fac55c-9125-4da5-8344-a9e9f5eace5c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:33:18.741572 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3b88db0d-5667-49b7-bbd9-009b6fc4a84d req-b9fac55c-9125-4da5-8344-a9e9f5eace5c service nova] Creating event network-changed:50417a65-e6f9-4910-9ec1-2842595dd62f for instance cd94558d-8f3d-4083-9088-6acb16b0de4e on n-h2-852086-5 Aug 27 04:33:18.746891 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3b88db0d-5667-49b7-bbd9-009b6fc4a84d req-b9fac55c-9125-4da5-8344-a9e9f5eace5c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035783 Aug 27 04:33:18.747885 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3730/7738] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:14.980559 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:35:14.981664 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:35:14.982464 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:14.983194 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=56 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:15.036759 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:15.037304 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:15.043495 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.043987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.044430 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.045140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.045599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.046045 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.070291 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.objects.instance [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lazy-loading 'flavor' on Instance uuid cd94558d-8f3d-4083-9088-6acb16b0de4e {{(pid=122407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:35:15.146901 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-81eba21e-4641-4faf-a8c5-d8014932e4bd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e/action" status: 202 len: 0 microversion: 2.1 time: 0.168294 Aug 27 04:35:15.147544 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4009/7739] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:35:14 2022] POST /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:35:15.154075 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:35:15.155033 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96abbb2e-fa0f-416e-845b-4c5358f3aaa0] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:35:15.155728 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=24 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:15.156559 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=48 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:15.158200 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:35:15.159207 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e (ip 10.222.0.69) !!! Aug 27 04:35:15.160908 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:35:15.161052 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e (ip 10.222.0.69) !!! Aug 27 04:35:15.171460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:15.172175 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:15.184495 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.184994 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.185456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.186233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:15.186709 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:15.187157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:15.336707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.345138 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4fec827-635b-4678-a636-a03a4f04decd tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.193056 Aug 27 04:35:15.346268 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3731/7740] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:15 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:16.369838 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.370574 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:16.380198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.380691 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.381133 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.381873 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:16.382447 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:16.382877 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:16.388734 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43374. Aug 27 04:35:16.391038 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43376. Aug 27 04:35:16.525432 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.534541 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2b49e757-42d7-4d75-a43f-ab32b6cb3a12 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.170911 Aug 27 04:35:16.535149 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4010/7741] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:16 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:17.556394 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.557046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:17.570903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.571409 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.571860 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.572575 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:17.573039 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:17.573477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:17.579560 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43382. Aug 27 04:35:17.581159 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [96abbb2e-fa0f-416e-845b-4c5358f3aaa0] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43384. Aug 27 04:35:17.713813 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.721969 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61635a06-4158-4d2b-a128-e70c362bd50b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.169502 Aug 27 04:35:17.722676 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3732/7742] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:17 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:18.742909 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.743483 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:18.750433 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.750920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.751360 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.752111 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:18.752581 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:18.752993 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:18.885542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:18.894816 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c5254655-51a2-41f0-ac42-a03b20519ac2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.155878 Aug 27 04:35:18.895394 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4011/7743] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:18 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:19.916627 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:19.917257 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:19.924891 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.925471 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.925917 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:19.926664 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:19.927129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:19.927567 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:20.067552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.075534 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aedca8ec-6b19-4b97-8c53-5e65ef1c16fb tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.162874 Aug 27 04:35:20.076127 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3733/7744] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:19 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:21.097018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:21.097641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:21.104563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.105056 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.105497 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.106230 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:21.106698 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:21.107157 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:21.243252 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.251172 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8d33499a-9dc8-4c09-8c40-cc6ed746ebf6 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.158175 Aug 27 04:35:21.251755 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4012/7745] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:21 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:22.273520 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:22.274137 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:22.280942 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:22.281435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:22.281882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:22.282617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:22.283822 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:22.284546 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:22.419936 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:22.427939 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f707e83-a790-41d6-9333-a9baae2f34cc tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.158433 Aug 27 04:35:22.428503 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3734/7746] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:22 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:23.449434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:23.450030 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:23.458298 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.458783 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.459217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.459919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:23.460372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:23.460791 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:23.600620 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:23.609933 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ff272b6e-2952-444c-9389-af33675fb630 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.164255 Aug 27 04:35:23.610847 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4013/7747] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:23 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:24.635269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:24.635901 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:24.642810 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.644268 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.644513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.645226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:24.645699 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:24.646188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:24.776364 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.784191 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c3a2e42-1460-4a47-8ffa-c119abe55e15 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.152858 Aug 27 04:35:24.784956 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3735/7748] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:24 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:25.805739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:25.806518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:25.813366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.813845 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.814321 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.815353 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:25.815987 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:25.816469 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:25.951587 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.960274 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-8ef56990-a8dd-48e5-a557-ffb8adc647ee tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.158744 Aug 27 04:35:25.960866 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4014/7749] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:25 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:26.983322 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:26.983951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:26.991500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:26.991997 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:26.992456 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:26.993163 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:26.993633 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:26.994076 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:27.137507 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.151189 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3fd99e77-3310-4c10-9d20-15be9657a1d8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.171414 Aug 27 04:35:27.152144 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3736/7750] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:26 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:28.174027 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:28.175547 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:28.183138 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.183628 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.184060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:28.184764 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:28.185366 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:28.185797 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:28.334417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.342450 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0a4860b4-c275-40c2-afd2-47d49166e786 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.172243 Aug 27 04:35:28.343020 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4015/7751] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:28 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:29.364340 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.364963 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:29.372162 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.372665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.373105 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.373826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.374331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.374772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.524233 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.532443 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8132543-8ff3-43eb-ae55-580b7b492a9b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1568 microversion: 2.1 time: 0.172266 Aug 27 04:35:29.533047 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3737/7752] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:29 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:29.554059 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:29.554695 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:29.562226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.562675 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.563121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.563834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.564297 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.564798 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.608861 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122407) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 04:35:29.678313 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a6d6ea24-9c20-482b-b37f-828ce0b7fa2b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "POST /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e/action" status: 202 len: 0 microversion: 2.1 time: 0.128744 Aug 27 04:35:29.678930 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4016/7753] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:35:29 2022] POST /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:35:29.687003 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.687642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:29.694448 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.694960 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.695415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.696144 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:29.696807 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:29.697252 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:29.839085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.847526 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ef54cb1-b51f-43fd-86eb-c360df8eef58 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1516 microversion: 2.1 time: 0.164325 Aug 27 04:35:29.848102 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3738/7754] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:29 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:30.199642 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-2535be59-16ed-4353-87d2-547b85712dba req-56e3ce09-c717-4932-b0c3-037f5776128c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd94558d-8f3d-4083-9088-6acb16b0de4e", "name": "network-vif-unplugged", "status": "completed", "tag": "50417a65-e6f9-4910-9ec1-2842595dd62f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:30.209392 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2535be59-16ed-4353-87d2-547b85712dba req-56e3ce09-c717-4932-b0c3-037f5776128c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:30.209982 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2535be59-16ed-4353-87d2-547b85712dba req-56e3ce09-c717-4932-b0c3-037f5776128c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:30.210555 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-2535be59-16ed-4353-87d2-547b85712dba req-56e3ce09-c717-4932-b0c3-037f5776128c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:30.224308 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.compute.server_external_events [req-2535be59-16ed-4353-87d2-547b85712dba req-56e3ce09-c717-4932-b0c3-037f5776128c service nova] Unable to find a host for instance cd94558d-8f3d-4083-9088-6acb16b0de4e. Dropping event network-vif-unplugged {{(pid=122407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 04:35:30.225207 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-2535be59-16ed-4353-87d2-547b85712dba req-56e3ce09-c717-4932-b0c3-037f5776128c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029685 Aug 27 04:35:30.226017 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4017/7755] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 04:35:30.868996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:30.869725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:30.877177 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:30.878251 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:30.878707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:30.879433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:30.879903 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:30.880342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:31.021951 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.030007 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e544f234-ec7f-47f7-9c6c-b4ed5aad15ce tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1518 microversion: 2.1 time: 0.165051 Aug 27 04:35:31.030606 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3739/7756] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:30 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:32.052261 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:32.052826 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:32.059636 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.060121 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.060556 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.061253 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:32.061706 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:32.062130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:32.200323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.208661 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-cc295917-9524-4f72-a2c6-cae4e3286e11 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1518 microversion: 2.1 time: 0.160936 Aug 27 04:35:32.209244 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4018/7757] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:32 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:33.230552 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:33.231183 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:33.239226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.239739 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.240173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.240882 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:33.241349 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:33.241781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:33.389059 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.398107 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79212cc5-64db-4fa7-b91b-2ce1bacd7bf0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1518 microversion: 2.1 time: 0.171403 Aug 27 04:35:33.398990 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3740/7758] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:33 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:34.420361 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:34.421068 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:34.429317 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:34.429785 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:34.430256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:34.430969 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:34.431428 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:34.431857 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:34.575195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:34.584783 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-453599e4-3b39-47b0-815e-8f6c44952739 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1518 microversion: 2.1 time: 0.168709 Aug 27 04:35:34.585362 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4019/7759] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:34 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:35.606905 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.607707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:35.614695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.615204 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.615666 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.616390 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:35.616864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:35.617309 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:35.840147 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.848293 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6f20c94-adbc-46c1-a66c-60f3d2d90364 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.245435 Aug 27 04:35:35.848881 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3741/7760] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:35 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:36.870233 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:36.870871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:36.878512 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.879203 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.879643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:36.880352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:36.880946 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:36.881371 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:37.020446 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.028752 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7dfeaf8d-c81b-4371-8df0-8df4ec82a72d tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.162962 Aug 27 04:35:37.029345 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4020/7761] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:36 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:38.050625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:38.051250 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:38.058270 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.058772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.059226 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.059961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:38.060435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:38.060878 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:38.197837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.206745 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2255bd52-37a2-403f-9a1e-dea9a541fd6b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.160040 Aug 27 04:35:38.207241 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3742/7762] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:38 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:39.228170 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.228951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:39.236239 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.237352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.237843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.238625 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:39.239090 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:39.239553 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:39.678662 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:39.686552 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b2240439-849a-4fed-8265-e71a6bd21463 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.462428 Aug 27 04:35:39.687126 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4021/7763] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:39 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:40.709269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.709946 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:40.719188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.719458 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.719908 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.720623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:40.721840 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:40.722678 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:40.854005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.861793 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cb62289-95ae-45bb-9c0b-e4c3ea7c417b tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.157073 Aug 27 04:35:40.862734 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3743/7764] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:40 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:41.883716 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.884313 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:41.891410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.891899 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.892336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:41.893199 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:41.893758 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:41.894259 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:42.030332 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.038786 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f37ad6a6-6ce1-4aa2-87a1-d7016c4cccf2 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.158978 Aug 27 04:35:42.039323 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4022/7765] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:41 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:43.060582 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.061215 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:43.068343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.068847 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.069299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.070018 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:43.070527 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:43.070971 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:43.205273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.213957 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2b2e04d-9acf-4b5f-8e5b-acdda29fe718 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.157034 Aug 27 04:35:43.214570 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3744/7766] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:43 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:44.235349 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:44.235958 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:44.244117 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.244611 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.245049 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:44.245765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:44.246247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:44.246702 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:44.251434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:44.413251 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.421527 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-f689d26f-0115-45dd-b5cb-9df3c7c1457a tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.190051 Aug 27 04:35:44.422106 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4023/7767] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:44 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:45.442556 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:45.443187 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:45.445913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=29 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:45.451642 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.452152 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.452606 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.453328 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:45.453796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:45.454269 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:45.457740 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=85 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:45.591439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.599966 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee24070d-143c-45fb-bd9e-b560a07f226e tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.161353 Aug 27 04:35:45.600554 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3745/7768] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:45 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:46.267370 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fd49b411-862a-4f1f-a726-4136f5986366 req-3f147039-1691-4a22-b063-d7306802485a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd94558d-8f3d-4083-9088-6acb16b0de4e", "name": "network-vif-plugged", "status": "completed", "tag": "50417a65-e6f9-4910-9ec1-2842595dd62f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:46.275237 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:35:46.280730 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd49b411-862a-4f1f-a726-4136f5986366 req-3f147039-1691-4a22-b063-d7306802485a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.281763 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd49b411-862a-4f1f-a726-4136f5986366 req-3f147039-1691-4a22-b063-d7306802485a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.282229 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd49b411-862a-4f1f-a726-4136f5986366 req-3f147039-1691-4a22-b063-d7306802485a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.296719 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fd49b411-862a-4f1f-a726-4136f5986366 req-3f147039-1691-4a22-b063-d7306802485a service nova] Creating event network-vif-plugged:50417a65-e6f9-4910-9ec1-2842595dd62f for instance cd94558d-8f3d-4083-9088-6acb16b0de4e on n-h2-852086-5 Aug 27 04:35:46.302517 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fd49b411-862a-4f1f-a726-4136f5986366 req-3f147039-1691-4a22-b063-d7306802485a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039072 Aug 27 04:35:46.304117 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4024/7769] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:46.620872 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.621531 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:46.628980 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.629477 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.629925 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.630669 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:46.631130 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:46.631565 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:46.774335 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.782306 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bceb25db-5624-4860-8b1b-f0b188d75865 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1574 microversion: 2.1 time: 0.165298 Aug 27 04:35:46.782887 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3746/7770] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:46 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:47.805540 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:47.806154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:35:47.812435 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.812918 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.813357 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.814060 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:35:47.814551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:35:47.815735 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:35:47.950659 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.958692 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-07a0a9e0-796f-4568-b2c8-9caaedaa5603 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1561 microversion: 2.1 time: 0.158065 Aug 27 04:35:47.959265 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4025/7771] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:35:47 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:01.331695 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:01.335283 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:01.336522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=12 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:01.337620 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=11 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:01.338781 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:37:01.338964 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:37:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.69) !!! Aug 27 04:37:01.341767 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:37:01.341982 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:37:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e (ip 10.222.0.69) !!! Aug 27 04:37:01.350236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-b462fd03-84f8-4e8b-b955-68b2b82db409 req-8f347462-4666-4da9-9ee9-4df4dea5953f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd94558d-8f3d-4083-9088-6acb16b0de4e", "tag": "50417a65-e6f9-4910-9ec1-2842595dd62f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:01.359835 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:01.360356 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:01.371157 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.371671 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.372128 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.373075 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.373566 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.374015 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.375837 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b462fd03-84f8-4e8b-b955-68b2b82db409 req-8f347462-4666-4da9-9ee9-4df4dea5953f service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.376341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b462fd03-84f8-4e8b-b955-68b2b82db409 req-8f347462-4666-4da9-9ee9-4df4dea5953f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.376777 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-b462fd03-84f8-4e8b-b955-68b2b82db409 req-8f347462-4666-4da9-9ee9-4df4dea5953f service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.393036 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-b462fd03-84f8-4e8b-b955-68b2b82db409 req-8f347462-4666-4da9-9ee9-4df4dea5953f service nova] Creating event network-changed:50417a65-e6f9-4910-9ec1-2842595dd62f for instance cd94558d-8f3d-4083-9088-6acb16b0de4e on n-h2-852086-5 Aug 27 04:37:01.398727 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-b462fd03-84f8-4e8b-b955-68b2b82db409 req-8f347462-4666-4da9-9ee9-4df4dea5953f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065196 Aug 27 04:37:01.399370 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4026/7772] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:01.408854 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:37:01.511624 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-114ca26a-00ce-484b-b183-cc49469d3cec tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 204 len: 0 microversion: 2.1 time: 0.181587 Aug 27 04:37:01.515880 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3747/7773] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:37:01 2022] DELETE /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:37:01.523232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:01.524522 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:01.532931 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.533743 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.535013 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.536018 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:01.536739 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:01.537444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:01.696552 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:01.704714 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-9ae182ca-30ed-4810-a747-0210d2e54042 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.187018 Aug 27 04:37:01.714262 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4027/7774] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:01 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:02.729028 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:02.729779 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:02.737826 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.738366 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.738821 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.739547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:02.740479 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:02.741073 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:02.970856 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:02.981085 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7b2b775-a06c-40cc-8c5f-9fc1074c1df0 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1567 microversion: 2.1 time: 0.257330 Aug 27 04:37:02.981670 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3748/7775] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:02 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:03.716708 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-11d8040b-0bf3-47c1-a239-3308835640a8 req-4f354411-e8f5-4846-bee2-ac0ad5478a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd94558d-8f3d-4083-9088-6acb16b0de4e", "name": "network-vif-deleted", "tag": "50417a65-e6f9-4910-9ec1-2842595dd62f"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:03.727055 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-11d8040b-0bf3-47c1-a239-3308835640a8 req-4f354411-e8f5-4846-bee2-ac0ad5478a21 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:03.727534 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-11d8040b-0bf3-47c1-a239-3308835640a8 req-4f354411-e8f5-4846-bee2-ac0ad5478a21 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:03.728020 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-11d8040b-0bf3-47c1-a239-3308835640a8 req-4f354411-e8f5-4846-bee2-ac0ad5478a21 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:03.739070 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-11d8040b-0bf3-47c1-a239-3308835640a8 req-4f354411-e8f5-4846-bee2-ac0ad5478a21 service nova] Creating event network-vif-deleted:50417a65-e6f9-4910-9ec1-2842595dd62f for instance cd94558d-8f3d-4083-9088-6acb16b0de4e on n-h2-852086-5 Aug 27 04:37:03.745175 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-11d8040b-0bf3-47c1-a239-3308835640a8 req-4f354411-e8f5-4846-bee2-ac0ad5478a21 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089386 Aug 27 04:37:03.746655 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4028/7776] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:37:04.002887 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:04.003528 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:04.011625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.012277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.012973 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.013921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:04.014420 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:04.014869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:04.082845 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:04.092407 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37482af0-5ff9-437b-8f2d-df9ff4efe007 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1219 microversion: 2.1 time: 0.093389 Aug 27 04:37:04.093245 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3749/7777] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:03 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:05.113973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:05.114734 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:05.125650 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.126135 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.126645 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.127359 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:05.127810 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:05.128231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:05.193217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:05.201174 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-4e540623-afa0-4125-b318-889c5edaa401 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1219 microversion: 2.1 time: 0.091591 Aug 27 04:37:05.201754 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4029/7778] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:05 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:06.222403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:06.223032 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:06.230848 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.231350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.231799 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.232513 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:06.232979 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:06.233415 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:06.299472 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:06.308368 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee82f85e-9b6f-4849-9110-e6a2da93ec27 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1219 microversion: 2.1 time: 0.089921 Aug 27 04:37:06.308936 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3750/7779] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:06 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:07.328962 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:07.329603 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:07.337231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.337717 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.338154 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.338885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:07.339342 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:07.340023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:07.402040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927ff4f71f684cf7ae50a9b345b2645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e17fff0e774e21b2ecf2f9b4cc8e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:07.410022 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-ac0861ed-8b0c-4882-a39a-f25bd8be87e8 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 200 len: 1219 microversion: 2.1 time: 0.085000 Aug 27 04:37:07.410640 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4030/7780] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:07 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:08.431382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:08.432149 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] [instance: cd94558d-8f3d-4083-9088-6acb16b0de4e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:08.441350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.442227 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.442900 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.444455 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:08.445260 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:08.446868 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:08.464565 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] HTTP exception thrown: Instance cd94558d-8f3d-4083-9088-6acb16b0de4e could not be found. Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Request method failure captured: Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e HTTP/1.1 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZ1qcrzapEf8tw6L9HdnUNDxAsEehshrIJ6tVIyqZ1zr-ID1XY1_FNi1wTgsB6_34iZ2DXptxqoTRi5j3u6s6sZYHopHl1-iqG-7KYr201AvY33xgdA8UrlUsOIUHMvvbeyri4Rh5NG81GvZb5QZWsjCf6DQdYOLpBmnQ2qP39fMPIk Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 90e17fff0e774e21b2ecf2f9b4cc8e67 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestShelveInstance-222176455 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/90e17fff0e774e21b2ecf2f9b4cc8e67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90e17fff0e774e21b2ecf2f9b4cc8e67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_90e17fff0e774e21b2ecf2f9b4cc8e67", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/90e17fff0e774e21b2ecf2f9b4cc8e67"}]}] Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestShelveInstance-222176455 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 90e17fff0e774e21b2ecf2f9b4cc8e67 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestShelveInstance-222176455 Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestShelveInstance-222176455-project Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: 927ff4f71f684cf7ae50a9b345b2645b Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestShelveInstance-222176455-project Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance cd94558d-8f3d-4083-9088-6acb16b0de4e could not be found. Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': 'cd94558d-8f3d-4083-9088-6acb16b0de4e'} Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd94558d-8f3d-4083-9088-6acb16b0de4e could not be found. Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd94558d-8f3d-4083-9088-6acb16b0de4e could not be found. Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:37:08.466512 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd94558d-8f3d-4083-9088-6acb16b0de4e could not be found. Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:37:08.471217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Returning 404 to user: Instance cd94558d-8f3d-4083-9088-6acb16b0de4e could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:37:08.472627 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f46491f5-17ba-4a45-8482-e7cfa57a3ebe tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e" status: 404 len: 111 microversion: 2.1 time: 0.044534 Aug 27 04:37:08.472627 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3751/7781] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:08 2022] GET /compute/v2.1/servers/cd94558d-8f3d-4083-9088-6acb16b0de4e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:08.658806 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-12fb5c9a-63d0-4169-9cef-ee34ef72c774 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] Calling method '.version_select at 0x7fe45d8ce160>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:08.693244 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-12fb5c9a-63d0-4169-9cef-ee34ef72c774 tempest-TestShelveInstance-222176455 tempest-TestShelveInstance-222176455-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1338462986" status: 202 len: 0 microversion: 2.1 time: 0.038435 Aug 27 04:37:08.694081 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4031/7782] 10.222.0.69 () {58 vars in 1254 bytes} [Sat Aug 27 04:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1338462986 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:26.626791 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:26.627884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:26.839940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02d14338-578f-476f-9840-77e0d93f990f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Action: 'create', calling method: .version_select at 0x7fe457e31e50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-297308890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVbMSwgs8BwqKvVM6PT4zFfk3K1nwU1KEyfZ4ChfckqSueEfi55dNTJ7RdO/m1E2KyuFHHkoiKMELnlB86/pqrmTtaqUrIxdNN86zRBql/tXndy6nJsf8Z0yfjZy+AoEw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:26.856343 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-02d14338-578f-476f-9840-77e0d93f990f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Getting quotas for project 1e3279502cd2475bbe199f709af8739f. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:26.862383 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-02d14338-578f-476f-9840-77e0d93f990f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Getting quotas for user a3514de37440483591144679ed2c2bda and project 1e3279502cd2475bbe199f709af8739f. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:26.897057 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02d14338-578f-476f-9840-77e0d93f990f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278701 Aug 27 04:37:26.897995 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3752/7783] 10.222.0.69 () {60 vars in 1159 bytes} [Sat Aug 27 04:37:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:28.250236 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-110877580", "imageRef": "acef3da5-f17c-4877-a77f-8b5440d3d46e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-297308890", "security_groups": [{"name": "tempest-secgroup-smoke-1073448750"}], "networks": [{"uuid": "6007a811-ae3c-4e11-a4b0-df3748144a13"}]}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:28.262226 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=22 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:28.262871 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:28.366689 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.network.neutron [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] validate_networks() for [('6007a811-ae3c-4e11-a4b0-df3748144a13', None, None, None, None, None)] {{(pid=122407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:37:28.783217 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Flavor limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:28.783639 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Image limits 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:28.784112 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Flavor pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:28.784518 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Image pref 0:0:0 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:28.784928 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.virt.hardware [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:28.794123 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.794635 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.795067 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.795813 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:28.796585 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:28.797232 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:28.814258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Getting quotas for project 1e3279502cd2475bbe199f709af8739f. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:37:28.820231 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.quota [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Getting quotas for user a3514de37440483591144679ed2c2bda and project 1e3279502cd2475bbe199f709af8739f. Resources: {'instances', 'ram', 'cores'} {{(pid=122407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:37:28.833191 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Going to run 1 instances... {{(pid=122407) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:37:28.836218 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acef3da5-f17c-4877-a77f-8b5440d3d46e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:37:28.883720 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-c441bbf3-4349-4f28-96b3-16d4cb531402 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.637567 Aug 27 04:37:28.884602 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4032/7784] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:37:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:28.901329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-201163d3-adad-47b0-a47c-b125ea0253c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:28.901961 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-201163d3-adad-47b0-a47c-b125ea0253c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:28.975564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-201163d3-adad-47b0-a47c-b125ea0253c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:28.984945 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-201163d3-adad-47b0-a47c-b125ea0253c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1247 microversion: 2.1 time: 0.092293 Aug 27 04:37:28.985684 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3753/7785] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:28 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:30.006870 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.009044 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:30.017040 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.017541 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.018211 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.019130 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:30.019599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:30.020037 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:30.090660 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.099595 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-e91535ea-d8de-423a-9f5c-44bb3e680b62 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1299 microversion: 2.1 time: 0.096908 Aug 27 04:37:30.100201 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4033/7786] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:30 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:31.119981 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:31.121451 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:31.128329 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:31.128828 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:31.129277 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:31.129998 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:31.131265 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:31.131876 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:31.335474 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:31.343512 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a67d1606-8c2d-4348-9b1b-a0d6a99ba555 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1373 microversion: 2.1 time: 0.227516 Aug 27 04:37:31.344100 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3754/7787] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:31 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:31.617997 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d973e669-f162-435b-a3b2-889f39d6d870 req-7de234f4-7059-4309-bf6b-a6482c982b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4291c6f5-0fb1-4873-a199-caf352397ee1", "tag": "ce1e476d-d3ad-4eb8-a534-a11c760b8d10"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:31.634823 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d973e669-f162-435b-a3b2-889f39d6d870 req-7de234f4-7059-4309-bf6b-a6482c982b3d service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:31.635597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d973e669-f162-435b-a3b2-889f39d6d870 req-7de234f4-7059-4309-bf6b-a6482c982b3d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:31.636241 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d973e669-f162-435b-a3b2-889f39d6d870 req-7de234f4-7059-4309-bf6b-a6482c982b3d service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:31.651320 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d973e669-f162-435b-a3b2-889f39d6d870 req-7de234f4-7059-4309-bf6b-a6482c982b3d service nova] Creating event network-changed:ce1e476d-d3ad-4eb8-a534-a11c760b8d10 for instance 4291c6f5-0fb1-4873-a199-caf352397ee1 on n-h2-852086-5 Aug 27 04:37:31.656781 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d973e669-f162-435b-a3b2-889f39d6d870 req-7de234f4-7059-4309-bf6b-a6482c982b3d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043929 Aug 27 04:37:31.657568 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4034/7788] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:32.365191 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.366057 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:32.373584 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.374093 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.374597 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.375361 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:32.375855 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:32.376320 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:32.520506 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:32.534436 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7796d825-a399-4738-b6d7-bb842d1c2809 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1373 microversion: 2.1 time: 0.173413 Aug 27 04:37:32.541671 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3755/7789] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:32 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:33.558542 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.559247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:33.565677 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.566195 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.566643 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.567347 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:33.567843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:33.568315 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:33.707275 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:33.715922 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-b5fe5d3e-c502-4b6b-bd25-c308ad452d07 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1373 microversion: 2.1 time: 0.162591 Aug 27 04:37:33.716547 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4035/7790] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:33 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:34.737906 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:34.738564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:34.746436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.746937 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.747384 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.748098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:34.748569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:34.749005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:34.889188 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:34.897982 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3964ae69-af55-470b-9f97-05a1f03d81c2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1373 microversion: 2.1 time: 0.164094 Aug 27 04:37:34.898714 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3756/7791] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:34 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:35.919276 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:35.919944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:35.926885 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:35.927919 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:35.928354 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:35.929077 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:35.929516 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:35.929944 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.063094 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:36.071230 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-5e975002-7e97-49db-9bf6-7edbca41a10a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1373 microversion: 2.1 time: 0.155746 Aug 27 04:37:36.071739 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4036/7792] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:35 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:36.956189 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c265b724-95b6-4e27-b1f9-7d04e199db03 req-2ff4c3df-db0a-4ce9-b3ee-7a3866b5b96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4291c6f5-0fb1-4873-a199-caf352397ee1", "name": "network-vif-plugged", "status": "completed", "tag": "ce1e476d-d3ad-4eb8-a534-a11c760b8d10"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:36.967264 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c265b724-95b6-4e27-b1f9-7d04e199db03 req-2ff4c3df-db0a-4ce9-b3ee-7a3866b5b96c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:36.967755 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c265b724-95b6-4e27-b1f9-7d04e199db03 req-2ff4c3df-db0a-4ce9-b3ee-7a3866b5b96c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:36.968198 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c265b724-95b6-4e27-b1f9-7d04e199db03 req-2ff4c3df-db0a-4ce9-b3ee-7a3866b5b96c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:36.979531 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c265b724-95b6-4e27-b1f9-7d04e199db03 req-2ff4c3df-db0a-4ce9-b3ee-7a3866b5b96c service nova] Creating event network-vif-plugged:ce1e476d-d3ad-4eb8-a534-a11c760b8d10 for instance 4291c6f5-0fb1-4873-a199-caf352397ee1 on n-h2-852086-5 Aug 27 04:37:36.984843 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c265b724-95b6-4e27-b1f9-7d04e199db03 req-2ff4c3df-db0a-4ce9-b3ee-7a3866b5b96c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094277 Aug 27 04:37:36.985365 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3757/7793] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:37.092378 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:37.092999 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:37.100161 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:37.100653 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:37.101092 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:37.101804 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:37.102292 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:37.102723 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:37.241726 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:37.250740 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fafe7b2c-b5af-472d-be79-b5ec2cc1349b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1373 microversion: 2.1 time: 0.162483 Aug 27 04:37:37.251346 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4037/7794] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:37 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:38.275869 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:38.276940 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:38.283660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:38.284172 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:38.284625 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:38.285345 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:38.285816 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:38.286295 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:38.478077 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:38.485801 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e601ddaa-2e2e-432e-b86d-2b2dd7f51bcd tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1373 microversion: 2.1 time: 0.216199 Aug 27 04:37:38.486400 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3758/7795] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:38 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1373 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:39.507491 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.508104 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.510942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:39.511719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=6 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:39.517595 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.518086 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.518646 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.519352 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.519811 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.520247 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.713358 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:39.721801 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-56e6d263-d652-4875-8d63-1f27d38ff035 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1558 microversion: 2.1 time: 0.218260 Aug 27 04:37:39.722411 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4038/7796] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:39 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:39.741934 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:39.742594 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:37:39.744595 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:39.750806 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.751303 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.751750 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.752468 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:39.752916 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:39.753376 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:39.945769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:39.953892 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71f18e02-a7dc-44b9-9cf6-bf9e20f3fac2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1558 microversion: 2.1 time: 0.216291 Aug 27 04:37:39.954454 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3759/7797] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:37:39 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:41.735779 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-d68c8f0e-51af-49ce-9db6-703376f92047 req-32dd326e-540e-4b62-92c0-53c9cc5a6505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4291c6f5-0fb1-4873-a199-caf352397ee1", "tag": "ce1e476d-d3ad-4eb8-a534-a11c760b8d10"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:41.746150 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d68c8f0e-51af-49ce-9db6-703376f92047 req-32dd326e-540e-4b62-92c0-53c9cc5a6505 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:37:41.746657 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d68c8f0e-51af-49ce-9db6-703376f92047 req-32dd326e-540e-4b62-92c0-53c9cc5a6505 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:37:41.747089 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-d68c8f0e-51af-49ce-9db6-703376f92047 req-32dd326e-540e-4b62-92c0-53c9cc5a6505 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:37:41.758696 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-d68c8f0e-51af-49ce-9db6-703376f92047 req-32dd326e-540e-4b62-92c0-53c9cc5a6505 service nova] Creating event network-changed:ce1e476d-d3ad-4eb8-a534-a11c760b8d10 for instance 4291c6f5-0fb1-4873-a199-caf352397ee1 on n-h2-852086-5 Aug 27 04:37:41.764703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-d68c8f0e-51af-49ce-9db6-703376f92047 req-32dd326e-540e-4b62-92c0-53c9cc5a6505 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093214 Aug 27 04:37:41.765320 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4039/7798] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:36.937029 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96abbb2e-fa0f-416e-845b-4c5358f3aaa0] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:39:36.937916 n-d-852086-5 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:39:36.938475 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:36.939292 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:36.940499 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:39:36.940632 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:39:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1/action (ip 10.222.0.69) !!! Aug 27 04:39:36.950809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-4922396"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:36.953325 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:36.961121 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.961617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.962063 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:36.962796 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:36.963263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:36.963701 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:37.171244 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b4f652f-7afe-4cae-9c06-cb9aef74d5c7 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "POST /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1/action" status: 202 len: 0 microversion: 2.1 time: 0.236576 Aug 27 04:39:37.171901 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3760/7799] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:39:36 2022] POST /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:39:43.587142 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:39:43.589295 n-d-852086-5 devstack@n-api.service[122407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:39:43.591765 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:43.594188 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=36 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:43.597690 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:39:43.598279 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.69) !!! Aug 27 04:39:43.609593 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-fd453ba2-89c9-47ee-9121-625eea9f25c1 req-e692c561-1321-4527-aab7-16a7a4868801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4291c6f5-0fb1-4873-a199-caf352397ee1", "name": "network-vif-plugged", "status": "completed", "tag": "ce1e476d-d3ad-4eb8-a534-a11c760b8d10"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:43.633273 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd453ba2-89c9-47ee-9121-625eea9f25c1 req-e692c561-1321-4527-aab7-16a7a4868801 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:43.634333 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd453ba2-89c9-47ee-9121-625eea9f25c1 req-e692c561-1321-4527-aab7-16a7a4868801 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:43.635004 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-fd453ba2-89c9-47ee-9121-625eea9f25c1 req-e692c561-1321-4527-aab7-16a7a4868801 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:43.652282 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-fd453ba2-89c9-47ee-9121-625eea9f25c1 req-e692c561-1321-4527-aab7-16a7a4868801 service nova] Creating event network-vif-plugged:ce1e476d-d3ad-4eb8-a534-a11c760b8d10 for instance 4291c6f5-0fb1-4873-a199-caf352397ee1 on n-h2-852086-5 Aug 27 04:39:43.660867 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-fd453ba2-89c9-47ee-9121-625eea9f25c1 req-e692c561-1321-4527-aab7-16a7a4868801 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077252 Aug 27 04:39:43.662504 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4040/7800] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:39:50.764342 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:50.765133 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:50.770959 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1657405897", "imageRef": "8788c7ad-b25d-4018-af42-cadbb1749217", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-297308890", "security_groups": [{"name": "tempest-secgroup-smoke-1073448750"}], "networks": [{"uuid": "6007a811-ae3c-4e11-a4b0-df3748144a13"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:50.795632 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [96abbb2e-fa0f-416e-845b-4c5358f3aaa0] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43860. Aug 27 04:39:50.797931 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [44d4d6b0-7d11-43f0-94e7-0456ef7fbb26] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43862. Aug 27 04:39:50.883922 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] validate_networks() for [('6007a811-ae3c-4e11-a4b0-df3748144a13', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:39:51.670953 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:39:51.671403 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:39:51.671902 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:39:51.672337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:39:51.672772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:39:51.682772 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.683286 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.683744 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.684692 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:51.685203 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:51.685652 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:51.703650 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Getting quotas for project 1e3279502cd2475bbe199f709af8739f. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:39:51.709025 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Getting quotas for user a3514de37440483591144679ed2c2bda and project 1e3279502cd2475bbe199f709af8739f. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:39:51.722433 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:39:51.724967 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8788c7ad-b25d-4018-af42-cadbb1749217',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:39:51.772574 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b9e87ee-dbe0-4072-a774-47c2806f11bb tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.012853 Aug 27 04:39:51.773511 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3761/7801] 10.222.0.69 () {60 vars in 1147 bytes} [Sat Aug 27 04:39:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:39:51.785277 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-87ceb812-fe27-4358-9291-2dded3ec82ec tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:51.786070 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-87ceb812-fe27-4358-9291-2dded3ec82ec tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:51.806635 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [b23a40fe-90b2-4295-a8ad-3b074f835978] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43876. Aug 27 04:39:51.811422 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] [36ad2984-c6c4-4183-b4a2-15607439466c] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43878. Aug 27 04:39:51.861629 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-87ceb812-fe27-4358-9291-2dded3ec82ec tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:51.869229 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-87ceb812-fe27-4358-9291-2dded3ec82ec tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1248 microversion: 2.1 time: 0.088668 Aug 27 04:39:51.869802 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4041/7802] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:51 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:52.893999 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:52.894702 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:52.902436 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:52.903085 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:52.903790 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:52.904665 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:52.905141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:52.905731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:52.972660 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:52.980619 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1884a464-1d95-4071-a767-5baf6b7126fa tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1308 microversion: 2.1 time: 0.092717 Aug 27 04:39:52.981726 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3762/7803] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:52 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:53.621715 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-7e8b4d11-3ff4-45fc-8d3f-769573c77a9d req-81137e4d-1601-41a5-9482-280a83f2de7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4291c6f5-0fb1-4873-a199-caf352397ee1", "name": "network-vif-unplugged", "status": "completed", "tag": "ce1e476d-d3ad-4eb8-a534-a11c760b8d10"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:53.645221 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7e8b4d11-3ff4-45fc-8d3f-769573c77a9d req-81137e4d-1601-41a5-9482-280a83f2de7e service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:53.646618 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7e8b4d11-3ff4-45fc-8d3f-769573c77a9d req-81137e4d-1601-41a5-9482-280a83f2de7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:53.648282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-7e8b4d11-3ff4-45fc-8d3f-769573c77a9d req-81137e4d-1601-41a5-9482-280a83f2de7e service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:53.674525 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:53.677210 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-7e8b4d11-3ff4-45fc-8d3f-769573c77a9d req-81137e4d-1601-41a5-9482-280a83f2de7e service nova] Creating event network-vif-unplugged:ce1e476d-d3ad-4eb8-a534-a11c760b8d10 for instance 4291c6f5-0fb1-4873-a199-caf352397ee1 on n-h2-852086-5 Aug 27 04:39:53.692435 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-7e8b4d11-3ff4-45fc-8d3f-769573c77a9d req-81137e4d-1601-41a5-9482-280a83f2de7e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074701 Aug 27 04:39:53.693493 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4042/7804] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:54.001972 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:54.002615 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:54.011781 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.012299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.013321 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.014068 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:54.014608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:54.015058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:54.216893 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:54.225605 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a0acc60-c709-4253-88fd-920dfd7af77a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.228359 Aug 27 04:39:54.226213 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3763/7805] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:53 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:55.249080 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:55.249794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:55.257323 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.257820 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.258285 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:55.259017 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:55.259466 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:55.259896 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:55.412891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.422034 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-2feabfa1-acac-4ffd-bb17-efb9211099e5 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.177636 Aug 27 04:39:55.423296 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4043/7806] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:55 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:56.444809 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:56.446453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:56.466765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:56.467547 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:56.468017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:56.468765 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:56.469253 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:56.469712 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:56.628484 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:56.636432 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90dc9df2-09fb-444f-b751-c2f1a4b452f2 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.196359 Aug 27 04:39:56.637111 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3764/7807] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:56 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:57.666264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:57.666932 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:57.676572 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:57.677258 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:57.677749 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:57.678652 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:57.679185 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:57.679754 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:57.816942 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.826067 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-fee600ce-7880-45c9-a106-82e16a34012e tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.165210 Aug 27 04:39:57.826682 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4044/7808] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:57 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:58.848368 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:58.849489 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:39:58.859231 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.860044 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.860569 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:58.861293 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:39:58.861760 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:39:58.862222 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:39:59.018112 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:59.026034 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb737852-493b-4c07-9c52-82e164be4588 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.182009 Aug 27 04:39:59.026656 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3765/7809] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:39:58 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:00.047140 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:00.048641 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:00.068012 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.068632 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.069139 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.069933 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:00.070554 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:00.071290 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:00.231372 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:00.240917 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-dbb7c126-dd7f-43d5-bb9a-5d0bdcec7fef tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.198053 Aug 27 04:40:00.242347 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4045/7810] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:00 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:01.272462 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:01.273118 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:01.283921 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:01.284452 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:01.284913 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:01.285836 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:01.286263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:01.286263 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:01.433852 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:01.442048 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e06251ba-47e6-4bef-b838-09f59281d2d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.173622 Aug 27 04:40:01.442646 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3766/7811] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:01 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:02.465751 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.468343 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:02.471198 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell0:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:02.477468 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.477970 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.478439 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.479160 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.479627 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.480061 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.686846 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7a74d598-4a2d-4207-a4f6-d60109f6ea76 req-19008b83-ea72-41c3-90e1-fa824564cbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4bed18-221d-475c-84a8-8fefc57a1d73", "tag": "ba866e67-33d7-440b-8203-f88db7513eb5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:02.691875 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:02.692725 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:02.699659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a74d598-4a2d-4207-a4f6-d60109f6ea76 req-19008b83-ea72-41c3-90e1-fa824564cbce service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:02.700153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a74d598-4a2d-4207-a4f6-d60109f6ea76 req-19008b83-ea72-41c3-90e1-fa824564cbce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:02.700623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7a74d598-4a2d-4207-a4f6-d60109f6ea76 req-19008b83-ea72-41c3-90e1-fa824564cbce service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:02.709830 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:02.713190 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7a74d598-4a2d-4207-a4f6-d60109f6ea76 req-19008b83-ea72-41c3-90e1-fa824564cbce service nova] Creating event network-changed:ba866e67-33d7-440b-8203-f88db7513eb5 for instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 on n-h1-852086-5 Aug 27 04:40:02.719748 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7a74d598-4a2d-4207-a4f6-d60109f6ea76 req-19008b83-ea72-41c3-90e1-fa824564cbce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036547 Aug 27 04:40:02.720668 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3767/7812] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:40:02.723703 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-006f17bf-a61f-4c0c-b03f-d559ddc867d6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.263210 Aug 27 04:40:02.724518 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4046/7813] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:02 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:03.746337 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:03.747064 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:03.753446 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:03.753954 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:03.754426 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:03.755153 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:03.755629 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:03.756070 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:03.896460 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:03.905300 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88864ba2-e619-48dd-86b6-e5c86da6d68b tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.164080 Aug 27 04:40:03.906097 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3768/7814] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:03 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:04.928021 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.928566 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:04.937920 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.938449 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.938898 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:04.939649 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:04.940116 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:04.940551 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:05.073272 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:05.082294 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-7a665fcf-af20-4402-ae03-f983d4928e51 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.159225 Aug 27 04:40:05.083412 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4047/7815] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:04 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:06.103763 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:06.104396 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:06.111590 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.112098 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.112551 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.113296 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:06.113769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:06.114242 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:06.250623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:06.258791 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1f3f491-68a4-4766-9daf-488473f759d1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.158955 Aug 27 04:40:06.259373 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3769/7816] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:06 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:07.281951 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:07.282939 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:07.290336 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.290824 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.291256 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:07.291959 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:07.292410 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:07.292866 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:07.428973 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:07.437665 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-d3476fbb-123c-4a7b-a387-63eaaf4d219d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.160944 Aug 27 04:40:07.438275 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4048/7817] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:07 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:08.217775 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a72f9407-260c-4acf-8d17-54803f5ca146 req-0a8e177a-ec54-4586-aa29-2f5605db6972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4bed18-221d-475c-84a8-8fefc57a1d73", "name": "network-vif-plugged", "status": "completed", "tag": "ba866e67-33d7-440b-8203-f88db7513eb5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:08.228749 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a72f9407-260c-4acf-8d17-54803f5ca146 req-0a8e177a-ec54-4586-aa29-2f5605db6972 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:08.229249 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a72f9407-260c-4acf-8d17-54803f5ca146 req-0a8e177a-ec54-4586-aa29-2f5605db6972 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:08.229751 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a72f9407-260c-4acf-8d17-54803f5ca146 req-0a8e177a-ec54-4586-aa29-2f5605db6972 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:08.241525 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a72f9407-260c-4acf-8d17-54803f5ca146 req-0a8e177a-ec54-4586-aa29-2f5605db6972 service nova] Creating event network-vif-plugged:ba866e67-33d7-440b-8203-f88db7513eb5 for instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 on n-h1-852086-5 Aug 27 04:40:08.246744 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a72f9407-260c-4acf-8d17-54803f5ca146 req-0a8e177a-ec54-4586-aa29-2f5605db6972 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033603 Aug 27 04:40:08.247362 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3770/7818] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:08.457647 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:08.458328 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:08.465120 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:08.465597 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:08.466051 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:08.467386 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:08.468335 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:08.468834 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:08.608599 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:08.616306 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-0cd2899a-2f87-4823-b980-028ff4581504 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1374 microversion: 2.1 time: 0.162502 Aug 27 04:40:08.616833 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4049/7819] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:08 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:09.639046 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:09.639769 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:09.646050 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:09.646589 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:09.647042 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:09.647753 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:09.648230 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:09.648675 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:09.787141 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:09.794984 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d51ff93-3917-467e-acac-3da8feffa0ce tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1559 microversion: 2.1 time: 0.161363 Aug 27 04:40:09.795520 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3771/7820] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:09 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:09.814952 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:09.815565 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:40:09.822408 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:09.822891 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:09.823326 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:09.824023 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:09.824488 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:09.824912 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:09.959009 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:09.967797 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-1681e77b-93b6-4c06-89a3-16069f71e9f6 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1559 microversion: 2.1 time: 0.155661 Aug 27 04:40:09.968329 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4050/7821] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:40:09 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:11.593453 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e29f8949-adf5-4fc0-92a6-ba6adeaa1cbc req-c083e449-aeb7-4e20-bcd9-bd699cfd5c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4bed18-221d-475c-84a8-8fefc57a1d73", "tag": "ba866e67-33d7-440b-8203-f88db7513eb5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:11.605022 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e29f8949-adf5-4fc0-92a6-ba6adeaa1cbc req-c083e449-aeb7-4e20-bcd9-bd699cfd5c47 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:40:11.605654 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e29f8949-adf5-4fc0-92a6-ba6adeaa1cbc req-c083e449-aeb7-4e20-bcd9-bd699cfd5c47 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:40:11.606103 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e29f8949-adf5-4fc0-92a6-ba6adeaa1cbc req-c083e449-aeb7-4e20-bcd9-bd699cfd5c47 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:40:11.620080 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e29f8949-adf5-4fc0-92a6-ba6adeaa1cbc req-c083e449-aeb7-4e20-bcd9-bd699cfd5c47 service nova] Creating event network-changed:ba866e67-33d7-440b-8203-f88db7513eb5 for instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 on n-h1-852086-5 Aug 27 04:40:11.626619 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e29f8949-adf5-4fc0-92a6-ba6adeaa1cbc req-c083e449-aeb7-4e20-bcd9-bd699cfd5c47 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038546 Aug 27 04:40:11.627222 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3772/7822] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:41:47.521249 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=24 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:47.522579 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=50 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:47.523676 n-d-852086-5 devstack@n-api.service[122407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:41:47.523817 n-d-852086-5 devstack@n-api.service[122407]: Sat Aug 27 04:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73/action (ip 10.222.0.69) !!! Aug 27 04:41:47.528789 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-284139571"}} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:47.531118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:41:47.539208 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:47.539705 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:47.540142 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:47.540846 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:47.541303 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:47.541728 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:47.737412 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3fbee3f9-347a-4f73-b646-3e64ee80f29f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "POST /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73/action" status: 202 len: 0 microversion: 2.1 time: 0.217906 Aug 27 04:41:47.738073 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4051/7823] 10.222.0.69 () {60 vars in 1278 bytes} [Sat Aug 27 04:41:47 2022] POST /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:41:52.730608 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:52.734500 n-d-852086-5 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=56 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:52.736113 n-d-852086-5 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:41:52.736484 n-d-852086-5 devstack@n-api.service[122408]: Sat Aug 27 04:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.69) !!! Aug 27 04:41:52.746058 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-70ca6ed4-c64f-4006-9da9-eb688e2187d8 req-93e46382-2bda-4a14-ac0a-d9846f00d164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4bed18-221d-475c-84a8-8fefc57a1d73", "name": "network-vif-plugged", "status": "completed", "tag": "ba866e67-33d7-440b-8203-f88db7513eb5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:52.767173 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70ca6ed4-c64f-4006-9da9-eb688e2187d8 req-93e46382-2bda-4a14-ac0a-d9846f00d164 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:41:52.767926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70ca6ed4-c64f-4006-9da9-eb688e2187d8 req-93e46382-2bda-4a14-ac0a-d9846f00d164 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:41:52.768543 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70ca6ed4-c64f-4006-9da9-eb688e2187d8 req-93e46382-2bda-4a14-ac0a-d9846f00d164 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:41:52.782631 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-70ca6ed4-c64f-4006-9da9-eb688e2187d8 req-93e46382-2bda-4a14-ac0a-d9846f00d164 service nova] Creating event network-vif-plugged:ba866e67-33d7-440b-8203-f88db7513eb5 for instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 on n-h1-852086-5 Aug 27 04:41:52.789621 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-70ca6ed4-c64f-4006-9da9-eb688e2187d8 req-93e46382-2bda-4a14-ac0a-d9846f00d164 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062111 Aug 27 04:41:52.790868 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3773/7824] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:01.711900 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:01.712836 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:01.717793 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_api:SELECT=2 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:01.718707 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1fa9728c-d4d3-4b94-acf1-b1f495582036 req-0870bf82-8fd5-4a38-a7cc-f3a239779f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4bed18-221d-475c-84a8-8fefc57a1d73", "tag": "ba866e67-33d7-440b-8203-f88db7513eb5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:01.720626 n-d-852086-5 devstack@n-api.service[122407]: DEBUG dbcounter [-] [122407] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:01.728334 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.729179 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.729769 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:01.730564 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1fa9728c-d4d3-4b94-acf1-b1f495582036 req-0870bf82-8fd5-4a38-a7cc-f3a239779f36 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.730778 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.731248 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.731382 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1fa9728c-d4d3-4b94-acf1-b1f495582036 req-0870bf82-8fd5-4a38-a7cc-f3a239779f36 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.731680 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:01.731798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1fa9728c-d4d3-4b94-acf1-b1f495582036 req-0870bf82-8fd5-4a38-a7cc-f3a239779f36 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:01.745240 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1fa9728c-d4d3-4b94-acf1-b1f495582036 req-0870bf82-8fd5-4a38-a7cc-f3a239779f36 service nova] Creating event network-changed:ba866e67-33d7-440b-8203-f88db7513eb5 for instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 on n-h1-852086-5 Aug 27 04:42:01.750665 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1fa9728c-d4d3-4b94-acf1-b1f495582036 req-0870bf82-8fd5-4a38-a7cc-f3a239779f36 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040404 Aug 27 04:42:01.751606 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3774/7825] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:01.762666 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Going to try to terminate instance {{(pid=122407) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:01.856714 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-a2a97659-1cdd-4a7c-bc44-71d30571137f tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 204 len: 0 microversion: 2.1 time: 0.149976 Aug 27 04:42:01.857982 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4052/7826] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:01 2022] DELETE /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:01.867439 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:01.868217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:01.875331 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.876087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.876731 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:01.877659 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:01.878129 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:01.878762 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:02.024358 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:02.032493 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-add1f7c0-5ad7-48ea-929b-188426e5a99d tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1683 microversion: 2.1 time: 0.170135 Aug 27 04:42:02.033068 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3775/7827] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:01 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:02.716673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-44f20ba1-3d6f-480b-9aa1-e9daaf980091 req-3d2f84d8-bbb6-4b52-b583-876ec6c6804a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4bed18-221d-475c-84a8-8fefc57a1d73", "name": "network-vif-unplugged", "status": "completed", "tag": "ba866e67-33d7-440b-8203-f88db7513eb5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:02.734921 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-44f20ba1-3d6f-480b-9aa1-e9daaf980091 req-3d2f84d8-bbb6-4b52-b583-876ec6c6804a service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:02.735943 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-44f20ba1-3d6f-480b-9aa1-e9daaf980091 req-3d2f84d8-bbb6-4b52-b583-876ec6c6804a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:02.736843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-44f20ba1-3d6f-480b-9aa1-e9daaf980091 req-3d2f84d8-bbb6-4b52-b583-876ec6c6804a service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:02.750577 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-44f20ba1-3d6f-480b-9aa1-e9daaf980091 req-3d2f84d8-bbb6-4b52-b583-876ec6c6804a service nova] Creating event network-vif-unplugged:ba866e67-33d7-440b-8203-f88db7513eb5 for instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 on n-h1-852086-5 Aug 27 04:42:02.756405 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-44f20ba1-3d6f-480b-9aa1-e9daaf980091 req-3d2f84d8-bbb6-4b52-b583-876ec6c6804a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043946 Aug 27 04:42:02.757113 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4053/7828] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:03.055298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:03.056505 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:03.063677 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.064176 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.064630 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.065370 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:03.065837 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:03.066310 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:03.207350 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:03.215611 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37e48fd1-e972-41fc-8625-54839476a5cc tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1683 microversion: 2.1 time: 0.165295 Aug 27 04:42:03.216195 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3776/7829] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:03 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:04.197771 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-892ce302-bd5a-4c95-98fb-29e6f668f41d req-f387ad17-e8dd-4acf-9b1a-02424f84ba31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4bed18-221d-475c-84a8-8fefc57a1d73", "name": "network-vif-deleted", "tag": "ba866e67-33d7-440b-8203-f88db7513eb5"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:04.207524 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-892ce302-bd5a-4c95-98fb-29e6f668f41d req-f387ad17-e8dd-4acf-9b1a-02424f84ba31 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:04.208011 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-892ce302-bd5a-4c95-98fb-29e6f668f41d req-f387ad17-e8dd-4acf-9b1a-02424f84ba31 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:04.208444 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-892ce302-bd5a-4c95-98fb-29e6f668f41d req-f387ad17-e8dd-4acf-9b1a-02424f84ba31 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:04.220213 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-892ce302-bd5a-4c95-98fb-29e6f668f41d req-f387ad17-e8dd-4acf-9b1a-02424f84ba31 service nova] Creating event network-vif-deleted:ba866e67-33d7-440b-8203-f88db7513eb5 for instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 on n-h1-852086-5 Aug 27 04:42:04.225015 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-892ce302-bd5a-4c95-98fb-29e6f668f41d req-f387ad17-e8dd-4acf-9b1a-02424f84ba31 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106826 Aug 27 04:42:04.225559 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4054/7830] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:04.236992 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:04.237623 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:04.245488 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:04.245996 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:04.246492 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:04.247217 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:04.247694 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:04.248135 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:04.283592 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:04.284108 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:04.284572 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:04.285041 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lazy-loading 'fault' on Instance uuid 5e4bed18-221d-475c-84a8-8fefc57a1d73 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:42:04.331730 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:04.340305 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4da95a36-3998-4aed-9039-0a5f765aa9b1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 200 len: 1338 microversion: 2.1 time: 0.107335 Aug 27 04:42:04.340878 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3777/7831] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:04 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:05.364186 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:05.365557 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 5e4bed18-221d-475c-84a8-8fefc57a1d73] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:05.371794 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:05.372282 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:05.372719 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:05.373417 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:05.373874 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:05.374341 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:05.387643 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.wsgi [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] HTTP exception thrown: Instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 could not be found. Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Request method failure captured: Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: request: GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 HTTP/1.1 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: Accept: application/json Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: Accept-Encoding: identity Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: Connection: close Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: Content-Length: 0 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: Content-Type: application/json Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: Host: 10.222.0.69 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: Openstack-System-Scope: None Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Auth-Token: gAAAAABjCZ-BQm2Xr0djsG_8bO9oH7F28Yyki3tKX1l6vosxrQV54pIKHoq-DD2WuAorDETHnzsN8Z5JhvQmiO-DnG2KrLeup1QhpNGuhX_CzIW95_NmwyiM37qfVcB8IuQveq5cZddgqGigh88IlR7Mwe5uWAIGrbwdTj610VCJ4u-Ur_DLlm8 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Id: None Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Domain-Name: None Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Identity-Status: Confirmed Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Is-Admin-Project: True Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Id: default Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Domain-Name: Default Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Id: 1e3279502cd2475bbe199f709af8739f Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Project-Name: tempest-TestSnapshotPattern-1807011872 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Role: member,reader Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Roles: member,reader Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1e3279502cd2475bbe199f709af8739f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1e3279502cd2475bbe199f709af8739f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1e3279502cd2475bbe199f709af8739f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1e3279502cd2475bbe199f709af8739f"}]}] Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant: tempest-TestSnapshotPattern-1807011872 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Id: 1e3279502cd2475bbe199f709af8739f Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-Tenant-Name: tempest-TestSnapshotPattern-1807011872 Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-User: tempest-TestSnapshotPattern-1807011872-project Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Id: default Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-User-Domain-Name: Default Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-User-Id: a3514de37440483591144679ed2c2bda Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: X-User-Name: tempest-TestSnapshotPattern-1807011872-project Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: method: > Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: exception: Instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 could not be found. Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: action_args: {'id': '5e4bed18-221d-475c-84a8-8fefc57a1d73'} Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 could not be found. Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 could not be found. Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:05.389250 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 could not be found. Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: ERROR nova.api.openstack.wsgi Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Returning 404 to user: Instance 5e4bed18-221d-475c-84a8-8fefc57a1d73 could not be found. {{(pid=122407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-3346f0ac-2a63-490f-898a-7a77e89cf6ac tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73" status: 404 len: 111 microversion: 2.1 time: 0.032168 Aug 27 04:42:05.394908 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4055/7832] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:05 2022] GET /compute/v2.1/servers/5e4bed18-221d-475c-84a8-8fefc57a1d73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:06.765540 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:06.766072 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:06.766908 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-f11a18ec-41cb-40c4-990d-57426965ef42 req-440c6561-2987-4644-98e4-505dc2f0ae42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4291c6f5-0fb1-4873-a199-caf352397ee1", "tag": "ce1e476d-d3ad-4eb8-a534-a11c760b8d10"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:06.774017 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:06.775299 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:06.776145 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:06.777125 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:06.777616 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:06.778080 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:06.782673 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f11a18ec-41cb-40c4-990d-57426965ef42 req-440c6561-2987-4644-98e4-505dc2f0ae42 service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:06.783235 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f11a18ec-41cb-40c4-990d-57426965ef42 req-440c6561-2987-4644-98e4-505dc2f0ae42 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:06.783833 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-f11a18ec-41cb-40c4-990d-57426965ef42 req-440c6561-2987-4644-98e4-505dc2f0ae42 service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:06.796345 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-f11a18ec-41cb-40c4-990d-57426965ef42 req-440c6561-2987-4644-98e4-505dc2f0ae42 service nova] Creating event network-changed:ce1e476d-d3ad-4eb8-a534-a11c760b8d10 for instance 4291c6f5-0fb1-4873-a199-caf352397ee1 on n-h2-852086-5 Aug 27 04:42:06.804188 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-f11a18ec-41cb-40c4-990d-57426965ef42 req-440c6561-2987-4644-98e4-505dc2f0ae42 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040549 Aug 27 04:42:06.805107 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4056/7833] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:06.815617 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:42:06.919864 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-367439a8-72fd-4011-bd1e-44e13ea0d1b8 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 204 len: 0 microversion: 2.1 time: 0.158503 Aug 27 04:42:06.920649 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3778/7834] 10.222.0.69 () {58 vars in 1239 bytes} [Sat Aug 27 04:42:06 2022] DELETE /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:06.930434 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:06.931563 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.compute.api [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122407) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:06.940683 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:06.941619 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:06.942118 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:06.943843 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:06.944640 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:06.945264 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:07.387690 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.policy [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:07.395648 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-110938af-b31d-47ed-bdfc-78bd2604fcd9 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1683 microversion: 2.1 time: 0.470098 Aug 27 04:42:07.396804 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4057/7835] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:06 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1683 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:08.418298 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:08.419036 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:08.427532 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:08.428548 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:08.429005 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:08.429926 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:08.430435 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:08.430884 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:08.682273 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3514de37440483591144679ed2c2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3279502cd2475bbe199f709af8739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:08.690356 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc13a09f-0629-4199-bbda-439526449c7a tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 200 len: 1683 microversion: 2.1 time: 0.276376 Aug 27 04:42:08.690964 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3779/7836] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:08 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 1683 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:09.191768 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [req-5352da76-e225-4e9a-b507-6d0e81819407 req-671a8b75-9b93-4e45-8f71-9c9ebfe61c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4291c6f5-0fb1-4873-a199-caf352397ee1", "name": "network-vif-deleted", "tag": "ce1e476d-d3ad-4eb8-a534-a11c760b8d10"}]} {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:09.202545 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5352da76-e225-4e9a-b507-6d0e81819407 req-671a8b75-9b93-4e45-8f71-9c9ebfe61c2c service nova] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.202945 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5352da76-e225-4e9a-b507-6d0e81819407 req-671a8b75-9b93-4e45-8f71-9c9ebfe61c2c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.203373 n-d-852086-5 devstack@n-api.service[122407]: DEBUG oslo_concurrency.lockutils [req-5352da76-e225-4e9a-b507-6d0e81819407 req-671a8b75-9b93-4e45-8f71-9c9ebfe61c2c service nova] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.215856 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.compute.server_external_events [req-5352da76-e225-4e9a-b507-6d0e81819407 req-671a8b75-9b93-4e45-8f71-9c9ebfe61c2c service nova] Creating event network-vif-deleted:ce1e476d-d3ad-4eb8-a534-a11c760b8d10 for instance 4291c6f5-0fb1-4873-a199-caf352397ee1 on n-h2-852086-5 Aug 27 04:42:09.221089 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [req-5352da76-e225-4e9a-b507-6d0e81819407 req-671a8b75-9b93-4e45-8f71-9c9ebfe61c2c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032918 Aug 27 04:42:09.221713 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4058/7837] 10.222.0.69 () {64 vars in 1317 bytes} [Sat Aug 27 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:09.712184 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:09.712737 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] [instance: 4291c6f5-0fb1-4873-a199-caf352397ee1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:42:09.720186 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.720614 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.721087 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.721801 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Acquiring lock "c415b947-a476-436d-b81a-456a5f662c42" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:42:09.722300 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:42:09.722720 n-d-852086-5 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Lock "c415b947-a476-436d-b81a-456a5f662c42" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:42:09.736885 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] HTTP exception thrown: Instance 4291c6f5-0fb1-4873-a199-caf352397ee1 could not be found. Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Request method failure captured: Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 HTTP/1.1 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: Accept: application/json Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: Accept-Encoding: identity Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: Connection: close Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: Content-Length: 0 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: Content-Type: application/json Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: Host: 10.222.0.69 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: Openstack-System-Scope: None Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.11 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjCZ-BQm2Xr0djsG_8bO9oH7F28Yyki3tKX1l6vosxrQV54pIKHoq-DD2WuAorDETHnzsN8Z5JhvQmiO-DnG2KrLeup1QhpNGuhX_CzIW95_NmwyiM37qfVcB8IuQveq5cZddgqGigh88IlR7Mwe5uWAIGrbwdTj610VCJ4u-Ur_DLlm8 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Id: None Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Domain-Name: None Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Is-Admin-Project: True Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Id: default Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Id: 1e3279502cd2475bbe199f709af8739f Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Project-Name: tempest-TestSnapshotPattern-1807011872 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Role: member,reader Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Roles: member,reader Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1e3279502cd2475bbe199f709af8739f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1e3279502cd2475bbe199f709af8739f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1e3279502cd2475bbe199f709af8739f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1e3279502cd2475bbe199f709af8739f"}]}] Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant: tempest-TestSnapshotPattern-1807011872 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Id: 1e3279502cd2475bbe199f709af8739f Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestSnapshotPattern-1807011872 Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-User: tempest-TestSnapshotPattern-1807011872-project Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Id: default Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-User-Domain-Name: Default Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-User-Id: a3514de37440483591144679ed2c2bda Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: X-User-Name: tempest-TestSnapshotPattern-1807011872-project Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: method: > Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: exception: Instance 4291c6f5-0fb1-4873-a199-caf352397ee1 could not be found. Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: action_args: {'id': '4291c6f5-0fb1-4873-a199-caf352397ee1'} Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4291c6f5-0fb1-4873-a199-caf352397ee1 could not be found. Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4291c6f5-0fb1-4873-a199-caf352397ee1 could not be found. Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:42:09.738798 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4291c6f5-0fb1-4873-a199-caf352397ee1 could not be found. Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Returning 404 to user: Instance 4291c6f5-0fb1-4873-a199-caf352397ee1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f7517a5-d19a-4c0d-a7c5-d60bf665c5e0 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1" status: 404 len: 111 microversion: 2.1 time: 0.032136 Aug 27 04:42:09.744864 n-d-852086-5 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3780/7838] 10.222.0.69 () {58 vars in 1236 bytes} [Sat Aug 27 04:42:09 2022] GET /compute/v2.1/servers/4291c6f5-0fb1-4873-a199-caf352397ee1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:09.907351 n-d-852086-5 devstack@n-api.service[122407]: DEBUG nova.api.openstack.wsgi [None req-be4d82cf-f5be-4af3-8a0a-47fd84c06bc1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] Calling method '.version_select at 0x7fe45683cca0>' {{(pid=122407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:09.932515 n-d-852086-5 devstack@n-api.service[122407]: INFO nova.api.openstack.requestlog [None req-be4d82cf-f5be-4af3-8a0a-47fd84c06bc1 tempest-TestSnapshotPattern-1807011872 tempest-TestSnapshotPattern-1807011872-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-297308890" status: 202 len: 0 microversion: 2.1 time: 0.029389 Aug 27 04:42:09.933011 n-d-852086-5 devstack@n-api.service[122407]: [pid: 122407|app: 0|req: 4059/7839] 10.222.0.69 () {58 vars in 1254 bytes} [Sat Aug 27 04:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-297308890 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)